Job Description:
Must Haves: Object oriented concepts, Python, PySpark, AWS
Detailed Job Description:
- We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming.
- The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python.
- This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.
Responsibilities :
- Design, develop and implement new features to our existing framework using PySpark and Python.
- Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
- Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
- Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.
- Test and debug code to ensure it produces the desired results.
- Document all programming tasks and procedures for future reference and troubleshooting.
Qualifications :
- Proficient in Python, PySpark, and Object-oriented programming concepts.
- Proven experience as a Senior Data Engineer or similar role.
- Experience with AWS is preferred, but not mandatory.