We are seeking a skilled and experienced Senior Data Engineer to join our client, a leader in the financial industry. This role is pivotal in designing, developing, and implementing robust data pipelines to support their analytics and AI initiatives. The ideal candidate will have a strong technical background, a passion for data, and a proven track record of delivering high-quality data engineering and data science solutions.
Key Responsibilities:
- Design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of financial data.
- Collaborate with data scientists and AI teams to perform feature engineering and optimize data for AI and machine learning applications.
- Ensure data quality, consistency, and reliability across all systems and processes.
- Work closely with cross-functional teams to understand data requirements and deliver tailored solutions.
- Identify valuable data sources and develop automated processes for data collection and integration.
- Optimize data workflows and implement best practices for performance and scalability.
- Monitor, troubleshoot, and improve data pipelines and workflows to ensure seamless operations.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or similar role, preferably in the financial industry.
- Proficiency in Python and Python ML frameworks, experience with Java is a plus
- Expertise in data processing frameworks (e.g., Apache Spark, Kafka) and cloud platforms (e.g., AWS, Azure, GCP).
- Strong SQL skills and experience with relational and non-relational databases.
- Familiarity with feature engineering techniques for AI and machine learning applications.
- Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.