Lead Data Engineer
ON SITE (3x Week in Yonkers NY)
US Greencard/Citizenship Required
My client is looking for a Data Engineering Manager for their growing team. As a critical member of the team, you will oversee the reliability, accessibility, and accuracy of organizational data. You will manage and optimize data infrastructure within MS Azure, ensuring reliable, accurate data flows across systems. This role involves building scalable solutions, collaborating with partners, and supporting analytics teams to meet business needs.
Responsibilities:

• Oversee daily operations and performance of Azure data, Power BI, UC4 platforms, and the data lake environment, including blob storage.
• Monitor, maintain, and optimize data warehouse performance, pipelines, security, and related systems to ensure scalability and reliability.
• Develop and implement procedures for system maintenance, monitoring, and performance enhancements.
• Collaborate with business and technology teams to deliver complex data integrations, pipelines, and data marts across real-time, near real-time, and batch processes.
• Ensure efficient integration and management of diverse data types (structured, semi-structured, unstructured) while overseeing data models, ETL/ELT processes, and quality assessments.
• Enforce data warehouse architecture standards through governance, best practices, and automation for scalable and reliable solutions.

Requirements:

• Advanced degree in CS, or equivalent computer engineering degree.
• Strong experience in :
• Azure Data Factory
• SQL
• PySpark
• PowerBI
• Expert in ETL/ELT pipelining
• Experience leading implementation projects