We are seeking a Data Engineer at a mid-level experience to join our growing Data Engineering team. The ideal candidate will have hands-on experience working with Azure to build and maintain data pipelines, data lakes, and understanding of data warehousing principles. The role will also require building quality and audit checks for data pipelines, ensuring the reliability and integrity of the data flow beyond just traditional ETL processes.
Key Responsibilities:
- Build and maintain robust data pipelines on Azure, specifically within the Azure Data Lake environment.
- Work closely with the team to implement data warehousing strategies, ensuring efficient data storage and retrieval.
- Collaborate with Power BI developers to ensure smooth data reporting integration with Power BI.
- Conduct data validation checks and build audits for data pipelines to ensure the accuracy and quality of the data.
- Assist in troubleshooting and optimizing the data pipeline processes.
- Collaborate cross-functionally to ensure that all data engineering needs are addressed with reliability and scalability.
Required Qualifications:
- 5-6 years of experience working with Azure, including building pipelines for data lakes.
- Strong understanding of data warehousing principles and architecture.
- Experience with Azure Synapse Analytics for reporting and integration with Power BI.
- Hands-on experience with data quality checks, audits, and validation in pipeline processes.
- Ability to work collaboratively in a team environment and contribute to overall project success.
Preferred Skills:
- Previous experience working with large-scale data systems and ensuring data reliability.
This is a Direct-Hire, Permanent Placement Opportunity with full benefits (health, vision, dental, and 401k)