ETL Developer with Azure

Rocky Hill CT – Full time /Perm

Open for H1B transfers

Job Description: We are looking for an experienced Senior ETL Developer to join our team at Rocky Hill, CT. This is an onsite position for a developer with 9+ years of industry experience in ETL development, SSIS, and working with cloud technologies and Data Lakes. The ideal candidate will also have experience using PySpark for large-scale data processing. A background in the healthcare industry is preferred but not required.

As a Senior ETL Developer, you will be responsible for designing, implementing, and maintaining data pipelines, working on the integration of various data sources into cloud-based Data Lakes while leveraging your expertise in PySpark for big data processing.

Key Responsibilities:

1. Develop and implement ETL solutions using SSIS for integrating data across multiple platforms.
2. Design, implement, and manage cloud-based Data Lakes (preferably using Azure Data Lake or AWS S3).
3. Leverage PySpark for distributed data processing, ensuring scalable and efficient data transformations.
4. Collaborate with data architects and business analysts to design optimal data workflows for various data sources.
5. Manage the cloud-based data infrastructure to ensure efficient data ingestion and integration into data lakes.
6. Optimize ETL workflows and data pipelines for performance and scalability.
7. Work with large datasets from diverse sources (relational databases, cloud services, APIs, etc.).
8. Implement data governance, data quality, and security best practices across data pipelines.
9. Troubleshoot and resolve issues related to data integration, performance, and cloud data architecture.
10. Provide mentorship and guidance to junior team members on best practices for cloud-based ETL development and data engineering.
11. Participate in CI/CD pipelines for automating the deployment of ETL jobs and cloud resources.
12. Ensure compliance with relevant data privacy regulations, including HIPAA, for healthcare-related data.

Qualifications:

1. 9+ years of hands-on experience in ETL development.
2. Strong expertise in SQL Server Integration Services (SSIS) for building and managing ETL workflows.
3. Proven experience working with cloud technologies (Azure) and cloud-based Data Lakes (e.g., Azure Data Lake).
4. Proficiency in PySpark for big data processing and distributed data transformation.
5. Experience with data lake architecture.
6. Strong skills in data modeling, T-SQL, and managing data pipelines.
7. Deep understanding of data governance, data quality, and data privacy best practices.
8. Familiarity with CI/CD processes for automating ETL deployment and cloud infrastructure management.
9. Experience with data orchestration tools such as Azure Data Factory.
10. Healthcare industry experience is a plus (knowledge of EHR/EMR systems, HIPAA compliance, and healthcare data formats).
11. Excellent analytical, troubleshooting, and communication skills.
12. Strong collaboration skills and ability to work with cross-functional teams.