We are looking for an experienced Cloud Data Engineer to join our direct client.
Must be a US Citizen or a Green Card holder.
The ideal candidate will have expertise in writing Python scripts, and crafting complex SQL queries along with AWS(EC2, S3 Redshift), Data Migration, Application Migration and ETL.
Proficient in Cloud Data Migration, including transitioning on-premises applications to cloud environments.
Responsibilities:
- Design, develop, modify, test, and automate data warehouse and business intelligence solutions, including architecture recommendations, quality management, metadata creation, troubleshooting, and performance tuning.
- Develop transition and implementation plans, recommending enhancements to development, maintenance, and standards.
- Contribute to the design, development, testing, implementation, and review of complex data warehouse and BI solutions.
- Build and refine components of complex data warehouse applications, including software development from established requirements, report/dashboard creation, and prototype development.
- Assist in designing technology infrastructure and configurations while recommending process improvements.
- Review and implement patches and new versions of data warehouse applications, deploying code and software packages.
- Play a key role in cross-functional initiatives and process improvement projects.
- Exercise independent judgment in complex business decisions, ensuring high attention to detail, data integrity, and accuracy.
- Communicate technical concepts clearly to non-technical audiences, demonstrating strong verbal and written communication skills.
- Demonstrate broad knowledge of programming tools, design, implementation, and testing practices.
- Rare domestic travel with potential overnight stays.
Required Skills:
- Bachelor’s degree or equivalent experience.
- Minimum of 8 years of relevant experience in developing and analyzing complex SQL across various RDBMS platforms (Microsoft SQL Server, Oracle).
- Expert-level knowledge of data modeling, with a strong understanding of different data structures and their optimal use cases.
- Experience creating scripts with Python
- Hands-on experience with ETL tools (Informatica).
- Proficiency in creating high-quality entity-relationship diagrams (ERDs).
- Strong writing skills for developing user and system documentation.
- Extensive experience with AWS Cloud Data Warehousing technologies.
- Proven ability to build and support data warehouse solutions using core AWS services (S3, DMS, Glue, Lambda), adhering to AWS architectural best practices.
- Development and modeling expertise with Amazon Redshift.
- Experience with AWS service APIs, AWS CLI, and SDKs for application development.
- Proficient in developing, deploying, and debugging cloud-based applications on AWS.
- Skilled in utilizing CI/CD pipelines for application deployment on AWS (GitLab, Terraform, DBMaestro).
- Strong understanding of cloud-native applications, with the ability to write code aligned with best practices.
- Experience in writing code for serverless applications.
- Knowledge of AWS security best practices (e.g., using IAM roles instead of embedding access keys in code).
- Experience with visualization tools (Tableau)
- Experience working on an Agile team
- Understanding of application lifecycle management
- Understanding of the use of containers in the development process
- Ability to author, maintain, and debug code modules on AWS.