Required skills

• Authored Data Pipeline software-design along with Lambda’s using Python and Boto3 libraries
• Identified Infrastructure cost and design pros and cons with multiple solution approaches with AWS Stack involving EB/SQS/SNS/CW for upcoming new Data Pipeline need.
• Developed Design flows with Snow Pipe and integrated with AWS Dynamo DB and implemented PoC's using Python & Java Springboot
• REST API definition and design using apigee / swagger ui.
• Enhanced the existing Data pipelines to orchestrate using Python based Lambda’s and utilities developed for cron services to perform automation.
• Authored IaC / Terraform based automation to enable CICD pipeline to setup sandbox environments to support multiple PoC’s
• Developed logz / CloudWatch based metrics dashboard generation on daily basis to meet the business need.

Qualifications

• Bachelors' degree in Computer Science, Informatics, or a related field required
• Masters’ degree in Computer Science preferred
• 3+ years of experience in a data engineering role
• 2+ years of experience with AWS and related services (e.g., EC2, S3, SNS, Lambda, IAM, Snowflake)
• Hands-on experience with ETL tools and techniques (Desirable)
• Basic proficiency with a dialect of ANSI SQL, APIs, and Python
• Knowledge of and experience with RDBMS platforms, such as MS SQL Server, MySQL, NoSQL, Postgres