Job Title: Sr Data Engineer with Automobile domain experience
Location: Lewisville TX (Day-one Onsite role & Local Consultants only)
Duration: 6 Months C2H
Mandatory skills:
Kafka
Lambda
Snowflake
Job Description:
· Bachelors' degree in Computer Science, Informatics, or a related field required
· Masters’ degree in Computer Science preferred
· 10+ years of experience in a data engineering role.
· Automotive electrical/electronics knowledge usually the signalling and data communication architecture.
· Candidate must have Battery Electric Vehicle related experience.
· 5+ years of experience with AWS and related services (e.g., EC2, S3, SNS, Lambda, IAM, Snowflake)
· Hands-on experience with ETL tools and techniques (Desirable)
· Basic proficiency with a dialect of ANSI SQL, APIs, and Python
· Knowledge of and experience with RDBMS platforms, such as MS SQL Server, MySQL, NoSQL, Postgres
· Authored Data Pipeline software-design along with Lambda’s using Python and Boto3 libraries.
· Identified Infrastructure cost and design pros and cons with multiple solution approaches with AWS Stack involving EB/SQS/SNS/CW for upcoming new Data Pipeline need.
· Developed Design flows with Snow Pipe and integrated with AWS Dynamo DB and implemented PoC's using Python & Java Springboot
· REST API definition and design using apigee / swagger ui.
· Enhanced the existing Data pipelines to orchestrate using Python based Lambda’s and utilities developed for cron services to perform automation.
· Authored IaC / Terraform based automation to enable CICD pipeline to setup sandbox environments to support multiple PoC’s
· Developed logz / CloudWatch based metrics dashboard generation on daily basis to meet the business need.