Job Title: Data Engineer

Location: Saint Louis, MO

Employment Type: (Full-time or contract)

Duration: Long Term

Only USC/GC

Job Description:

Development operations (DevOps) engineers are responsible for the production and ongoing maintenance of a website platform. They also manage cloud infrastructure and system administration and work with teams to identify and repair issues on an as-needed basis, so strong communication skills are important in this position. They are generally expected to work well under pressure with tight deadlines for certain tasks, and a proactive demeanor and friendly disposition are also helpful. DevOps engineers may work with junior and senior engineers, project managers, and executives, as well as administrative assistants, executive assistants, and a receptionist. Hours can be flexible, though they typically work during regular weekly business hours, and they are not usually responsible for customer/client interaction or supervising junior employees. 5- 10 years of experience.

• Assists in preparing technical design specifications based on functional requirements and analysis documents.
• Reviews functional requirements, analysis and design documents and provides feedback.
• Collaborates with other development staff to achieve quality and consistency. Participates in architecture, design, and code reviews.
• Develops and maintains operational and system level documentation.
• 5 + years of experience.
• 5+ years experience in a building data pipelines/ETL and data processing
• 5+ years hands-on experience and proficiency in SQL a must
• 3+ years hands-on experience with Linux shell scripting.
• 5+ years hands-on experience with PySpark/Spark SQL
• 3+ years of Apache Spark design and development experience using Scala.
• 5+ years of experience with Big Data or Hadoop tools such as Spark, Hive.
• 3+ years of experience with Data Frames and Resilient Distributed Datasets (RDDs).
• 3+ years of experience in building and scaling the distributed infrastructure.
• 3+ years of experience in production cloud infrastructure with AWS services especially S3, Lambda, RDS , EKS, GLUE, EMR services.
• 3+ years of working with messaging/data streaming services, especially Kafka.
• 2+ years of Agile scrum experience and JIRA. 2+ years of CI/CD/CT for software deployment and integration.
• Ability to manage tasks independently and take ownership of responsibilities.
• Demonstrates critical thinking skills with ability to communicate across functional departments to achieve desired outcomes.
• Excellent interpersonal skills with proven ability to influence with impact across functions and disciplines.
• Ability to manage multiple projects/deadlines, identifying the necessary steps and moving forward through completion

Warm Regards,

linkedin.com/in/wariya-siraj-7634b8169