Title: Data Engineer

Location: San Francisco, CA (1-2 Days onsite/Week)

Duration: 12+ Month Contract

Key Responsibilities:

• Design and implement scalable data pipelines using Databricks and Spark.

• Develop and maintain data processing applications in Scala and Python.

• Integrate and manage data streams using Kafka.

• Build and maintain microservices using Spring Boot.

• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.

• Optimize and troubleshoot data workflows to ensure high performance and reliability.

• Ensure data quality and integrity across various data sources.

Required Skills and Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.

• Proven experience as a Data Engineer or in a similar role.

• Proficiency in Databricks, Spark, Scala, Kafka, Python, and Spring Boot.

• Strong understanding of microservices architecture.

• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

• Excellent problem-solving skills and attention to detail.

• Strong communication and teamwork abilities.