Hi,

We are seeking a skilled and motivated Data Engineer to join our team in Sunnyvale, CA(Hybrid) .

Job Title: Data Engineer

Location: Sunnyvale, CA(Hybrid)

Duration: 6+ Months

Must have:

Responsibilities:

Technical Skills:

Extensive experience with Google Cloud Platform (GCP) or Microsoft Azure.

Familiarity with services like Big Query, Dataflow, DATAPROC (GCP), or Azure Data Factory, Azure Synapse Analytics, Azure Databricks (Azure).

Big Data Technologies:

Expertise in PYSPARK for large-scale data processing.

Experience with Apache Hadoop, Kafka, and other big data technologies is a plus.

Database Management:

Strong proficiency in writing complex SQL queries and optimizing SQL performance for large-scale data processing.

Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) is a plus.

ETL & Data Integration:

Solid experience in designing, implementing, and maintaining ETL pipelines.

Experience with data integration tools like Apache NIFI, Azure Data Factory, Google Dataflow, etc.

Data Warehousing:

Experience with cloud-based data warehouses like Big Query (GCP), Azure Synapse Analytics, or other similar platforms.

Ability to design and optimize data storage schemas (fact tables, star schema, snowflake schema, etc.).

Programming:

Strong experience in Python, especially with libraries such as PySpark for data manipulation and processing.

Experience with Apache Spark and the Spark SQL module is highly preferred.

Automation & Orchestration:

Familiarity with automation tools like Airflow, Cloud Composer, or other orchestration tools.

Soft Skills:

Problem-Solving: Strong analytical and problem-solving skills, with the ability to debug, optimize, and troubleshoot complex data pipelines.

Collaboration: Strong communication skills to collaborate with data scientists, analysts, and business users.

Time Management: Ability to manage multiple tasks and prioritize work effectively in a fast-paced environment.

Attention to Detail: Strong focus on ensuring data integrity and quality throughout the pipeline.

Regards,

SHIV SHARMA | SR. TECHNICAL RECRUITER

Email:

Address: 4637 Chabot Dr #250, Pleasanton, CA 94588

BAYONE.COM | CONNECT ON LINKEDIN