Data Engineer

job
  • Compunnel Inc.
Job Summary
Location
Irving ,TX 75084
Job Type
Contract
Visa
Any Valid Visa
Salary
PayRate
Qualification
BCA
Experience
2Years - 10Years
Posted
25 Jan 2025
Share
Job Description

Job Overview:

We are seeking a skilled and motivated GCP Data Engineer to join our team supporting a leading telecom client. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions using Google Cloud Platform (GCP) technologies. You will work closely with cross-functional teams to optimize data workflows, support analytics, and ensure the integrity of large datasets to drive insights and business decisions for our telecom client.


Key Responsibilities:

Design, implement, and manage data pipelines using Google Cloud Platform (GCP) tools such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer.

Collaborate with data scientists, analysts, and business stakeholders to define data requirements, data models, and ETL processes for various telecom use cases.

Develop and maintain scalable and efficient data architectures to support high-volume, high-performance telecom data processing and analytics.

Integrate data from multiple sources (both on-premise and cloud-based systems) and ensure seamless data flow and synchronization.

Implement best practices for data governance, security, and compliance to protect sensitive telecom customer data.

Monitor data pipeline performance, troubleshoot issues, and optimize performance for cost-effectiveness and scalability.

Design and manage cloud infrastructure using GCP tools to automate deployment and configuration of data solutions.

Provide technical expertise in areas such as data transformation, data storage, and real-time data streaming, enabling data-driven decision-making within the telecom environment.

Assist with data migration from legacy systems to GCP and ensure smooth transition of data workloads.

Continuously evaluate emerging GCP technologies to improve and enhance the data engineering environment for telecom analytics.


Required Skills and Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Proven experience (3+ years) as a Data Engineer, with at least 2 years working with GCP.

Proficiency in Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer.

Strong experience with SQL and NoSQL databases (e.g., BigQuery, Cloud SQL, etc.).

Experience with ETL tools and data pipeline orchestration.

Familiarity with programming languages such as Python, Java, or Scala for data processing.

Knowledge of data modeling, data warehousing, and data lakes.

Experience with real-time data processing and streaming (e.g., Apache Kafka, Cloud Pub/Sub).

Strong understanding of data security, privacy, and compliance in a cloud-based environment.

Familiarity with Agile methodologies and working in cross-functional teams.

Excellent communication skills and the ability to collaborate effectively with business stakeholders.


Preferred Skills:

Experience in the telecom industry or with telecom-specific data.

Certifications in Google Cloud Professional Data Engineer or related certifications.

Familiarity with tools like Apache Airflow for orchestration.

Experience with DevOps and automation tools for CI/CD in cloud environments.

Experience with machine learning and AI-based data pipelines is a plus.

Other Smiliar Jobs
 
  • Durham, NC
  • 2 Days ago
  • Boston, MA
  • 1 Days ago
  • Philadelphia, PA
  • 10 Hours ago
  • Sunnyvale, CA
  • 10 Hours ago
  • Gainesville, FL
  • 3 Days ago
  • Wilmington, NC
  • 2 Days ago
  • Quincy, MA
  • 1 Days ago
  • Middletown, PA
  • 1 Days ago
  • San Francisco, CA
  • 10 Hours ago
  • Jacksonville, FL
  • 2 Days ago
  • Salt Lake City, UT
  • 2 Days ago
  • Spring, TX
  • 3 Days ago
  • Albany, NY
  • 3 Days ago
  • Baton Rouge, LA
  • 3 Days ago
  • Chicago, IL
  • 3 Days ago