Data Engineer II

job
  • Crystal Equation Corporation
Job Summary
Location
San Mateo ,CA
Job Type
Contract
Visa
Any Valid Visa
Salary
PayRate
Qualification
BCA
Experience
2Years - 10Years
Posted
06 Jan 2025
Share
Job Description

Pay range is $70-$84 per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.


Responsibilities:

Designs, develops, modifies, tests and automation used to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems and tuning warehouse applications. Develops transition and implementation plans. Recommends changes in development, maintenance and standards.


• Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle)

• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases

• Experience with ETL tools (Informatica)

• Ability to create quality ERD’s (entity-relationship diagrams)

• Excellent writing skills for writing user and system documentation

• AWS Cloud Data Warehousing Technologies

• Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda)

• Development/modeling experience with Amazon Redshift

• Experience using the AWS service APIs, AWS CLI, and SDKs to build applications

• Proficiency in developing, deploying, and debugging cloud-based applications using AWS

• Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro)

• Ability to apply a basic understanding of cloud-native applications to write code

• Proficiency writing code for serverless applications

• Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)

• Ability to author, maintain, and debug code modules on AWS

• Database: AWS Aurora Postgres

• Data Access: AWS Athena

• Data Analytics: AWS Quicksight

• Familiarity working with or knowledge of Alteryx, Collibra, Immuta, Okta a plus.

• Experience with visualization tools (Tableau)

• Experience creating scripts with Python

• Experience working on an Agile team

• Understanding of application lifecycle management

• Understanding of the use of containers in the development process


Qualifications

• 5 to 9+ years of experience in data engineering, data science, and software engineering.

• Bachelor’s degree in computer science, Information Systems, or another related field

• Must be a US Citizen or a Green Card holder.

Other Smiliar Jobs
 
  • Alameda, CA
  • 2 Days ago
  • Sunnyvale, CA
  • 2 Days ago
  • Fremont, CA
  • 2 Days ago
  • Sonoma, CA
  • 2 Days ago
  • Santa Clara, CA
  • 2 Days ago
  • Santa Rosa, CA
  • 2 Days ago
  • Hayward, CA
  • 2 Days ago
  • San Jose, CA
  • 2 Days ago
  • San Francisco, CA
  • 2 Days ago
  • Plano, TX
  • 6 Days ago
  • Burlingame, CA
  • 6 Days ago
  • Austin, TX
  • 6 Days ago
  • Alameda, CA
  • 1 Days ago
  • Sunnyvale, CA
  • 1 Days ago