We are on the lookout for a Senior Data Engineer for a direct client.
This is a long-term contract role, at least 12 months .
This is based in Santa Monica, CA and would require some onsite time, but there is an opportunity for the hiring manager to allow remote work on a case by case basis.
- 3 - 5 years experience in Quality validating ETL pipelines and Data Warehouses
- Expert SQL knowledge and experience working with relational databases as well as a working familiarity with a variety of databases.
- Good experience in data analytics, data engineering, data modeling, data warehousing, and big data platform
- Strong programming (Scala/Java) or scripting skills (Python)
- Experience with but not limited to JUnit/TestNG/BDD or similar tools
- Experience in a range of common big data tools & technologies such as Airflow, Hive, Snowflake, Databricks, Spark etc.
- Experience in working with large datasets (Terabytes or more)
- Test and validate ETL logic and Data Pipelines
- Own the quality of every release into production with a data-driven approach
- Create, deliver and continuously improve our quality processes for delivering operational
- data to address all types of subscriber and commerce operations to our stakeholders.
- Partner with Data Analysts, Product and Engineering teams to deeply understand the underlying transactional systems behavior and business use cases.
- Translate reporting and operational technical specifications, including calculations, custom groups, parameters, filtering criteria and/or aggregations into test requirements.
- Build automated and reusable tests for data stores to improve quality and development velocity
- Diagnose issues, report defects, and propose regression tests to catch recurring bugs
- Mentor fellow Test Engineers on the team to ramp up on automation concepts and contribute towards expanding test coverage