Sr Data Engineer
Iselin, NJ
W2 Role
Job Responsibilities:
- Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse
- Provide production support for Data Warehouse issues such data load problems, transformation translation problems.
- Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
- Able to work on data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations.
- Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
- Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and Snow SQL.
- Able to provide data ingestion and processing pipelines using Python, Databricks, Snow SQL
- Able to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality)
Required Qualifications - Overall 10+ years of experience is required.
- Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data Warehouse
- Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.
- Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modelling
- Good knowledge of MS Azure configuration items with respect to Snowflake
- Experience in writing scripts (UNIX, Python)
- Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
Good to Have: - Experience in Finance / Banking industry - some understanding of Securities and Banking products.