As a Data Engineer, you will build industrialized data assets and data pipelines in support of Business Intelligence and Advance Analytic objectives. The Data Engineer handles leading and delivering new and innovative data driven solutions that are elegant and professional. You will work closely with our forward-thinking Data Scientists, BI developers, System Architects, and Data Architects to deliver value to our vision for the future. Our team focuses on writing maintainable tests and code that meet the customer’s need and scale without rework. Our engineers and architects work in highly collaborative environments across many disciplines (user experience, database, streaming technology, custom rules engines, and ai/ml and most web technologies). We work on innovative technologies – understanding and inventing modern designs and integration patterns along the way.

Looking for someone who is passionate about data and data quality, someone who has high interest in this will be a great fit. They handle critical data to get cars delivered to the customers and the bottom line for data passion and the ability to provide the products to customers

Top Skills

• Degree Requirement – Bachelor Degree in the data space or a related field (computer science, information technology, mathematics are good fields)
• Years of experience – 5-7 years’ experience building ET L- (ETL – extract transform and load) ETL – code utilizing different technologies, connects you to a database and helps extract it out so the table and the fields do the transformation cleaning, connect to another database and actually load it to the new database
• Working with azure cloud technologies
• Understanding databases, database structures, data model, data architecture
• Expert in multiple tools and technologies including Azure and Databricks, Scala, Spark, Python, SQL, .NET, REST API, Angular, SQL Server, PostgreSQL, SQL Server Integration Services (SSIS), Complex ETL with massive data, PowerBI
• Understanding databases, database structures, data model, data architecture

Responsible for extracting data from our manufacturing plant floor applicants, data is provided for our business partner to use in an operation supporting manner such as operations/analytical uses, creating analytical reports, not doing the actual development, forcing the data and making it available in databases. They are looking to move to cloud this year, work around migrating current data pipelines to cloud.

Daily Breakdown – every day is mostly the same, come in and start their daily responsibilities, has stand ups where they discuss the work that they have on top for the sprint, where they are at if there are any blockers, if they need help expediting the work with leadership, very independent working but still around other team members that will be working on the same data, some interaction with their business partners, understanding what is needed. Some adhoc meetings that may come up that they have to attend. Define what the scope of the sprint is going to be prior to the sprint, they have a lot of backlogs to fulfill, sometimes priorities change they might be working on something and have to switch to something more critical.

Scope is defined in 3-week sprints - what’s assigned should be delivered in this timeframe

• You will assemble large, complex data sets that meet functional / non-functional business requirements.

• You will identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Lead and deliver exceptional data driven solutions across many different languages, tools, and technology.

• Develop a culture which takes challenging and complex ideas and turns them into production solutions.

• Have a broad, enterprise-wide view of business and varying degrees of appreciating for strategy, process, capabilities, enablers, and governance.