Data Engineer

Hybrid 3 days onsite in Atlanta GA.

Robert Half is searching for a Sr. Data engineer who will have ownership of designing and developing large scale data solution. You will have deep technical skills in a variety of technology to play an important role in developing and delivering proof of concepts and product implementation.

Responsibilities

• Design and develop high performant data ingestion pipelines from multiple sources using Azure Databricks and Azure Data Factory
• Working with event bases streaming technologies to ingest and process data
• Design and Implement Data Lakehouse
• Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
• Evaluating the performance and applicability of multiple tools against customer requirements
• Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
• Work with contractors to deliver products and services for the bottlers
• Conduct Pilots with bottlers and measure value
• Transition successful pilots into commercial applications
• Ensure design and implementation of technologies that comply with security standards and application architecture principles (in alignment with platform architects and respective review boards) and that consider state of the art data and analytics concepts
• Review code/solutions developed by team prior to migration to production

What makes you a good fit?

• Strong knowledge of data management principles
• Experience in building ETL pipelines
• Hands on experience designing and delivering solutions using the Azure including Azure Storage, Azure Data Factory, PySpark, Python, Databricks, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
• Experience working with structured and unstructured data
• Experience working in DevOps environment
• 6 years of relevant experience
• Ability to balance high customer orientation and service attitude with business priorities
• Analytic thinking, and problem-solving skills
• High energy, with strong will and ambition to learn and work on new things
• Outstanding proven verbal, written and interpersonal communication skills
• Ability to adapt quickly to changing product scope and priorities (demand driven)
• Proven ability to influence and collaborate effectively with cross-functional teams
• Demonstrates noticeable commitment to foster and preserve a culture of diversity and inclusion by creating environments where people of diverse backgrounds are excited to bring all of who they are and do their best work