Job Description

Data Engineer

• Strong experience in python and Java programming with working knowledge of micro-services architecture.

• Good experience Bigdata programming and Hadoop. Good understanding and knowledge of best practices for Hadoop, data modeling, data integration, data pipe-lining and data delivery.

• Good experience in Spark, need to be able to tune the spark jobs.

• Conduct code reviews to ensure adherence to quality standards.

• Experience with design, implementation and optimization of large-scale data and analytics solution

• Experience in building automated data pipelines and data stores including designing, implementing, testing, debugging, and deploying.

• Experience in building metadata driven solutions that are reusable and highly configurable.

• Experience in development of scripts using Unix, Python, etc for loading, extracting and transforming data.

• Experience in developing production-ready data ingestion and processing pipelines using Java, Spark, Scala, Python.

• Implement best practices for data engineering, including data modeling, performance optimization, and monitoring.

• Excellent communication and analytical skills.

• Proven experience as a technical lead or similar role in data engineering.

• Strong understanding of data warehousing and data architecture principles.

• Proficiency in SQL and other data manipulation languages.

• Experience in data visualization tools and data integration platforms.