The Swift Group is seeking a highly skilled and experienced
Data Engineer to join our team. The ideal candidate will have a strong background in building and managing data pipelines, collaborating with development teams, and working with various data processing and cloud technologies. You will play a key role in designing, implementing, and maintaining scalable data solutions.
Required Qualifications:- 4+ years of data engineering experience, and solid educational training in data engineering
- Experience in building and managing data pipelines
- Experience working on a highly collaborative development team
- Experience with python
- Experience with cloud computing using AWS services
- Experience processing data using spark
- Experience with an RDBMS (Postgres, Oracle, MySQL) and writing SQL queries
- Experience with Linux and shell scripting
- Experience analyzing data in different file formats like csv, xml, json, avro, parquest, etc.
- Experience writing unit tests
- BA/BS Degree in relevant field (5 years of relevant experience in lieu of a degree)
- US citizenship with an active TS/SCI with Polygraph security clearance required
Desired Qualifications:- Experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines
- Experience with java or scala
- Experience administering an EMR/Spark cluster
- Experience conducting performance tuning of a spark job
- Experience supporting Hive, Iceberg, or another technology providing SQL access to data
- Experience developing cloud-based security solutions
- Experience following a configuration management process to review and deploy code as part of releases
- MA/MS Degree
The Swift Groups is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status, or any other protected class.