Where we work: Our AWS partnered analytics organization owns the world’s biggest financial data store and runs continuous analytics on global stock data movement. Our mission is to ensure investor protection and market integrity. We are constantly working on how to “hack/break” market systems with the goal of being ahead of potential bad actors in the market.
Leading Innovator in Machine Learning/AI, Big Data, AWS, trading algorithms.
We work on the world’s largest financial store (21 petabytes when complete). There is no other comparable opportunity in the market. We look at 130 billion financial transactions every day. That's more than Twitter, Visa, PayPal, and Facebook combined.
Amazon Web Services - Select Partner: We use cloud computing to automate and store massive amounts of data.
Must have:
- Strong in SQL and have some Python
- Python
- SQL (this is likely very important)
- Big Data (Spark, Hadoop, SQL)
- Some unit testing (testing the code they’ve written)
- (For the Senior Developer only) Financial markets experience such as Nasdaq & other
Nice to have:
JD: Responsibilities:
- Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
- Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.
- Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality assurance.
- Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.
- Work with data scientists and analysts to support data-driven decision-making across the organization.
- Ability to write and maintain automated unit, integration, and end-to-end tests.
- Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology, Design, and Engineering
Industries
Financial Services and Banking
#J-18808-Ljbffr