Lead Databricks Engineer (Director Level)

New York, NY

Full Time

Hybrid (3 days onsite)

PRIMARY FUNCTION:

This role is for someone who can implement Databricks and Tableau from scratch

The Databricks Lead is responsible for architecting scalable, best-in-class Data Warehouse, Business Intelligence/Reporting solutions and processes, develop, and maintain our analytics platform. With a focus on driving data-driven decision-making, this role creates innovative reports, views, dashboards, scorecards, visualizations, and mobile analytics apps. The Director drives requirements gathering, Data Profiling, develops KPIs, metrics, and leads adoption of the platform. The Director works closely with the IT Management team and stakeholders across entire organization to develop data-informed reports, supporting successful business growth and operational efficiency.

RESPONSIBILITIES:

• Design, develop and implement data solutions based on best industry practices.
• Proactively drive the vision for BI and Data warehousing across organization. Build cross-functional relationships to understand data needs and deliver on those needs using our "4R” model (the Right Data, the Right People, the Right Time, the Right Decisions).
• Create data pipelines to facilitate the movement of data between multiple data sources and cloud databases to create a unified data view.
• Transform and cleanse raw data into a format that is suitable for analysis and visualization.
• Analyze business and functional requirements and translate those into database structures and technical designs.
• Create and implement a Unified Data Framework and data model to bridge and to contextualize data sources across systems.
• Define data validation rules and automation.
• Ensure data quality across data warehouse and analytics platforms.
• Develop visualizations, reports, dashboards, apps and KPI scorecards.
• Deliver enhancements with a view towards effectively normalized databases, best practices, and integration of data stores.
• Implement Software Development Lifecycle (SDLC) and other best practices, including the creation and maintenance of proper technical and business process documentation.
• Partner with VP of IT in ROI analysis and business case studies for project approval.
• Manage & execute projects, develop schedules, manage risks and issues, facilitate meetings, report status to IT Leadership and Business Stakeholders.
• Perform Root Cause Analysis on major issues with a focus on finding ways to prevent repeated future problems.
• Stay up to date with emerging technology trends and recommend relevant enhancements or integrations to improve operational effectiveness.

QUALIFICATIONS:

Skills:

• Ad-hoc report writing using advanced SQL techniques.
• Experience building Business Analytics applications for Salesforce CRM products and ERP systems.
• Expert knowledge of data management, Master Data Management (MDM) , Data Quality.
• Ability to gather, synthesize and analyze data and draw logical conclusions.
• Strong analysis and problem-solving abilities. Technical eye for details.
• Solid teamwork and interpersonal skills with a customer service focus and a solid understanding of ITIL process.
• Highly self-motivated and able to work independently with minimal supervision.
• Excellent verbal and written communication skills.
• Expertise in managing multiple projects in parallel.
• Experienced knowledge of project management methodologies such as SCRUM, Agile, hybrid and best practices.
• Business Requirements gathering, writing business and functional requirements.
• Understanding of User Experience, User Acceptance and Regression Testing concepts.

Work Experience:

• The ideal candidate has 5 or more years' experience with software development, data warehouses & data lake, and demonstrable experience managing a team and external consultants.
• Implementation experience with Databricks data warehouse & Tableau self-service analytics is essential.
• Hands on experience with Data warehouse & BI tools (Tableau, Qlik Sense, Power BI, Databricks, Snowflake – Tableau and Databricks preferred).
• Well versed in SQL, Scripting, Database, ETL processes, Data Modeling, Data Warehouse methodologies, Data Management, Data Modeling and Performance Tuning.
• SDLC implementation experience.
• Knowledge of Salesforce CRM and Sage Intacct data model is preferred.

Education:

• Bachelor's degree in computer science or related area, or equivalent experience.
• Advanced degree a plus.
• PMP or PGPM PMI Certification or equivalent preferred.