Pay Rangenn$118,800.00-$196,200.00nnCompany OverviewnnThe people of Memorial Sloan Kettering Cancer Center (MSK) are united by a singular mission: ending cancer for life. Our specialized care teams provide personalized, compassionate, expert care to patients of all ages. Informed by basic research done at our Sloan Kettering Institute, scientists across MSK collaborate to conduct innovative translational and clinical research that is driving a revolution in our understanding of cancer as a disease and improving the ability to prevent, diagnose, and treat it. MSK is dedicated to training the next generation of scientists and clinicians, who go on to pursue our mission at MSK and around the globe.nnPlease review important announcements about vaccination requirements and our upcoming EHR implementation by clicking here ( .nnImportant Note for MSK Employees:nnYour Career Hub profile is submitted to the hiring team as your internal resume. Please be sure your profile is fully complete with your skills, relevant experience and education (if required). Click here ( to learn more. Please note, this link is only accessible for MSK employees.nnJob DescriptionnnData Engineer IInnExciting Opportunity at MSKnnSeeking experienced data infrastructure engineer to help drive MSK’s data modernization journey. You will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem that will be used for multiple purposes including data science and analytics. Seeking a talented data engineer to be a key player in MSK’s mission to fight cancer. You will leverage your skills with Spark, Data Lakehouse, and cloud technologies to design, develop, and maintain scalable data processing systems, enabling us to derive valuable insights from our data in a hybrid and multi-cloud data ecosystem.nnPosition Overview:nnWork closely with stakeholders to understand data requirements and provide technical solutionsnnDevelop ELT data pipelines using PySpark coding best practices.nnUse CI/CD and other dataops best practices.nnTransform data into conformed models and data products.nnMonitor and optimize data processing jobs for performance, ensuring efficient resource utilization, optimal data storage structure and minimal processing time.nnImplement data validation and quality checks to ensure the integrity and reliability of data throughout the processing lifecycle.nnCreate and maintain documentation for data pipelines, processes, and best practices.nnKeep abreast of the latest developments in data engineering and related technologies.nnRequired Skills:nnStrong proficiency with PySpark development and troubleshooting.nnExperience with Databricks and medallion architecture.nnSolid understanding of database design fundamentals.nnSolid understanding of cloud infrastructure concepts including network and security.nnExperience with CI/CD for development lifecycle and testing automation.nnImplementation expertise on AWS technologies including S3, EC2, Glue, MWAA.nnStrong analytical, problem solving and organizational skills.nnExcellent communication and collaboration skills.nnMinimum 4+ years of Cloud Data Engineer working experience.nnCore Skills:nnAn in-depth understanding of both business and technical discussions.nnExcellent communication and collaboration skills.nnStrong analytical, problem solving and organizational skills.nnAdditional Information:nnLocation: 633 Third Avenue, NYnnReporting to Director, Data ManagementnnSchedule: Hybrid, 4 days a month onsitennPay Range: $118,800 - $196,200nnHelpful Links:nnMSK Compensation Philosophy ( Our Greats Benefits Offeringsnn#LI-POSTnn#LI-HYBRIDnnClosingnnMSK is an equal opportunity and affirmative action employer committed to diversity and inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration without regard to race, color, gender, gender identity or expression, sexual orientation, national origin, age, religion, creed, disability, veteran status or any other factor which cannot lawfully be used as a basis for an employment decision.nnFederal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.nnStay in touch!nnRegister now to join Memorial Sloan Kettering’sTalent Community ( to receive inside information on our organization and new job opportunities.nnJob LocationsUSA-NY-New YorknnPosted Date11 hours ago(12/19/2024 8:43 AM)nnRequisition ID 2024-82233nnCategory Digital Informatics and TechnologynnPay Range $118,800.00-$196,200.00