WHO we’re looking for:

We are looking for a Gen AI Test Lead who will be responsible for leading the design, execution, and oversight of testing strategies specifically focused on Generative AI applications, collaborating with cross-functional teams to ensure the quality, functionality, and reliability of AI-powered features across various platforms, while staying up-to-date with emerging GenAI technologies and testing methodologies. Your key responsibilities include developing comprehensive test plans, designing test cases, identifying potential issues, managing a team of testers, and working closely with developers to resolve defects related to Generative AI implementations. You will collaborate with cross-functional teams, including researchers, engineers, designers, health coaches, physicians and product managers, to ensure the efficient execution of GenAI initiatives. This is a unique opportunity to work on cutting-edge projects that will shape the future of Health AI.

You will be a core part of a passionate team charged with developing, incubating, and launching a portfolio of digital health product concepts that will disrupt the healthcare paradigm. By leveraging smart phones, wearables, embedded devices and the IoT in the health/wellness domain, your work will significantly benefit real-world patients, seniors, physicians and care givers. With a unique advantage in the consumer electronics market and growing focus on digital health, this will provide you with exciting technical challenges and a rewarding career experience.

The Digital Health Team (DHT) is an interdisciplinary team with an aim to empower providers, consumers, and clinical researchers. Creating hyper-personalized health applications leveraging GenAI/LLM technologies, develop prognostic biomarkers by applying clinically explainable AI on advanced sensing technology, explore use cases by co-innovating with our partners, and design services through pilots that eventually turn into groundbreaking commercial, consumer-grade products that are used every day.

Role and Responsibilities:

• Lead and drive overall test design, planning, execution, and oversight of testers internally and externally.
• Manage vendors that offer internal user testing, external user testing, and large-scale human testing services.
• Build strategic GenAI evaluation capabilities (e.g., data-driven processes, evaluation frameworks, analytical tools) to identify and prioritize opportunities to accelerate GenAI product development cycles.
• Collaborate closely with GenAI research, engineering, UI/UX, health experts and product teams to align program objectives with broader organizational goals.
• Proactively identify program risks, develop and execute mitigation plans, and communicate rationale and updates clearly.
• Guide the work of onshore and offshore workers to complete data annotation/evaluation projects.

Required Experience and Education:

• 5+ years of proven experience with a track record of successfully delivering complex projects.
• 1+ years working on GenAI/LLM application evaluation related work
• Bachelor's degree required.
• Hands-on experience working with vendors offering AI testing services.
• Experience prioritizing and ensuring key initiatives move forward, managing multiple cross-functional stakeholders, and working with urgency.
• Expertise in software testing methodologies and best practices.
• (Preferred) Experience with automated testing frameworks and tools.
• (Preferred) Proficiency in programming languages relevant to AI development (e.g., Python).
• (Preferred) Strong understanding of Generative AI concepts, including natural language processing, machine learning, and deep learning.