Requirement Details:

Job Title: Senior Research Data Scientist

Location: 100% Remote (But must be located in Seattle to come into the office as needed)

Duration: 12+ months with potential for extension

Rate Range: $100-103/hr on W2

Job Summary:

• We are seeking a highly skilled and motivated Data Scientist to join our Responsible AI team.
• In this role, you will be responsible for designing, coordinating, supporting, and executing evaluations of large language model (LLM) features to ensure their safety, fairness, and alignment.
• You will work closely with multidisciplinary teams, including Research Scientists, Product Managers, Engineers, and other Data Scientists, to drive human-centric evaluations that inform product decisions and improve model performance.
• This position requires a combination of strong technical skills, experience in industry settings, and a deep understanding of human-centered data science.
• Familiarity with responsible AI principles and practices is a strong plus.

Key Responsibilities:

• Design, implement, support, and evaluate experiments for LLM feature safety, including both human and automated evaluations.
• Develop scalable pipelines and tools to process and analyze heterogenous datasets.
• Collaborate with cross-functional teams to operationalize research findings
• Write high-quality, maintainable code, and contribute to shared codebases
• Create and maintain documentation for research processes and evaluation frameworks.
• Communicate findings effectively through presentations and reports, translating technical results into actionable insights for diverse audiences.

Key Qualifications:

• Strong programming skills in Python, with experience in writing production-level code and implementing best practices (e.g., unit testing, version control).
• Experience with data engineering, including working with large datasets or heterogenous datasets with mixed provenance.
• Solid understanding of machine learning concepts, particularly related to LLMs, NLP, and model evaluation.
• Experience designing and executing experiments, including human-centered evaluations and automated benchmarking.
• Experience in observational or experimental research with human subjects.
• Familiarity with SQL for data manipulation and analysis.
• Strong analytical and problem-solving skills, with experience applying statistical methods to real-world problems.
• Excellent verbal and written communication skills, with experience in explaining technical concepts to non-technical stakeholders.

Strongly Preferred:

• Hands-on, technical experience solving data science or ML problems with LLMs, preferably in an applied industry context
• Experience with responsible AI, including fairness, transparency, and safety in AI systems.
• Background in human-centered data science, HCI, or social science fields relevant to understanding human-AI interactions or measuring human-centered phenomena.

Education:

• Master’s or PhD in Computer Science, Machine Learning, Data Science, Statistics, Cognitive Science, Psychology, Human-Computer Interaction, or a related field.