Requirement Details:

Job Title: Content Producer (UK or Canadian English)

Location: Cupertino, CA (Hybrid)

Duration: 6+ months with potential for extension

Rate Range: $40-43/hr on W2

Job Description:

• Native-level fluency in English (British or Canadian English), with exceptional written and verbal communication skills
• Linguistic/cultural skills: expert knowledge of grammar, spelling, and cultural appropriateness to accurately represent British user experience and ensure content aligns with local cultural and linguistic norms
• Ability to work cross-functionally with Design, Product, Editorial, Safety and Engineering teams to deliver quality results on time. Collaborate with cross functional teams to precisely define the evaluation requirements necessary for Machine Learning/ Large Language Models implementation across different projects.
• Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback

Responsibilities may include, but are not limited to:

• Evaluating content, researching and verifying accuracy of relevant metadata pertaining to different media types.
• Quality assurance reviewing, verifying, editing, scoring, transcribing, copywriting, and reporting on data and/or assets across a broad scope of media and content types.
• Problem solving, provide clear suggestion/feedback to leads, and effectively communicate recommendations to both editorial and engineering teams.
• Leverage established workflows and tooling for various content tasks. Collaborate and follow guidance from the Project Lead, Style Guides, and Terminology Databases on all matters related to the project requirements.
• Experience in Large Language Models and knowledge about LLM evaluation techniques, such as human evaluation and automated benchmarks is desirable.
• Conduct research with humans to validate and create automated benchmarks for LLM evaluations. Collect data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
• Advanced degree in linguistics, computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).