A

Appen

Provides human-annotated data for AI training

Strategic Project Lead – AI Post-Training

Project ManagementConfirmed live in the last 24 hours
Full-timeLondon, UKNo salary listedRemote

About the Job

Requirements

  • 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a generative AI or frontier AI environment.
  • Familiarity with at least one AI post-training or model evaluation workflow.
  • Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
  • Understanding of data quality, annotation workflows, and quality assurance methods.
  • Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards.
  • Ability to troubleshoot, stay organized, and manage multiple priorities.
  • Interest in current AI developments, including frontier models and post-training approaches.

Responsibilities

  • Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management.
  • Lead client communication, status reporting, planning sessions, and escalations.
  • Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans.
  • Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs.
  • Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients.
  • Advise on data design, evaluation approaches, and project feasibility based on domain expertise.
  • Develop reusable guidelines, standard operating procedures, and quality assurance frameworks to improve consistency across programs.
  • Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development.

Desired Qualifications

  • Experience with reinforcement learning from human feedback, preference data, or model response evaluation.
  • Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
  • Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
  • Exposure to AI companies, frontier AI labs, or model evaluation programs.
  • Bilingual capabilities, particularly German or a Nordic language.

About the Company

Appen

Provides human-annotated data for AI training

Appen creates and curates large datasets used to train and improve artificial intelligence. It relies on a global, crowdsourced workforce to produce human-annotated data across text, images, audio, and video, which powers AI systems such as search engines and social feeds. Its products include data annotation services and platforms (like Figure Eight) and specialized data like mobile location data (Quadrant) to support ML pipelines. The company differentiates itself through scale, a broad range of data types, and a history of strategic acquisitions that expand its capabilities (e.g., Leapforce for search relevance, Figure Eight for annotation tooling, Quadrant for location data), enabling end-to-end data supply for enterprise AI. Its goal is to help organizations build reliable AI by providing high-quality labeled data and to capitalize on opportunities in generative and enterprise AI while returning to profitability under new leadership.

Company size
10,001+
Company stage
IPO
Headquarters
Sydney NSW, Australia
Founded
1996

Recently Posted Jobs

Explore more opportunities at Appen

See more jobs