L

Labelbox

SaaS data labeling and management platform

Forward Deployed Research Scientist

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeCalifornia, USA$200k - $300k /yrIn-person

About the Job

Requirements

  • Master of Science or PhD in Machine Learning, natural language processing, Computer Science, or a related quantitative field.
  • Hands-on experience fine-tuning large language models, including open-weight models such as Llama, Mistral, or Qwen.
  • Strong understanding of large language model training pipelines, including pretraining, supervised fine-tuning, reinforcement learning from human feedback, direct preference optimization, and the effects of data quality and composition at each stage.
  • Experience designing and executing rigorous experiments, including hypothesis formation, controlled comparisons, and statistical analysis of results.
  • Ability to move from problem definition to experimental results in days rather than months.
  • Strong written and verbal communication skills to present findings to client research teams and contribute to published work.
  • Ability to extract actionable questions from ambiguous client conversations, scope an approach quickly, and iterate.
  • Ability to work across field engineering, project management, operations, and applied research teams.
  • Ability to communicate empirical results clearly and constructively, including when results show that a data strategy is not working.

Responsibilities

  • Engage with research teams at frontier AI labs during client scoping meetings, discuss methodology, challenge assumptions about data requirements, and shape project specifications using scientific understanding of how data composition affects model outcomes.
  • Develop a working understanding of each client's architecture, training methodology, and target capabilities to assess data strategies, identify risks, and iterate based on empirical evidence.
  • Run ablation studies and fine-tune models on client and proxy data to measure the impact of data on model performance and identify problems before delivery.
  • Partner with the Human Data Operations team to review annotation schemas, task designs, and quality rubrics before project execution, ensuring specifications support client training objectives.
  • Collaborate with the Applied Research team by sharing generalizable field findings, reusable methodologies, and empirical results, and help complete joint research projects.
  • Contribute to benchmarks, white papers, and conference submissions.
  • Work across multiple client engagements simultaneously on timescales of days to weeks.
  • Collaborate with field delivery engineers, Human Data Operations, Applied Research, and client research teams.
  • Allocate 25–30% of team capacity to research collaboration with Applied Research.

Desired Qualifications

  • Prior experience at a frontier AI lab, applied machine learning startup, or in a research role with direct client or stakeholder interaction.
  • Experience evaluating and benchmarking large language models, including designing metrics, building evaluation harnesses, and critically interpreting results.
  • Familiarity with human data pipelines, including annotation workflows, quality assurance methodology, and inter-annotator agreement analysis.
  • Experience with reinforcement learning, reward modeling, or reinforcement learning from human feedback environments.
  • Published research in machine learning, natural language processing, or adjacent fields, including conferences, journals, or technical reports.

About the Company

Labelbox

SaaS data labeling and management platform

Labelbox provides a data-centric platform to create and manage labeled training data for machine learning, offered as a SaaS with tiered subscriptions and professional services. The platform acts as a data factory with three core components: an enterprise software for data management and annotation, Alignerr for frontier labeling, and an expert marketplace, supporting annotation across images, video, and text with workflow automation and real-time collaboration. It enables model-assisted labeling and integrates with ML pipelines through an API-first approach, plus tools for model evaluation and creating datasets for fine-tuning. Its goal is to streamline the production of high-quality labeled data to speed AI development and improve model performance across industries, differentiating itself with end-to-end data labeling and management and an ecosystem of labeling services and experts.

Company size
201-500
Company stage
Series E
Total funding
$288.9M
Headquarters
San Francisco, CA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Labelbox

See more jobs