S

Snorkel AI

Builds training data and test environments for AI

Forward Deployed Researcher - Data as a Service

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeHybrid

About the Job

Responsibilities

  • Own a technical domain end to end, including setting the technical bar for what to build and determining what to build next.
  • Partner with frontier AI research labs to design datasets and environments that improve model performance.
  • Lead technical conversations with customer researchers to understand model capabilities, failure modes, data requirements, and success criteria.
  • Probe model behavior through systematic evaluation to uncover weaknesses and identify high-impact data interventions.
  • Benchmark frontier models against datasets to demonstrate value to customers, build or adapt evaluation harnesses as needed, and turn results into pass-rate analysis, failure-mode breakdowns, and purchase recommendations.
  • Design evaluation frameworks, calibration processes, and quality rubrics that establish measurable project success metrics.
  • Develop technical specifications for data projects that balance research rigor with operational feasibility.
  • Hold the demand shape for the domain, including which labs want what, at what volume, against what bar, and where requests are converging.
  • Develop a point of view on where the domain is heading and partner with Research on what should exist before a customer asks for it.
  • Serve as a thought partner to customer research teams throughout the sales cycle, building trust and credibility.
  • Stay current on frontier AI research, reinforcement-learning environment design, post-training techniques, and evaluation methodologies.

Desired Qualifications

  • Strong expertise in frontier AI concepts, including large language models, training data pipelines, evaluation methodologies, post-training techniques such as reinforcement learning from human feedback, direct preference optimization, and reinforcement learning from AI feedback, and domain areas such as coding agents, reasoning, multimodal models, or reinforcement-learning environments.
  • Experience in applied machine learning research, data science, or research-intensive technical roles.
  • Customer-facing or collaborative research experience, or demonstrated aptitude for client engagement.
  • Proficiency in Python, familiarity with machine-learning frameworks and large language model APIs, and comfort running evaluations in containerized environments.
  • Ability to deliver technical presentations and explain complex concepts to diverse audiences.
  • Familiarity with data curation workflows, synthetic data generation, large-language-model-as-a-judge, or evaluation framework design.
  • Willingness to make and state a defensible assumption when a request arrives underspecified, rather than waiting for the customer to close the gap.
  • Ability to work in a fast-moving environment, with comfort around ambiguity and rapid iteration.
  • Bachelor of Science in Computer Science, Machine Learning, or a related field, with 4+ years of experience in AI/ML research or technical roles; an advanced degree is preferred.

About the Company

Snorkel AI

Builds training data and test environments for AI

Snorkel AI builds training datasets and simulated work environments for AI labs and companies developing models and software agents. Its data products combine expert demonstrations, scoring rules, and quality checks, while runnable environments let agents practice tasks such as coding or using business software. The company pairs domain specialists with its own data development technology to generate examples, evaluate model behavior, and refine weak areas through repeated feedback. Customers buy ready-made datasets or commission tailored data and evaluation work, and enterprises also use its specialized agent solutions. Snorkel AI was founded in 2019 and is headquartered in San Francisco, California.

Company size
201-500
Company stage
Late Stage VC
Total funding
$586.2M
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Snorkel AI

See more jobs