O

Outset

AI-driven interview solution for candidate evaluation

Research Engineer

AI ResearchConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA$200k - $240k /yrHybrid

About the Job

Requirements

  • Several years of software engineering experience, including experience supporting researchers in a lab or comparable setting.
  • Experience translating specific scientific requirements and experiment designs into code.
  • Experience building and operating large-scale data pipelines on human behavior data, and confirming that the pipelines matched the criteria and design the researchers specified.
  • Strong Python skills, including the ability to read and audit code produced by agentic coding tools.
  • Knowledge of file systems, software libraries, databases, SQL, tabular data, and Git-based workflows.
  • Experience with cloud infrastructure and running many jobs concurrently.
  • Working understanding of machine learning, including how transformer-based language models behave, how model APIs are used, and what fine-tuning involves.
  • Ability to write deterministic, reproducible, cost-aware, and well-documented code.

Responsibilities

  • Own the evaluation infrastructure that tests competing modeling approaches so new tests can be set up quickly, run concurrently and automatically, and be monitored.
  • Implement measurement pipelines exactly as specified by the scientists, with deterministic and traceable outputs.
  • Maintain versioned evaluation datasets with held-out sets that are never used for training.
  • Build and maintain data pipelines for human-participant data, external datasets, and model training data, including linkage of records belonging to the same participant across sources.
  • Keep research code in step with the production product so validated improvements ship promptly.
  • Detect and prevent threats to the validity of evaluations.
  • Track compute and API spend across experiments and their implications for production-stage costs.
  • Manage repositories, code review, documentation, and the reproducibility of the team's coding workflow.
  • Identify implementation choices that can be made more correct or more efficient, and propose changes.

Desired Qualifications

  • Hands-on experience engineering large language model systems, including prompt pipelines, evaluation harnesses, embedding computation, agentic systems, and/or fine-tuning infrastructure.
  • Experience fine-tuning open-weight language models on multi-GPU hardware.
  • Experience serving open-weight models with an inference framework such as vLLM or SGLang, including batched inference and prefix caching for many requests that share a common prompt.
  • Experience with experiment tracking and cost monitoring for machine learning workloads.
  • Experience with survey or panel data and data collection platforms.
  • Experience extracting and storing model activations for downstream analysis.
  • Experience with experiment tracking and cost monitoring for machine learning workloads, including GPU provisioning across cloud providers.
  • Prior work on generative agents, digital twins, or simulation of human respondents.

About the Company

Outset

AI-driven interview solution for candidate evaluation

Outset.ai provides an AI-powered interview platform for HR that helps businesses assess candidates more efficiently. Its core tool is an AI interviewer that conducts interviews, asks dynamic follow-up questions, and categorizes responses to reveal deeper insights about a candidate’s fit. The system works by running interviews, generating follow-up prompts as needed, and analyzing answers to produce structured data and scoring to guide hiring decisions. What sets Outset.ai apart is its focus on an automatically conducted, adaptive interview process and organized response analysis, enabling HR teams of all sizes to streamline recruitment and rely on data-driven results rather than manual screening alone. The company aims to reduce the time and resources spent on candidate evaluation while increasing the accuracy and speed of hiring decisions.

Company size
51-200
Company stage
Series B
Total funding
$52M
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Outset

See more jobs