A

Abundant

On-demand human operators ensure AI reliability

Member of Technical Staff - Alignment

AI ResearchConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA$250k - $450kIn-person

About the Job

Requirements

  • Build test pipelines and learn unfamiliar codebases quickly.
  • Have in-depth knowledge of large language model safety, including attacks, red teaming, monitoring and control evaluations, and reward hacking.
  • Turn ambiguous model-safety concerns into experiments, conduct them, and interpret the results accurately.
  • Read transcripts closely and identify details that may invalidate results.
  • Have applied research in production systems, especially post-training, distillation, or evaluation on which a system depends.
  • Write clearly enough that research results influence others' actions.
  • Make decisions quickly with incomplete evidence and support decisions with data.

Responsibilities

  • Run experiments on how environments shape model behavior, including reward hacking, cheating, unsafe tool use, and deception over long runs, and change how the environments are built.
  • Test graders for ways to achieve high scores without completing the task, address these weaknesses, and maintain attacks as routinely run tests.
  • Build tools to monitor agents, including trajectory monitors, red-team harnesses, and safety benchmarks that remain challenging as models improve; use them on real runs.
  • Secure environments through network isolation, escape prevention, credential security, and limiting potential harm from an agent.
  • Choose and answer a research question about oversight, control, or long-horizon autonomy, and publish the findings.
  • Determine what the organization will not build and clearly explain to partners what is and is not safe to use.

Desired Qualifications

  • Published work on control, dangerous capability evaluations, oversight, or interpretability.
  • Experience with reinforcement learning from human feedback or reinforcement learning from AI feedback, and a perspective on how training choices affect behavior.
  • Experience building or running a public benchmark or agent task suite.
  • Experience running many agents concurrently, including sandboxes, containers, and logging.
  • Experience advising on AI safety or governance policy.

About the Company

Abundant

On-demand human operators ensure AI reliability

Abundant provides a human-in-the-loop platform that makes AI agents reliable in production, especially for healthcare, legal, and financial services. Its system runs AI tasks and, when an edge case arises, calls a Human Intelligence API where expert operators complete the task and hand control back; all interactions are logged to create labeled training data and improve models, with an analytics dashboard for monitoring. The key difference is a dedicated human-override layer and a focus on real-world reliability in regulated industries, backed by founders with extensive experience in planning systems, content classification, and cloud infrastructure. The goal is to increase AI accuracy and task success in production by combining automated agents with precise human supervision and data-driven model improvement.

Company size
11-50
Company stage
Seed
Total funding
$130K
Headquarters
San Francisco, CA
Founded
2024

Recently Posted Jobs

Explore more opportunities at Abundant

See more jobs