A

Apollo Research

Audits AI models for deceptive alignment

Research Scientist/Engineer - Fundamental Research

AI ResearchConfirmed live in the last 24 hours
Full-time$245k - $590k

About the Job

Requirements

  • Ability to design and execute empirical experiments and accelerate iteration cycles toward research milestones.
  • Ability to use multiple AI models effectively, select appropriate models for tasks, recognize when not to use AI, and experiment with AI workflows.
  • Familiarity with prior research on AI scheming and ability to develop original ideas, clarify underspecified concepts, design experiments, and produce scientific writing, figures, blog posts, microsites, and social media threads.
  • Strong interest in AI progress, with ongoing awareness of model releases and experimentation with AI workflows to understand AI cognition.
  • Hands-on experience training large language models using reinforcement learning, including resolving GPU failures and learning-instability issues.
  • Rigorous quantitative skills in areas such as scaling laws in large language models, statistical physics, dynamical systems, or applied statistics, with the ability to model empirical phenomena mathematically and extract signal from noisy data.
  • Commitment to the mission of reducing catastrophic loss-of-control risk from misaligned artificial general intelligence.

Responsibilities

  • Collaborate with leading AI developers and multiple research labs, applying research work to how capable AI systems are built and deployed.
  • Study the reinforcement-learning dynamics that lead to reward-seeking, evaluation awareness, or misaligned preferences; design and train model organisms; and scale insights to frontier systems.
  • Build empirical foundations for scaling laws of scheming and predict how scheming risks evolve as model capabilities scale.
  • Develop novel evaluation techniques that can scale to highly evaluation-aware models.
  • Study AI cognition and discover patterns in the reasoning processes of frontier AI systems.

Desired Qualifications

  • Strong software engineering skills; the team's stack uses Python.
  • Project management experience, including managing strong individual contributors and keeping research projects on schedule despite delays or unexpected experimental results.

About the Company

Apollo Research

Audits AI models for deceptive alignment

Apollo Research is an AI safety organization that audits high-risk failure modes in large AI models, with a focus on deceptive alignment where models pretend to be aligned while pursuing their own objectives. It conducts fundamental research in interpretability and behavioral model evaluations, then applies these insights to audit real-world models. By combining examination of model internals with behavioral assessments, Apollo Research aims to provide stronger safety assurances than relying on behavioral evaluations alone. Its goal is to minimize catastrophic risks associated with advanced AI systems and ensure more reliable, safe behavior in deployed models.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
London, United Kingdom
Founded
2023

Recently Posted Jobs

Explore more opportunities at Apollo Research

See more jobs