A

Apollo Research

Audits AI models for deceptive alignment

AI Security & Control Researcher

Offensive Security & TestingConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • At least 5 years in hands-on technical security roles, not purely governance, risk, and compliance, with the ability to think structurally about threat modeling and failure modes, read code, understand infrastructure, and evaluate technical controls.
  • Direct experience with security research, threat modeling, or offensive security.
  • Ability to work in a small, fast-moving team and own ambiguous, open-ended research questions.
  • Strong written communication to produce clear and precise threat models, security levels, and failure-mode documentation.

Responsibilities

  • Develop threat models for coding agents that may be misaligned or compromised, covering near-term risks such as leaking private internal data and long-term risks such as sabotaging safety research.
  • Treat coding agents as insider risks, accounting for their credentials, code and network access, and ability to execute arbitrary actions.
  • Map kill chains and attack progressions using frameworks such as MITRE ATT&CK, adapted for agentic AI.
  • Build and maintain coding-agent security levels that define Watcher's robustness against categories of failure modes; make the levels concrete, testable, useful for internal product prioritization, and communicable to customers.
  • Maintain a comprehensive, accurate, and current library of coding-agent failure modes.
  • Stay current with academic and industry literature on coding-agent security, AI security, and adjacent fields including prompt injection, deception, accidental security implications, and supply-chain attacks on AI systems.
  • Design realistic attack trajectories and example exploits for monitor development and backtesting, and work with the research team to ensure monitors are trained and evaluated against credible adversarial behavior.
  • Adjudicate flagged agent trajectories by determining whether ambiguous behavior is a genuine attack, a benign but unusual workflow, or warrants deeper investigation, and feed judgments into monitor improvement.
  • Red-team and improve Watcher's monitors and policies, document findings, and feed findings into product improvement.
  • Work with technical research staff to build adversarial test suites into the backtesting pipeline.
  • Develop a comprehensive coding-agent threat model, compare it with conventional human-insider threats, and publish a detailed research piece building on existing research.
  • Review the internal database of 50+ coding-agent failure modes, suggest improvements, and ultimately maintain the database and integrate new failures.
  • Prioritize the failure modes Watcher should cover, ensuring each product component covers the most important failure modes efficiently.

Desired Qualifications

  • Experience with AI/ML systems security, large language model security, or AI control research.
  • Detection engineering, security operations center, or incident analysis experience.
  • Familiarity with insider-threat programs or insider-risk frameworks.
  • Red-teaming or offensive-security background.
  • Formal AI safety research background.

About the Company

Apollo Research

Audits AI models for deceptive alignment

Apollo Research is an AI safety organization that audits high-risk failure modes in large AI models, with a focus on deceptive alignment where models pretend to be aligned while pursuing their own objectives. It conducts fundamental research in interpretability and behavioral model evaluations, then applies these insights to audit real-world models. By combining examination of model internals with behavioral assessments, Apollo Research aims to provide stronger safety assurances than relying on behavioral evaluations alone. Its goal is to minimize catastrophic risks associated with advanced AI systems and ensure more reliable, safe behavior in deployed models.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
London, United Kingdom
Founded
2023

Recently Posted Jobs

Explore more opportunities at Apollo Research

See more jobs