F

FAR AI

Non-profit AI safety research institute

Jailbreaking Lead - Red Team

Offensive Security & TestingConfirmed live in the last 24 hours
Full-timeRemote in USA$225k - $350k /yr

About the Job

Requirements

  • A track record of finding non-obvious, high-severity vulnerabilities in frontier AI systems, including universal or near-universal jailbreaks in heavily defended risk domains.
  • Technical judgment about vulnerability significance and how defenses are constructed across frontier models, with the communication skills to prompt action by frontier labs and governments.
  • Deep hands-on jailbreaking experience with success against modern frontier models with layered defenses, including chaining multiple attack techniques through defense-in-depth stacks.
  • Experience with black-box optimization methods, multimodal attacks, and/or agentic red-teaming.
  • Deep understanding of large language model architectures, training processes, and failure modes, including their influence on model behavior under adversarial conditions.
  • A strong track record in AI, adversarial machine learning, security, or another highly technical subject, such as computer science, cybersecurity, mathematics, or physics.
  • Ability to thrive in rapidly evolving environments where techniques become obsolete quickly and new approaches must be developed.
  • Demonstrated drive for mission and impact, ambition to create real impact on frontier AI systems, and persistence in achieving ambitious goals.

Responsibilities

  • Personally develop universal and near-universal jailbreaks against frontier closed- and open-weight models in CBRNE, cyber, agentic security, extreme persuasion, and emerging risk domains.
  • Dismantle defense-in-depth stacks, including input filters, model-level refusal and safe completion, reasoning monitors, output filters, and account-level moderation, by chaining novel and established techniques.
  • Escalate initial vulnerabilities to expose their most severe form, maximizing universality, success rate, and capability of elicited output.
  • Set the technical bar for vulnerability severity and generality on every major engagement.
  • Invent new attack classes when existing techniques fail, monitor and incorporate state-of-the-art methods from the literature, and build a proprietary portfolio of techniques.
  • Shape the jailbreaking research agenda in partnership with the team lead and stress-test new affordances such as agents, tool use, long context, multimodal capabilities, and reasoning.
  • Set standards for rigor, creativity, and precision in jailbreaking; mentor individual contributors through pairing sessions, post-engagement retrospectives, and internal write-ups; and review major red-teaming deliverables for technical quality, severity judgment, and clarity.
  • On the management track, hire, manage, and grow a jailbreaking team while maintaining hands-on technical capability.
  • Work directly with frontier labs and government agencies to translate findings into mitigations.
  • Contribute to public reports, benchmarks, and the FAR.AI safety leaderboard.
  • Make calibrated technical judgments about vulnerability universality and reliability and what a capable threat actor could do with a finding.

Desired Qualifications

  • Prior collaboration with AI labs, security teams, or government safety institutes.
  • A track record in top capture-the-flag teams, offensive security research, or adversarial machine learning research.
  • Published work in AI safety, security, or robustness.
  • Ability to communicate technical findings and recommended mitigations to technical and non-technical audiences, including frontier lab safety teams and senior policymakers.
  • Prior experience mentoring technical individual contributors or leading a small technical team; required only for the management track.

About the Company

FAR AI

Non-profit AI safety research institute

FAR AI is a non-profit research institute focused on making advanced AI safe and beneficial for society. It conducts in-house work on model evaluation, interpretability, and robustness, and it funds collaborations to pursue safety research ideas. A core activity is red-teaming frontier AI systems to uncover vulnerabilities and inform safety standards for developers and governments. The organization runs FAR.Labs in Berkeley and hosts global dialogues to foster collaboration, supported by philanthropic funding with for-profit revenue kept to 10% to preserve independence.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Berkeley, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at FAR AI

See more jobs