A

Anthropic

Builds Claude AI models with a focus on safety

Policy Program Manager - Safeguards Regulatory

Regulatory Compliance & EthicsUpdated on Nov 7
Full-time

About the Job

Requirements

  • Experience in trust and safety, AI safety, or a related field, including designing and implementing safeguards against misuse or harm.
  • Understanding of AI safety, including principal risk areas and the evaluations and safeguards used to address them, sufficient to engage substantively with technical experts.
  • Experience running risk assessment or harm mitigation programs from identification through resolution.
  • Experience translating policy or regulatory requirements into practical operational processes.
  • Ability to drive complex, cross-functional programs to completion in a fast-moving environment, including with technical teams outside one's discipline.
  • Clear written communication, including documentation for technical, legal, and external audiences.
  • Strong attention to detail and judgment to recognize when work is at risk and raise it early.
  • Commitment to the safe development and deployment of AI.
  • Bachelor's degree or an equivalent combination of education, training, and/or experience.
  • Field of study relevant to the role, as demonstrated through coursework, training, or professional experience.

Responsibilities

  • Manage and drive complex safety initiatives that identify, assess, and mitigate risks from frontier models, from initial risk assessment through deployment of safeguards.
  • Partner with the Safeguards incident management team to strengthen incident response and reporting processes, including policies for incident escalation and external reporting.
  • Conduct post-incident reviews and work with subject matter experts for each harm area to incorporate findings into model and product safeguards.
  • Own the safety strategy and deliverables for AI systems used in high-risk settings, including risk assessments, technical documentation, and information that deploying customers need to use those systems safely.
  • Define required safety and risk controls for models and products, ensure each control has an owner and documented procedure, and confirm that it operates as intended.
  • Partner with owners of each risk area to develop an understanding of AI risks, safety evaluations, and mitigation strategies, and prepare safety documentation, transparency reports, and regulatory submissions.

Desired Qualifications

  • Experience with AI-specific regulation, such as the EU AI Act.
  • Experience leading incident response programs, including escalation paths and external reporting obligations.
  • Experience preparing safety documentation, transparency reports, or regulatory submissions.
  • Experience working with technical and research teams on safety evaluations.

About the Company

Anthropic

Builds Claude AI models with a focus on safety

Anthropic builds the Claude family of AI models and sells them to businesses, software developers, and consumers, with research on making AI safe and understandable at the center of its work. In 2024 it introduced the Model Context Protocol, an open standard for connecting AI assistants to outside apps and data that OpenAI and Google adopted the next year. People use the Claude app to write and analyze files, programmers hand coding tasks to Claude Code, and companies build Claude into their own products through its API. Anthropic earns money from subscriptions, business plans, and usage-based API fees. Siblings Dario and Daniela Amodei founded Anthropic in 2021 with other former OpenAI employees, and it is based in San Francisco.

Company size
5,001-10,000
Company stage
N/A
Total funding
$243.8B
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Anthropic

See more jobs