A

Anthropic

Builds Claude AI models with a focus on safety

Safeguards Enforcement Analyst - Integrity & Authenticity

Risk & ComplianceConfirmed live in the last 24 hours
Full-time$285k - $330k /yr

About the Job

Requirements

  • Experience in trust and safety, policy enforcement, threat intelligence, or a closely related field focused on influence operations, disinformation, coordinated inauthentic behavior, election integrity, or privacy and surveillance harms.
  • Experience establishing and scaling policy enforcement or content review workflows.
  • Proficiency in SQL and/or other data analysis tools to draw insights from large datasets.
  • Experience identifying emerging risks and threat actors, and communicating findings to stakeholders such as Product, Policy, Engineering, and Legal teams.
  • Experience working with generative AI products, including writing effective prompts for content review and enforcement.
  • Understanding of the challenges involved in implementing product policies at scale, including in content moderation.
  • A bachelor's degree or an equivalent combination of education, training, and/or experience; the field must be relevant to the role as demonstrated through coursework, training, or professional experience.
  • This role may require responding to escalations during weekends and holidays, particularly around major electoral events.

Responsibilities

  • Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
  • Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems.
  • Review flagged content to drive enforcement and policy improvements.
  • Enforce usage policies by detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and the targeting, tracking, or surveillance of individuals and groups.
  • Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios.
  • Stay current with emerging AI policy enforcement best practices, evolving threat actor tactics, and regulations concerning elections, privacy, and surveillance, and use this knowledge to inform decisions and workflows.

Desired Qualifications

  • Experience conducting cross-platform investigations into influence operations, coordinated inauthentic behavior, or disinformation campaigns.
  • Familiarity with open-source intelligence techniques and tools for threat actor tracking and network analysis.
  • Working knowledge of privacy law, surveillance technology, or data broker ecosystems related to targeting and tracking harms.
  • Experience with large language models and understanding how AI could be misused to generate synthetic personas, fabricate quotes, or automate persuasion at scale.
  • Familiarity with election security frameworks, campaign finance law, or electoral integrity standards in one or more jurisdictions.
  • Experience navigating evolving regulations relevant to this area, such as the Digital Services Act, EU AI Act, Federal Election Commission regulations, and General Data Protection Regulation.
  • Experience working with election bodies, civil society organizations, or government agencies on integrity or disinformation-related issues.
  • Proficiency in Python for data analysis and automation.
  • Experience with dark web monitoring or tracking threat actors across surface, deep, and dark web environments.

About the Company

Anthropic

Builds Claude AI models with a focus on safety

Anthropic builds the Claude family of AI models and sells them to businesses, software developers, and consumers, with research on making AI safe and understandable at the center of its work. In 2024 it introduced the Model Context Protocol, an open standard for connecting AI assistants to outside apps and data that OpenAI and Google adopted the next year. People use the Claude app to write and analyze files, programmers hand coding tasks to Claude Code, and companies build Claude into their own products through its API. Anthropic earns money from subscriptions, business plans, and usage-based API fees. Siblings Dario and Daniela Amodei founded Anthropic in 2021 with other former OpenAI employees, and it is based in San Francisco.

Company size
5,001-10,000
Company stage
Debt Financing
Total funding
$243.8B
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Anthropic

See more jobs