A

Anthropic

Builds Claude AI models with a focus on safety

Machine Learning/Research Engineer - Safeguards

Applied Machine Learning +1Confirmed live in the last 24 hours
Full-time$350k - $500k /yr

About the Job

Requirements

  • Have 4+ years of experience in machine learning engineering, research engineering, or applied research in academia or industry.
  • Have proficiency in Python and experience building machine learning systems.
  • Be able to work across the research-to-deployment pipeline, from exploratory experiments to production systems.
  • Have strong communication skills and be able to explain complex technical concepts to non-technical stakeholders.

Responsibilities

  • Develop classifiers to detect misuse and anomalous behavior at scale, including synthetic data pipelines for training classifiers and methods to automatically source representative evaluations for iteration.
  • Build systems to monitor harms spanning multiple exchanges, such as coordinated cyber attacks and influence operations, and develop methods for aggregating and analyzing signals across contexts.
  • Evaluate and improve the safety of agentic products by developing threat models and environments to test agentic risks, and developing and deploying mitigations for prompt injection attacks.
  • Conduct research on automated red-teaming, adversarial robustness, and other methods to test for or find misuse.

Desired Qualifications

  • Experience with language modeling and transformers.
  • Experience building classifiers, anomaly detection systems, or behavioral machine learning.
  • Experience with adversarial machine learning or red-teaming.
  • Experience with interpretability or probes.
  • Experience with reinforcement learning.
  • Experience with high-performance, large-scale machine learning systems.

About the Company

Anthropic

Builds Claude AI models with a focus on safety

Anthropic builds the Claude family of AI models and sells them to businesses, software developers, and consumers, with research on making AI safe and understandable at the center of its work. In 2024 it introduced the Model Context Protocol, an open standard for connecting AI assistants to outside apps and data that OpenAI and Google adopted the next year. People use the Claude app to write and analyze files, programmers hand coding tasks to Claude Code, and companies build Claude into their own products through its API. Anthropic earns money from subscriptions, business plans, and usage-based API fees. Siblings Dario and Daniela Amodei founded Anthropic in 2021 with other former OpenAI employees, and it is based in San Francisco.

Company size
5,001-10,000
Company stage
N/A
Total funding
$243.8B
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Anthropic

See more jobs