A

Anthropic

Builds Claude AI models with a focus on safety

TPU Performance Engineer

Applied Machine LearningUpdated on Nov 7
Full-time$280k - $850k /yr

About the Job

Requirements

  • Significant experience optimizing machine learning systems for TPUs, GPUs, or other accelerators.
  • A track record of solving large-scale systems problems and low-level optimization.
  • Results-oriented approach, flexibility, and willingness to take on work beyond the job description.
  • Interest in machine learning research.
  • Interest in the societal impacts of the work.
  • Strong communication skills.

Responsibilities

  • Identify and address performance issues across research, training, and inference machine learning systems.
  • Design and optimize kernels for TPUs.
  • Provide researchers with feedback on how model changes affect performance.
  • Implement low-latency, high-throughput sampling for large language models.
  • Adapt existing models for low-precision inference.
  • Build quantitative models of system performance.
  • Design and implement custom collective communication algorithms.
  • Debug kernel performance at the assembly level.

Desired Qualifications

  • Experience with high-performance, large-scale machine learning systems.
  • Experience designing and implementing kernels for TPUs or other machine learning accelerators.
  • Deep understanding of accelerators, such as a background in computer architecture.
  • Experience with machine learning framework internals.
  • Experience with language modeling using transformers.

About the Company

Anthropic

Builds Claude AI models with a focus on safety

Anthropic builds the Claude family of AI models and sells them to businesses, software developers, and consumers, with research on making AI safe and understandable at the center of its work. In 2024 it introduced the Model Context Protocol, an open standard for connecting AI assistants to outside apps and data that OpenAI and Google adopted the next year. People use the Claude app to write and analyze files, programmers hand coding tasks to Claude Code, and companies build Claude into their own products through its API. Anthropic earns money from subscriptions, business plans, and usage-based API fees. Siblings Dario and Daniela Amodei founded Anthropic in 2021 with other former OpenAI employees, and it is based in San Francisco.

Company size
5,001-10,000
Company stage
N/A
Total funding
$243.8B
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Anthropic

See more jobs