A

Anthropic

Builds Claude AI models with a focus on safety

Software Engineer - Tokens and Prompt Structures

Backend EngineeringConfirmed live in the last 24 hours
Full-time$320k - $405k /yr

About the Job

Requirements

  • Have 5+ years of software engineering experience, including meaningful time maintaining libraries, software development kits, or developer-facing application programming interfaces.
  • Have familiarity with machine learning terminology and large language model architecture sufficient to work effectively with researchers and understand experiment results.
  • Have experience carrying out complex refactors in large codebases.
  • Have strong communication skills and enjoy working closely with researchers and engineers to understand their needs.
  • Be results-oriented, flexible, and focused on impact.
  • Be willing to take on work outside the job description when needed.
  • Care about the societal impacts of the work.
  • Minimum education is a bachelor's degree or an equivalent combination of education, training, and/or experience.
  • Have a field of study relevant to the role, demonstrated through coursework, training, or professional experience.

Responsibilities

  • Maintain and improve the encoding libraries used by engineers and researchers across the organization.
  • Run experiments to determine optimal ways to feed structured data into Claude without confusing it.
  • Design data structures and abstractions that shield most of the organization from encoding details while enabling power users.
  • Adapt the encoding libraries to support emerging research directions and ensure research ideas can be shipped to production.
  • Optimize encoding performance across systems that depend on the libraries.

Desired Qualifications

  • Have experience with tokenizers or other text and data encoding systems.
  • Have experience maintaining a widely used library over a long period of time.
  • Have experience with performance optimization.
  • Have experience with Python and/or Rust.
  • Have experience with reinforcement learning or model training infrastructure.

About the Company

Anthropic

Builds Claude AI models with a focus on safety

Anthropic builds the Claude family of AI models and sells them to businesses, software developers, and consumers, with research on making AI safe and understandable at the center of its work. In 2024 it introduced the Model Context Protocol, an open standard for connecting AI assistants to outside apps and data that OpenAI and Google adopted the next year. People use the Claude app to write and analyze files, programmers hand coding tasks to Claude Code, and companies build Claude into their own products through its API. Anthropic earns money from subscriptions, business plans, and usage-based API fees. Siblings Dario and Daniela Amodei founded Anthropic in 2021 with other former OpenAI employees, and it is based in San Francisco.

Company size
5,001-10,000
Company stage
N/A
Total funding
$243.8B
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Anthropic

See more jobs