A

Anysphere

Hybrid human-AI coding productivity tool

Model Engineer - RL Data

AI ResearchPosted on Nov 10
Full-timePalo Alto, CA, USA

About the Job

Requirements

  • Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++.
  • Experience with reinforcement learning algorithms for language models, scaling laws, or building reinforcement learning environments and evaluations.
  • Experience with distributed training at scale and debugging problems that only appear at scale.
  • Experience training frontier-scale models.
  • A strong background in reinforcement learning and machine learning fundamentals.
  • Hands-on experience training large models through pretraining, post-training, or reinforcement learning.
  • A track record of original work in machine learning, such as new methods or measurable improvements demonstrated through research, open source, or production impact.

Responsibilities

  • Design and run rigorous experiments that turn research ideas into measurable gains in model capability.
  • Improve data recipes through data quality, deduplication, and mixture experiments.
  • Define what makes reinforcement learning data and rewards effective, including grader design and preventing reward hacking.
  • Advance training science through architecture and scaling experiments and post-training recipes for coding and computer-use agents.
  • Build evaluations and targeted tasks that expose model weaknesses and guide team investment.
  • Partner with engineers to take promising results from small experiments to frontier-scale training runs.

Desired Qualifications

  • Handle ambiguous research tasks with little guidance and own a research direction end-to-end.
  • Care deeply about data quality and investigate the data when appropriate.
  • Approach research with a truth-seeking focus on learning the science rather than proving one's ideas.
  • Be an excellent programmer and software engineer, comfortable working across the research stack in Python and PyTorch or JAX.
  • MS or PhD in Computer Science, machine learning, mathematics, physics, or a related field, or equivalent research experience.

About the Company

Anysphere

Hybrid human-AI coding productivity tool

Anysphere builds AI-powered software development tools to boost programmer productivity. Its main product, Cursor, is an AI-first code editor that helps engineers write, understand, and modify code with a hybrid human-AI approach, enabling rapid iterations and instant answers to code questions. The company differentiates itself through a highly skilled team and strong in-person collaboration in San Francisco, supporting fast research-to-product cycles. Its goal is to make Cursor the most helpful and delightful code editor, capable of generating large pull requests with ease and reducing bugs.

Company size
1,001-5,000
Company stage
Acquired
Total funding
$5.4B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Anysphere

See more jobs