A

Anysphere

Hybrid human-AI coding productivity tool

Senior Model Engineer - RL Data

AI ResearchPosted on Nov 10
Full-timePalo Alto, CA, USA$220k - $357k /yr

About the Job

Requirements

  • At least 3 years of hands-on experience training or post-training large neural networks with 1 billion or more parameters, including pre-training, fine-tuning, or reinforcement learning-based methods such as RLHF or DPO.
  • Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++.
  • A Master’s or PhD in Computer Science, machine learning, mathematics, physics, or a related field, or equivalent research experience.

Responsibilities

  • Design and run rigorous experiments that turn research ideas into measurable gains in model capability.
  • Improve data recipes through data quality, deduplication, and mixture experiments.
  • Define what makes reinforcement learning data and rewards good, including grader design and preventing reward hacking.
  • Advance training science through architecture and scaling experiments and post-training recipes for coding and computer-use agents.
  • Build evaluations and targeted tasks that expose model weaknesses and guide where the team invests next.
  • Partner with engineers to take promising results from small experiments to frontier-scale training runs.

Desired Qualifications

  • Handle ambiguous research tasks with little guidance and own a research direction end to end.
  • Care deeply about data quality and be able to investigate the data when appropriate.
  • Take a truth-seeking approach, aiming to learn about the science rather than prove ideas correct.
  • Have experience with reinforcement learning algorithms for language models, scaling laws, or building reinforcement learning environments and evaluations.
  • Have experience with distributed training at scale and debugging problems that only appear at scale.
  • Have experience training frontier-scale models.
  • Have a strong background in reinforcement learning and machine learning fundamentals.
  • Be an excellent programmer and software engineer, comfortable working across the research stack in Python and PyTorch or JAX.
  • Have hands-on experience training large models through pre-training, post-training, or reinforcement learning.
  • Have a track record of original work in machine learning, such as new methods or measurable improvements, demonstrated through research, open source, or production impact.

About the Company

Anysphere

Hybrid human-AI coding productivity tool

Anysphere builds AI-powered software development tools to boost programmer productivity. Its main product, Cursor, is an AI-first code editor that helps engineers write, understand, and modify code with a hybrid human-AI approach, enabling rapid iterations and instant answers to code questions. The company differentiates itself through a highly skilled team and strong in-person collaboration in San Francisco, supporting fast research-to-product cycles. Its goal is to make Cursor the most helpful and delightful code editor, capable of generating large pull requests with ease and reducing bugs.

Company size
1,001-5,000
Company stage
Acquired
Total funding
$5.4B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Anysphere

See more jobs