H

Handshake

Connects talent with jobs and AI training work

Member of Technical Staff - Post-Training

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • At least 3 years of demonstrated strength in post-training, fine-tuning, or model-evaluation work, with relevant experience potentially including reinforcement learning, supervised fine-tuning, LoRA/PEFT, full fine-tuning, RLHF, DPO, PPO, reward modeling, or training environments.
  • Strong Python skills and the ability to write clean, efficient, scalable software.
  • Hands-on experience with modern machine-learning tooling, particularly PyTorch and large-scale data, training, or evaluation workflows.
  • Sound experimental judgment, including forming hypotheses, choosing meaningful metrics, diagnosing failures, and distinguishing signal from noise.
  • Experience designing systems, including making tradeoffs around quality, scale, reliability, and reuse.
  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
  • Ability to work effectively with researchers, engineers, domain experts, and customers.
  • Experience building or operating large-scale machine-learning training, inference, data, or evaluation systems is especially compelling.
  • Experience developing large-language-model or agent benchmarks, evaluation methodologies, annotation systems, or data-quality frameworks is especially compelling.
  • Research or applied work on reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems is especially compelling.
  • Published research, meaningful open-source contributions, or evidence of technical leadership in machine-learning systems or AI research is especially compelling.
  • Experience productizing research or repeated customer work into robust, reusable platforms is especially compelling.

Responsibilities

  • Design post-training systems and methodologies for frontier models, including supervised fine-tuning, reinforcement learning, preference optimization, reward modeling, and related approaches.
  • Translate open-ended research or partner needs into hypotheses, experiments, evaluation plans, and production-quality implementations.
  • Build and improve evaluation frameworks, benchmarks, training environments, data-processing pipelines, and quality-control systems.
  • Prototype, evaluate, interpret results, and use findings to develop the next system or product.
  • Partner with AI researchers and domain experts to develop high-signal data, feedback, and evaluation methods.
  • Identify repeatable patterns across engagements and productize them into reusable software and platforms.
  • Raise the technical bar through design judgment, clear communication, code quality, and mentorship.
  • Contribute to the field through benchmarks, open-source tools, research, and technical writing where it creates leverage.

About the Company

Handshake

Connects talent with jobs and AI training work

Handshake connects job seekers, employers, and university career centers through recruiting software, and supplies AI labs with experts who train and test language models. Its career platform combines job matching, recruiting events, and profiles that show completed AI projects and paid training experience. Handshake AI recruits and matches fellows to projects where they review model answers, create training data, and apply knowledge from their own fields. Employers pay for recruiting subscriptions and promotions, while its enterprise AI team builds agents and trains models inside customers' systems. Handshake was founded in 2014 and is headquartered in San Francisco.

Company size
501-1,000
Company stage
Series F
Total funding
$434M
Headquarters
San Francisco, CA
Founded
2014

Recently Posted Jobs

Explore more opportunities at Handshake

See more jobs