H

Handshake

Connects talent with jobs and AI training work

Member of Technical Staff - AI Engineering

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • 2–10 years of recent, demonstrated experience in one or more of synthetic or LLM-generated data, post-training and model-evaluation work, privacy engineering, or data anonymization/de-identification at scale.
  • A hands-on individual-contributor track record; this is not a team-lead or engineering-management role.
  • Strong Python skills and the ability to write clean, efficient, scalable software for large, messy, real-world datasets.
  • Sound judgment for reasoning about data quality, risk, and utility, including forming hypotheses, choosing meaningful metrics, diagnosing failures, and distinguishing signal from noise.
  • Experience designing systems, including tradeoffs around quality, scale, reliability, and reuse, rather than only implementing specifications.
  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
  • Collaborative, low-ego communication and the ability to work effectively with researchers, engineers, domain experts, and customers.

Responsibilities

  • Design and build systems that improve the quality, scale, and safety of data generated and acquired for frontier model training, spanning synthetic data generation and data anonymization/PII removal.
  • Translate ambiguous research, partner, or compliance needs into clear hypotheses, experiments, evaluation plans, and production-quality implementations.
  • Build and improve data-processing pipelines, evaluation frameworks, benchmarks, and quality-control systems to generate higher-signal synthetic data or verify sensitive data has been properly de-identified.
  • Run fast, rigorous iteration loops: prototype, evaluate, interpret results, and turn learnings into the next system or product.
  • Partner directly with researchers, domain experts, and, where relevant, legal and compliance teams to ensure data is both high-utility and responsibly handled.
  • Identify repeatable patterns across engagements and productize them into reusable software and platforms.
  • Raise the technical bar through strong design judgment, clear communication, code quality, and mentorship.

Desired Qualifications

  • Experience building or operating large-scale synthetic or LLM-generated data pipelines for model training.
  • Experience building or operating large-scale data de-identification or anonymization systems, ideally involving relational or graph-structured data, and preserving referential/relationship integrity after anonymization.
  • Experience developing LLM/agent benchmarks, evaluation methodologies, annotation systems, or data-quality frameworks.
  • Research or applied work on reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems.
  • Prior work in a regulated or high-sensitivity data environment such as healthcare, finance, HR/people data, or government, or experience with re-identification risk assessment and privacy auditing.
  • Published research, meaningful open-source contributions, or evidence of technical leadership in ML systems, data engineering, or AI research.
  • Experience productizing research or repeated customer work into robust, reusable platforms.

About the Company

Handshake

Connects talent with jobs and AI training work

Handshake connects job seekers, employers, and university career centers through recruiting software, and supplies AI labs with experts who train and test language models. Its career platform combines job matching, recruiting events, and profiles that show completed AI projects and paid training experience. Handshake AI recruits and matches fellows to projects where they review model answers, create training data, and apply knowledge from their own fields. Employers pay for recruiting subscriptions and promotions, while its enterprise AI team builds agents and trains models inside customers' systems. Handshake was founded in 2014 and is headquartered in San Francisco.

Company size
501-1,000
Company stage
Series F
Total funding
$434M
Headquarters
San Francisco, CA
Founded
2014

Recently Posted Jobs

Explore more opportunities at Handshake

See more jobs