Member of Technical Staff
Raydar
Member of Technical Staff
Raydar
AI-powered recruiting agency for tech roles
Raydar · San Francisco, United States · Full-time · Posted 2026-09-19
Salary: USD 180,000–280,000
Workplace: on_site
About the company
Our client is an applied AI research company developing training environments and datasets. Its technical teams build the systems that help AI models learn from complex tasks and data.
The role
Raydar is recruiting for this role on behalf of our client. Own quality across environments and datasets as a Member of Technical Staff, Head of Quality. This is a hands-on evaluation and data-review role with responsibility for automation and a growing quality team.
What you'll do
- Review human data and environment outputs in detail.
- Build automated evaluations, graders, and QA agents.
- Detect reward hacking, broken verifiers, and distribution mismatches.
- Define measurable quality metrics and acceptance criteria.
- Own delivery acceptance for customer projects.
- Hire, onboard, and manage quality engineers and reviewers.
What we're looking for
- 1 to 5 years of relevant LLM evaluation, QA engineering, or ML data-quality experience.
- Experience building automated quality systems for ML data, agents, or large-scale pipelines.
- Technical understanding of what makes training data and environments useful for learning.
- Hands-on work with LLM evaluations, annotation, or human-in-the-loop review.
- Ability to build graders, judge models, telemetry, and dashboards.
- Strong attention to detail and willingness to spend substantial time reviewing data manually.
Bonus points
- RL environment, verifier, or reward-design experience.
- Founder or zero-to-one product-building experience.
- A STEM degree.
Compensation and benefits
- Base salary: USD 180,000 to 280,000 per year.
- Equity: Competitive equity.
Location and work model
- San Francisco, California, United States.
- Fully onsite role; exact weekly office-day count is not specified.
- Visa transfers are supported.
Powered by Workable
Raydar is an AI-powered talent acquisition firm that serves tech-focused organizations on a contingency basis, charging client companies only after a successful hire. It uses proprietary AI to identify a large pool of candidates and conducts a short 15-minute AI-driven interview (recorded and transcribed) before human recruiters review materials, provide interview prep, and assist with offers and negotiations. What sets it apart is the blend of automated sourcing and screening with hands-on human oversight and tailored client support. Its goal is to help organizations hire more efficiently by speeding up sourcing while maintaining thorough evaluation and negotiation assistance.
Explore more opportunities at Raydar