Software Engineer
Raydar
Software Engineer
Raydar
AI-powered recruiting agency for tech roles
Raydar · San Francisco, United States · Full-time · Posted 2026-10-01
Salary: USD 260,000–290,000
Workplace: on_site
About the company
Our client is a technology company.
The role
Raydar is recruiting for this role on behalf of our client. Design datasets, evaluation methods and measurement frameworks that shape how machine learning models are trained and assessed. Collaborate with external research partners, run fast experiments and convert findings into concrete specifications for large-scale training work.
What you'll do
- Design targeted data samples that reveal weaknesses in model behavior across a range of subject areas.
- Build and refine scoring rubrics and reward signals used in model training pipelines.
- Study how human annotators behave and run experiments to improve model capabilities.
- Develop quantitative methods for assessing dataset quality, diversity and downstream impact.
- Own the data pipelines that supply both naturally occurring and artificially generated training material.
- Work with research partners to turn their training goals into clear data and evaluation specifications.
What we're looking for
- 1 to 4 years of experience in software or machine learning engineering.
- Strong Python skills and experience building dependable data pipelines, experimentation tooling or evaluation systems.
- Hands-on experience with language model evaluation, post-training, reward modeling or closely related ML infrastructure.
- Sound scientific judgment, including setting up well-controlled tests and drawing conclusions from imperfect results.
- Background in building or auditing training data and judging how well it supports model performance.
- Ability to learn unfamiliar domains quickly and reason across them.
Compensation and benefits
- Base salary: USD 260,000 to 290,000 per year
- Equity
- Profit sharing
Location and work model
- San Francisco, CA, United States
- On-site
- Full-time
Powered by Workable
Raydar is an AI-powered talent acquisition firm that serves tech-focused organizations on a contingency basis, charging client companies only after a successful hire. It uses proprietary AI to identify a large pool of candidates and conducts a short 15-minute AI-driven interview (recorded and transcribed) before human recruiters review materials, provide interview prep, and assist with offers and negotiations. What sets it apart is the blend of automated sourcing and screening with hands-on human oversight and tailored client support. Its goal is to help organizations hire more efficiently by speeding up sourcing while maintaining thorough evaluation and negotiation assistance.
Explore more opportunities at Raydar