Machine Learning Infrastructure Engineer
Raydar
Machine Learning Infrastructure Engineer
Raydar
AI-powered recruiting agency for tech roles
Raydar · San Francisco, United States · Full-time · Posted 2026-10-12
Salary: USD 200,000–300,000
Workplace: on_site
About the company
Our client is a fast-growing software company.
The role
Raydar is recruiting for this role on behalf of our client. Own and scale the systems that train and run machine learning models in production, partnering with researchers so new models ship quickly and dependably. This is an individual contributor role for a versatile engineer who understands how models behave under load and can improve speed, stability and spend.
What you'll do
- Run and enhance the production systems that deliver model predictions, with a focus on latency, observability and uptime.
- Set up and refine training environments for models across a broad range of sizes.
- Develop logging, metrics and alerting across the machine learning stack.
- Create internal data pipelines and tools that shorten the path from research experiment to production release.
- Design infrastructure that distributes workloads across several cloud vendors, balancing quality, response time and cost.
What we're looking for
- 3+ years of experience in machine learning infrastructure.
- Proven track record operating production model deployment systems in a demanding, high-performing engineering team.
- Strong Python skills and systems engineering experience with Kubernetes.
- Deep expertise in diagnosing GPU performance limits, tuning model deployment and monitoring.
- Comfort working in a fast-paced startup environment.
Bonus points
- Hands-on experience with training and deployment on a small number of machines.
- Prior work at a startup that develops its own models.
- Technical degree from a leading program.
- Research publications at top machine learning venues.
- Open source contributions in machine learning tooling.
- Strong results in math or computer science competitions.
Compensation and benefits
- Base salary: USD 200,000 to 300,000 per year
- Equity
- Health, dental and vision coverage
- Parental leave
- Flexible time off
Location and work model
- San Francisco, California, United States
- On-site, 5 days per week in office
- Full-time
Powered by Workable
Raydar is an AI-powered talent acquisition firm that serves tech-focused organizations on a contingency basis, charging client companies only after a successful hire. It uses proprietary AI to identify a large pool of candidates and conducts a short 15-minute AI-driven interview (recorded and transcribed) before human recruiters review materials, provide interview prep, and assist with offers and negotiations. What sets it apart is the blend of automated sourcing and screening with hands-on human oversight and tailored client support. Its goal is to help organizations hire more efficiently by speeding up sourcing while maintaining thorough evaluation and negotiation assistance.
Explore more opportunities at Raydar