R

Raydar

AI-powered recruiting agency for tech roles

Forward Deployed Machine Learning Engineer

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeRemote in USA

About the Job

Requirements

  • At least 4 years of engineering experience, including hands-on machine learning model evaluation work.
  • Experience deploying end-to-end machine learning evaluation or benchmark systems to production against demanding customer timelines.
  • Strong proficiency with machine learning evaluation frameworks and benchmark design, including approaches such as large language model-as-judge.
  • Experience owning backend and infrastructure systems such as large-scale data pipelines, execution environments, storage, and orchestration.
  • Customer-facing engineering experience managing enterprise stakeholders.
  • A degree in computer science, physics, or a related technical field.
  • Current unrestricted U.S. work authorization without visa sponsorship.

Responsibilities

  • Define, design, and build production benchmarks and evaluations with customers and internal researchers.
  • Build and own backend infrastructure, including data pipelines, execution environments, storage, and orchestration.
  • Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.
  • Own the engineering portion of customer engagements from technical scoping through production delivery.
  • Identify repeatable evaluation patterns and infrastructure gaps that can become scalable products.
  • Move quickly through ambiguity while maintaining strong technical judgment and clear written communication.

Desired Qualifications

  • Experience building evaluations or human-data pipelines for large language models.
  • Experience working directly with AI researchers or foundation-model labs.
  • Published work or meaningful open-source contributions in machine learning evaluations or benchmarks.
  • Early-stage business-to-business startup, forward-deployed engineering, or high-ownership generalist experience.

About the Company

Raydar

AI-powered recruiting agency for tech roles

Raydar is an AI-powered talent acquisition firm that serves tech-focused organizations on a contingency basis, charging client companies only after a successful hire. It uses proprietary AI to identify a large pool of candidates and conducts a short 15-minute AI-driven interview (recorded and transcribed) before human recruiters review materials, provide interview prep, and assist with offers and negotiations. What sets it apart is the blend of automated sourcing and screening with hands-on human oversight and tailored client support. Its goal is to help organizations hire more efficiently by speeding up sourcing while maintaining thorough evaluation and negotiation assistance.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Santa Monica, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Raydar

See more jobs