S

Scale AI

Supplies AI training data and builds AI apps

Senior/Staff Machine Learning Research Engineer - General Agents, Enterprise GenAI

AI Application EngineeringConfirmed live in the last 24 hours
Full-time$290.4k - $363k

About the Job

Requirements

  • At least 5 years of experience building and deploying machine learning or artificial intelligence systems for real-world production use cases.
  • Strong engineering fundamentals supported by a Bachelor's and/or Master's degree in Computer Science, Machine Learning, or Artificial Intelligence, or equivalent practical experience.
  • Deep understanding of modern large language models, prompt-, context-, and system-level optimization, and agentic system design.
  • Proficiency in Python, including writing production-quality, testable, and maintainable code.
  • Experience building systems that integrate models with external tools, application programming interfaces, databases, and services.
  • Ability to work in ambiguous problem spaces while balancing research-driven approaches with pragmatic product constraints.
  • Strong communication skills and comfort working in customer-facing or cross-functional environments.

Responsibilities

  • Design and implement end-to-end agent systems that combine large language model reasoning, tool use, memory, and control logic to solve recurring enterprise use cases.
  • Build scalable, reliable agent architectures that can be deployed across many customers with varying data, tools, and constraints.
  • Develop evaluation frameworks, datasets, environments, and metrics to measure agent performance, reliability, and business impact in production settings.
  • Collaborate with product managers, customers, data annotators, and other engineering teams to translate enterprise requirements into robust agent designs.
  • Productionize frontier agent techniques, including planning, multi-step reasoning and tool use, and multi-agent patterns, into maintainable, observable systems.
  • Own deployment, monitoring, and iteration of agent systems, including failure analysis and continuous improvement based on real-world usage.
  • Contribute to technical direction and architectural decisions for general agent development best practices and methods, with increasing scope and leadership at the Staff level.

Desired Qualifications

  • Hands-on experience building artificial intelligence agents using modern generative artificial intelligence stacks, including OpenAI APIs and commercial or open-source large language models.
  • Experience with agent frameworks, orchestration layers, or workflow systems, including tool calling, planners, and multi-agent setups.
  • Familiarity with evaluation, monitoring, and observability for large-language-model-powered systems in production.
  • Experience deploying machine learning systems in cloud environments and operating them at scale.
  • Experience fine-tuning or adapting foundation models using supervised fine-tuning, reinforcement learning with verifiable rewards, and low-rank adaptation to improve agent performance on domain-specific tasks.
  • Interest in shaping the future of general-purpose enterprise agents and their real-world impact.

About the Company

Scale AI

Supplies AI training data and builds AI apps

Scale AI supplies the data that AI labs use to train and test their models, and it builds custom AI applications for companies and government agencies such as the Pentagon. It first made its name labeling camera and sensor data for self-driving car companies like Waymo, then worked with OpenAI on InstructGPT, the 2022 forerunner of ChatGPT. Freelancers, some of them doctors and lawyers, write, label, and grade examples through its Outlier platform, and labs pay Scale for this data and for tests of model quality. Clients pay Scale to build AI tools on their own data, and some of those tools run on classified military networks. Alexandr Wang and Lucy Guo founded Scale AI in 2016, and it is based in San Francisco.

Company size
1,001-5,000
Company stage
Acquired
Total funding
$1.6B
Headquarters
San Francisco, CA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Scale AI

See more jobs