Full-Time

Research Engineer

Evals

Updated on 9/3/2026

AGI, Inc.

AGI, Inc.

11-50 employees

Advanced AI for natural language understanding

No salary listed

H1B Sponsorship Available

San Francisco, CA, USA

In Person

Top-tier relocation and immigration support is available.

Category
AI & Machine Learning (1)
Required Skills
Data Visualization
Machine Learning
Quality Assurance (QA)

Get referred to AGI, Inc.

See people who can refer or advise you

Requirements
  • Build and maintain evaluation systems for model capability, agentic behavior, on-device performance, and end-user experience.
  • Measure non-deterministic systems, including agent evaluation, tool use, long-horizon tasks, and multilingual behavior.
  • Push back on metrics that are being gamed without disrupting the team.
  • Provide a link to an evaluation, benchmark, or measurement system built and explain what decision it changed.
  • Work in person in San Francisco.
Responsibilities
  • Own evaluation suites that gate every model and agent release, covering capability, behavior, regressions, and human-rated rubrics.
  • Own dashboards and tooling that accelerate researcher experiment loops and support leadership decisions.
  • Define the release bar and determine what is ready to ship.
  • Support research by ensuring that measurements reflect intended goals.
  • Assist product engineers by instrumenting real-user behavior on real devices.
  • Support partnerships by translating improvement measurements into standards an original equipment manufacturer partner can use.
  • Audit existing evaluations, identify noise and gaps, and fix evaluation deficiencies.
  • Stand up new agentic, on-device, or behavioral evaluation surfaces and use their output to inform decisions.
  • Catch regressions before release and shape the research roadmap through evaluation results.
  • Evaluate on-device performance trade-offs, real-user evaluation, and quality assurance for artificial intelligence at original equipment manufacturer scale.

AGI, Inc. develops and deploys highly capable artificial intelligence systems focused on natural language understanding. Its product is a software system that processes language using deep learning models to understand and answer questions, aiming to perform at human-level accuracy on standard NLU benchmarks such as SQuAD. Unlike many AI developers that target broad capabilities, AGI, Inc. centers on advancing NLU performance on established datasets, with the goal of solving core language understanding challenges. The company measures its progress by achieving human-level results on benchmark datasets and applying its technology to real-world language tasks.

Company Size

11-50

Company Stage

N/A

Total Funding

N/A

Headquarters

Austin, Texas

Founded

2021

Get referred to AGI, Inc.

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • August 2026 product pages say AGI-0 and AGI MCP are live for select partners.
  • LinkedIn reported 28,167 followers and active San Francisco hiring on September 1, 2026.
  • Snapdragon optimization gives AGI distribution through OEMs, not just a standalone app.

What critics are saying

  • Only 1-10 employees as of September 1, 2026 cannot support enterprise-scale execution.
  • Apple or Google can restrict accessibility automation, instantly breaking AGI’s screen-reading agent workflow.
  • The MultiOn rebrand and vanished browser-product documentation signal strategy churn and weak moat.

What makes AGI, Inc. unique

  • AGI-0 runs on-device, keeping actions private across apps without per-app integrations.
  • March 12, 2026 Snapdragon collaboration embeds AGI’s agent stack into device platforms.
  • August 6, 2026 AGI MCP turned Android phones into tool servers for any MCP client.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Relocation Assistance

Company Equity

Growth & Insights and Company News

Headcount

6 month growth

44%

1 year growth

44%

2 year growth

44%
Fortune
Dec 3rd, 2023
Sam Altman sheds light on feud with Elon Musk: 'The closer people are to being pointed in the same direction, the more contentious the disagreements are'

Google had just acquired DeepMind, a neural networking startup based in London, which made it the most likely company to develop artificial general intelligence, or AGI, a system that can match humans when faced with an unfamiliar task.