R

Rivian

Makes electric pickups, SUVs and delivery vans

AI Agent Performance Lead

AI Application EngineeringUpdated on Nov 12
Full-timeIn-person

About the Job

Requirements

  • At least 7 years of technical sales/revenue operations experience, software engineering experience, or AI operations experience, with proficiency in TypeScript or JavaScript (Node.js).
  • Hands-on experience evaluating large language models and understanding how models reason and fail.
  • Ability to read REST API specifications and work with JSON Schemas provided by technical teams.
  • Ability to translate business goals such as lead qualification, response-time reduction, and conversion into deterministic agent code.
  • Deep understanding of sales funnels, customer journeys, frontline workflows, and operational levers that influence conversion and customer satisfaction.
  • Experience presenting and distilling complex concepts for a C-suite audience.
  • Experience explaining technical concepts such as prompting, tool calling, and model behavior to non-technical stakeholders, and explaining business concepts to technical stakeholders.
  • Conversational writing skills to craft concise, natural, persuasive dialogue aligned with brand tone and voice.
  • Demonstrated ability to define product strategy and translate ambiguous business problems into prioritized roadmaps and executable requirements.

Responsibilities

  • Define conversation logic, decision policies, and behavioral guardrails, including safety, privacy, and brand tone, for AI agents across customer scenarios and journeys.
  • Map customer journeys through the agent by defining decision points, routing logic, qualification criteria, and handoff conditions to optimize lead quality, conversion, and customer experience.
  • Define agent performance metrics, including conversation completion rates, lead quality scores, customer satisfaction, routing accuracy, time-to-resolution, and sales-pipeline impact.
  • Partner with Analytics and Commercial Technology to build dashboards showing agent performance in daily operations, weekly performance trends, and monthly business-impact analysis.
  • Ensure data pipelines capture the signals needed to measure agent effectiveness.
  • Present channel performance, risk, and roadmap updates in recurring reviews, translating model behavior, evaluation results, and experimentation outcomes into decision-ready narratives for executives.
  • Diagnose model behavior, tool-use failures, instruction conflicts, and workflow breakdowns using transcripts and evaluation data.
  • Run A/B tests on agent behavior changes and measure impacts on conversation quality, customer satisfaction, lead-routing accuracy, and sales outcomes.
  • Regularly sample and review agent conversations to identify patterns, assess quality, understand failure modes, and surface improvement opportunities.
  • Translate agent limitations into product requirements and prioritize them based on business impact.
  • Serve as the primary escalation point for agent-related issues and coordinate cross-functional triage and root-cause analysis.
  • Communicate with sales, customer-support field teams, and cross-functional stakeholders to identify high-impact improvements.
  • Drive progress in ambiguous, cross-functional environments and remove execution barriers through clear decisions, ownership, and communication.

Desired Qualifications

  • Experience with agent frameworks such as LangChain or CrewAI, or with building multi-step reasoning systems.
  • Background in product operations, sales engineering, or customer success, with experience understanding both technical details and commercial impact.
  • Familiarity with sales technology tools such as Salesforce, HubSpot, Gong, Outreach, or Chili Piper.
  • Experience with state-machine design or conversational user-experience frameworks.
  • Basic working knowledge of Python for data processing or evaluation scripting.
  • Exposure to automotive, retail, or direct-to-consumer sales environments.

About the Company

Rivian

Makes electric pickups, SUVs and delivery vans

Rivian designs and builds electric pickup trucks, SUVs, and delivery vans, pairing off-road ability with electronics and software it develops itself. In 2021, its R1T became the first fully electric pickup truck on the US consumer market, ahead of larger rivals such as Ford and Tesla. It makes the R1T pickup, the R1S and R2 SUVs, and commercial vans in Normal, Illinois, and sells them directly online and in its own stores rather than through dealers. Its vehicles run on Rivian's own software, which gains features through updates sent over the internet, and most revenue comes from vehicle sales, with service and optional software adding more. Rivian was founded in 2009 and is based in Irvine, California.

Company size
10,001+
Company stage
IPO
Headquarters
Irvine, CA
Founded
2009

Recently Posted Jobs

Explore more opportunities at Rivian

See more jobs