G

Google

Runs Search and YouTube and builds Gemini AI

Software Engineering Manager - Business AI Agent

Engineering LeadershipConfirmed live in the last 24 hours
Full-timeMountain View, CA, USAIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
  • At least 8 years of experience coding in one or more general-purpose programming languages, such as Python, Java, C++, or Go, focused on backend system architecture.
  • Experience building automated LLM evaluation pipelines, automated rating systems (AutoRaters), or defining LLM-specific reliability metrics, such as measuring grounding, helpfulness, safety, and hallucination or error reduction.
  • Experience with backend, distributed systems, or AI/ML systems infrastructure.
  • Experience managing software engineers, including performance management, mentoring, and team growth.

Responsibilities

  • Manage and mentor a Software Engineering team, owning the roadmap and architecture for applied AI, low-latency scoring, and automated evaluation.
  • Lead Knowledge Library and merchant control engineering, building advanced retrieval-augmented generation integrations, including PDF ingestion and auto-learning, for custom agent behavior.
  • Oversee autonomous execution tooling and Universal Commerce Protocol integration to enable active user journeys, including catalog lookups, universal carts, and reservations.
  • Advocate prompt tuning and loss diagnosis while scaling LLM-based AutoRater frameworks to reduce hallucinations and measure conversation factuality.
  • Partner with Product, Data Science, UX, and core Google platform teams to define Ground Truth datasets, investigative dashboards, and model upgrade standards.
  • Manage engineers across multiple teams and locations, a large product budget, and oversee deployment of large-scale projects across multiple sites internationally.
  • Optimize multi-turn AI reasoning loops and tool-calling pipelines for real-time responsiveness.
  • Develop robust data pipelines for the Merchant Knowledge Library to power accurate retrieval-augmented generation.
  • Build automated evaluation frameworks and AutoRaters to continuously measure conversation quality and factuality at scale.

Desired Qualifications

  • A master's degree or PhD in Computer Science or a related technical field.
  • At least 3 years of experience working in a complex, matrixed organization.
  • Experience developing, calibrating, and productionizing LLM-based AutoRater frameworks or automated regression testing.
  • Experience designing agentic tooling and integrating agents with commerce platforms.
  • Experience in conversational AI architectures, agent orchestration harnesses, and retrieval-augmented generation for knowledge libraries.
  • A track record of technical leadership partnering with Product Management, Data Science, and UX to build Ground Truth datasets and performance-tracking dashboards.

About the Company

Google

Runs Search and YouTube and builds Gemini AI

Google runs the world's most used search engine and free services such as YouTube, Android, and Gmail, and it builds the Gemini AI models that work inside them. In 2017, its researchers invented the transformer, the neural network design behind ChatGPT and most other AI chatbots. People use these services without paying, and Google earns most of its money from ads placed beside search results and YouTube videos. Businesses rent computing power and Gemini models through Google Cloud, and Google also sells subscriptions and Pixel phones. Larry Page and Sergey Brin founded Google in 1998 as Stanford PhD students; it is based in Mountain View, California, United States, and is the main business of parent company Alphabet.

Company size
10,001+
Company stage
IPO
Headquarters
Mountain View, CA
Founded
1998

Recently Posted Jobs

Explore more opportunities at Google

See more jobs