G

Google

Runs Search and YouTube and builds Gemini AI

Program Manager 3 - Software Engineering

Program ManagementPosted on Nov 5
Full-timeSan Bruno, CA, USAIn-person

About the Job

Requirements

  • A bachelor's degree or equivalent practical experience.
  • Five years of experience in program or project management.
  • Experience with the software development life cycle and managing engineering programs.
  • Experience working with engineering teams.

Responsibilities

  • Lead cross-team migrations to next-generation machine learning frameworks, runtimes, and training systems across distributed models.
  • Drive the strategic roadmap and operational delivery for production machine learning serving platforms, ensuring low-latency inference, high availability, and zero-downtime rollouts.
  • Partner with capacity planning and engineering teams to optimize compute scalability, hardware efficiency, and accelerator utilization, including tensor processing units and graphics processing units.
  • Manage cross-functional dependencies, milestones, and technical blockers across modeling, systems, site reliability engineering, and platform teams.
  • Establish operational cadences, proactively manage technical risks, and communicate program status, roadmaps, and trade-offs to executive leadership.
  • Drive YouTube’s multi-year machine learning infrastructure strategy across training modernization, next-generation serving, and frontier model scaling.
  • Coordinate stakeholders to plan requirements, manage project schedules, identify risks, and communicate progress and deadlines across cross-functional partners.
  • Serve as the connector between recommendation research scientists, systems software engineers, site reliability engineers, hardware operations, and Google-wide platform teams.
  • Lead infrastructure transitions, establish operational excellence for compute allocation and duty cycles, and partner with engineering leadership to guide YouTube’s AI infrastructure.

Desired Qualifications

  • Five years of experience managing cross-functional or cross-team projects.
  • Proven experience driving large-scale software migrations or platform modernizations across dozens of participating engineering teams without regressing product latency or stability.
  • A technical background, such as a degree in Computer Science, Engineering, or Mathematics, or experience with software engineering, scripting, distributed systems architecture, or deep learning systems.
  • Working AI fluency and familiarity with machine learning concepts, including model training, inference serving, evaluation, and compute accelerators, with the ability to converse credibly with machine learning engineers and researchers.
  • Familiarity with compute resource planning, capacity budgeting, hardware efficiency, or accelerator duty-cycle analysis involving tensor processing units or graphics processing units.

About the Company

Google

Runs Search and YouTube and builds Gemini AI

Google runs the world's most used search engine and free services such as YouTube, Android, and Gmail, and it builds the Gemini AI models that work inside them. In 2017, its researchers invented the transformer, the neural network design behind ChatGPT and most other AI chatbots. People use these services without paying, and Google earns most of its money from ads placed beside search results and YouTube videos. Businesses rent computing power and Gemini models through Google Cloud, and Google also sells subscriptions and Pixel phones. Larry Page and Sergey Brin founded Google in 1998 as Stanford PhD students; it is based in Mountain View, California, United States, and is the main business of parent company Alphabet.

Company size
10,001+
Company stage
IPO
Headquarters
Mountain View, CA
Founded
1998

Recently Posted Jobs

Explore more opportunities at Google

See more jobs