A

Apple

Designs phones, computers and their operating systems

Software Engineering Manager - Agentic Evaluation Platform

Engineering LeadershipConfirmed live in the last 24 hours
Full-timeCupertino, CA, USANo salary listedIn-person

About the Job

Requirements

  • At least 5 years of experience developing production software using technologies such as Python, Java, Go, or Swift.
  • At least 3 years of engineering management experience, including owning roadmap and delivery, mentoring, setting clear expectations, and providing consistent, honest feedback.
  • Strong technical leadership and the ability to set architectural direction and inspire a team.
  • Experience with test infrastructure, continuous integration and continuous delivery, or evaluation and machine learning platforms.
  • Demonstrated creative and critical-thinking abilities.
  • Excellent spoken and written communication skills and the ability to collaborate across teams.
  • A Master of Science or Bachelor of Science degree in Computer Science, Machine Learning, or a related field, or equivalent experience.

Responsibilities

  • Lead and grow a team of engineers building backend services, compute orchestration, and evaluation harnesses.
  • Set the team's technical direction and roadmap, and own delivery against it.
  • Own the backend services and application programming interfaces that expose evaluation as a platform capability, including job submission, execution, and results retrieval.
  • Own compute orchestration across heterogeneous device and host fleets, including scheduling, capacity, allocation, throughput, and utilization targets.
  • Own harness engineering that drives devices and models through a run, captures output, and hands off to scoring.
  • Define and steward interfaces and contracts between harnesses, pipelines, and consuming teams, including versioning, backward compatibility, and migration paths.
  • Own data workflows that move results from execution through scoring to storage and reporting, and own their underlying schemas.
  • Deliver and evolve reliability and health dashboards and release-readiness signals used for ship decisions.
  • Set the bar for diagnosability across the stack, from environment provisioning through pipeline execution to scoring, prioritizing automated triage and durable fixes over recurring manual investigation.
  • Partner with quality engineering engineers, feature teams, architecture leads, and infrastructure teams to align on interfaces, priorities, and shared standards and to maintain a defensible quality bar.
  • Recruit, mentor, and develop engineers, including senior individual contributors, with a focus on engineering rigor, technical depth, and clear ownership.
  • Operate effectively in ambiguity and reshape team scope as the evaluation platform and underlying Siri architecture evolve.

Desired Qualifications

  • Experience building or leading teams that apply large language models or artificial intelligence agents to engineering workflows, such as data generation, code generation, or agentic pipelines with human-in-the-loop review.
  • Depth in distributed systems and backend services, including REST or gRPC; cloud infrastructure, including Docker or Kubernetes; data platforms; or large-scale test and release infrastructure.
  • Familiarity with large language model and agentic evaluation concepts.
  • Experience implementing model evaluation frameworks and experiment workflows, including offline and online experiments, to measure how model or platform changes affect accuracy, latency, and engagement.
  • Experience building machine learning platforms and infrastructure used by multiple teams for experimentation and deployment.
  • Experience designing and integrating monitoring, logging, and alerting solutions, including dashboards, anomaly detection, and real-time alerts, to track reliability and performance in production systems.
  • Experience developing data-processing pipelines with big-data frameworks such as Apache Spark, Kafka, or Flink to ingest, transform, and analyze large-scale log or event data.
  • Demonstrated cross-functional leadership and the ability to drive coverage and quality decisions with senior stakeholders.
  • Experience hiring and growing a team, including senior engineers.
  • Comfort operating in ambiguity and reshaping team scope as the domain matures.

About the Company

Apple

Designs phones, computers and their operating systems

Apple designs and sells consumer electronics, from iPhone smartphones and Mac computers to tablets and wearable devices. Its operating systems manage apps and built-in functions for communication and work, while iCloud stores files and synchronizes data across devices. Customers buy additional digital services through subscriptions such as Apple Music and Apple TV, and developers distribute software through the App Store. Apple earns money from hardware sales, subscriptions and digital transactions, selling directly to customers and through retailers and mobile carriers around the world. It was founded in 1976 and has its headquarters in Cupertino, California.

Company size
10,001+
Company stage
IPO
Headquarters
Cupertino, CA
Founded
1976

Recently Posted Jobs

Explore more opportunities at Apple

See more jobs