A

Apple

Designs phones, computers and their operating systems

AI/ML Senior Software Engineer - AI, Evaluation

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeCupertino, CA, USANo salary listedIn-person

About the Job

Requirements

  • A BS, MS, or PhD in Computer Science, Machine Learning, or a related field.
  • At least 8 years of software engineering experience, including ownership of production systems used by other teams.
  • Exceptional Python skills and strong understanding of system design, API design, system testing and validation, debugging, and monitoring.
  • Experience shipping production code with AI coding agents while maintaining high quality.

Responsibilities

  • Own a core evaluation system end-to-end for multiple features, including its architecture, roadmap, reliability, and developer experience.
  • Design testing and validation strategies that catch real failures before partners do.
  • Build and maintain integrations with annotation, compute, reporting, and benchmarking platforms.
  • Partner with teams building LLM judges on the platform and turn their recurring needs into product.
  • Set standards for using AI coding agents without compromising quality.
  • Treat internal users' needs as a priority, maintain focus on Apple customers and product quality, and communicate clearly to align cross-functional partners.

Desired Qualifications

  • Proficiency in building agentic systems, LLM-based applications, LLM-as-judge systems, and offline evaluations.
  • Ability to interpret evaluation results, including human agreement and run-to-run consistency, while respecting constraints such as data retention and privacy policies.
  • Expertise building and maintaining technical integrations across multiple platforms in a large organization with varying technical requirements and scaling, volume, and throughput needs.
  • Product-mindedness and ability to turn ambiguous requirements into a focused plan.

About the Company

Apple

Designs phones, computers and their operating systems

Apple designs and sells consumer electronics, from iPhone smartphones and Mac computers to tablets and wearable devices. Its operating systems manage apps and built-in functions for communication and work, while iCloud stores files and synchronizes data across devices. Customers buy additional digital services through subscriptions such as Apple Music and Apple TV, and developers distribute software through the App Store. Apple earns money from hardware sales, subscriptions and digital transactions, selling directly to customers and through retailers and mobile carriers around the world. It was founded in 1976 and has its headquarters in Cupertino, California.

Company size
10,001+
Company stage
IPO
Headquarters
Cupertino, CA
Founded
1976

Recently Posted Jobs

Explore more opportunities at Apple

See more jobs