Software Engineer - Evaluation Engineering

Summary

Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs.

Minimum Qualifications

5+ years building production web applications. Strong TypeScript and a modern framework (React). Experience with data-heavy UIs: large tables, filtering, comparison, and visualization. Working proficiency in Python, with experience collaborating on typed API contracts (OpenAPI or generated clients) with backend teams. Experience owning or leading a codebase or major area: code review, setting patterns, and mentoring contributors. Strong cross-team communication. BS or MS in Computer Science or equivalent experience

Preferred Qualifications

Experience with analytical or relational data backends (for example, PostgreSQL and query or aggregation design). You should be able to reason about why a view is slow and fix it at the query layer. Experience building internal developer platforms or analytics consoles. Experience leading framework upgrades and migrations in a live codebase. Familiarity with ML/LLM evaluation workflows, such as judging, traces, and cost or token metering.

Description

We are looking for a Full-Stack Software Engineer to own the user-facing UI of our evaluation platform. Teams across Siri and Apple Intelligence use our web console to create, run, browse, and compare evaluation jobs at scale. You will set the front-end's engineering standards and help drive the service APIs and data queries behind agent flows, the UI, and other clients, working with the services and data teams. The hardest problems here are data-dense. Scenario browsing, job comparison, and cost reporting are limited by how evaluation data is stored and queried, not by the UI layer. You will help shape the query and aggregation side with the data backend, then build the interface on top. You will partner with the pipeline, device, evaluator, and CLI teams rather than work inside their internals.

Responsibilities

Own the evaluation console front-end (TypeScript/React): architecture, code review, and patterns. Set the standards for consistency across contributors. Build data-dense interfaces for scenario browsing, job comparison, and cost reporting, including tables, filtering, comparison views, and charting at scale. Help drive the service APIs and data queries behind agent flows, the UI, and other clients (CLI, automation). Partner with the services and data teams on endpoint design, query and aggregation shapes, and the OpenAPI spec that generated clients build from. Contribute Python changes where needed, and advocate for user-facing workflow needs on the shared contract. Work with product and modeling DRIs on UX and workflows, so evaluation builders and users can self-serve. Drive platform debt paydown: major framework upgrades and consolidating parallel old/new redesigns (for example, the job creation flow and the admin console). Recommend and land the retire-or-keep calls with the team.