A

Apple

Designs phones, computers and their operating systems

Applied AI Scientist - Image Autograder Systems, Evaluation

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeCupertino, CA, USANo salary listedIn-person

About the Job

Requirements

  • A Master's or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field is required.
  • Deep understanding of visual-language models is required.
  • Familiarity with image quality assessment, including perceptual quality dimensions, evaluation metrics, and rubric design, is required.
  • Proficiency in Python and the ability to write well-structured, production-ready model code are required.
  • Strong communication skills for explaining autograder quality and driving autograder adoption with partner teams are required.

Responsibilities

  • Focus on autograder research, training, and adoption.
  • Collaborate with AI feature teams, evaluation design teams, and annotation teams to refine feature requirements, grading rubrics, and gold annotation sets.
  • Develop, evaluate, and iterate on grading prompts to align autograder behavior with grading rubrics and gold sets.
  • Identify when prompt tuning reaches its limits and apply advanced techniques such as fine-tuning to close remaining grading accuracy gaps.
  • Design analyses to measure and explain autograder quality.
  • Collaborate with machine learning engineers and feature teams on autograder deployment and adoption.
  • Develop scalable systems to accelerate autograder training processes.

Desired Qualifications

  • At least 1 year of industry experience building visual-language-model-based products.
  • Familiarity with autograder and evaluator concepts, including grading accuracy, agreement with human raters, calibration, and rubric design.
  • Strong expertise in prompt tuning and fine-tuning for visual-language models.
  • Ability to read AI literature and translate it into applied autograder experiments.
  • Prior experience building agentic systems to scale autograder training and validation.

About the Company

Apple

Designs phones, computers and their operating systems

Apple designs and sells consumer electronics, from iPhone smartphones and Mac computers to tablets and wearable devices. Its operating systems manage apps and built-in functions for communication and work, while iCloud stores files and synchronizes data across devices. Customers buy additional digital services through subscriptions such as Apple Music and Apple TV, and developers distribute software through the App Store. Apple earns money from hardware sales, subscriptions and digital transactions, selling directly to customers and through retailers and mobile carriers around the world. It was founded in 1976 and has its headquarters in Cupertino, California.

Company size
10,001+
Company stage
IPO
Headquarters
Cupertino, CA
Founded
1976

Recently Posted Jobs

Explore more opportunities at Apple

See more jobs