A

Apple

Designs phones, computers and their operating systems

Quality Engineer - Employee Experience Engineering

Test Automation EngineeringConfirmed live in the last 24 hours
Full-timeCork, IrelandNo salary listedIn-person

About the Job

Requirements

  • Experience in software engineering, quality engineering, or application operations as part of a team, with understanding of the software development lifecycle and agile or sprint-based delivery processes.
  • Experience testing AI applications, evaluating model outputs, performing basic prompt engineering, and automating data validation.
  • Experience with manual testing, user acceptance testing, regression testing, and exploratory testing.
  • A B.S. or M.S. in Computer Science or Software Engineering, or equivalent experience.

Responsibilities

  • Drive quality engineering through internal testing, including user acceptance testing.
  • Design and generate realistic synthetic datasets, including adversarial and edge-case scenarios, that closely resemble real-world user interactions, prompts, and response patterns to support comprehensive project testing.
  • Systematically review AI-generated outputs against a defined evaluation rubric to identify fabricated facts, invented references, non-existent entities, and unsupported claims.
  • Analyse evaluation data to identify recurring failure patterns, quality degradation trends, and areas of improvement across model versions and product domains.
  • Generate actionable insights from validation results to prioritize model retraining efforts and prompt refinement.
  • Design and build end-to-end automated evaluation pipelines that streamline validation from input ingestion and response evaluation to scoring and reporting.
  • Integrate LLM-as-a-judge frameworks and custom evaluation models into the automation pipeline to enable consistent, repeatable, and scalable quality assessments as part of the CI/CD pipeline.
  • Implement alerting and monitoring mechanisms within the AI automation framework to detect quality drops in real time and trigger escalation workflows.
  • Partner with ML engineers, prompt engineers, product teams, and content and legal teams to align evaluation standards with business goals and compliance requirements.
  • Maintain documentation of technical processes, systems, and troubleshooting.
  • Build relationships with internal business partners to understand their needs and advocate for their experience.

Desired Qualifications

  • Proficiency in testing and operations within Apple platforms, including macOS and iOS.
  • Expertise in CI/CD pipelines and release management processes.
  • Experience with test automation frameworks such as XCTest, XCUITest, Selenium, and Playwright.
  • Experience in AI prompt engineering.
  • Exposure to native application development in Swift or SwiftUI.
  • Experience in customer-facing or support roles that required escalation management.
  • Familiarity with Jira, Radar, or analogous issue tracking systems for sprint and release management.

About the Company

Apple

Designs phones, computers and their operating systems

Apple designs and sells consumer electronics, from iPhone smartphones and Mac computers to tablets and wearable devices. Its operating systems manage apps and built-in functions for communication and work, while iCloud stores files and synchronizes data across devices. Customers buy additional digital services through subscriptions such as Apple Music and Apple TV, and developers distribute software through the App Store. Apple earns money from hardware sales, subscriptions and digital transactions, selling directly to customers and through retailers and mobile carriers around the world. It was founded in 1976 and has its headquarters in Cupertino, California.

Company size
10,001+
Company stage
IPO
Headquarters
Cupertino, CA
Founded
1976

Recently Posted Jobs

Explore more opportunities at Apple

See more jobs