P

PlayStation

Develops games, hardware, and online services

Senior Software Development Engineer in Test - AI/ML

Test Automation EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A bachelor's degree in Computer Science or equivalent is required.
  • At least 5 years of experience as an SDET or QE engineer focused on backend and distributed systems is required.
  • Experience using large language models to generate, transform, and prioritize test cases for AI-powered experiences is required.
  • Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows is required.
  • Strong experience testing RESTful APIs, microservices, and distributed architectures is required.
  • Proficiency in Python, Java, JavaScript, or similar languages for automation development is required.
  • Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium is required.
  • Experience with CI/CD systems and test pipelines such as Jenkins or GitHub Actions is required.
  • Experience with cloud and container technologies such as AWS, GCP, Kubernetes, or Docker is required.
  • Familiarity with databases, monitoring, and observability tools is required.
  • A strong understanding of SDLC, Agile methodologies, and release processes is required.
  • Strong problem-solving, debugging, and communication skills are required.

Responsibilities

  • Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.
  • Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.
  • Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
  • Lead quality engineering efforts for multifunctional projects, driving risk assessment, dependency management, and release readiness.
  • Design, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.
  • Build automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.
  • Debug test failures, service anomalies, model inconsistencies, and AI behavior regressions to identify root causes and drive resolution.
  • Perform functional, integration, regression, API, end-to-end, performance, and reliability testing for distributed systems.
  • Improve automation reliability, reduce flakiness, and optimize execution efficiency.
  • Partner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.
  • Collaborate across teams to establish scalable quality standards, tooling, and guidelines.
  • Guide quality strategy and develop automation frameworks; manage implementation for complex cross-functional machine-learning-powered products and services; lead embedded quality engineering efforts within projects.

Desired Qualifications

  • Experience validating ML outputs using statistical analysis or scenario-based testing approaches is preferred.
  • Familiarity with ML infrastructure, data pipelines, or model-serving platforms such as Seldon, KServe, or Ray Serve is preferred.
  • Prior work in content moderation ML, security, fraud detection, or adversarial ML is preferred.
  • Experience testing high-scale, low-latency online services is preferred.
  • Experience with Databricks or similar ML platform tooling is preferred.
  • Familiarity with Node.js, React, or modern frontend technologies is preferred.
  • Experience testing mobile, console, or other non-PC platforms is preferred.

About the Company

PlayStation

Develops games, hardware, and online services

PlayStation is the brand behind Sony Interactive Entertainment’s gaming hardware, services, and studios. It creates and sells game consoles and related devices, runs the online PlayStation Network and subscription services, and develops and publishes games through PlayStation Studios. The product set works as an ecosystem: a console for playing games, a network for online play, digital storefronts for buying games, and a large portfolio of first- and third-party games from its studios around the world. Compared with rivals, PlayStation relies on a long history of console generations, a big collection of exclusive games, and a global network of studios to offer unique experiences that are tied to its hardware and services. Its goal is to provide engaging, borderless play experiences for players worldwide, continually delivering new hardware, services, and games that bring people together.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Japan
Founded
2008

Recently Posted Jobs

Explore more opportunities at PlayStation

See more jobs