V

Vizient

Healthcare performance improvement and supply chain

Lead Architect - AI Quality and Reliability Engineering

Test Automation EngineeringPosted on Nov 11
Full-timeIn-person

About the Job

Requirements

  • Required experience with quality engineering strategy and execution, test automation, and validation standards across a product.
  • Ability to design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Ability to establish data validation and reconciliation practices to ensure healthcare data and calculated metrics are accurate, complete, consistent, and integral.
  • Ability to develop automated testing approaches for AI-enabled applications, including large language model evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Ability to build and maintain automated regression suites, test datasets, continuous integration and continuous delivery quality gates, and monitoring capabilities.
  • Experience with end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Ability to partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Ability to champion shift-left quality engineering, mentor engineers, and improve automation, testing practices, and product reliability.

Responsibilities

  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish data validation and reconciliation practices to ensure healthcare data and calculated metrics are accurate, complete, consistent, and integral.
  • Develop automated testing approaches for AI-enabled applications, including large language model evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, continuous integration and continuous delivery quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.

Desired Qualifications

  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.

About the Company

Vizient

Healthcare performance improvement and supply chain

Vizient, Inc. helps healthcare providers improve performance and lower costs. It serves academic medical centers, health systems, community and rural hospitals, and ambulatory care groups by delivering knowledge, solutions, and expertise through members. The company’s main products are in supply chain management, clinical and operational performance improvement, and strategic consulting. It uses data analytics and industry insights to help members optimize operations, increase efficiency, and improve patient outcomes. Revenue comes from membership fees, consulting services, and performance improvement programs, and the company expands capabilities through acquisitions such as Intalere to better serve its member base.

Company size
1,001-5,000
Company stage
Debt Financing
Total funding
$2B
Headquarters
Irving, TX
Founded
1977

Recently Posted Jobs

Explore more opportunities at Vizient

See more jobs