V

Vizient

Healthcare performance improvement and supply chain

AI/ML Engineer Team Lead

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • A relevant degree is preferred.
  • Seven or more years of relevant experience are required.
  • Experience providing technical leadership for complex, production-grade software or AI systems is required.
  • Demonstrated experience personally designing, building, deploying, and operating generative AI or machine learning applications in enterprise production environments is required.
  • Strong experience with Python and modern API and service development, including FastAPI or comparable frameworks, is required.
  • Experience with large language models, prompt engineering, structured outputs, tool or function calling, retrieval-augmented generation, and agentic workflows is required.
  • Experience establishing evaluation strategies for nondeterministic AI systems, including test datasets, regression evaluation, grounding, quality measurement, and failure analysis, is required.
  • Strong understanding of the appropriate boundaries between probabilistic AI behavior and deterministic software, rules, retrieval, and data processing is required.
  • Experience with cloud-native architecture, asynchronous processing, APIs, events or queues, persistence, monitoring, and production observability is required.
  • Experience addressing enterprise security, privacy, reliability, auditability, supportability, performance, and cost requirements is required.
  • Strong technical leadership, mentoring, communication, problem-solving, architecture, and cross-functional collaboration skills are required.

Responsibilities

  • Lead the architecture, development, deployment, and operation of enterprise-grade AI and machine learning solutions.
  • Design solutions that combine large language models, agentic workflows, retrieval, structured data, APIs, and deterministic processing.
  • Translate complex expert workflows into modular, testable, and maintainable software components.
  • Determine where AI inference, deterministic logic, retrieval, rules, or traditional data processing will produce the most reliable outcome.
  • Establish evaluation strategies using representative test sets, expert-reviewed outcomes, regression testing, quality measurements, and stage-level analysis.
  • Design observability capabilities that capture intermediate outputs, decision traces, evaluation results, performance measures, and failure modes.
  • Lead investigations into grounding failures, hallucinations, retrieval quality, prompt behavior, model selection, orchestration, latency, accuracy, and cost.
  • Evaluate architectural tradeoffs across performance, maintainability, extensibility, security, reliability, supportability, and operating cost.
  • Develop APIs, services, prototypes, and production components while contributing to design reviews, code reviews, and complex technical problem-solving.
  • Implement security, privacy, auditability, monitoring, and production-readiness practices for AI-enabled applications.
  • Partner with domain experts, product leaders, architects, data teams, and platform teams to convert specialized knowledge into scalable system behavior.
  • Develop reusable AI capabilities, engineering patterns, evaluation frameworks, and platform components that support multiple solutions.
  • Mentor engineers and strengthen team practices across AI engineering, software design, testing, observability, and production operations.
  • Drive continuous improvement by incorporating production metrics, evaluation results, expert feedback, and real-world user outcomes.

Desired Qualifications

  • Experience with Microsoft Azure, Azure AI Foundry, Azure AI Search, or comparable cloud AI and semantic-retrieval technologies is preferred.
  • Experience with Databricks, vector databases, embeddings, reranking, semantic search, or enterprise knowledge-retrieval platforms is preferred.
  • Experience developing AI solutions involving sensitive, regulated, or high-consequence data and decisions is preferred.

About the Company

Vizient

Healthcare performance improvement and supply chain

Vizient, Inc. helps healthcare providers improve performance and lower costs. It serves academic medical centers, health systems, community and rural hospitals, and ambulatory care groups by delivering knowledge, solutions, and expertise through members. The company’s main products are in supply chain management, clinical and operational performance improvement, and strategic consulting. It uses data analytics and industry insights to help members optimize operations, increase efficiency, and improve patient outcomes. Revenue comes from membership fees, consulting services, and performance improvement programs, and the company expands capabilities through acquisitions such as Intalere to better serve its member base.

Company size
1,001-5,000
Company stage
Debt Financing
Total funding
$2B
Headquarters
Irving, TX
Founded
1977

Recently Posted Jobs

Explore more opportunities at Vizient

See more jobs