H

HP Inc.

Makes computers and printers for work and home

Senior Machine Learning Platform Engineer - Model Hosting & MLOps

Applied Machine LearningConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Hands-on experience hosting LLM inference on GPU infrastructure in a production environment, including explaining personal contributions and management of throughput, latency, utilization, reliability, and cost.
  • Experience building the model-serving platform for custom models, including inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.
  • Strong software engineering skills, especially Python, and experience building services, automation, and maintainable production code.
  • Experience developing infrastructure for machine-learning workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other; experience using infrastructure as code such as Terraform or an equivalent tool.
  • Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.
  • Experience building or operating machine-learning deployment pipelines with versioned artifacts, automated validation, continuous integration and continuous delivery, environment promotion, and rollback.
  • Familiarity with LLM agent patterns, including model invocation, tool calls, and multi-step workflows, and their effects on serving capacity, reliability, and access controls.
  • Working knowledge of production concerns for inference services, including scaling, latency, availability, logging and metrics, shared incident response, access control, and cost.
  • Ability to work across model development, application, platform, and security teams; turn ambiguous requirements into a working design; and document the operational approach.

Responsibilities

  • Design and build hosting for custom machine-learning and artificial-intelligence models across AWS and Azure, focusing on GPU-backed LLM inference and real-time endpoints, and supporting batch inference where appropriate.
  • Package models and their dependencies into reproducible serving workloads, and choose and implement managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost.
  • Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration.
  • Help design secure connections and deployment patterns between cloud and on-premises environments as hosting needs evolve.
  • Develop infrastructure as code and deployment automation so model-hosting environments can be provisioned, reviewed, promoted, and maintained consistently.
  • Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement; connect training or model preparation to deployment through automated pipelines and appropriate quality gates.
  • Partner with application teams to design and prototype agent workflows, including model and tool orchestration, state handling, failure recovery, and evaluation.
  • Translate agent workload patterns into hosting decisions about model selection, context length, concurrency, latency, cost, tool access, and end-to-end tracing.
  • Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and model behavior; share responsibility for diagnosing incidents and improving capacity, reliability, and cost.
  • Create reusable deployment templates, reference architectures, documentation, and onboarding paths that help other teams ship models safely.
  • Partner with model and application teams on practical tradeoffs such as online versus batch inference, managed versus self-hosted serving, scaling, evaluation, data handling, and operational ownership.

Desired Qualifications

  • Advanced GPU inference optimization, including capacity planning, batching, autoscaling, memory use, model loading, and performance tuning.
  • Experience serving generative or other compute-intensive custom models beyond LLMs, including selecting and tuning inference servers and runtime configurations.
  • Experience with AWS SageMaker or EKS, Azure Machine Learning or AKS, or equivalent managed and self-hosted model platforms.
  • Experience with hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff.
  • Experience with model registries, experiment tracking, data or feature pipelines, scheduled retraining, model evaluation, and drift or quality monitoring.
  • Experience with secure enterprise deployment patterns such as private networking, IAM/RBAC, secrets management, auditability, and handling sensitive data.
  • Experience building shared machine-learning platform capabilities or self-service workflows used by multiple engineering teams.
  • Hands-on development of agent workflows, including tool integration, evaluation, tracing, or guardrails.

About the Company

HP Inc.

Makes computers and printers for work and home

HP designs personal computers, printers and related supplies for households, businesses and public institutions, with products for everyday work and professional computing. Its Z workstations support demanding technical tasks, while its commercial printing systems serve offices, print shops and industrial manufacturers. It sells devices and replacement supplies directly and through partners, and earns service revenue from software, support and managed computer and printer fleets. Founded as a partnership in 1939, the company is headquartered in Palo Alto, California, and retained the PC and printing businesses after separating Hewlett Packard Enterprise in 2015.

Company size
10,001+
Company stage
IPO
Headquarters
Palo Alto, CA
Founded
1939

Recently Posted Jobs

Explore more opportunities at HP Inc.

See more jobs