H

HP Inc.

Makes computers and printers for work and home

AI Runtime and ML Model Systems Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeHouston, TX, USANo salary listedIn-person

About the Job

Requirements

  • At least 7 years of experience in systems engineering, software architecture, AI runtimes, or a related field.
  • Experience designing AI runtime systems, inference platforms, or model execution frameworks for edge devices or other resource-constrained environments.
  • Strong understanding of how AI models use compute engines, memory, and hardware acceleration, including trade-offs across CPU, GPU, and NPU execution.
  • Experience with inference frameworks such as ONNX Runtime, TensorRT, or OpenVINO, and understanding of their hardware dependencies and execution behavior.
  • Ability to translate product and performance requirements into system architectures, interface definitions, and technical specifications.
  • Strong software engineering fundamentals, including APIs, concurrency, memory management, and the interaction between operating systems and hardware.
  • Ability to guide cross-functional engineering teams and communicate architectural decisions and trade-offs clearly.
  • Bachelor’s degree in computer science, software engineering, information technology, a related field, or equivalent practical experience.

Responsibilities

  • Define runtime architectures and performance strategies for AI workloads across heterogeneous compute resources.
  • Assess how model types, hardware capabilities, memory requirements, and workload behavior should influence system design.
  • Design runtime abstraction layers and interfaces that connect applications and models to inference engines and hardware backends.
  • Define model placement, scheduling, and routing policies across CPU, GPU, and NPU resources, including fallback behavior and resource availability considerations.
  • Evaluate inference technologies such as ONNX Runtime, TensorRT, and OpenVINO to guide framework selection and integration decisions.
  • Establish approaches for memory allocation, model lifecycle management, and resource coordination when multiple AI workloads execute concurrently.
  • Translate product requirements into performance targets, system requirements, and architectural guidance for development teams.
  • Define benchmarks and validation criteria; use prototype results and system measurements to assess architectural choices.
  • Lead design reviews and collaborate with platform, security, and hardware and software partners to resolve dependencies and guide engineering roadmaps.

Desired Qualifications

  • Experience architecting AI runtime or system software for Windows PCs.
  • Familiarity with hardware acceleration backends and software ecosystems from Intel, AMD, NVIDIA, or Qualcomm.
  • Knowledge of different model architectures, quantization approaches, and their implications for compatibility, memory footprint, and execution.
  • Experience planning for resource contention, power and thermal constraints, and concurrent AI workloads.
  • Familiarity with C++ and Python for evaluating technical feasibility, reviewing implementations, or developing architectural proofs of concept.
  • Knowledge of agentic applications, multiple-model execution, and local and cloud inference strategies.

About the Company

HP Inc.

Makes computers and printers for work and home

HP designs personal computers, printers and related supplies for households, businesses and public institutions, with products for everyday work and professional computing. Its Z workstations support demanding technical tasks, while its commercial printing systems serve offices, print shops and industrial manufacturers. It sells devices and replacement supplies directly and through partners, and earns service revenue from software, support and managed computer and printer fleets. Founded as a partnership in 1939, the company is headquartered in Palo Alto, California, and retained the PC and printing businesses after separating Hewlett Packard Enterprise in 2015.

Company size
10,001+
Company stage
IPO
Headquarters
Palo Alto, CA
Founded
1939

Recently Posted Jobs

Explore more opportunities at HP Inc.

See more jobs