H

Human Intuition

Member of Technical Staff - Inference

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeNew York, NY, USANo salary listedIn-person

About the Job

Requirements

  • Experience building and operating machine learning services or performance-sensitive distributed systems.
  • Strong Python skills and an understanding of model serving, accelerator memory, and concurrency.
  • Hands-on experience with an inference engine or substantial production model-serving workloads.
  • Ability to investigate performance bottlenecks and distinguish measured improvements from assumptions.
  • Ownership of reliability, debugging, and clear operational documentation.

Responsibilities

  • Build inference services and model routing with explicit reliability, latency, and cost targets.
  • Profile representative agent workloads, including long contexts, tool calls, streaming, and concurrent requests.
  • Improve throughput and resource use through scheduling, batching, caching, and informed deployment choices.
  • Develop reproducible benchmarks that connect serving changes to task quality as well as speed and cost.
  • Implement versioned rollouts, observability, capacity planning, and practical failure recovery.
  • Partner with research and infrastructure engineers to support evaluation and post-training workloads.

Desired Qualifications

  • Experience with GPU profiling, quantization, KV cache management, distributed serving, capacity scheduling, or contributions to inference software.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Human Intuition

See more jobs