H

Hugging Face

Open-source AI models and ML hub

Senior Machine Learning Engineer - Voice Agents

AI Application Engineering +1Confirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Able to own a substantial part of an architecture and drive it forward autonomously.
  • Experience building developer-facing infrastructure at an AI or developer-tools company, such as inference APIs or agent infrastructure.
  • Substantial open-source contributions to a Python library.
  • Comfortable with asynchronous Python and distributed systems, including their failure modes.
  • Have shipped a real-time system involving streaming, WebSockets or WebRTC, audio or video pipelines, or live inference.
  • Practical experience with large language models or multimodal models in production.
  • Clear written communication and a habit of collaborating asynchronously and in public.
  • Motivated by voice and conversational AI.

Responsibilities

  • Take architectural ownership of large parts of the speech-to-speech library, including pipeline design, latency budget, and reliability of the real-time loop.
  • Integrate new automatic speech recognition, text-to-speech, and end-to-end speech models, while keeping abstractions clean as the model landscape changes.
  • Review community pull requests, triage issues, cut releases, and grow the contributor group around the project.
  • Design the developer API and streaming protocol, including session lifecycle, transport using WebSockets or WebRTC, authentication, error semantics, and versioning.
  • Build the serving side, including real-time inference on GPUs, concurrency, autoscaling, observability, and cost per session.
  • Work with the Hub and inference teams to make voice agents easy to integrate into products and demos.
  • Take the product from demo to production through load testing, service-level objectives, and graceful degradation when a model or network path misbehaves.
  • Write documentation, examples, and templates that help developers get a running agent quickly.
  • Support deployments relying on the stack, starting with the Reachy Mini fleet.
  • Give public talks about the work, including blog posts, demos, or conference talks, if desired.

Desired Qualifications

  • Contributions to a voice-agent framework such as speech-to-speech, Pipecat, LiveKit Agents, Vocode, or TEN.
  • Contributions to llama.cpp or another low-level inference runtime.
  • Hands-on work with automatic speech recognition, text-to-speech, or end-to-end speech models, including evaluation of latency and quality trade-offs.
  • Experience with GPU serving, quantization, or on-device inference.
  • Audio pipeline knowledge, including voice activity detection, echo cancellation, jitter buffers, barge-in, and turn detection.
  • Experience shipping to embedded or robotics targets.
  • A public track record through talks, blog posts, or demos.

About the Company

Hugging Face

Open-source AI models and ML hub

Hugging Face provides tools and a platform to build and share machine learning applications. Its core offering, the Hugging Face Hub, lets researchers and developers publish, discover, and collaborate on models, datasets, and apps. The Transformers library is a popular open-source Python toolkit that helps download and fine-tune state-of-the-art models for NLP and other tasks. The company uses a freemium, open-core model, offering free access to core resources while selling paid features for teams and enterprises to speed AI development and deployment.

Company size
1,001-5,000
Company stage
Acquired
Total funding
$395.7M
Headquarters
New York City, New York
Founded
2016

Recently Posted Jobs

Explore more opportunities at Hugging Face

See more jobs