Z

Zoox

Fully electric autonomous ride-hailing service platform

Machine Learning Engineer - Vision Foundation Models

Computer VisionConfirmed live in the last 24 hours
Full-time$254k - $305k /yr

About the Job

Requirements

  • An MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field, with at least 6 years of industry experience, or a PhD with at least 3 years of industry experience.
  • Deep expertise in computer vision and deep learning for image and video understanding, including object detection, pose and action recognition, and fine-grained classification, with hands-on experience using modern convolutional and vision-transformer detectors and self-supervised or foundation-model backbones such as DINOv3.
  • Strong proficiency in Python and PyTorch for model design, training, and evaluation.
  • Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.
  • A track record of owning the full machine-learning lifecycle on real-world data, including dataset curation and labeling guidelines, training, metric design using precision, recall, and false-positive rate at an operating point, and error analysis.

Responsibilities

  • Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition.
  • Own a model or feature area end to end by curating data, defining labeling guidelines, training and evaluating models, and taking them through deployment.
  • Set the quality bar for owned models using rigorous evaluation and error analysis so they are reliable enough to support live operations.
  • Deploy models under real-time and compute constraints shared with the onboard perception system.
  • Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans.

Desired Qualifications

  • Experience with in-cabin or occupant monitoring, ideally including multi-camera or fisheye imagery and low-light conditions.
  • Experience deploying deep learning models to real-time, resource-constrained systems, including robotics, automotive, or edge devices, using TensorRT, ONNX, or similar tools.
  • Proficiency in C++ for model integration.

About the Company

Zoox

Fully electric autonomous ride-hailing service platform

Zoox designs and operates an autonomous ride-hailing service built around a purpose-built, fully electric vehicle designed specifically for autonomous operation. The vehicle uses advanced sensors, cameras, and AI to navigate complex urban environments, offering a four-passenger interior for comfort. Unlike competitors that retrofit existing cars, Zoox engineers both the vehicle and the service from the ground up, enabling optimized safety, efficiency, and passenger experience through integrated software that optimizes routing and reduces wait times. The company emphasizes safety through extensive testing and regulatory collaboration, and sustainability via electric mobility. The ultimate goal is to provide a smarter, safer, and more efficient urban transportation system that improves city life while reducing emissions.

Company size
5,001-10,000
Company stage
Acquired
Total funding
$1.2B
Headquarters
Menlo Park, CA
Founded
2014

Recently Posted Jobs

Explore more opportunities at Zoox

See more jobs