Inactive
Z

Zoox

Fully electric autonomous ride-hailing service platform

PhD Research Intern - Multi-Modal Foundation Encoder for Perception

Computer VisionPosted on Apr 21
Internship · Summer 2026, Fall 2026San Mateo, CA, USA

About the Job

Requirements

  • Currently working towards a Ph.D., or advanced degree in a relevant engineering program
  • Good academic standing
  • Able to commit to a 12-week internship during one of the following summer 2026 cohorts: May 18th - August 7th, OR May 26th - August 14th, OR June 15th - September 4th
  • At least one previous industry internship, co-op, or project completed in a relevant area
  • Ability to relocate to the Bay Area, California (or Boston, Massachusetts) for the duration of the internship
  • Interns at Zoox may not use any proprietary information they are working on as part of their thesis, any published work with their university, or to be distributed to anyone outside of Zoox

Responsibilities

  • Lead the development of a multi-modality (vision, LiDAR, Radar, and language), temporal foundation encoder to support 3D object detection & tracking, 3D segmentation (occupancy), and live maps.
  • Your research will aim to significantly improve system performance on long-tail events and rare classes by utilizing a large-capacity foundation model to learn rich representations across different sensor modalities.
  • Additionally, the project aims to improve perception in adverse environmental conditions (such as medium to heavy rain and fog, reducing false positives on water splashes or dust particles) , achieve long-range sensing for highway driving , and build robustness to occlusion.
  • This is a highly research-driven role with the goal of publication.
  • You will have the opportunity to explore novel directions such as tri-modal foundation models with self-supervised pre-training, radar-language grounding for zero-shot detection, efficient sensor fusion via sparse cross-attention, or integrating 3D Gaussian Splats for dynamic agent geometry and streaming sparse Gaussian occupancy prediction.

Desired Qualifications

  • Currently enrolled in a Ph.D. program in Computer Science, Electrical/Computer Engineering, Robotics, or a related field with a focus on Deep Learning, Computer Vision, or Autonomous Driving.
  • Publication record in top-tier AI/Robotics conferences (e.g., CVPR, ICCV, ECCV, NeurIPS, ICLR, ICRA).
  • Prior experience designing and training foundation models (such as World Models, VLMs, LLMs, or VLAs) using large-scale multi-modal autonomous driving datasets.
  • Hands-on experience developing deep learning models for 3D object detection, tracking, or 3D segmentation.
  • Experience working with multi-modal sensor data, specifically combining representations from vision, LiDAR, Radar, or language.
  • Experience with 4D radar object detection or handling sensor data in adverse weather conditions.
  • Experience with cross-modal alignment for zero-shot detection.
  • Familiarity with 3D Gaussian Splatting, voxel grid representations, or streaming sparse occupancy prediction.
  • Experience with self-supervised pre-training or masked sensor modeling.

About the Company

Zoox

Fully electric autonomous ride-hailing service platform

Zoox designs and operates an autonomous ride-hailing service built around a purpose-built, fully electric vehicle designed specifically for autonomous operation. The vehicle uses advanced sensors, cameras, and AI to navigate complex urban environments, offering a four-passenger interior for comfort. Unlike competitors that retrofit existing cars, Zoox engineers both the vehicle and the service from the ground up, enabling optimized safety, efficiency, and passenger experience through integrated software that optimizes routing and reduces wait times. The company emphasizes safety through extensive testing and regulatory collaboration, and sustainability via electric mobility. The ultimate goal is to provide a smarter, safer, and more efficient urban transportation system that improves city life while reducing emissions.

Company size
5,001-10,000
Company stage
Acquired
Total funding
$1.2B
Headquarters
Menlo Park, CA
Founded
2014

Recently Posted Jobs

Explore more opportunities at Zoox

See more jobs