X

XPENG Motors

Designs and manufactures intelligent electric vehicles and aircrafts

Staff Machine Learning Engineer / Research Scientist - Foundation Model

Applied Machine Learning +1Confirmed live in the last 24 hours
Full-timeSanta Clara, CA, USAIn-person

About the Job

Requirements

  • A Master's degree or higher in Computer Science, Electrical Engineering, Computer Engineering, or a related field, with at least 3 years of experience in deep learning research or productization.
  • Strong proficiency in PyTorch and modern transformer-based model design.
  • Experience in large-scale pretraining or multimodal modeling involving vision, language, or planning.
  • Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
  • Familiarity with distributed training, including DDP or FSDP, and large-batch optimization.

Responsibilities

  • Design and implement large-scale multimodal architectures, such as vision-language-action transformers, for end-to-end autonomous driving.
  • Develop pretraining and fine-tuning strategies using large labeled and unlabeled fleet data, including images, video, LiDAR, CAN bus, maps, and human driving behaviors.
  • Research and integrate cross-modal alignment methods, such as visual grounding, temporal reasoning, policy distillation, imitation learning, and reinforcement learning, to improve model interpretability and action quality.
  • Scale training across thousands of GPUs using distributed training frameworks such as FSDP and DDP in collaboration with infrastructure engineers.
  • Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
  • Contribute to model deployment optimization, including quantization, export, and latency-accuracy trade-offs for onboard execution.

Desired Qualifications

  • A PhD in Computer Science, Computer Engineering, or Electrical Engineering, with at least 1 year of relevant industry experience.
  • A publication record in top-tier AI conferences such as CVPR, ICCV, NeurIPS, ICLR, ICML, or ECCV.
  • Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures such as ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies.
  • Familiarity with RLHF, DPO, GRPO, trajectory prediction, or policy learning for control tasks.
  • Ability to collaborate cross-functionally with infrastructure, perception, and planning teams to deliver production-ready models.

About the Company

XPENG Motors

Designs and manufactures intelligent electric vehicles and aircrafts

XPENG stands out as a leader in the tech industry, with its focus on intelligent mobility solutions such as electric vehicles and eVTOL aircraft, demonstrating a competitive edge in the rapidly evolving transportation sector. The company's proprietary Advanced Driver Assistance System (XPILOT) and intelligent operating system (Xmart OS) enhance the user experience by integrating technology and mobility, positioning XPENG as a pioneer in smart, people-first mobility. The company's culture fosters technological advancement, making it an exciting workplace for those passionate about shaping the future of transportation.

Company size
1,001-5,000
Company stage
Not listed
Total funding
$8.2B
Headquarters
Guang Zhou Shi, China
Founded
2014

Recently Posted Jobs

Explore more opportunities at XPENG Motors

See more jobs