C

Caterpillar

Makes heavy machinery, engines and gas turbines

Autonomous Driving End-to-End Engineer

Robotics & Autonomous SystemsConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • A PhD in computer science, artificial intelligence, automation, electronic information, or a related major is required.
  • Have a strong foundation in deep learning and machine learning, and be familiar with sequence modeling and Transformer architectures.
  • Be proficient in PyTorch or TensorFlow.
  • Be familiar with classic end-to-end autonomous driving approaches such as UniAD and VAD, major vision-language-action architectures such as RT-2 and OpenVLA, and bird's-eye-view or occupancy representations.
  • Be proficient in Python and C++, with sound coding and engineering implementation practices.
  • Have project, competition, or research experience in end-to-end driving, vision-language-action, or imitation learning; any of these types of experience is sufficient.

Responsibilities

  • Research end-to-end autonomous driving models for next-generation autonomous driving, connecting perception, prediction, and decision-making, and explore methods that generate planned trajectories directly from raw sensor data.
  • Research vision-language-action and robotics foundation models, including the use of large language and vision-language models as reasoning engines for semantic understanding and reasoning in complex mining conditions.
  • Use methods such as imitation learning and Diffusion Policy to research learning operational skills such as loading, digging, and unloading, and advance operational autonomy.
  • Explore closed-loop simulation training as an alternative to traditional open-loop imitation learning to improve generalization in long-tail conditions.
  • Track leading academic and industrial approaches, build and validate algorithm prototypes, share technical findings regularly, and continually evolve the solutions.
  • Coordinate with perception, planning, control, and system integration teams, and deliver algorithm solutions and research documentation.

Desired Qualifications

  • High-quality publications or notable open-source projects in end-to-end driving, vision-language-action, imitation learning, or Diffusion Policy.
  • Familiarity with world models, closed-loop simulation training, or reinforcement learning.
  • Research experience in robotic manipulation.
  • Familiarity with ROS or ROS2 and real-vehicle debugging.

About the Company

Caterpillar

Makes heavy machinery, engines and gas turbines

Caterpillar makes construction and mining machines, diesel and natural gas engines, industrial gas turbines and locomotives for contractors, mines, energy companies and data center builders. It is the world's largest maker of construction and mining equipment, and its yellow Cat bulldozers and excavators work in nearly every country. Customers buy or rent machines through independent Cat dealers, while its engines and turbines generate electricity and push natural gas through pipelines. Caterpillar earns money from equipment sales and from the parts and repairs that dealers supply over a machine's working life. It was formed in 1925 when California's Holt and Best tractor companies merged, and it is based in Irving, Texas.

Company size
10,001+
Company stage
IPO
Headquarters
Irving, TX
Founded
1925

Recently Posted Jobs

Explore more opportunities at Caterpillar

See more jobs