NVIDIA is searching for an outstanding researcher on the topic of Foundation Models for Generalist Embodied Agent Research (GEAR). Everything that moves will eventually be autonomous. ChatGPT unifies all kinds of natural language understanding tasks in a single interface: text in, text out. What is the equivalent for an embodied Agent? What does it take to build a model that actively explores the world, ingests a multimodal sensory stream, plans over long horizons, acquires new skills, and bootstraps its own capabilities?

You will work with an amazing and collaborative research team that consistently publishes influential works on LLMs, multimodal foundation models, AI in gaming, robotics, policy learning, and simulation. Our past projects include Voyager, MineDojo, Eureka, VIMA, MimicPlay, Prismer, and more. Your contributions will have a significant impact on our cutting-edge research projects and will help shape our products.

What you’ll be doing:

• Design and implement novel techniques and methods for LLMs, multimodal models, and embodied agents.

• Engineer robust infrastructure and data pipelines for scaling up foundation models.

• Work with product groups to transfer technology.

• Mentor interns.

• Collaborate with external researchers.

What we need to see:

• Ph.D. in Computer Science/Engineering, Electrical Engineering, etc., or equivalent research experience.

• Outstanding engineering skills for rapid research prototyping, open-source release, or production development. Python is required; C++ and CUDA experiences are plus.

• Excellent knowledge and hands-on experience for training LLMs, multimodal foundation models, or large generative models.

• Experience in foundation and diffusion models, reinforcement learning, agent learning, and applied robotics

• Knowledge of common AI frameworks, such as PyTorch.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront in developing AI Agents!

The base salary range is 160,000 USD - 253,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.