Internship

AI/ML Intern: Reinforcement Learning

Updated on 4/29/2024

Sanctuary AI

Sanctuary AI

51-200 employees

Develops humanoid robots powered by AI

Robotics & Automation
Industrial & Manufacturing
AI & Machine Learning

Vancouver, BC, Canada

Required Skills
Python
Atlassian
Git
Data Structures & Algorithms
Pytorch
Confluence
Computer Vision
Requirements
  • Pursuing MS or Ph.D. in Machine Learning, Computer Science, Applied Math, or related field
  • Experience implementing a variety of RL and IL methods with a focus in a specialization such as computer vision or robotics
  • Hands-on experience integrating ML models onto a robotics platform
  • Experience implementing and deploying (dexterous) robotic manipulation tasks in simulation and on physical robots
  • Experience taking ML R&D and trained models into production
  • Experience with computer vision systems
  • Experience in simulation-to-reality transfer learning
  • Development with Python 3.6 or later
  • Working knowledge of PyTorch and/or JAX
  • Familiarity with ROS2
  • Extensive knowledge of RL/IL principles and use
  • Experience with Atlassian tools; Jira, Confluence, or equivalent e.g. GitLab
Responsibilities
  • Design, implement, and improve state-of-the-art Reinforcement Learning (RL) and Imitation Learning (IL) algorithms and test them in real-world settings
  • Keep up to date with state-of-the-art RL/IL methodologies and robotics
  • Identify, communicate, and drive promising research directions to the team
  • Find ways of improving existing implementations of RL/IL pipelines with regards to standard metrics such as sample efficiency, speed, computational resource usage, and scalability
  • Design RL/IL training and data-collection pipelines to facilitate fast deployment on physical robots
  • Work with a multidisciplinary team to develop novel algorithms and investigate sources of errors with existing implementations

Sanctuary AI focuses on the development of Phoenix™, a humanoid general-purpose robot employing the Carbon™ AI control system. This initiative not only aims to address labor shortages but enhances work safety and efficiency, setting a foundation for ambitious goals like space exploration. The company's commitment to tackling critical challenges with advanced robotics positions it as an intellectual hub for professionals eager to impact the future of labor and space exploration.

Company Stage

Series A

Total Funding

$93.8M

Headquarters

Vancouver, Canada

Founded

2018

Growth & Insights
Headcount

6 month growth

0%

1 year growth

22%

2 year growth

146%

Benefits

Medical, dental, & vision insurance

Wellness programs

Stock options

PTO

Schedule flexibility