Expert Scientist
Reinforcement Learning
Confirmed live in the last 24 hours
Sanctuary AI

51-200 employees

Human-like intelligence general-purpose robotics
Company Overview
Sanctuary’s mission is to create the world’s first human-like intelligence in general-purpose robots that will help us work more safely, efficiently, and sustainably. The company is committed to augmenting human creativity and has experience launching market-defining innovations rooted previously unsolved and deep scientific problems. Sanctuary hopes in the not-too-distant future, robots will help us explore, and prosper in outer space.
AI & Machine Learning
Industrial & Manufacturing
Robotics & Automation
B2B

Company Stage

Seed

Total Funding

$89.7M

Founded

2018

Headquarters

Vancouver, Canada

Growth & Insights
Headcount

6 month growth

21%

1 year growth

79%

2 year growth

194%
Locations
Vancouver, BC, Canada
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Atlassian
Confluence
Data Structures & Algorithms
JIRA
Git
Pytorch
Tensorflow
Python
CategoriesNew
AI & Machine Learning
Mechanical Engineering
Requirements
  • Create, develop, and enhance cutting-edge RL algorithms and evaluate their performance in practical applications
  • Stay current with the latest developments in RL techniques and their application in robotics
  • Identify, communicate, and lead research initiatives that show promise to the wider ML team
  • Discover strategies for enhancing current RL learning processes, considering key performance metrics like sample efficiency, speed, computational resources, and scalability
  • Devising RL training and data collection pipelines to expedite implementation on physical robots
  • Collaborate within a diverse team to devise innovative algorithms and investigate the root causes of errors in existing implementations
  • Your Experience
  • Qualifications
  • Ph.D. in Machine Learning, Computer Science, Applied Mathematics, or equivalent practical background in Reinforcement Learning
  • 5+ years of practical experience applying various Reinforcement Learning methods, with focus on robotics in the real world
  • 3+ years of hands-on experience implementing and deploying robotic manipulation tasks, both in simulation and on physical robots
  • 3+ years of practical experience in Offline Reinforcement Learning, including algorithm development, implementation, and optimization for real-world use
  • Proven expertise in continual learning, employing adaptive model training to improve long-term performance and accuracy
  • 4+ years experience in developing and optimizing large-batch parallel simulations for Reinforcement Learning
  • Proven expertise in sim-to-real transfer
  • Experience in transitioning Machine Learning research and trained models into real-world production
  • Active involvement in integrating Machine Learning models into a robotics platform
  • A track record of publishing research in esteemed AI conferences such as Neurips, ICLR, ICML, and CORL
  • Skills
  • Development with Python 3.6 or later
  • Working knowledge of PyTorch and/or TensorFlow
  • Familiarity with ROS2
  • Expertise in use of Reinforcement Learning principles and their application
  • Experience with Atlassian tools; Jira, Confluence, or equivalent i.e. GitLab
  • Traits
  • Above all else, a consistently positive attitude and a willingness to do whatever it takes to create robust solutions to complex problems
  • Strong leadership skills in organizing R&D work for ML projects
  • Eager to take on new challenges with tenacity and positivity
  • Patience, persistence, and attention to detail when resolving performance issues
  • Enthusiasm for bringing human-like intelligence to machines
  • Ability to drive development of new functionalities from concept to production
  • Ability to multitask and prioritize in a fast paced environment
Responsibilities
  • Sanctuary-a multi award-winning LinkedIn Top Startup company-is seeking an Expert Scientist of Reinforcement Learning (RL) to join our team in engineering and innovating unique robotic manipulation tasks
  • As our Expert Scientist, your role will involve choosing the most cutting-edge methods, creating training and data collection systems, overseeing the evaluation of these algorithms in simulated environments, and implementing them on our robots in real-world situations. You will also enjoy the exclusive chance to make a meaningful impact by working with novel haptic and proprioceptive sensing techniques, thanks to our in-house robot resources