Software Engineer
Model Inference
Updated on 12/2/2023
OpenAI

501-1,000 employees

AI research and deployment company
Company Overview
OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's mission is to ensure that artificial general intelligence (AGI)—by which they mean highly autonomous systems that outperform humans at most economically valuable work—benefits all of humanity.
AI & Machine Learning
Social Impact
Venture Capital

Company Stage

Later Stage VC

Total Funding

$11.3B

Founded

2015

Headquarters

San Francisco, California

Growth & Insights
Headcount

6 month growth

-22%

1 year growth

85%

2 year growth

271%
Locations
San Francisco, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Microsoft Azure
Kubernetes
CategoriesNew
AI & Machine Learning
Software Engineering
Requirements
  • Experience with high-throughput scheduling as a service
  • Proficiency in testing, debugging, and maintaining systems written in low-level systems languages (C++ or Go)
  • Knowledge of modern AI architectures
  • At least 3 years of professional software engineering experience
  • In-depth understanding of network technologies from L1 to L7
  • Ability to own problems end-to-end and learn new knowledge as needed
  • Good intuition for when off-the-shelf solutions are applicable
  • Ability to work in a fast-paced environment with loosely defined tasks and competing priorities or deadlines
Responsibilities
  • Improve the reliability, security, scalability, and observability of distributed inference infrastructure
  • Build tools to identify bottlenecks and sources of instability and implement solutions
  • Ensure efficient use of AI models deployed on a large fleet of Azure VMs under Kubernetes
Desired Qualifications
  • Experience with supercomputing scale
  • Familiarity with AI research and deployment
  • Knowledge of safety considerations in AI development