Full-Time

Software Engineer

Model Inference

Posted on 7/15/2024

OpenAI

OpenAI

1,001-5,000 employees

Develops safe and beneficial AI technologies

AI & Machine Learning

Mid

San Francisco, CA, USA

Category
Backend Engineering
Software Engineering
Required Skills
Kubernetes
Microsoft Azure
Go
C/C++
Requirements
  • Have experience with high-throughput scheduling as a service, particularly at supercomputing scale.
  • Are proficient in testing, debugging, and maintaining systems written in low-level systems languages, particularly C++ or Go.
  • Either know or can quickly learn the fundamentals of modern AI architectures.
  • Have at least 3 years of professional software engineering experience.
  • Know network technologies inside and out from L1 to L7.
  • Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done.
  • Have a good intuition for when off-the-shelf solutions will work, and build tools to accelerate your own workflow quickly if they won’t.
  • Have the ability to move fast in an environment where things are sometimes loosely defined and may have competing priorities or deadlines.
Responsibilities
  • Improve the reliability, security, scalability, and observability of our distributed inference infrastructure.
  • Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues.
  • Ensure the most efficient use of a constellation of different state-of-the-art AI models deployed on a large, heterogeneous fleet of Azure VMs under Kubernetes.

OpenAI develops artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models that can perform various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the capabilities of their AI systems. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and redistributes excess earnings to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission. OpenAI collaborates with businesses, researchers, and government entities to ensure responsible AI deployment, making it a leader in the AI industry.

Company Stage

Late Stage VC

Total Funding

$18.4B

Headquarters

San Francisco, California

Founded

2015

Growth & Insights
Headcount

6 month growth

64%

1 year growth

181%

2 year growth

444%
Simplify Jobs

Simplify's Take

What believers are saying

  • Entry into smart robots opens new revenue streams in robotics and automation.
  • Transformation into a Public Benefit Corporation could attract socially responsible investors.
  • Rapid AI model releases allow OpenAI to maintain leadership in state-of-the-art models.

What critics are saying

  • Rapid AI model releases may cause industry fatigue and slower technology adoption.
  • Competition in smart robots from Nvidia's Jetson Thor platform is a significant challenge.
  • Regulatory complexities may arise from transforming into a Public Benefit Corporation.

What makes OpenAI unique

  • OpenAI's capped profit model ensures ethical AI development and social benefit focus.
  • The company is pioneering in AGI, aiming for AI systems smarter than humans.
  • OpenAI's open API fosters global collaboration with developers and businesses.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health insurance

Dental and vision insurance

Flexible spending account for healthcare and dependent care

Mental healthcare service

Fertility treatment coverage

401(k) with generous matching

20-week paid parental leave

Life insurance (complimentary)

AD&D insurance (complimentary)

Short-term/long-term disability insurance (complimentary)

Optional buy-up life insurance

Flexible work hours and unlimited paid time off (we encourage 4+ weeks per year)

Annual learning & development stipend

Regular team happy hours and outings

Daily catered lunch and dinner

Travel to domestic conferences

INACTIVE