Full-Time

Engineering Product Manager

Ray Core

Posted on 10/22/2024

Anyscale

Anyscale

201-500 employees

Platform for scaling AI workloads

Enterprise Software
AI & Machine Learning

Compensation Overview

$237k - $284.6kAnnually

Senior, Expert

San Francisco, CA, USA

Hybrid position based in San Francisco, CA.

Category
Product Management
Product Strategy
Product
Required Skills
Product Management
Requirements
  • Experience building core distributed systems
  • Experience leading an open-ended project (Computer Science Systems research background is a plus)
  • Experience with operating data / ML infra in production is a plus
  • Solid engineering management experience leading productive, high-performing teams
  • Managing through other managers is a requirement
  • Record of helping teams scale quickly while maintaining a good culture
  • Experience going from 0-1 as a founder and a great track record of execution
  • Mindset towards achieving results, and excellent prioritization skills
  • Effective communication
Responsibilities
  • Drive the strategy of the Anyscale Ray Core (or Core Runtime) group
  • Drive the execution of Ray Core team’s key projects towards Ray 2.0 and beyond
  • Hiring, team Building: Build a world-class team of distributed systems engineers
  • Focus on building and maintaining a culture of collaboration within the team
  • Communicate your work to a broader audience through talks, tutorials, and blog posts
  • Work closely with our product team to enhance our distributed computing framework
  • Leading the charge in the OSS community to optimize our footprint and user experience
  • Help us to build and shape a world-class company

Anyscale provides a platform designed to scale and productionize artificial intelligence (AI) and machine learning (ML) workloads. Its main product, Ray, is an open-source framework that helps developers manage and scale AI applications across various fields, including Generative AI, Large Language Models (LLMs), and computer vision. Ray allows companies to enhance the scalability, latency, and cost-efficiency of their AI operations, with some users reporting improvements of over 90% in these areas. Anyscale's clients include major tech companies like OpenAI and Ant Group, who utilize Ray to train large models and improve their ML platforms. Unlike many competitors, Anyscale focuses on providing a comprehensive solution that integrates seamlessly into existing workflows. The company's goal is to empower organizations to efficiently scale their AI capabilities and optimize their operations.

Company Stage

Series C

Total Funding

$252.5M

Headquarters

San Francisco, California

Founded

2019

Growth & Insights
Headcount

6 month growth

99%

1 year growth

54%

2 year growth

147%
Simplify Jobs

Simplify's Take

What believers are saying

  • Anyscale's collaboration with Nvidia enhances AI capabilities and performance on their platform.
  • The launch of Anyscale Endpoints offers a 10X cost reduction for open-source LLMs.
  • Keerti Melkote's appointment as CEO follows a year of 4x revenue growth.

What critics are saying

  • The 'ShadowRay' vulnerability exposes sensitive data in Ray's AI workloads.
  • OctoML's OctoAI service presents competitive pressure with similar optimization solutions.
  • Rapid adoption of Ray may lead to scalability challenges and service disruptions.

What makes Anyscale unique

  • Anyscale's Ray framework allows seamless scaling from laptops to cloud environments.
  • Ray is widely adopted by tech giants like OpenAI and Ant Group for AI workloads.
  • Anyscale's SaaS model provides recurring revenue through subscription fees for Ray's features.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Medical, Dental, and Vision insurance

401K retirement savings

Flexible time off

FSA and Commuter benefits

Parental and family leave

Office & phone plan reimbursement

INACTIVE