Full-Time

Product Manager

AI Platform

Updated on 3/14/2025

Anyscale

Anyscale

501-1,000 employees

Platform for scaling AI workloads

Compensation Overview

$180.2k - $214kAnnually

+ Stock Options + Healthcare Plans

Mid, Senior

Palo Alto, CA, USA + 1 more

More locations: San Francisco, CA, USA

This is a hybrid role, requiring some in-office presence.

Category
Product Management
Product
Required Skills
Product Management
Requirements
  • A technical background, with 2+ years of experience in software engineering and 2+ years in product management roles
  • Experience with billing and pricing systems including trial programs and product packaging
  • Familiarity with enterprise identity models, such as role-based access control, SCIM, and user provisioning
  • Proven ability to design customer-centric solutions, especially in onboarding flows, fraud prevention, and organizational embedding of SaaS platforms
  • Strong customer-facing experience in a B2B SaaS/PaaS environment, with a focus on addressing enterprise needs
  • Exceptional skills in prioritization and execution, particularly in high-impact projects with tight deadlines
Responsibilities
  • Lead strategic initiatives to enhance the Anyscale Platform, focusing on billing, identity, permissions, onboarding, and fraud detection
  • Collaborate with engineering teams to develop scalable, robust infrastructure components such as billing pipelines, marketplace integrations, and advanced user management systems
  • Engage with customers and stakeholders to understand pain points and translate them into innovative, value-driven solutions that simplify AI platform operations
  • Define and prioritize roadmaps for critical projects, including platform isolation, role-based access control, SCIM provisioning, and onboarding and trial flows
  • Optimize the customer journey, ensuring seamless onboarding experiences and implementing fraud detection measures to enable growth-oriented strategies
  • Contribute to the evolution of the Anyscale object model, aligning resource hierarchies and identity frameworks to enterprise needs

Anyscale provides a platform designed to scale and productionize artificial intelligence (AI) and machine learning (ML) workloads. Its main product, Ray, is an open-source framework that helps users manage and enhance AI applications across various fields, including Generative AI, Large Language Models (LLMs), and computer vision. Ray allows companies to improve the scalability, latency, and cost-efficiency of their AI operations, with some clients experiencing performance improvements of over 90%. Anyscale serves a range of clients, including major tech companies like OpenAI and Ant Group, who rely on Ray to train large models and enhance their ML platforms. Unlike many competitors, Anyscale focuses on providing a comprehensive solution that integrates seamlessly into existing workflows. The company's goal is to empower organizations to effectively scale their AI initiatives and optimize their operational efficiency.

Company Size

501-1,000

Company Stage

Series C

Total Funding

$252.5M

Headquarters

San Francisco, California

Founded

2019

Simplify Jobs

Simplify's Take

What believers are saying

  • Anyscale's $100M Series C funding indicates strong investor confidence and growth potential.
  • Partnership with Nvidia enhances performance and cost-efficiency for AI deployments.
  • Anyscale Endpoints offers 10X cost-efficiency for popular open-source LLMs.

What critics are saying

  • ShadowRay vulnerability in Ray framework poses significant security risk with no patch.
  • OctoML's OctoAI service increases competition in AI infrastructure market.
  • Dependency on Nvidia's technology could be risky if Nvidia faces issues.

What makes Anyscale unique

  • Anyscale's Ray framework scales AI applications from laptops to cloud seamlessly.
  • Ray is widely used in Generative AI, LLMs, and computer vision fields.
  • Anyscale's SaaS model provides recurring revenue through subscription fees for Ray platform.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Medical, Dental, and Vision insurance

401K retirement savings

Flexible time off

FSA and Commuter benefits

Parental and family leave

Office & phone plan reimbursement

Growth & Insights and Company News

Headcount

6 month growth

18%

1 year growth

6%

2 year growth

-5%
Blockchain News
Oct 29th, 2024
Anyscale and Astronomer Collaborate to Enhance Scalable Machine Learning

This partnership allows organizations to effectively manage and scale their ML workflows by integrating Astronomer's workflow management capabilities with Anyscale's distributed computing power.

Datanami
Oct 1st, 2024
Anyscale Unveils New Products and AI Platform Enhancements at Ray Summit 2024

Anyscale unveils new products and AI Platform enhancements at Ray Summit 2024.

Financial Post
Jul 31st, 2024
Anyscale Names Industry Veteran Keerti Melkote Chief Executive Officer

SAN FRANCISCO, July 31, 2024 (GLOBE NEWSWIRE) - Anyscale, the company behind Ray, the open source framework for scalable AI, named industry veteran Keerti Melkote as chief executive officer following a year of 4x revenue growth and explosive open source adoption.

Blockchain News
Jun 6th, 2024
Anyscale and deepsense.ai Collaborate on Cross-Modal Search for E-commerce

Anyscale and deepsense.ai develop a scalable cross-modal image retrieval system for e-commerce.

VentureBeat
Mar 27th, 2024
‘Shadowray’ Vulnerability On Ray Framework Exposes Thousands Of Ai Workloads, Compute Power And Data

Join us in Atlanta on April 10th and explore the landscape of security workforce. We will explore the vision, benefits, and use cases of AI for security teams. Request an invite here. Thousands of companies use the Ray framework to scale and run highly complex, compute-intensive AI workloads — in fact, you’d be hard-pressed to find a large language model (LLM) that hasn’t been built on Ray. Those workloads contain loads of sensitive data, which, researchers have found, could be highly exposed through a critical vulnerability (CVE) in the open-source unified compute framework. For the last seven months, this flaw has allowed attackers to exploit thousands of companies’ AI production workloads, computing power, credentials, passwords, keys, tokens and “a trove” of other sensitive information, according to new research from Oligo Security. The vulnerability is under dispute — meaning that it is not considered a risk and has no patch. This makes it a “shadow vulnerability,” or one that doesn’t appear in scans. Fittingly, researchers have dubbed it “ShadowRay.”