Software Engineer

ML Platform

Confirmed live in the last 24 hours

Locations

San Francisco, CA, USA

Experience Level

Entry

Junior

Mid

Senior

Expert

Desired Skills

Data Structures & Algorithms

Pytorch

Tensorflow

Requirements

Solid background in algorithms, data structures, system design
Experience working with modern machine learning tooling (PyTorch, Tensorflow, JAX)
At least 1+ year of relevant work experience

Responsibilities

Building a highly available service for ML model serving
Improve Ray Serve and our other libraries to make authoring next-generation production ML applications as easy as possible
Improve our autoscaling capabilities to drive performance improvements & cost savings
Reduce latency and improve throughput for single- and multi-model serving

Desired Qualifications

Experience building and maintaining an open source project
Experience building and operating machine learning infrastructure in production
Experience building highly available serving systems

About Anyscale:

At Anyscale, we’re on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that’s creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

We’re a San Francisco based company, proud to be backed by $250+ million from top-tier investors like Andreessen Horowitz, NEA, and Addition.

About the role:

Anyscale is looking to hire strong engineers to build next generation high-performance machine learning serving systems (both our open source libraries and SaaS offering).

Much of the tooling used to serve ML models today is inherited from the previous generation of infrastructure, but emerging ML applications come with a new set of requirements: high compute requirements, the need for specialized hardware, and composing many different models along with business logic in a single request.

Our goal is provide a simple but powerful set of tools to make bringing complex ML applications to production a reality.

About the Platform team:

The Platform team’s mission is to build world class systems for serving ML models in production. Part of this work is building and maintaining the open source Ray Serve library, as well as contributing directly to the Anyscale platform used by our customers to run mission-critical applications.

Much of our work is user-facing: you’ll have the opportunity to collaborate with open source users and customers from small startups with lean ML engineering teams to industry-leading companies using Ray, such as Uber, Shopify, and ByteDance.

As part of this role, you will:

Building a highly available service for ML model serving
Improve Ray Serve and our other libraries to make authoring next-generation production ML applications as easy as possible
Improve our autoscaling capabilities to drive performance improvements & cost savings
Reduce latency and improve throughput for single- and multi-model serving

We’d love to hear from you if you have:

Solid background in algorithms, data structures, system design
Experience working with modern machine learning tooling (PyTorch, Tensorflow, JAX)
At least 1+ year of relevant work experience

Bonus points!

Experience building and maintaining an open source project
Experience building and operating machine learning infrastructure in production
Experience building highly available serving systems

Compensation

At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.

This role is also eligible to participate in Anyscale’s Equity and Benefits offerings, including the following:

Stock Options
Healthcare plans, with premiums covered by Anyscale at 99%
401k Retirement Plan
Wellness stipend
Education stipend
Paid Parental Leave
Paid Time Off
Commute reimbursement
100% of in office meals covered

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

51-200 employees

Website

Application development platform

Company Overview

Anyscale’s mission is to make distributed computing simple and accessible for engineers. The company is building a framework for running machine learning applications at any scale

Benefits

Medical, Dental, and Vision insurance
401K retirement savings
Flexible time off
FSA and Commuter benefits
Parental and family leave
Office & phone plan reimbursement

Company Core Values

Empathy, Trust, and Candor. Being empathetic helps build trust in our community and company, and fosters successful decision-making.
Always Be Learning. We learn eagerly, from different teams within and outside the company. Respectful debate makes our company stronger.
Act Like an Owner. We have a strong ownership mentality. Every person on the team has the potential to make a huge impact.
Bias for Action. We practice high-velocity decision-making, despite encountering ambiguity frequently.