Full-Time

Research Engineer

Confirmed live in the last 24 hours

Anyscale

501-1,000 employees

Scalable compute platform for AI, Python

AI & Machine Learning

Compensation Overview

$170,112 - $237,000Annually

+ Equity + Stock Options + Wellness Stipend + Education Stipend + Paid Parental Leave + Flexible Time Off + Commute Reimbursement + In-Office Meals Covered

Mid

San Francisco, CA, USA

Required Skills

Data Structures & Algorithms

Requirements

3+ years of experience working as an applied scientist, research engineer, or software engineer focused on LLMs
Solid fundamentals in algorithms, data structures, system design
Domain expertise in LLMs and generative AI
Experience working with systems engineering aspects of LLMs (e.g. distributed training, autoscaling inference etc)
Experience with approaches to LLM model improvement and fine-tuning (such as LoRA and RLHF)
Published research in the Gen AI space
Experience using Ray

Responsibilities

Build extensions to existing open source LLMs such as adding support for function templates
Push the boundaries of existing LLM applications (e.g. building cutting edge question answering applications)
Develop features to enable production deployment of LLMs (e.g. what does CI for LLMs look like? How do you do evals of LLMs)
Work on systematically improving the quality of LLM Application
Jointly define your own projects as the ecosystem evolves
Work closely with the first 50 users of the things you build
Help build a world-class company

About Anyscale:

At Anyscale, we’re on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that’s creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role:

We are looking for people who want to enable developers in the upcoming Generative AI/LLM revolution. We’re hiring exceptional Software Engineers and Research Engineers (or hybrids of the two) to help us build out Anyscale’s LLM offering, building on our work on high-performance LLM inference

We’re looking for passionate, motivated people who are excited to build advanced LLM applications as well as the platform and infrastructure to enable them.

We are particularly looking for Senior or staff and above candidates who can help and execute on a vision for the future of generative AI. We are open to both Individual Contributors and people who are primarily technical but have prior experience managing a small team.

As part of this role, you will

Build extensions to existing open source LLMs such as adding support for function templates.
Push the boundaries of existing LLM applications (e.g. building cutting edge question answering applications)
Develop features to enable production deployment of LLMs (e.g. what does CI for LLMs look like? How do you do evals of LLMs)
Work on systematically improving the quality of LLM Application
Jointly define your own projects as the ecosystem evolves.
Work closely with the first 50 users of the things you build.
Help us build a world class company.

We’d love to hear from you if you have:

3+ years of experience working as an an applied scientist, research engineer or software engineer focused on LLMs.
You enjoy coding for 50% or more of your time.
Solid fundamentals in algorithms, data structures, system design
Domain expertise in LLMs and generative AI.

Bonus points!

Experience working with systems engineering aspects of LLMs (e.g. distributed training, autoscaling inference etc)
Experience with approaches to LLM model improvement and fine tuning (such as LoRA and RLHF)
Published research in the Gen AI space
Experience using Ray

Compensation

At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
This role is also eligible to participate in Anyscale’s Equity and Benefits offerings, including the following:Stock Options
Healthcare plans, with premiums covered by Anyscale at 99%
401k Retirement Plan
Wellness stipend
Education stipend
Paid Parental Leave
Flexible Time Off
Commute reimbursement
100% of in office meals covered

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Anyscale

View

Website

View Company Profile

Anyscale provides a scalable compute platform for AI and Python applications, utilizing Ray and distributed computing technologies for reinforcement learning, deep learning, and model serving. The platform supports various use cases such as large language models, demand forecasting, industrial automation, NLP, and recommendation systems.

Company Stage

Series C

Total Funding

$259.6M

Headquarters

San Francisco, California

Founded

2019

Growth & Insights

Headcount

6 month growth

↓ -3%

1 year growth

↑ 44%

2 year growth

↑ 239%

Benefits

Medical, Dental, and Vision insurance

401K retirement savings

Flexible time off

FSA and Commuter benefits

Parental and family leave

Office & phone plan reimbursement