S

Scale AI

Supplies AI training data and builds AI apps

Staff Software Engineer - Data Platform

Backend EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • At least 8 years of full-time engineering experience after graduation, specializing in back-end systems and building large-scale data storage, streaming, and warehousing systems.
  • Extensive experience with database technologies such as MongoDB and Postgres; streaming and processing solutions such as Kinesis, Flink, and Spark; indexing and caching technologies such as Elasticsearch and Redis; and data query engines such as Trino, Presto, and Snowflake.
  • Experience working with containerization and deployment technologies such as Kubernetes and public cloud offerings.
  • Extensive experience in software development and a deep understanding of distributed systems, cloud platforms, and data systems.
  • Experience driving cross-functional collaboration and communication at an organizational or broader level.

Responsibilities

  • Drive the architecture, design, implementation, and reliability of foundational data platforms and systems, working with stakeholders and internal customers to understand and refine requirements.
  • Collaborate with cross-functional teams to define, design, and deliver new features.
  • Identify opportunities to improve programming practices, including process enhancements and tool upgrades.
  • Present technical information to teams and stakeholders, providing guidance on development processes and technologies.
  • Provide technical leadership by upholding and improving engineering standards across the organization and mentoring junior engineers.

Desired Qualifications

  • Strong knowledge of software engineering best practices and continuous integration and continuous delivery tooling such as CircleCI.
  • Experience with performance tuning and cost optimization of cloud-based data platforms.
  • Experience defining a data lifecycle strategy and designing or implementing tooling for data privacy requirements such as GDPR.
  • Experience scaling products at high-growth startups.
  • Interest in working with artificial intelligence technologies.
  • A track record of mentoring and leading teams in successful projects.
  • Excellent communication and collaboration skills, and the ability to translate complex technical concepts for non-technical stakeholders.

About the Company

Scale AI

Supplies AI training data and builds AI apps

Scale AI supplies the data that AI labs use to train and test their models, and it builds custom AI applications for companies and government agencies such as the Pentagon. It first made its name labeling camera and sensor data for self-driving car companies like Waymo, then worked with OpenAI on InstructGPT, the 2022 forerunner of ChatGPT. Freelancers, some of them doctors and lawyers, write, label, and grade examples through its Outlier platform, and labs pay Scale for this data and for tests of model quality. Clients pay Scale to build AI tools on their own data, and some of those tools run on classified military networks. Alexandr Wang and Lucy Guo founded Scale AI in 2016, and it is based in San Francisco.

Company size
1,001-5,000
Company stage
Acquired
Total funding
$1.6B
Headquarters
San Francisco, CA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Scale AI

See more jobs