S

Snorkel AI

Builds training data and test environments for AI

Senior / Staff Software Engineer - Platform

Platform EngineeringConfirmed live in the last 24 hours
Full-time$220k - $300k /yr

About the Job

Requirements

  • At least 5 years of experience building platform infrastructure, backend services, or production data systems, including pipelines, data access layers, distributed services, or ETL/ELT systems at scale.
  • Strong proficiency in Python and experience designing REST APIs for internal services and developers.
  • Strong background in distributed systems and cloud platforms, preferably AWS, with hands-on experience with S3, RDS, EKS, EventBridge, IAM, and Terraform-managed environments.
  • Familiarity with data orchestration tools such as Prefect, Airflow, or Dagster, and transformation frameworks such as dbt.
  • Understanding of data governance concepts including role-based access control, personally identifiable information handling, audit logging, and data lineage.
  • A track record of leading complex engineering initiatives, influencing stakeholders, and delivering measurable impact.
  • Ability to work in a fast-paced environment with strong technical communication skills.
  • Fluency with modern developer tooling and willingness to adopt new tools quickly.

Responsibilities

  • Design and build agent infrastructure that safely and reliably accelerates workflows for engineering and operations teams.
  • Design and implement event-driven data flows using event brokers, change data capture connectors, schema registries, event routing, and dead-letter queues, ensuring reliable event delivery and visible, recoverable failures.
  • Build systems that track data movement through the platform, enforce access controls, and log activity, including personally identifiable information handling, retention policy enforcement, and audit infrastructure for enterprise and regulatory compliance.
  • Set strategy and architecture for build systems, testing frameworks, and continuous integration and continuous deployment pipelines, and drive the transition toward robust automated continuous deployment.
  • Instrument services with OpenTelemetry, define and monitor service-level objectives such as query latency, pipeline success rates, and service reliability, and build alerting that identifies issues before incidents occur.
  • Participate in on-call support for the systems built by the team.
  • Contribute to infrastructure cost visibility and optimization through query cost estimation, workload right-sizing, and routing data to cost-effective storage tiers based on access patterns.
  • Collaborate with engineers, product managers, and designers to improve consistency and standards across codebases, infrastructure, and processes.

Desired Qualifications

  • Experience building shared libraries or software development kits consumed by multiple teams, including versioning, backward compatibility, and migration support.
  • Experience with event-driven architectures, including change data capture, event buses, schema registries, and at-least-once delivery semantics.
  • Experience with OpenTelemetry, ClickHouse, or similar observability infrastructure.
  • Prior work in regulated environments such as SOC 2, FedRAMP, or HIPAA, where compliance requirements shaped system design.
  • Experience with Ray or similar frameworks for distributed compute workloads.
  • Experience in hyper-growth startup environments or scaling engineering organizations.
  • Prior experience as a technical lead, team lead, or hands-on engineering manager.

About the Company

Snorkel AI

Builds training data and test environments for AI

Snorkel AI builds training datasets and simulated work environments for AI labs and companies developing models and software agents. Its data products combine expert demonstrations, scoring rules, and quality checks, while runnable environments let agents practice tasks such as coding or using business software. The company pairs domain specialists with its own data development technology to generate examples, evaluate model behavior, and refine weak areas through repeated feedback. Customers buy ready-made datasets or commission tailored data and evaluation work, and enterprises also use its specialized agent solutions. Snorkel AI was founded in 2019 and is headquartered in San Francisco, California.

Company size
201-500
Company stage
Late Stage VC
Total funding
$586.2M
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Snorkel AI

See more jobs