S

Spiral

Open-source columnar DB with emergent schema

Developer Relations Engineer

Developer Relations & AdvocacyConfirmed live in the last 24 hours
Full-time$175k - $275k /yrIn-person

About the Job

Requirements

  • Experience doing machine-learning or training-infrastructure work, including familiarity with data-loading, video-decoding, or GPU-utilization challenges.
  • Strong technical writing ability, with examples of previously written work.
  • Fluency in Python and familiarity with the PyTorch, Hugging Face, and data-pipeline ecosystem.
  • A working understanding of GPUs, training loops, and performance bottlenecks.
  • Established connections in developer and/or AI communities.

Responsibilities

  • Write technical cookbooks and end-to-end examples for video ingestion, GPU data loading for training, and multimodal feature engineering.
  • Build and maintain reference pipelines using real datasets, including datasets on Hugging Face, and keep the pipelines working as the product evolves.
  • Produce benchmarks and accompanying writeups.
  • Advocate for developers internally by translating friction experienced by the employee and users into improvements to the product, client SDKs such as pyspiral, and documentation.
  • Answer user questions in GitHub, community channels, and conferences, and turn recurring questions into permanent documentation.
  • Represent Spiral at conferences.
  • Give occasional talks or workshops.
  • Collaborate with the team to create a feedback loop between developers/researchers and the product and documentation.
  • Conduct research on new applications of the core Spiral product as needed.

Desired Qualifications

  • Contributions to open-source projects in relevant areas, such as PyTorch data or DataLoader, Hugging Face datasets, Ray Data, or video-decoding tools.
  • Experience with columnar or analytical data formats.
  • An existing audience among machine-learning practitioners.
  • Prior developer-relations, AI research, or research-engineering experience.

About the Company

Spiral

Open-source columnar DB with emergent schema

Spiral builds Vortex, an open-source columnar database format designed to store diverse data types, including large values like images and videos, inside tabular structures. Its emergent schema lets users append columns or rows and enrich objects with new properties as data grows, avoiding rewrites and supporting millions of columns. The system uses a forest of LSM trees and object-storage formats, with features like cell push-down to boost performance and plans to integrate with Apache Arrow and Iceberg for interoperability. Its goal is to provide a high-performance, flexible analytics platform with storage–compute cohesion and a bring-your-own-compute model for scalable, evolving data workloads.

Company size
11-50
Company stage
Series A
Total funding
$22M
Headquarters
New York City, New York
Founded
2023

Recently Posted Jobs

Explore more opportunities at Spiral

See more jobs