C

Cartesia

Develops foundation models with subquadratic architectures

Research Engineer - Data Infrastructure, Language Modeling

Data EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • Hands-on experience with machine learning data infrastructure, including training data pipelines, dataset versioning, large-scale data loading, and the interplay between data systems and model training and inference.
  • Strong modern engineering execution, including clean, well-tested code and fluency with current tools.
  • Familiarity with building and evaluating datasets for generative models and reasonable working knowledge of how they are trained and how inference works.

Responsibilities

  • Build and operate performant, scalable data processing infrastructure for acquiring, ingesting, and combining massive text datasets.
  • Design and operate scalable, high-throughput, and reproducible data pipelines covering ingestion, preprocessing, filtering, deduplication, and augmentation.
  • Design and run ablation experiments to understand how data sources, processing choices, and mixture weights affect model quality.
  • Partner closely with research and infrastructure teams to co-design data loading, versioning, and experimentation pipelines.
  • Establish and enforce rigorous standards for data quality, with a tight feedback loop between dataset characteristics and model behavior.
  • Identify and source novel datasets; manage relationships and budgets with external data vendors and partners.

Desired Qualifications

  • Experience with large-scale data processing using parallel infrastructure such as Ray, Spark, or Kubernetes.
  • Experience with pretraining language models.

About the Company

Cartesia

Develops foundation models with subquadratic architectures

Cartesia.ai develops advanced AI foundation models using new subquadratic architectures and state space models. Its models are designed as underlying systems that can be adapted for many applications and are released in part under open-source licenses (e.g., Apache 2.0), with licensing, partnerships, and consulting as revenue streams. The companyโ€™s products work by providing large, adaptable AI models that clients can license or customize for specific needs, enabling faster processing and efficient inference compared to traditional designs. Cartesia differentiates itself from competitors by using subquadratic, state space approaches instead of relying mainly on standard Transformer models, and by combining open-source releases with enterprise partnerships. The goal is to help businesses and research institutions access powerful, adaptable AI capabilities while building a community around its technology and sustaining revenue through licensing and services.

Company size
51-200
Company stage
Late Stage VC
Total funding
$191M
Headquarters
San Francisco, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at Cartesia

See more jobs