W

Waabi

Autonomous trucking software licensing to OEMs

Technical Lead Manager - ML Dataset Platform

Engineering LeadershipConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Designed and built large-scale data infrastructure for machine-learning training, including storage formats, dataset versioning, extract-transform-load workflows, and data loading.
  • Understands performance characteristics of petabyte-scale sensor or multimodal data.
  • Very strong Python skills and comfort working in PyTorch training loops.
  • Strong software-engineering fundamentals and experience with distributed systems, cloud storage, and data-processing frameworks such as Spark, Ray, or Beam.
  • Led a platform or infrastructure effort used by multiple teams, defined its APIs, and drove adoption across an organization.
  • Managed or technically led a team of engineers, including hiring and mentoring, and can balance hands-on technical contribution with roadmap ownership and stakeholder management.
  • Communicates clearly with researchers and engineers, builds consensus across teams with different needs, and delivers in a fast-paced environment.

Responsibilities

  • Lead and grow the ML Dataset Platform team as its technical lead and people manager by setting technical direction, defining the roadmap, hiring, and mentoring engineers.
  • Define APIs, tools, and storage formats for machine-learning datasets, balancing data and tooling reuse with the specific needs of each training workload.
  • Build tooling to manage datasets at scale, including versioning and efficient incremental updates without full rebuilds.
  • Design APIs that let teams express training-time transformations along the continuum between reproducible ahead-of-time extract-transform-load and dynamic transformation within data loaders.
  • Own common data-loading tools used across workloads, including observability into bottlenecks and training-job throughput.
  • Streamline data access for multi-cloud training so datasets are available as needed with predictable cost and latency.
  • Make data lineage a fully automatic property of every dataset, from raw data through to the model trained on it.
  • Partner with the ML Training Platform team on the boundary between data and training infrastructure, and with ML development teams on transitioning shared-dataset tooling into the platform.
  • Drive adoption by working directly with model teams to migrate their training data onto the platform and feeding findings back into the team roadmap.

Desired Qualifications

  • Experience with machine-learning data infrastructure in autonomous driving or robotics, including multi-sensor logs, LiDAR, cameras, or high-definition maps.
  • Experience with columnar and tensor storage formats such as Parquet, Lance, WebDataset, and Zarr, and dataset-versioning tools.
  • Experience with multi-cloud or hybrid training environments and their data-movement challenges.
  • Experience with data lineage, metadata catalogs, or feature-store systems.

About the Company

Waabi

Autonomous trucking software licensing to OEMs

Waabi develops autonomous trucking technology. Its flagship Waabi Driver is a self-driving system that can be trained to make decisions, apply learned skills to new routes and terrains, and work with different hardware setups. A key part of its approach is Waabi World, a sophisticated simulation environment that lets the system be trained and tested virtually, reducing real-world driving miles, lowering costs, and increasing safety. The company licenses this technology to trucking fleets and OEMs for factory-level integration, aiming for large-scale commercialization. What sets Waabi apart is its emphasis on end-to-end training, geography and hardware adaptability, and its strong leadership in AI and self-driving research. Its goal is to bring safe, affordable autonomous trucking to scale by licensing the Waabi Driver to industry players and enabling widespread deployment.

Company size
201-500
Company stage
Series C
Total funding
$1B
Headquarters
Toronto, Canada
Founded
2021

Recently Posted Jobs

Explore more opportunities at Waabi

See more jobs