Full-Time

ML Compiler Backend Developer – Senior Staff

d-Matrix

d-Matrix

51-200 employees

AI inference platform with IMC technology

Data & Analytics
Hardware
AI & Machine Learning

Senior

Santa Clara, CA, USA

Required Skills
Tensorflow
Pytorch
Requirements
  • Bachelor's degree in Computer Science with minimum of 7+ years of industry experience or MSCS Preferred with 5+ Years of relevant industry experience.
  • Ability to deliver production quality code in modern C++.
  • Experience in modern compiler infrastructures, for example: LLVM, MLIR.
  • Experience in machine learning frameworks and interfaces, for example: ONNX, TensorFlow and PyTorch.
  • Experience in production compiler development.
  • Algorithm design ability, from high level conceptual design to actual implementation.
  • Experience with relevant Open Source ML projects like Torch-MLIR, ONNX-MLIR, Caffe, TVM.
  • Passionate about thriving in a fast-paced and dynamic startup culture.
Responsibilities
  • Developing the compiler backend, specifically the problem of assigning hardware resources in a spatial architecture to execute low level instructions.
  • Model partitioning (pipelined, tensor, model and data parallelism), tiling, resource allocation, memory management, scheduling and optimization (for latency, bandwidth and throughput).

d-Matrix stands out in the AI compute platform sector by specifically targeting the energy and cost challenges of large-scale AI inference with their in-memory computing (IMC) techniques and chiplet level interconnects. Their approach has led to a more efficient integration of memory and compute resources, which is critical for the demanding workloads of generative AI and large language models. By offering a scalable solution that adapts to various model sizes, d-Matrix provides a sustainable and economically viable platform for companies facing the growing energy demands of AI technologies.

Company Stage

Series B

Total Funding

$161.5M

Headquarters

Santa Clara, California

Founded

2019

Growth & Insights
Headcount

6 month growth

0%

1 year growth

47%

2 year growth

334%