M

MatX

Designs high-throughput AI hardware chips

Software Engineer - Kernels

Systems Software EngineeringUpdated on Nov 14
Full-timeMountain View, CA, USA

About the Job

Requirements

  • A Bachelor's degree in Computer Science or an equivalent degree is required.
  • At least 10 years of software development experience is required.
  • Experience optimizing software for specialized hardware using techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming is required.
  • Proficiency in at least one of assembly, C++, C, Zig, or Rust is required.

Responsibilities

  • Design and optimize kernels that interface directly with the hardware.
  • Work in partnership with the ML Research and Hardware Engineering teams.
  • Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack.
  • Work from the Mountain View, California office three days per week, Tuesday through Thursday.

Desired Qualifications

  • Experience implementing kernels for ML models such as Transformers.
  • Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, and tensor parallelism.
  • Familiarity with how compilers work.

About the Company

MatX

Designs high-throughput AI hardware chips

MatX builds high-throughput AI accelerators for large language models. Its main product is a dedicated chip where every transistor is optimized for running large neural networks, aiming to deliver strong performance for training and inference of LLMs. The company also develops the surrounding software stack, including compilers, to make the hardware easy to program for ML engineers (e.g., through JAX-based workflows). Unlike general-purpose processors, MatX focuses on specialization and full-stack optimization from silicon to software. Its goal is to enable organizations with substantial AI workloads to scale efficiently by providing powerful, purpose-built hardware and the compatible software tools they need to deploy and optimize large models.

Company size
51-200
Company stage
Series B
Total funding
$604.9M
Headquarters
Mountain View, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at MatX

See more jobs