C

Cerebras

AI accelerator hardware replacing GPUs

Full Stack Machine Learning Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedHybrid

About the Job

Requirements

  • Strong programming skills in C++ and Python.
  • Hands-on experience bringing up and debugging machine learning models in PyTorch or a comparable framework.
  • Practical experience with MLIR, including dialects, rewrite patterns, transformation passes, and lowering pipelines.
  • Understanding of compiler fundamentals, including intermediate representations, dataflow analysis, and code generation.
  • Understanding of transformer architectures, attention mechanisms, tensor operations, and numerical precision.
  • Experience profiling and optimizing workloads on GPUs or other AI accelerators.
  • Ability to debug correctness and performance issues across model code, compiler-generated code, kernels, and runtime execution.

Responsibilities

  • Bring up new models by understanding model architectures, loading and converting weights, implementing supported execution paths, and establishing correctness against reference implementations.
  • Lower models to hardware using MLIR by developing and extending dialects, graph transformations, lowering passes, and hardware-specific mappings.
  • Support model operations such as attention, matrix multiplication, normalization, positional embeddings, and other operators through compiler and kernel changes.
  • Optimize execution through operator fusion, tensor layouts, tiling, memory allocation, data movement, and parallel execution.
  • Optimize inference by tuning prefill and decode performance, KV cache management, batching, and quantization to improve latency, throughput, and memory efficiency.
  • Validate model quality by investigating numerical differences and measuring the accuracy impact of precision changes and compiler optimizations.
  • Diagnose bottlenecks using profiling, execution traces, and hardware counters to identify compute, memory, communication, and runtime limitations.
  • Work closely with hardware, compiler, kernel, and runtime teams to deliver reliable model support and repeatable performance benchmarks.

Desired Qualifications

  • Experience with LLM inference, including GQA, sliding-window attention, MoE, KV caching, and speculative decoding.
  • Experience with FP16, BF16, FP8, or low-bit quantization and their accuracy and performance tradeoffs.
  • Experience developing accelerator kernels or hardware-specific compiler backends.
  • Familiarity with distributed execution, model parallelism, and accelerator memory hierarchies.
  • Contributions to MLIR, LLVM, inference frameworks, or related open-source projects.

About the Company

Cerebras

AI accelerator hardware replacing GPUs

Cerebras Systems creates AI acceleration hardware and software. Its CS-2 system is designed to replace traditional GPU clusters for AI workloads, speeding up training and inference while simplifying the setup by eliminating the need for parallel programming, distributed training, and cluster management. The product works as a single, large processor-based accelerator with accompanying software and cloud services to run AI models efficiently, reducing latency and time to results. Compared with competitors, Cerebras differentiates itself with the largest processor in the industry and an integrated hardware-software stack that aims to streamline AI workflows rather than relying on multi-GPU clusters. The company's goal is to help research labs, healthcare, finance, and other industries achieve faster, more cost-effective AI development and deployment by offering a turnkey high-performance AI compute solution.

Company size
501-1,000
Company stage
IPO
Headquarters
Sunnyvale, CA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Cerebras

See more jobs