P

Persimmons.ai

Generative AI inference accelerator for edge

Compiler Engineer - Frontend

Full-Time
No salary listed
Senior
Bachelor's, Master's, PhD
San Jose, CA, USA
In Person
Software EngineeringSystems Software Engineering
Company Does Not Provide H1B Sponsorship

About the job

Requirements
  • At least 6 years of experience in compiler development and deep knowledge of modern compiler frameworks including LLVM, MLIR, TVM, XLA, and IREE.
  • A proven track record of leading compiler or runtime systems projects from design through deployment.
  • Experience processing models from popular frameworks such as PyTorch, TensorFlow, and JAX, with familiarity with model architectures and workloads including transformers and diffusion models.
  • Familiarity with auto-scheduling and program synthesis techniques for high-performance machine-learning kernels, such as TVM, Halide, or Ansor, or experience with other hardware-aware scheduling techniques.
  • Familiarity with hardware architectures and their optimization implications, including memory hierarchies, systolic arrays, DMA engines, and GPU-style parallelism.
  • Fluency with modern artificial-intelligence tools and workflows, including using AI assistants for research, analysis, or productivity.
  • Strong C++ and Python skills.
  • A BS, MS, or PhD degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • Strong interpersonal, verbal, and written communication skills.
  • The capability to achieve objectives under tight deadlines.
  • Experience executing tasks while managing competing priorities.
  • Practical knowledge of working with large codebases.
  • Experience writing and debugging multithreaded programs.
  • Strong teamwork and the ability to guide and influence effectively within a dynamic matrix environment.
  • Excellent problem-solving skills and the ability to work in a dynamic, fast-paced environment.
Responsibilities
  • Design and build a compiler that converts AI models from popular machine-learning frameworks into assembly code running on accelerator hardware.
  • Develop and implement scheduling algorithms to improve technology performance.
  • Collaborate with cross-functional teams to design, test, and optimize hardware and software solutions.
  • Analyze and improve the efficiency, scalability, and performance of systems.
  • Monitor industry trends and advancements to maintain competitive and innovative solutions.
  • Provide technical leadership across the compiler team and mentor engineers in advanced compiler techniques.
  • Help scale the compiler team as the company grows.

About the company

Persimmons.ai designs and builds a flexible, low-power generative AI inference system as a fabless semiconductor company. Its main product is a generative AI accelerator and accompanying software stack for AI inference, targeting high compute density and scalable performance across both edge devices and data centers. The system combines hardware (chiplet-based accelerator architecture), algorithms, and compiler technology to optimize generative AI workloads efficiently. Unlike traditional single-die accelerators, Persimmons emphasizes a scalable, full-stack approach that integrates hardware, software, and compilers to maximize inference throughput per watt from edge to high-performance computing (HPC) environments. The company aims to deliver a practical solution that enables dense, energy-efficient AI inference at scale for diverse deployment locations and workloads.

Company Size

11-50

Company Stage

N/A

Total Funding

N/A

Headquarters

San Jose, California

Founded

2023

Get referred to Persimmons.ai

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • August 2026 hiring for compiler and silicon roles signals active buildout and capital access.
  • SkyeChip’s November 2025 IP licensing deal validates Persimmons’ chiplet platform and partnerability.
  • Leadership pages list veterans from Nvidia, Intel, Microsoft, Amazon, and Apple, strengthening credibility.

What critics are saying

  • No verified funding or customer disclosures surfaced by August 2026, signaling weak commercial traction.
  • Public job listings for compiler and silicon engineers imply heavy pre-tapeout execution risk in 2026.
  • A failed first silicon or missed software stack would leave Persimmons.ai boxed out by Nvidia.

What makes Persimmons.ai unique

  • Persimmons.ai’s chiplet-based inference stack targets edge devices and data centers with one architecture.
  • June 2026 job posts show deep compiler, RTL, and physical-design integration under one roof.
  • The company markets full-stack control over hardware, compilers, and model optimization for inference.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Unlimited Paid Time Off

401(k) Retirement Plan

401(k) Company Match

Growth & Insights

Headcount

6 month growth

4%

1 year growth

0%

2 year growth

10%