E

EnCharge AI

Analog in-memory AI hardware and software

AI Runtime Engineer

Applied Machine Learning +1Confirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
  • Strong proficiency in C/C++ and low-level systems programming.
  • Deep understanding of task scheduling, concurrency, and memory hierarchy.
  • Experience with hardware-aware optimizations and dataflow architectures.
  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
  • Experience with low-latency, high-throughput workload execution for AI models.
  • Strong debugging and profiling skills for optimizing AI execution performance.
  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving).

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
  • Optimize data movement between host and device using PCIe, DMA, and shared memory.
  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, and vLLM.
  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.

About the Company

EnCharge AI

Analog in-memory AI hardware and software

EnCharge AI designs and sells AI-accelerating hardware and software for edge-to-cloud workloads, focusing on analog in-memory computing. Its products include chiplets, ASICs, PCIe cards, and flexible software that integrates across platforms. The approach uses semiconductor design to implement analog in-memory computing for fast AI processing with lower power and smaller footprint, compatible with existing systems. Compared with competitors, it prioritizes sustainability with lower CO2 emissions and total cost of ownership, backed by a leadership team with 20+ years in AI hardware and a track record of 350 million chips shipped, 150 patents, and 300 publications, and aims to democratize advanced AI by making it affordable and environmentally sustainable.

Company size
51-200
Company stage
Series B
Total funding
$162.9M
Headquarters
Santa Clara, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at EnCharge AI

See more jobs