G

GlobalFoundries

Semiconductor foundry delivering specialized chips

AI/ML Compiler & Runtime Software Engineer - AI SDK Team

Systems Software EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • 1–4 years of hands-on software engineering experience, with strong experience in compiler, runtime, embedded software, or AI/ML systems.
  • Strong hands-on experience with IREE, LLVM, and MLIR compiler infrastructure, including developing MLIR dialects, compiler passes, lowering pipelines, pattern rewrites, code-generation flows, or backend integration for custom hardware.
  • Good understanding of the IREE code-generation flow, dispatch formation, executable generation, HAL/runtime concepts, and target-specific lowering.
  • Strong exposure to AI compiler/runtime stacks used for edge AI or accelerator-backed inference.
  • Experience with AI model formats and frameworks such as PyTorch, ONNX, and TensorFlow Lite/TFLite, and related conversion or import flows.
  • Working knowledge of torch-mlir, TOSA, Linalg, tensor dialects, bufferization, quantization dialects, and MLIR-based model-lowering concepts.
  • Strong understanding of neural-network execution and optimization, including quantization, operator fusion, tensor layouts, memory planning, tiling, vectorization, and kernel selection.
  • Experience enabling or optimizing workloads for AI accelerators, NPUs, DSPs, vector processors, matrix engines, or custom SoC IP.
  • Strong C/C++ programming skills and Python scripting ability for compiler tooling, testing, automation, and model workflow integration.
  • Experience in Linux development environments, including cross-compilation, debugging, profiling, build systems, and runtime bring-up.
  • Strong debugging and problem-solving skills across compiler IR, generated code, runtime behavior, and hardware/software interaction.
  • Ability to work with architecture and hardware teams to understand accelerator capabilities and translate them into compiler/runtime enablement.
  • Proven ability to technically lead complex software modules, mentor engineers, and drive execution across cross-functional teams.

Responsibilities

  • Architect, design, and develop AI/ML compiler and runtime software for RISC-V-based IP, NPU, and SoC platforms.
  • Develop and enhance IREE-based compiler flows, including MLIR lowering, code generation, runtime integration, and deployment paths for edge AI workloads.
  • Create and maintain custom MLIR dialects, compiler passes, lowering pipelines, and transformation flows to map AI workloads efficiently to custom NPU and accelerator hardware.
  • Work across AI framework import paths, including PyTorch, ONNX, and TFLite, and enable lowering through torch-mlir, TOSA, Linalg, and related MLIR dialects.
  • Optimize neural-network workloads for edge deployment, including operator fusion, tiling, memory planning, quantization, layout transformation, and accelerator-aware scheduling.
  • Enable efficient execution of AI models across CPU, vector, matrix, and NPU acceleration paths while balancing latency, throughput, memory footprint, and power efficiency.
  • Collaborate with architecture, hardware, firmware, FPGA, validation, and product teams to bring up AI workloads on simulators, FPGA platforms, emulation environments, and silicon.
  • Analyze model performance, identify compiler/runtime bottlenecks, and drive optimizations across graph-level, operator-level, and kernel-level execution paths.
  • Define software architecture and technical direction for AI SDK components, including compiler pipelines, runtime interfaces, model deployment flows, and accelerator integration.
  • Build test infrastructure, validation flows, benchmark suites, and CI pipelines for AI compiler/runtime correctness, performance, and regression tracking.
  • Provide technical leadership to engineers working on AI compiler, runtime, model deployment, and edge AI software development.
  • Support software enablement, debugging, performance tuning, and deployment of AI workloads on target platforms with internal and customer-facing teams.

Desired Qualifications

  • Experience working on RISC-V, ARM, x86, DSP, GPU, or custom accelerator software stacks.
  • Familiarity with RISC-V Vector, matrix acceleration concepts, custom instructions, or accelerator-specific code generation.
  • Experience with edge AI deployment on real devices, development boards, FPGA platforms, emulators, simulators, or early silicon.
  • Familiarity with FPGA prototyping, Linux bring-up, board-level debugging, or pre-silicon software validation.
  • Exposure to LLM and edge inference stacks such as llama.cpp, GGML/GGUF, ONNX Runtime, TensorFlow Lite, TVM, and XNNPACK, including understanding quantization, memory-footprint optimization, kernel performance, and deployment constraints on resource-limited devices.
  • Experience with AI model benchmarking and optimization for vision, audio, transformers, GenAI, robotics, automotive, industrial, or real-time embedded workloads.
  • Understanding of hardware-software co-design, memory hierarchy, DMA, scratchpad memory, cache behavior, and accelerator data movement.
  • Experience with runtime systems, kernel libraries, microkernels, custom dispatch flows, or accelerator runtime APIs.
  • Familiarity with CI/CD and agile tools such as Jenkins, Git, CMake, Bazel, and Jira, or similar engineering infrastructure.
  • Experience working in customer-facing enablement, silicon bring-up, platform software, or SDK delivery environments.
  • Excellent communication and interpersonal skills, with the ability to explain complex compiler and AI runtime topics clearly to software, hardware, and product stakeholders.

About the Company

GlobalFoundries

Semiconductor foundry delivering specialized chips

GlobalFoundries is a semiconductor foundry that manufactures chips for a broad range of customers, focusing on feature-rich, reliable technologies for cars, IoT, 5G, and other high-growth markets. It operates by fabricating silicon wafers for customer designs, offering mature, specialized processes rather than chasing the most advanced nodes. This makes it different from peers that prize the latest process nodes; GlobalFoundries emphasizes diversification across a global manufacturing footprint (U.S., Europe, Singapore) and stable supply for essential applications. Its goal is to be a leading supplier of high-volume, specialty manufacturing that enables reliable chips for everyday devices and growing tech markets.

Company size
10,001+
Company stage
IPO
Headquarters
Town of Malta, New York
Founded
2009

Recently Posted Jobs

Explore more opportunities at GlobalFoundries

See more jobs