AI Compiler & Kernel Engineer - Software Engineering

Company:

Job Area:

Engineering Group, Engineering Group > Software Engineering

General Summary:

Qualcomm Cloud AI is seeking an experienced AI Compiler & Kernel Engineer to develop and optimize high-performance AI operators for large-scale cloud inference workloads. You will work across model, compiler, runtime, and hardware layers to maximize inference performance while minimizing memory footprint and resource utilization on Qualcomm Cloud AI platforms.

Key Responsibilities

• Develop and optimize AI kernels and operators for Qualcomm Cloud AI platforms.
• Enable and optimize LLM, MoE, and multimodal models for large-scale cloud inference.
• Drive accuracy, performance and efficiency optimizations across the software stack.
• Improve model memory footprint and ROM / RAM efficiency through kernel, graph, and compiler optimizations.
• Collaborate with performance and modeling teams to deliver best-in-class inference efficiency.
• Analyze and resolve performance bottlenecks using profiling, benchmarking, and modeling methodologies.

Required Qualifications

• Master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Electrical Engineering, or related fields.
• 5+ years of experience in Cloud AI inference, kernel/operator development, or AI compiler technologies.
• Good verbal and written English communication skills for effective collaboration across global teams.
• Proficiency in C++, Python, and Linux development environments.
• Deep understanding of Transformer architectures, such as LLMs, MoE, and modern foundation models.
• Strong experience with compiler technologies such as MLIR, Triton, TVM, or similar frameworks, including graph transformation, operator lowering, scheduling, operator fusion, kernel auto-tuning, code generation and memory scheduling.
• Strong experience with parallel computing architectures and performance optimization techniques, including vectorization, tiling, memory hierarchy optimization, and workload scheduling.
• Strong experience with graph optimization, model accuracy validation, performance optimization, and memory optimization.
• Solid experience in requirement analysis, system design, and end-to-end solution architecture.
• Solid experience in leading cross-functional engineering teams and delivering complex technical projects.

Preferred Qualifications

• Experience optimizing transformer-related operators such as Attention, FlashAttention, KV Cache, Embedding, GEMM, Softmax, and MoE routing is highly desirable.
• Hands-on experience developing custom operators and high-performance kernels, either manually or through compiler frameworks such as MLIR or Triton with AI accelerator platforms, such as GPUs, NPUs, TPUs, or custom AI hardware.

Minimum Qualifications:

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 6+ years of Software Engineering or related work experience.
OR
Master's degree in Engineering, Information Systems, Computer Science, or related field and 5+ years of Software Engineering or related work experience.
OR
PhD in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.

• 3+ years of work experience with Programming Language such as C, C++, Java, Python, etc.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

To all Staffing and Recruiting Agencies:Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

If you would like more information about this role, please contact Qualcomm Careers.