Staff GenAI Evaluation Engineer

Qualcomm AI Research looking for talented machine learning algorithm evaluation engineers with experience in machine learning to enable embedded GenAI. Come join a high-caliber team of engineers building advanced machine learning technology, best-in-class solutions, tools such as AI Model Efficiency Toolkit, Snapdragon Neural Processing Engine (SNPE) SDK and others to enable state-of-the-art networks/systems to run on devices with limited power, memory, and computation. Join Qualcomm’s AI Research team to design and implement highly optimized machine learning solutions for generative AI, in collaboration with a multi-disciplinary team of researchers and engineers.

Responsibilities:

• As GenAI evaluation engineer, work with world-class engineers at Qualcomm Research to evaluate ML software tools and algorithms to ensure they meet quality standards
• Learn the latest cutting-edge technologies in machine learning and new emerging applications and participate in each step of the development process and drive quality improvements.
• Port AI/ML solutions to various platforms and optimize the performance on multiple hardware accelerators (like CPU/GPU/NPU)
• Collaborate with members of the software teams and plan a comprehensive evaluation approach.
• Work with a small team of engineers to implement the evaluation strategy, deciding key performance metrics (KPIs), developing automation, and performing qualitative tests.
• Develop a deep understanding of the ML algorithms developed in the project.
• Apply tools and algorithms on wide variety of use cases, develop best practices, provide detailed analysis, extend research, and identify areas for further optimization.

Required Skills:

• Great at software development with excellent analytical, development, and debugging skills.
• Strong understanding of Machine Learning fundamentals.
• Understanding of generative AI and its usage in various application
• Experience with LLM, LVM, LMM models, and other NN architectures.
• Proficiency in designing, implementing and training ML algorithms in high-level languages/frameworks (PyTorch and TensorFlow).
• Excellent interpersonal, written, and oral communications skills

Preferred Skills:

• MS or PhD in Computer Science/Engineering
• 5+ years of proven experience in software development for GenAI, machine learning or high-performance computing with strong programming skills in Python and software design.
• Familiarity with AI agent frameworks (like LangChain, LlamaIndex, Autogen).
• Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT).
• Experience with machine learning accelerators, optimizing algorithms for hardware acceleration cores, working with heterogeneous or parallel computing systems.
• Design and develop generalized AI solutions, including RAG systems, to enhance user capabilities with our AI accelerators.
• Experience in Android/Linux or other embedded systems.

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail [email protected] or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).