Principal Agentic AI Architect

Job Details:

Job Description:

Location: Shanghai, China
 

Role Overview

We are seeking aPrincipal Engineer – Agentic AI Architect to lead the design and development of next-generationagentic AI systems integrated withFPGA/ASIC platforms.

This role sits at the intersection of:

• Large Language Models (LLMs)

• Agent frameworks & autonomous systems

• Retrieval-Augmented Generation (RAG)

• Hardware-aware AI system design (FPGA / ASIC / EDA)

You will define architecture, drive technical strategy, and build scalable AI systems that bridgesoftware intelligence and hardware acceleration.

Key Responsibilities

AI Architecture & System Design

• Design and implementagentic AI systems using LLMs, tools, and multi-agent orchestration

• ArchitectRAG pipelines for enterprise-scale knowledge integration

• Defineend-to-end AI system architecture from data ingestion → reasoning → action

Agentic AI & LLM Development

• Develop advanced workflows using:

  • tool-using agents

  • planning & reasoning agents

  • multi-agent collaboration frameworks

• Evaluate and integrate leading LLMs (open-source and proprietary)

• Optimize prompt engineering, memory, and reasoning capabilities

Hardware-Aware AI Optimization

• Co-design AI systems with:

  • FPGA acceleration

  • ASIC platforms

  • heterogeneous compute (CPU/GPU/FPGA)

• ExploreLLM inference optimization on FPGA (quantization, compilation, partitioning)

• Collaborate with hardware teams onEDA and system integration

Framework & Platform Development

• Build internal platforms using

  • LangChain

  • LlamaIndex

  • custom agent orchestration framework

• Develop reusable components for:

  • memory management

  • tool integration

  • knowledge retrieval

Technical Leadership

• Lead architecture reviews and guide engineering teams

• Mentor senior engineers and influence cross-functional teams

• Drive innovation inAI + hardware convergence

What Makes This Role Unique

• Opportunity to defineagentic AI architecture for hardware-driven systems

• Work at the convergence of:

  • AI reasoning systems

  • FPGA acceleration

  • next-generation computing platforms

• High-impact role influencingfuture AI + semiconductor integration

Impact

You will help shape howAI agents interact with hardware, enabling:

• intelligent system orchestration

• real-time decision-making pipelines

• scalable AI deployment on FPGA platforms

Summary

This role is ideal for asenior technical leader who can:

• bridgeLLM + Agentic AI + RAG withFPGA/ASIC system architecture

• and drive innovation innext-generation AI systems.

Qualifications:

• Deep understanding of:

  • LLM architectures and inference

  • RAG systems and vector databases

  • Agentic AI / autonomous agents

• Hands-on experience building:

  • Production-grade LLM applications

  • Multi-step reasoning and orchestration workflows

  • Scalable and reliable AI systems in production

• Strong background in:

  • FPGA / ASIC / EDA systems

  • Heterogeneous computing architectures

• Familiarity with:

  • Hardware acceleration for AI workloads

  • Performance optimization across system stack

Technical Skills

• Programming:

  • Python

  • C++ (preferred)

• Experience with:

  • Distributed systems design

  • APIs and microservices architecture

  • Cloud and/or edge AI deployment

• Hands-on experience with:

  • LLM fine-tuning, quantization, and model distillation

  • On-device / edge AI deployment

  • Robotics, autonomous systems, or real-time AI pipelines

• Knowledge of:

  • Compiler stacks (e.g., MLIR, TVM)

  • AI model optimization for FPGA platforms

Job Type:

Regular

Shift:

Shift 1 (China)

Primary Location:

Shanghai, China

Additional Locations:

Posting Statement:

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.