Principal Enterprise AI Architect

Join the Enterprise AI & Automation team in NVIDIA IT to architect the future of agentic AI at scale. NVIDIA’s Enterprise AI Platform powers AI agents to transform employee productivity and accelerate business impact. As the lead enterprise AI architect, you will design, evangelize, and implement the architectural foundations of this platform. You will guide the vision for orchestration, integration, security, and lifecycle management of AI agents, ensuring the platform delivers trusted, scalable, and innovative solutions. This is a rare opportunity to define the blueprint for enterprise AI agents inside one of the world’s most advanced AI companies. If you thrive at the intersection of systems architecture, AI innovation, and enterprise transformation, join us and make your mark on the future of agentic AI.

What you will be doing:

• Define and evolve the architecture for NVIDIA’s Enterprise AI Platform, including frameworks for agent orchestration, multi-agent coordination, RAG, deployment, monitoring, and life cycle management.

• Architect and enable data flywheels that drive continuous improvement of AI agents through evaluation, feedback, and iteration loops.

• Partner with engineering, product, and research teams to shape platform strategy and roadmaps, while evaluating LLMs, agentic frameworks, and NVIDIA’s own NeMo and AIQ technologies.

• Ensure integration with enterprise data sources and tools (e.g., ServiceNow, Salesforce, SAP, Workday, GDrive, SharePoint, Confluence) with strong content security focus.

• Drive architectural decisions across deployment models (on-prem, cloud, hybrid, containerized) to deliver scalable, reliable, and efficient solutions.

• Lead design reviews, develop technical documentation, and mentor engineers in principles of architecture and code development.

• Champion observability, monitoring, versioning, and telemetry to ensure trustworthy and auditable AI agents.

• Influence enterprise adoption of the platform by partnering with stakeholders across IT, chip design, supply chain, sales, finance, and HR, and serve as a reference adopter providing feedback to strengthen NVIDIA’s ecosystem.

What we need to see:

• Bachelor’s degree in Computer Science or related field (or equivalent experience); Master’s or PhD preferred.

• 15+ years of demonstrable experience in software architecture, systems design, or enterprise platform engineering.

• Deep expertise in architecting large-scale distributed systems with a focus on reliability, performance, and security.

• Demonstrate proficiency in AI/ML systems, generative AI, or agentic AI frameworks.

• Familiarity with large language models, RAG pipelines, orchestration frameworks (e.g., ReAct, LangChain, AutoGPT-like flows).

• Experience integrating enterprise platforms (e.g., ERP, CRM, ITSM) with APIs, data connectors, or custom services.

• Hands-on development of AI agents, frameworks, and tooling, including setting architectural and coding standards.

• Solid understanding of security, governance, and compliance for AI in enterprise contexts.

• Excellent collaboration skills with the ability to influence cross-functional stakeholders and build trusted partnerships.

• Ability to communicate complex architectural concepts clearly and inspire confidence across technical and business audiences.

Ways to stand out from the crowd:

• Hands-on experience with containerized deployments, Kubernetes, and hybrid cloud/on-prem environments.

• Prototyping skills in Python with ability to build proof-of-concept agent workflows.

• Experience with NVIDIA AI technologies such as NeMo, NeMo Guardrails, AIQ, or GPU-optimized inference stacks.

• Track record of publishing technical papers, architecture patterns, or thought leadership in AI systems.

• Knowledge of observability tools, telemetry dashboards, and evaluation frameworks for AI agent performance as well as experience solving real-world problems with AI in IT, supply chain, or finance domains.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and creative people in the world working here! If you are driven by impact, passionate about enterprise AI, and inspired to shape the blueprint of agentic AI at scale, we want to hear from you. Apply today!

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD.Applications for this job will be accepted at least until January 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.