A

Accenture

Advises businesses and runs their technology

AI Infrastructure Architect

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • Minimum 15 years of experience is stated in the project role information.
  • A bachelor's degree or equivalent in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline is required.
  • At least 12 years of overall experience in software engineering, data engineering, AI/ML engineering, cloud architecture, or enterprise technology architecture is required.
  • At least 8 years of experience designing and deploying enterprise-grade advanced AI, data, analytics, or cloud-native solutions using at least one cloud vendor is required.
  • At least 2 years of experience in LLM and generative AI solution architecture, including agentic AI, RAG, prompt engineering, model integration, and evaluation patterns is required.
  • At least 2 years of experience architecting and operationalizing LLM-driven application architecture patterns in production or enterprise-scale environments is required.
  • At least 6 years of experience in engineering, machine learning, deep learning, NLP solutions, data engineering, or large-scale analytical engineering applications is required.
  • Demonstrated experience as a senior architect in financial services, healthcare, manufacturing, retail, telecom, or life sciences, aligning technology choices with business, risk, and compliance expectations is required.
  • Deep architecture and hands-on engineering experience with Databricks Mosaic AI, Model Serving, Agent Framework, MLflow tracing and evaluation, Vector Search, Unity Catalog, Delta Lake, Delta Live Tables, Lakehouse Monitoring, Feature Store, Databricks Workflows, Jobs, and Model Training is required.
  • Ability to shape enterprise-grade AI architecture covering RAG, embeddings, vector databases, semantic retrieval, context engineering, multi-agent orchestration, tool calling, memory, model routing, and GenAI evaluation is required.
  • Experience defining non-functional requirements and architecture controls for performance, scalability, security, privacy, governance, observability, resiliency, cost optimization, and operational readiness is required.
  • Ability to compare platforms, frameworks, foundation models, and deployment patterns and make evidence-based technology recommendations and defensible architecture trade-offs is required.
  • Experience establishing AI gateway/control-plane patterns, agent registry and certification gates, authorization models, layered guardrails, model risk controls, and production governance is required.
  • Strong stakeholder management and thought leadership skills, including communicating architecture decisions to executives, product leaders, security teams, and engineering delivery teams, are required.

Responsibilities

  • Architect and build custom artificial intelligence infrastructure and hardware solutions.
  • Optimize AI infrastructure and hardware performance, power consumption, cost, and computational-stack scalability.
  • Advise on AI infrastructure technology and vendor evaluation, selection, and full-stack integration.
  • Serve as the definitive technical authority for end-to-end AI architecture on Databricks.
  • Own the complete AI platform architecture spanning classical machine learning, generative AI, LLM applications, RAG, agentic systems, context engineering, model platforms, inference, and enterprise AI integration.
  • Connect business goals, industry priorities, and transformation agendas to a coherent technical vision and sequenced AI implementation roadmap.
  • Lead and integrate work across domain architects and subject matter specialists, resolving cross-domain design decisions and ensuring cohesive, technically sound, enterprise-ready AI solutions.
  • Partner with CIOs, CTOs, business leaders, and delivery stakeholders to shape enterprise AI strategy and convert business priorities into phased technical roadmaps.
  • Lead enterprise AI architecture assessments, target-state definition, gap analysis, platform selection, modernization opportunities, and implementation sequencing.
  • Set enterprise direction for lakehouse-native AI platforms on Databricks; define governed RAG and multi-agent architectures using Delta Lake, Unity Catalog, Vector Search, and Mosaic AI; establish model-serving, evaluation, tracing, and monitoring patterns through MLflow and Databricks workflows; and guide architecture decisions for data governance, scalability, and cost control.
  • Own end-to-end technical solutions for complex AI platforms, aligning domains to business objectives, enterprise standards, and non-functional requirements.
  • Define architectural direction for model- and tool-agnostic multi-agent systems, including orchestration, memory, tool and skill use, agent registry, AI gateway/control-plane patterns, and service abstraction.
  • Establish enterprise context-layer architecture spanning knowledge graphs, ontologies, vector search, semantic retrieval, prompt and context assembly, and conversation-state management.
  • Set security, governance, observability, performance, scalability, and reliability standards across AI solution domains, including identity, authorization, PII protection, layered guardrails, auditability, and evaluation gates.
  • Mandate productized evaluation and observability practices covering accuracy, relevance, groundedness, latency, model quality, cost, safety, reliability, and production-support metrics.
  • Drive architecture decisions for high-throughput, low-latency inference, model routing, model adaptation and fine-tuning, caching, cost controls, and production-ready deployment platforms.
  • Produce and own authoritative architecture artifacts, including blueprints, architecture decision records, sequence diagrams, design specifications, integration patterns, reusable reference architectures, and governance playbooks.

Desired Qualifications

  • Databricks Machine Learning Professional, Data Engineer Professional, or Generative AI certification exposure; exposure to Spark/PySpark, Unity Catalog governance, Delta Live Tables, MLflow, LangGraph/LangChain, model fine-tuning, and lakehouse performance optimization is desirable.
  • Exposure to open-source AI and orchestration frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, Semantic Kernel, MLflow, FastAPI, Docker, and Kubernetes is desirable.
  • Experience with responsible AI, model risk management, AI governance boards, red-teaming, synthetic data, human-in-the-loop review, A/B testing, and GenAI FinOps is desirable.
  • Recognized thought leadership through reusable architecture assets, platform accelerators, whitepapers, client advisory, internal capability building, or conference and community participation is desirable.
  • Experience with large language models is listed as a good-to-have skill.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs