A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree or equivalent in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
  • At least 12 years of overall experience in software engineering, data engineering, AI/ML engineering, cloud architecture, or enterprise technology architecture.
  • At least 8 years of experience designing and deploying enterprise-grade advanced AI, data, analytics, or cloud-native solutions using at least one cloud vendor.
  • At least 2 years of experience in LLM and generative AI solution architecture, including agentic AI, RAG, prompt engineering, model integration, and evaluation patterns.
  • At least 2 years of experience architecting and operationalizing LLM-driven application architecture patterns in production or enterprise-scale environments.
  • At least 6 years of experience in engineering, machine learning, deep learning, NLP solutions, data engineering, or large-scale analytical engineering applications.
  • Demonstrated experience as a senior architect in financial services, healthcare, manufacturing, retail, telecom, or life sciences, aligning technology choices with business, risk, and compliance expectations.
  • Deep architecture and hands-on engineering experience with Databricks Mosaic AI, Model Serving, Agent Framework, MLflow tracing and evaluation, Vector Search, Unity Catalog, Delta Lake, Delta Live Tables, Lakehouse Monitoring, Feature Store, Databricks Workflows, Jobs, and Model Training.
  • Ability to shape enterprise-grade AI architecture covering RAG, embeddings, vector databases, semantic retrieval, context engineering, multi-agent orchestration, tool calling, memory, model routing, and GenAI evaluation.
  • Experience defining non-functional requirements and architecture controls for performance, scalability, security, privacy, governance, observability, resiliency, cost optimization, and operational readiness.
  • Ability to compare platforms, frameworks, foundation models, and deployment patterns, making evidence-based technology recommendations and defensible architecture trade-offs.
  • Experience establishing AI gateway/control-plane patterns, agent registry and certification gates, authorization models, layered guardrails, model risk controls, and production governance.
  • Strong stakeholder management and thought leadership skills, with ability to communicate architecture decisions to executives, product leaders, security teams, and engineering delivery teams.

Responsibilities

  • Partner with CIOs, CTOs, business leaders, and delivery stakeholders to shape enterprise AI strategy and convert business priorities into phased technical roadmaps.
  • Lead enterprise AI architecture assessments, target-state definition, gap analysis, platform selection, modernization opportunities, and implementation sequencing.
  • Set enterprise direction for lakehouse-native AI platforms on Databricks; define governed RAG and multi-agent architectures using Delta Lake, Unity Catalog, Vector Search, and Mosaic AI; establish model serving, evaluation, tracing, and monitoring patterns through MLflow and Databricks workflows; and guide architecture decisions for data governance, scalability, and cost control.
  • Own the end-to-end technical solution for complex AI platforms, ensuring all domains align with business objectives, enterprise standards, and non-functional requirements.
  • Define architectural direction for model- and tool-agnostic multi-agent systems, including orchestration, memory, tool and skill use, agent registry, AI gateway/control-plane patterns, and service abstraction.
  • Establish enterprise context-layer architecture spanning knowledge graphs, ontologies, vector search, semantic retrieval, prompt and context assembly, and conversation state management.
  • Set security, governance, observability, performance, scalability, and reliability standards across AI solution domains, including identity, authorization, PII protection, layered guardrails, auditability, and evaluation gates.
  • Mandate productized evaluation and observability practices covering accuracy, relevance, groundedness, latency, model quality, cost, safety, reliability, and production support metrics.
  • Drive architecture decisions for high-throughput, low-latency inference, model routing, model adaptation and fine-tuning, caching, cost controls, and production-ready deployment platforms.
  • Produce and own authoritative architecture artifacts, including blueprints, architecture decision records, sequence diagrams, design specifications, integration patterns, reusable reference architectures, and governance playbooks.
  • Lead and integrate work across multiple domain architects and subject matter specialists, resolving cross-domain design decisions and ensuring the full AI solution is cohesive, technically sound, and enterprise-ready.

Desired Qualifications

  • Exposure to Databricks Machine Learning Professional, Data Engineer Professional, or Generative AI certifications; Spark/PySpark; Unity Catalog governance; Delta Live Tables; MLflow; LangGraph/LangChain; model fine-tuning; and lakehouse performance optimization.
  • Exposure to open-source AI and orchestration frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, Semantic Kernel, and MLflow, as well as FastAPI, Docker, and Kubernetes.
  • Experience with responsible AI, model risk management, AI governance boards, red-teaming, synthetic data, human-in-the-loop review, A/B testing, and GenAI FinOps.
  • Recognized thought leadership through reusable architecture assets, platform accelerators, whitepapers, client advisory, internal capability building, or conference and community participation.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs