A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timePune, Maharashtra, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree or equivalent in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
  • At least 12 years of overall experience in software engineering, data engineering, AI/ML engineering, cloud architecture, or enterprise technology architecture.
  • At least 8 years of experience designing and deploying enterprise-grade advanced AI, data, analytics, or cloud-native solutions using at least one cloud vendor.
  • At least 2 years of experience in LLM and generative AI solution architecture, including agentic AI, retrieval-augmented generation, prompt engineering, model integration, and evaluation patterns.
  • At least 2 years of experience architecting and operationalizing LLM-driven application architecture patterns in production or enterprise-scale environments.
  • At least 6 years of experience in engineering, machine learning, deep learning, natural language processing solutions, data engineering, or large-scale analytical engineering applications.
  • Demonstrated experience as a senior architect in industry domains such as financial services, healthcare, manufacturing, retail, telecommunications, or life sciences, aligning technology choices to business, risk, and compliance expectations.
  • Deep architecture and hands-on engineering experience with Databricks Mosaic AI, Model Serving, Agent Framework, MLflow tracing and evaluation, Vector Search, Unity Catalog, Delta Lake, Delta Live Tables, Lakehouse Monitoring, Feature Store, Databricks Workflows, Jobs, and Model Training.
  • Ability to shape enterprise-grade AI architecture covering retrieval-augmented generation, embeddings, vector databases, semantic retrieval, context engineering, multi-agent orchestration, tool calling, memory, model routing, and generative AI evaluation.
  • Experience defining non-functional requirements and architecture controls for performance, scalability, security, privacy, governance, observability, resiliency, cost optimization, and operational readiness.
  • Ability to compare platforms, frameworks, foundation models, and deployment patterns and make evidence-based technology recommendations and defensible architecture trade-offs.
  • Experience establishing AI gateway and control-plane patterns, agent registry and certification gates, authorization models, layered guardrails, model risk controls, and production governance.
  • Ability to communicate architecture decisions to executives, product leaders, security teams, and engineering delivery teams.

Responsibilities

  • Serve as the definitive technical authority for end-to-end AI architecture on Databricks.
  • Own the complete AI platform architecture spanning classical machine learning, generative AI, LLM applications, retrieval-augmented generation, agentic systems, context engineering, model platforms, inference, and enterprise AI integration.
  • Connect business goals, industry priorities, and transformation agendas to a coherent technical vision and sequenced AI implementation roadmap.
  • Apply practical industry experience to ensure AI architectures address domain realities, regulatory expectations, security constraints, operational processes, and measurable business outcomes.
  • Lead and integrate work across multiple domain architects and subject matter specialists, resolve cross-domain design decisions, and ensure the full AI solution is cohesive, technically sound, and enterprise-ready.
  • Partner with CIOs, CTOs, business leaders, and delivery stakeholders to shape enterprise AI strategy and convert business priorities into phased technical roadmaps.
  • Lead enterprise AI architecture assessments, target-state definition, gap analysis, platform selection, modernization opportunities, and implementation sequencing.
  • Set enterprise direction for lakehouse-native AI platforms using Databricks; define governed retrieval-augmented generation and multi-agent architectures using Delta Lake, Unity Catalog, Vector Search, and Mosaic AI; establish model serving, evaluation, tracing, and monitoring patterns through MLflow and Databricks workflows; and guide architecture decisions for data governance, scalability, and cost control.
  • Own end-to-end technical solutions for complex AI platforms, aligning all domains to business objectives, enterprise standards, and non-functional requirements.
  • Define architectural direction for model- and tool-agnostic multi-agent systems, including orchestration, memory, tool and skill use, agent registry, AI gateway and control-plane patterns, and service abstraction.
  • Establish enterprise context-layer architecture spanning knowledge graphs, ontologies, vector search, semantic retrieval, prompt and context assembly, and conversation state management.
  • Set security, governance, observability, performance, scalability, and reliability standards across AI solution domains, including identity, authorization, personally identifiable information protection, layered guardrails, auditability, and evaluation gates.
  • Mandate productized evaluation and observability practices covering accuracy, relevance, groundedness, latency, model quality, cost, safety, reliability, and production support metrics.
  • Drive architecture decisions for high-throughput, low-latency inference, model routing, model adaptation and fine-tuning, caching, cost controls, and production-ready deployment platforms.
  • Produce and own authoritative architecture artifacts, including blueprints, architecture decision records, sequence diagrams, design specifications, integration patterns, reusable reference architectures, and governance playbooks.

Desired Qualifications

  • Exposure to Databricks Machine Learning Professional, Data Engineer Professional, or Generative AI certifications; Spark or PySpark; Unity Catalog governance; Delta Live Tables; MLflow; LangGraph or LangChain; model fine-tuning; and lakehouse performance optimization.
  • Exposure to open-source AI and orchestration frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, Semantic Kernel, MLflow, FastAPI, Docker, and Kubernetes.
  • Experience with responsible AI, model risk management, AI governance boards, red-teaming, synthetic data, human-in-the-loop review, A/B testing, and generative AI FinOps.
  • Recognized thought leadership through reusable architecture assets, platform accelerators, whitepapers, client advisory, internal capability building, or conference and community participation.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs