Full-Time

Large Language Model Architect

Posted on 9/10/2026

Accenture

Accenture

10,001+ employees

Global professional services and technology consulting

No salary listed

Bengaluru, Karnataka, India

In Person

Bachelor's

Category
Software Engineering (1)
Required Skills
LLM
Kotlin
gRPC
Kubernetes
Microsoft Azure
Python
Software Testing
Neural Networks
Machine Learning
Apache Kafka
Java
Kinesis
OpenTelemetry
Infrastructure as Code (IaC)
RAG
Istio
AWS
Go
Terraform
REST APIs
LangChain
DevOps
Google Cloud Platform

Get referred to Accenture

See people who can refer or advise you

Requirements
  • A minimum of 15 years of experience is required.
  • 15 years of full-time education.
  • At least 12 years of software engineering experience, including at least 2 years delivering AI, machine learning, or generative AI solutions in production environments.
  • A demonstrated track record of leading end-to-end delivery of complex, multi-cloud AI solutions beyond prototypes.
  • Prior experience as a technical lead or principal engineer who managed 10 or more engineers.
  • Advanced Python experience, including packaging and production-grade code quality.
  • Experience with Go or Java/Kotlin for platform and infrastructure services is advantageous.
  • Knowledge of REST, gRPC, event-driven architecture, Kafka or Kinesis, clean architecture, and domain-driven design.
  • Experience with prompt engineering; retrieval-augmented generation pipeline design, including chunking strategies, embedding models, and vector stores; knowledge graph design; and agentic frameworks such as LangChain, LlamaIndex, or AutoGen.
  • Experience with fine-tuning using LoRA, QLoRA, and PEFT, including dataset curation and evaluation.
  • Experience with large language model evaluation frameworks, including RAGAS, LLM-as-judge, regression testing, and quality gates.
  • Deep expertise in at least one of AWS, Azure, or GCP, including compute, networking, identity and access management, and storage.
  • Experience with Kubernetes, including EKS, AKS, or GKE.
  • Experience with infrastructure as code using Terraform; Pulumi or AWS CDK experience is also valued.
  • Ability to produce and communicate architecture artifacts, including architecture decision records and solution design documents, to technical and non-technical audiences.
  • Knowledge of well-architected frameworks across cloud providers.
  • Experience implementing responsible AI practices, including guardrails, personally identifiable information redaction, output filtering, OWASP Large Language Model Top 10 mitigations, and awareness of the AI Act or GDPR.
  • Strong FinOps capabilities, including cost governance, token-cost optimization, and multi-cloud spend visibility.
Responsibilities
  • Architect and deliver end-to-end generative AI solutions.
  • Define the AI roadmap for key customers.
  • Design production-grade retrieval-augmented generation pipelines, agentic workflows, and multi-model orchestration patterns.
  • Lead technical design and governance activities.
  • Own architecture decision records, run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams.
  • Drive AI infrastructure platform engineering.
  • Build and scale model-serving infrastructure using Bedrock, Vertex AI, and Azure OpenAI, along with AI gateway and routing layers.
  • Own multi-cloud delivery across AWS, Azure, and GCP using infrastructure as code, Kubernetes, and GitOps workflows.
  • Embed observability and LLMOps by instrumenting AI systems with OpenTelemetry, large-language-model tooling, token and cost dashboards, and drift detection.
  • Implement responsible AI and security controls, including guardrails, output filtering, prompt-injection defenses, data-residency controls, and OWASP Large Language Model Top 10 mitigations.
  • Guide engineers through complex technical challenges, lead code and architecture reviews, and help establish engineering quality standards.
  • Work with product, data science, and business stakeholders to translate AI objectives into executable technical roadmaps.
Desired Qualifications
  • Fine-tuning experience using LoRA, QLoRA, and PEFT, including dataset curation and evaluation.
  • Cloud certifications such as AWS Solutions Architect Professional, Azure AI Engineer, or Google Professional Machine Learning Engineer.
  • Experience with AI ethics, model cards, bias auditing, or fairness testing.
  • Background in platform engineering or building internal developer platforms.
  • Exposure to service mesh technologies such as Istio or Linkerd and API gateway patterns for AI microservices.
  • Experience working in regulated industries such as finance, healthcare, or the public sector.

Accenture is a global professional services firm that helps companies navigate technology-driven change. It offers strategies and services across consulting, digital, technology, and operations, with a strong emphasis on cloud, artificial intelligence, security, and enterprise reinvention. Accenture works by delivering end-to-end solutions, combining advisory work with implementation, technology platforms, and managed services to transform how organizations operate and compete in today’s digital world. The company differentiates itself through its long history as a dedicated tech-advisory arm that gained independence in 2001, its scale, and its active acquisitions—particularly since 2013—to expand capabilities in digital, cloud, and security. Its goal is to help the world’s largest corporations rethink and reshape their operations to stay ahead of rapid technological shifts.

Company Size

10,001+

Company Stage

IPO

Headquarters

Dublin, Ireland

Founded

1989

Get referred to Accenture

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • June 2026 revenue reached $18.7 billion, up 6%, with 17% operating margin.
  • Accenture doubled cyber spending to $9 billion, adding $208 million ARR immediately.
  • AI services and partner launches, including Radisson and ChatGPT, expand monetizable demand.

What critics are saying

  • FY26 revenue guidance fell to 3%-4% local currency growth after June 2026.
  • LearnVantage faded by June 2026, signaling failed product focus and shifting priorities.
  • DoJ continues investigating Accenture Federal Services, threatening contracts and a prolonged reputational overhang.

What makes Accenture unique

  • Accenture Edge targets $240 billion mid-market demand with repeatable enterprise-grade solutions.
  • Dragos, runZero, and NetRise create a differentiated OT cybersecurity platform around critical infrastructure.
  • Accenture still pairs consulting, cloud, and AI delivery across 770,000 employees worldwide.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Professional Development Budget

401(k) Retirement Plan

401(k) Company Match

Company News

Yahoo Finance
Sep 3rd, 2026
Accenture drops LearnVantage focus, shifts $9B to cybersecurity and mid-market expansion

Accenture is shifting its growth strategy, de-emphasising LearnVantage, a learning and training business it built and promoted heavily in 2024. The company mentioned LearnVantage only once on its June 2026 earnings call, listing it amongst AI enablers rather than highlighting it as a standalone growth driver. Meanwhile, Accenture is redirecting resources toward cybersecurity, which has grown from $700 million in fiscal 2016 to $10 billion in fiscal 2025. The company is acquiring a majority stake in an operational technology security specialist, alongside two smaller firms, combining them into a platform for critical infrastructure. These assets generate $208 million in annual recurring revenue, growing at 48%. Accenture's acquisition budget for fiscal 2026 is approximately $9 billion against $73.1 billion in trailing twelve-month revenue. The company has also launched Accenture Edge, targeting mid-market companies. The stock is down 24.3% over the past year.

Yahoo Finance
Aug 28th, 2026
Accenture and 2 dividend stocks offering 5%+ yields backed by growing cash flows

Central banks in Asia and Europe are tightening policy, yet cash deposits offer limited returns. This creates opportunities for dividend-focused investors seeking reliable income streams. Three stocks from the Dividend Powerhouses screener currently offer yields above 5% with covered, growing payouts. The screener identifies 1,851 companies with compelling dividend profiles. Accenture, a global consulting and technology services firm, offers a 3.48% yield backed by strong free cash flow. The company generates revenue primarily from Products clients (US$22.3 billion), Health & Public Service (US$14.9 billion), and Financial Services (US$13.8 billion). Its market capitalisation stands at approximately US$111 billion. The firm is reshaping itself for the AI era through acquisitions and partnerships with Google Cloud and ServiceNow. Key risks include whether AI and slower IT spending will reshape consulting economics faster than Accenture can adjust.

Business Wire
Aug 27th, 2026
Accenture to Acquire COMWARE to Strengthen Accenture Edge and Accelerate Digital Core Reinvention for Mid-Market Companies in Japan

Accenture has agreed to acquire COMWARE Co., Ltd., a Tokyo-based provider of end-to-end technology services for mid-market companies.

StockTitan
Aug 25th, 2026
Accenture acquires Dutch SAP partner McCoy to boost mid-market AI and ERP capabilities

Accenture has agreed to acquire McCoy, a Dutch SAP transformation partner specialising in mid-market companies. Upon closing, McCoy will join Accenture Edge, the firm's mid-market business serving companies with annual revenues between $300 million and $3 billion. Founded in 2012, McCoy operates from the Netherlands with offices in Spain and the Philippines. The company employs over 380 professionals who design, implement and manage SAP solutions across ERP, data and business applications. McCoy holds SAP Gold Partner status and serves clients in high-tech, manufacturing, public sector, utilities and retail. The acquisition will strengthen Accenture Edge's position in the EMEA mid-market whilst expanding SAP modernisation capabilities in the Netherlands. The deal is subject to regulatory approvals. Financial terms were not disclosed.

Yahoo Finance
Aug 5th, 2026
Accenture targets $240B+ cybersecurity market with Edge launch as AI drives growth

Accenture and Automatic Data Processing continue demonstrating steady revenue growth, though at single-digit rates, as both companies explore AI opportunities to expand their service offerings. Accenture, which provides strategy, consulting, technology, and operations services globally, reported an approximately 13% net income margin for the quarter ended May 31, 2026. The company is experiencing significant traction for AI services and targeting a more than $240 billion addressable market with Accenture Edge, offering cybersecurity solutions to mid-sized organisations. Automatic Data Processing, delivering cloud-based human capital management and payroll outsourcing solutions, posted an approximately 18% net income margin for the quarter ended June 30, 2026. The company recently launched a Canadian wage tracking tool. Accenture's quarterly revenue reached $18.7 billion in Q2 2026, whilst Automatic Data Processing reported $5.5 billion for the same period.