A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A minimum of 7.5 years of experience is listed; the professional and technical section also states 12+ years of software engineering experience, including at least 2 years delivering AI, machine learning, or generative AI in production environments.
  • Demonstrated track record of leading end-to-end delivery of complex, multi-cloud AI solutions beyond prototypes.
  • Prior experience as a tech lead or principal engineer who managed 10 or more engineers.
  • Advanced Python skills, including packaging and production-grade code quality.
  • Experience with Go or Java/Kotlin for platform and infrastructure services is advantageous.
  • Experience with REST, gRPC, event-driven architecture using Kafka or Kinesis, clean architecture, and domain-driven design.
  • Experience with prompt engineering; RAG pipeline design including chunking strategies, embedding models, and vector stores; knowledge graph design; agentic frameworks such as LangChain, LlamaIndex, or AutoGen; and fine-tuning using LoRA, QLoRA, and PEFT, including dataset curation and evaluation.
  • Experience with LLM evaluation frameworks such as RAGAS and LLM-as-judge, regression testing, and quality gates.
  • Deep expertise in at least one of AWS, Azure, or GCP, including compute, networking, identity and access management, and storage.
  • Experience with Kubernetes, including EKS, AKS, or GKE.
  • Experience with infrastructure as code using Terraform; Pulumi or AWS CDK are also valued.
  • Ability to produce and communicate architecture artefacts, including architecture decision records and solution design documents, to technical and non-technical audiences.
  • Knowledge of Well-Architected Frameworks across cloud providers.
  • Knowledge of responsible AI, including guardrails, personally identifiable information redaction, output filtering, OWASP LLM Top 10, and AI Act or GDPR awareness.
  • Strong FinOps sensibility, including cost governance, token cost optimization, and multi-cloud spend visibility.
  • 15 years of full-time education.

Responsibilities

  • Architect and deliver end-to-end generative AI solutions.
  • Define the AI roadmap for key customers.
  • Design retrieval-augmented generation pipelines, agentic workflows, and multi-model orchestration patterns for production-grade systems.
  • Own architecture decision records, run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams.
  • Build and scale model-serving infrastructure using Bedrock, Vertex AI, or Azure OpenAI, and build AI gateway and routing layers.
  • Own multi-cloud delivery across AWS, Azure, and GCP using infrastructure as code, Kubernetes, and GitOps workflows.
  • Instrument AI systems with OpenTelemetry, LLM-specific tooling, token and cost dashboards, and drift detection.
  • Implement responsible AI and security measures, including guardrails, output filtering, prompt injection defenses, data residency controls, and OWASP LLM Top 10 mitigations.
  • Guide engineers through complex technical challenges, lead code and architecture reviews, and help set engineering quality standards.
  • Work with product, data science, and business stakeholders to turn AI objectives into executable technical roadmaps.

Desired Qualifications

  • Fine-tuning experience using LoRA, QLoRA, and PEFT, including dataset curation and evaluation, is noted as very good to have.
  • Cloud certifications such as AWS Solutions Architect Professional, Azure AI Engineer, or Google Professional Machine Learning Engineer.
  • Experience with AI ethics, model cards, bias auditing, or fairness testing.
  • Background in platform engineering or building internal developer platforms.
  • Exposure to service mesh technologies such as Istio or Linkerd and API gateway patterns for AI microservices.
  • Experience working in regulated industries such as finance, healthcare, or the public sector.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs