A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A minimum of 7.5 years of experience is required; the professional and technical skills section also specifies 12+ years of software engineering experience, including at least 2 years delivering AI, machine learning, or generative AI in production environments.
  • Demonstrated track record leading end-to-end delivery of complex, multi-cloud AI solutions beyond prototypes.
  • Prior experience as a tech lead or principal engineer who has managed 10+ engineers.
  • Advanced Python skills, including packaging and production-grade code quality.
  • Experience with Go or Java/Kotlin for platform and infrastructure services is advantageous.
  • Knowledge of REST, gRPC, event-driven architecture, Kafka or Kinesis, clean architecture, and domain-driven design.
  • Experience with prompt engineering; retrieval-augmented generation pipeline design, including chunking strategies, embedding models, and vector stores; knowledge graph design; agentic frameworks such as LangChain, LlamaIndex, or AutoGen; and fine-tuning using LoRA, QLoRA, PEFT, dataset curation, and evaluation.
  • Experience with LLM evaluation frameworks, including RAGAS, LLM-as-judge, regression testing, and quality gates.
  • Deep expertise in at least one of AWS, Azure, or GCP, including compute, networking, identity and access management, and storage.
  • Kubernetes experience, including EKS, AKS, or GKE; infrastructure as code using Terraform, Pulumi, or AWS CDK.
  • Ability to produce and communicate architecture artifacts, including architecture decision records and solution design documents, to technical and non-technical audiences.
  • Knowledge of cloud-provider Well-Architected Frameworks; responsible AI practices, including guardrails, personally identifiable information redaction, output filtering, OWASP LLM Top 10, and AI Act or GDPR awareness; and FinOps practices including cost governance, token cost optimization, and multi-cloud spend visibility.
  • Fifteen years of full-time education.

Responsibilities

  • Architect large language models that process and generate natural language, including designing neural network parameters trained on large quantities of unlabeled text data.
  • Architect and deliver end-to-end generative AI solutions and define the AI roadmap for key customers.
  • Design production-grade retrieval-augmented generation pipelines, agentic workflows, and multi-model orchestration patterns.
  • Own architecture decisions and technical design governance, maintain architecture decision records, run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams.
  • Build and scale model-serving infrastructure using Bedrock, Vertex AI, or Azure OpenAI, along with AI gateway and routing layers.
  • Own multi-cloud delivery across AWS, Azure, and GCP using infrastructure as code, Kubernetes, and GitOps workflows.
  • Instrument AI systems with OpenTelemetry and LLM-specific tooling, token and cost dashboards, and drift detection.
  • Implement responsible AI and security controls, including guardrails, output filtering, prompt-injection defenses, data-residency controls, and OWASP LLM Top 10 mitigations.
  • Mentor and guide engineers through technical challenges, lead code and architecture reviews, and help establish engineering quality standards.
  • Work with product, data science, and business stakeholders to turn AI objectives into executable technical roadmaps.

Desired Qualifications

  • Fine-tuning experience with LoRA, QLoRA, and PEFT, including dataset curation and evaluation, is described as very good to have.
  • Cloud certifications such as AWS Solutions Architect Professional, Azure AI Engineer, or Google Professional Machine Learning Engineer.
  • Experience with AI ethics, model cards, bias auditing, or fairness testing.
  • Background in platform engineering or building internal developer platforms.
  • Exposure to service mesh technologies such as Istio or Linkerd and API gateway patterns for AI microservices.
  • Experience working in regulated industries such as finance, healthcare, or the public sector.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs