A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A minimum of 18 years of experience is required.
  • 15 years of full-time education.
  • 12 or more years of software engineering experience, including at least 2 years delivering AI, machine learning, or generative AI in production environments.
  • A demonstrated track record of leading end-to-end delivery of complex, multi-cloud AI solutions beyond prototypes.
  • Prior experience as a technical lead or principal engineer who managed 10 or more engineers.
  • Advanced Python skills, including packaging and production-grade code quality.
  • Deep expertise in at least one of AWS, Azure, or Google Cloud Platform, including compute, networking, identity and access management, and storage.
  • Ability to produce and communicate architecture artifacts, including architecture decision records and solution design documents, to technical and non-technical audiences.
  • Knowledge of Well-Architected Frameworks across cloud providers.
  • Knowledge of responsible AI, including guardrails, personally identifiable information redaction, output filtering, OWASP LLM Top 10, and AI Act or GDPR awareness.
  • FinOps knowledge, including cost governance, token cost optimization, and multi-cloud spend visibility.

Responsibilities

  • Architect and deliver end-to-end generative AI solutions.
  • Define AI roadmaps for key customers.
  • Design retrieval-augmented generation pipelines, agentic workflows, and multi-model orchestration patterns for production-grade systems.
  • Lead technical design and governance; own architecture decision records, run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams.
  • Build and scale model-serving infrastructure using Bedrock, Vertex AI, and Azure OpenAI, along with AI gateway and routing layers.
  • Own multi-cloud delivery across AWS, Azure, and Google Cloud Platform using infrastructure as code, Kubernetes, and GitOps workflows.
  • Instrument AI systems with OpenTelemetry and LLM-specific tooling, token and cost dashboards, and drift detection.
  • Implement responsible AI and security measures, including guardrails, output filtering, prompt-injection defenses, data-residency controls, and OWASP LLM Top 10 mitigations.
  • Guide engineers through complex technical challenges, lead code and architecture reviews, and help set engineering quality standards.
  • Work with product, data science, and business stakeholders to turn AI objectives into executable technical roadmaps.

Desired Qualifications

  • Go or Java/Kotlin for platform and infrastructure services.
  • Prompt engineering.
  • Retrieval-augmented generation pipeline design, including chunking strategies, embedding models, and vector stores.
  • Knowledge graph design.
  • Agentic frameworks such as LangChain, LlamaIndex, and AutoGen, or equivalent.
  • Fine-tuning experience with LoRA, QLoRA, and PEFT, including dataset curation and evaluation.
  • LLM evaluation frameworks, including RAGAS, LLM-as-judge, regression testing, and quality gates.
  • Kubernetes, including EKS, AKS, and GKE.
  • Terraform, Pulumi, or AWS CDK for infrastructure as code.
  • Cloud certifications such as AWS Solutions Architect Professional, Azure AI Engineer, or Google Professional Machine Learning Engineer.
  • Experience with AI ethics, model cards, bias auditing, or fairness testing.
  • Background in platform engineering or building internal developer platforms.
  • Exposure to service mesh tools such as Istio or Linkerd and API gateway patterns for AI microservices.
  • Experience working in regulated industries, including finance, healthcare, or the public sector.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs