A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline is required.
  • At least 5 years of software, data, or AI engineering experience, including 2 years in cloud-native engineering and 1 year in GenAI, LLM, NLP, or agentic AI delivery.
  • At least 7 years of software, data, or AI engineering experience, including 3 years in cloud-native architecture or engineering and 1–2 years in GenAI, LLM, NLP, or agentic AI delivery.
  • Hands-on coding experience in Python and a strong understanding of APIs, distributed systems, CI/CD, testing, observability, and secure SDLC practices.
  • Experience delivering AI/ML or data products in at least one industry domain such as financial services, healthcare, retail, manufacturing, telecom, or media.
  • Hands-on experience with Vertex AI / Gemini Enterprise Agent Platform, Gemini models, Model Garden, Agent Builder/Agent Engine patterns, Vertex AI Search, BigQuery, AlloyDB/Cloud SQL vector support, Cloud Run, GKE, Pub/Sub, Cloud Functions, IAM, Cloud Logging, and Monitoring.
  • A strong understanding of LLM application architecture patterns, including RAG, function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics.
  • Ability to implement traditional ML and GenAI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement.
  • Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments.

Responsibilities

  • Design and build LLM application components, including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
  • Build Gemini-powered LLM applications and agents; implement grounding/RAG with BigQuery, Vertex AI Search, and vector stores; orchestrate tool calling and event-driven workflows; evaluate model output quality; and deploy AI services on Cloud Run or GKE.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for structured and unstructured enterprise content.
  • Engineer safety and control components, including PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with architects, data engineers, product owners, and security stakeholders to convert solution designs into tested, observable, and maintainable software components.
  • Maintain technical artifacts such as component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.
  • Design, build, integrate, test, and operationalize enterprise-grade LLM, GenAI, and agentic AI components across active client engagements.
  • Own platform-specific engineering on GCP, translating high-level architecture into production-quality components for LLM-driven applications, RAG pipelines, multi-agent workflows, and AI platform integrations.
  • Apply industry experience to identify domain data, process constraints, controls, and adoption risks while designing safe, scalable, and relevant GenAI solutions.
  • Contribute code, design decisions, reusable patterns, and engineering documentation.

Desired Qualifications

  • Google Cloud Professional Data Engineer, Professional ML Engineer, or Cloud Architect certification experience; experience with BigQuery-based semantic layers, Dataform/dbt, LangChain/LlamaIndex, GKE ML workloads, and MLOps on Vertex AI.
  • Exposure to open-source frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, and Kubernetes.
  • Experience with Responsible AI, model risk management, synthetic data generation, human-in-the-loop review, A/B testing, and GenAI cost optimization.
  • Google Cloud Data Services.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs