A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline is required.
  • At least 7.5 years of experience is required.
  • Hands-on coding experience in Python and a strong understanding of APIs, distributed systems, continuous integration and continuous delivery (CI/CD), testing, observability, and secure software development lifecycle (SDLC) practices are required.
  • Experience delivering AI/ML or data products in at least one industry domain such as financial services, healthcare, retail, manufacturing, telecom, or media is required.
  • Hands-on experience with Vertex AI / Gemini Enterprise Agent Platform, Gemini models, Model Garden, Agent Builder/Agent Engine patterns, Vertex AI Search, BigQuery, AlloyDB/Cloud SQL vector support, Cloud Run, Google Kubernetes Engine (GKE), Pub/Sub, Cloud Functions, Identity and Access Management (IAM), Cloud Logging, and Monitoring is required.
  • Strong understanding of LLM application architecture patterns including retrieval-augmented generation (RAG), function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics is required.
  • Ability to implement traditional machine learning and generative AI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement is required.
  • Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems is required.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments is required.

Responsibilities

  • Design and build LLM application components including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
  • Build Gemini-powered LLM applications and agents; implement grounding/RAG with BigQuery, Vertex AI Search, and vector stores; orchestrate tool calling and event-driven workflows; evaluate model output quality; and deploy AI services on Cloud Run or GKE.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for structured and unstructured enterprise content.
  • Engineer safety and control components including PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with architects, data engineers, product owners, and security stakeholders to convert solution designs into tested, observable, and maintainable software components.
  • Maintain technical artifacts such as component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.

Desired Qualifications

  • Google Cloud Professional Data Engineer, Professional ML Engineer, or Cloud Architect certification experience; experience with BigQuery-based semantic layers, Dataform/dbt, LangChain/LlamaIndex, GKE ML workloads, and MLOps on Vertex AI.
  • Exposure to open-source frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, and Kubernetes.
  • Experience with Responsible AI, model risk management, synthetic data generation, human-in-the-loop review, A/B testing, and GenAI cost optimization.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs