A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timePune, Maharashtra, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline is required.
  • At least 7.5 years of experience is required; the listed experience bands describe Level 8 as typically requiring 7+ years of software, data, or AI engineering experience, including 3+ years in cloud-native architecture or engineering and 1–2+ years in GenAI, LLM, NLP, or agentic AI delivery.
  • Hands-on coding experience in Python and strong understanding of APIs, distributed systems, CI/CD, testing, observability, and secure SDLC practices.
  • Experience delivering AI/ML or data products in at least one industry domain such as banking, insurance, healthcare, public sector, retail, or energy.
  • Hands-on experience with Microsoft Foundry / Azure AI Foundry, Foundry Agent Service, Azure OpenAI models, Azure AI Search, Prompt Flow, Azure Functions, Logic Apps, API Management, Event Grid, Microsoft Fabric, Entra ID, Key Vault, Azure Monitor, and Application Insights.
  • Strong understanding of LLM application architecture patterns including RAG, function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics.
  • Ability to implement traditional ML and GenAI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement.
  • Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments.

Responsibilities

  • Design and build LLM application components including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
  • Create Foundry-based agents with enterprise tools, knowledge, and memory; integrate Azure AI Search for RAG; implement secure API/tool calls through API Management, Logic Apps, and Functions; and instrument traces, evaluations, guardrails, and policy controls for production agents.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for structured and unstructured enterprise content.
  • Engineer safety and control components including PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with architects, data engineers, product owners, and security stakeholders to convert solution designs into tested, observable, and maintainable software components.
  • Maintain technical artifacts such as component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.
  • Design, build, integrate, test, and operationalize enterprise-grade LLM, GenAI, and agentic AI components across active client engagements.
  • Own platform-specific engineering on Azure, translating high-level architecture into working, production-quality components for LLM-driven applications, RAG pipelines, multi-agent workflows, and AI platform integrations.
  • Apply practical industry experience to identify domain data, process constraints, controls, and adoption risks while designing safe, scalable, and relevant GenAI solutions.
  • Contribute code, design decisions, reusable patterns, and engineering documentation as a hands-on technical or engineering lead.

Desired Qualifications

  • Azure AI Engineer, Azure Solutions Architect, or Azure Developer certification.
  • Experience with Microsoft Fabric, Semantic Kernel, Prompt Flow, private networking, Defender for Cloud, and enterprise Responsible AI governance.
  • Exposure to open-source frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, and Kubernetes.
  • Experience with Responsible AI, model risk management, synthetic data generation, human-in-the-loop review, A/B testing, and GenAI cost optimization.
  • Experience with Large Language Models (LLMs).

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs