A

Accenture

Advises businesses and runs their technology

Large Language Model Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timePune, Maharashtra, IndiaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline is required.
  • Hands-on coding experience in Python and a strong understanding of APIs, distributed systems, CI/CD, testing, observability, and secure software development lifecycle practices are required.
  • Experience delivering AI/ML or data products in at least one industry domain such as banking, insurance, healthcare, public sector, retail, or energy is required.
  • Hands-on experience with Microsoft Foundry / Azure AI Foundry, Foundry Agent Service, Azure OpenAI models, Azure AI Search, Prompt Flow, Azure Functions, Logic Apps, API Management, Event Grid, Microsoft Fabric, Entra ID, Key Vault, Azure Monitor, and Application Insights is required.
  • Strong understanding of LLM application architecture patterns, including retrieval-augmented generation, function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics, is required.
  • Ability to implement traditional machine learning and generative AI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement is required.
  • Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems is required.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments is required.
  • A minimum of 7.5 years of experience is required.

Responsibilities

  • Architect large language models that process and generate natural language, including designing neural network parameters trained on large quantities of unlabeled text data.
  • Design, build, integrate, test, and operationalize enterprise-grade LLM, generative AI, and agentic AI components across active client engagements.
  • Own platform-specific engineering on Azure, translating high-level architecture into production-quality components for LLM-driven applications, RAG pipelines, multi-agent workflows, and AI platform integrations.
  • Apply practical industry experience to identify domain data, process constraints, controls, and adoption risks when designing safe, scalable, and relevant generative AI solutions.
  • Contribute code, design decisions, reusable patterns, and engineering documentation as a hands-on technical or engineering lead.
  • Design and build LLM application components, including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
  • Create Foundry-based agents with enterprise tools, knowledge, and memory; integrate Azure AI Search for RAG; implement secure API/tool calls through API Management, Logic Apps, and Functions; and instrument traces, evaluations, guardrails, and policy controls for production agents.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for structured and unstructured enterprise content.
  • Engineer safety and control components, including PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with architects, data engineers, product owners, and security stakeholders to convert solution designs into tested, observable, and maintainable software components.
  • Maintain technical artifacts such as component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.

Desired Qualifications

  • Azure AI Engineer, Azure Solutions Architect, or Azure Developer certification experience; experience with Microsoft Fabric, Semantic Kernel, Prompt Flow, private networking, Defender for Cloud, and enterprise Responsible AI governance.
  • Exposure to open-source frameworks such as LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, and Kubernetes.
  • Experience with Responsible AI, model risk management, synthetic data generation, human-in-the-loop review, A/B testing, and generative AI cost optimization.
  • Large Language Models (LLMs) are listed as good-to-have skills.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs