E

EXL

Analyzes business data and runs outsourced operations

GenAI / Agentic Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeUnited States$200k - $280k /yrIn-person

About the Job

Requirements

  • A Master’s degree in computer science, AI, or IT Management.
  • 12–18 years of progressive IT/AI experience, with substantial senior technical architecture and client delivery experience.
  • Extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Deep hands-on background in enterprise integration patterns.
  • Expert-level capability comparing orchestration layers such as LangChain, LlamaIndex, and Semantic Kernel, and evaluating execution environments such as vLLM and TensorRT-LLM.
  • Deep familiarity with enterprise data storage decisions, including managed vector services such as Pinecone, distributed open-source engines such as Milvus and Qdrant, and extending relational systems with pgvector.

Responsibilities

  • Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements.
  • Act as a senior technical architect and advisor to client leadership, connecting AI capabilities with business transformation.
  • Oversee multiple architectural delivery streams and make decisions on technology stacks, framework selection, and infrastructure trade-offs across the seven-layer AI stack.
  • Define multi-year GenAI roadmaps by evaluating architectural trade-offs across the seven-layer LLM stack; compare commercial APIs such as GPT-4o and Claude 3.5 Sonnet with hosted open-source LLMs such as Llama 3 based on cost, latency, and data privacy.
  • Review and approve macro-level AI architectures; architect scalable data ingestion pipelines and select standard semantic RAG, Agentic RAG, or GraphRAG according to enterprise complexity.
  • Design integrated AI observability layers for LLMs and implement tools such as LangSmith, Phoenix, and Arize to track token consumption, trace agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Architect data protection pipelines using Enterprise Data Loss Prevention tools, ensure data is sanitized before reaching external APIs, and implement semantic caching to prevent sensitive data leakage.
  • Lead onshore client-facing engagements and pitch AI solutions to C-suite stakeholders, translating engineering trade-offs into financial and operational return-on-investment frameworks.

About the Company

EXL

Analyzes business data and runs outsourced operations

EXL analyzes business data and runs outsourced operations for insurers, healthcare payers, banks, retailers, and other large organizations. Its teams combine industry expertise with data engineering and AI to handle tasks such as claims processing, payment reviews, customer service, and finance within existing technology environments. The company also builds software, including LifePRO, which manages insurance policies, and EXLdata.ai, which connects fragmented data for use in AI systems. Clients pay for consulting projects, ongoing managed services, and software delivered through the cloud. EXL was founded in 1999 and is headquartered in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1999

Recently Posted Jobs

Explore more opportunities at EXL

See more jobs