J

JP Morgan Chase

Runs a consumer bank and an investment bank

Lead Software Engineer AI Agent Developer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • At least 8 years of software engineering experience, including leading the design and delivery of large-scale production systems.
  • Demonstrated experience building and operating LLM or agentic systems in production with strict latency and reliability requirements.
  • Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
  • Strong understanding of knowledge graphs and Open Knowledge Formats (OKFs); Neo4J is preferred.
  • Expertise in context and memory engineering, model evaluation methodologies, and quality measurement.
  • Experience implementing observability for distributed systems and AI applications, including tracing, metrics, logs, dashboards, alerting, and on-call readiness.
  • Strong programming skills in one or more of Python, Java, Go, or TypeScript, along with strong API and distributed-systems fundamentals.
  • Familiarity with retrieval systems, vector databases, and hybrid search patterns.

Responsibilities

  • Architect and ship scalable, resilient, production-grade autonomous agent systems that meet latency, reliability, security, and uptime requirements.
  • Design agentic architectures, including planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution.
  • Build robust tool interfaces and tool ecosystems, including APIs, function-calling patterns, permissions, and safe execution.
  • Engineer context, memory, and state-management strategies, including short- and long-term memory, summarization, retrieval, grounding, and caching.
  • Own model evaluation and quality measurement, including offline and online evaluations, regression testing, and failure-mode analysis.
  • Implement end-to-end observability for LLM systems, including tracing, metrics, logging, prompt and tool telemetry, and incident response.
  • Drive cost and performance optimization across models and infrastructure, including throughput, batching, caching, routing, quantization, and inference efficiency.
  • Mentor engineers and set engineering standards for production AI systems, including code quality, design reviews, and operational excellence.

Desired Qualifications

  • Agentic AI architecture experience with planner/executor patterns, multi-agent orchestration, tool-use design, and retrieval workflows.
  • LLM and foundation-model expertise, including prompting strategies, tool-augmented generation, and understanding model behavior.
  • Context and memory engineering experience, including short- and long-term memory, summarization, retrieval grounding, and caching strategies.
  • Knowledge graph experience; Neo4J is preferred, along with Open Knowledge Formats (OKFs).
  • Experience with retrieval systems, vector databases, and hybrid search patterns.

About the Company

JP Morgan Chase

Runs a consumer bank and an investment bank

JPMorgan Chase runs the largest bank in the United States, which serves households and small businesses as Chase and large companies, governments, and investors as J.P. Morgan. During the 2008 financial crisis it bought the failing investment bank Bear Stearns and lender Washington Mutual, and in 2023 it took over First Republic Bank after regulators seized it. Chase takes deposits and earns interest on credit cards, mortgages, and car loans, while the investment side earns fees for advising on mergers, raising money for companies, trading stocks and bonds, and managing wealth. Formed in a 2000 merger, JPMorgan Chase traces its roots to 1799 and is based in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1799

Recently Posted Jobs

Explore more opportunities at JP Morgan Chase

See more jobs