J

JP Morgan Chase

Runs a consumer bank and an investment bank

Executive Director – Agent Platform Lead

AI Application EngineeringUpdated on Nov 7
Full-time$147.3k - $260kIn-person

About the Job

Requirements

  • At least 10 years of experience in technology, including at least 3 years building production LLM-based applications or agent systems.
  • Hands-on experience designing agentic systems, including multi-agent orchestration, tool calling, MCP integration, retrieval-augmented generation pipelines, context and memory management, and understanding production failure modes.
  • Working knowledge of operating large language models at scale, including evaluations, retrieval-augmented generation, Harness Agents, model tuning and serving, rate limits, model gateway patterns, and runtime evaluation.
  • Ability to set technical direction and raise engineering quality across teams without direct line authority through standards, reference architectures, and review.
  • A track record of influencing a platform or product roadmap the candidate did not own, with evidence that the advocated capability was built and used.
  • Strong writing and speaking skills sufficient to communicate with principal engineers and senior executives.

Responsibilities

  • Define production-proven patterns across SmartSDK, Agent Studio, the RAG SDK, and the MCP SDK for multi-agent orchestration, tool calling, MCP server design, state and memory management, human oversight hooks, and model access through the managed GenAI gateway.
  • Run architecture and code reviews for every co-built or delivered agent, and mentor Product Specialists across NYC, London, Hyderabad, and Singapore.
  • Embed with Line of Business engineering teams on high-complexity use cases, write code where needed, and bring solutions to production using paved paths rather than custom one-offs.
  • Partner with Agents & Evals product and engineering leaders on the roadmap, convert field feedback into a ranked, evidence-backed list of capability gaps, and get Product Specialists into private preview to learn features before Line of Business teams.
  • Work with Governance, Model Risk Management, and Compliance to make controls for the AgentSDK agent manifest, deployment gates, and audit trail engineering defaults rather than late-stage review findings.
  • Define shipment-readiness standards for agents, including onboarding gates, regression suites, tool-use fidelity, safety boundary tests, and shadow or canary evaluation in production.
  • Contain blast radius, mitigate prompt injection, enforce least-privilege tool access, and review tool surfaces for each MCP integration shipped.
  • Maintain the Agent Developer Playbook, AI/ML paved paths, and reference architectures to scale the platform and drive adoption.

Desired Qualifications

  • Experience with MCP at scale, including tool schema design, server architecture, tool-surface security, and enterprise system integration.
  • Experience in financial services, healthcare, or government, including model risk management and audit-driven engineering.
  • Experience building or operating agent evaluation frameworks, including structured output evaluation, tool-use fidelity, safety boundary testing, and production regression tracking.
  • Experience with human-oversight engineering for autonomous systems, including escalation paths, intervention hooks, and auditability.
  • Breadth across the machine learning platform, including model training, fine-tuning and serving, and data sourcing from Databricks, Snowflake, and S3.
  • A Master of Science or PhD in Computer Science, Engineering, or a related field, or equivalent practical depth.
  • Production-grade Python experience.

About the Company

JP Morgan Chase

Runs a consumer bank and an investment bank

JPMorgan Chase runs the largest bank in the United States, which serves households and small businesses as Chase and large companies, governments, and investors as J.P. Morgan. During the 2008 financial crisis it bought the failing investment bank Bear Stearns and lender Washington Mutual, and in 2023 it took over First Republic Bank after regulators seized it. Chase takes deposits and earns interest on credit cards, mortgages, and car loans, while the investment side earns fees for advising on mergers, raising money for companies, trading stocks and bonds, and managing wealth. Formed in a 2000 merger, JPMorgan Chase traces its roots to 1799 and is based in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1799

Recently Posted Jobs

Explore more opportunities at JP Morgan Chase

See more jobs