J

JP Morgan Chase

Runs a consumer bank and an investment bank

Lead Software Engineer - AI Platform, Vice President

Platform EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USA$156.8k - $215kIn-person

About the Job

Requirements

  • A master's degree in computer science, software engineering, computer engineering, information systems, or a related technical field, plus at least four years of relevant industry experience building or operating cloud, platform, or infrastructure systems.
  • Hands-on experience operating production-grade environments, including EC2, networking, storage, monitoring, and cost management.
  • Strong knowledge of Linux systems, containers, networking, storage, and distributed systems, with experience in orchestration or workload-scheduling technologies.
  • Experience with infrastructure-as-code and delivery automation using tools such as Terraform or CloudFormation, configuration management, and CI/CD pipelines.
  • Proficiency in Python and shell scripting, with sound software engineering practices for building maintainable automation, services, and platform integrations.
  • Working knowledge of AI/ML development workflows and the ability to translate research requirements into platform designs, communicate technical trade-offs, manage delivery dependencies, and drive risk and control items to closure.
  • Experience in one or more of the following domains: cloud and accelerated compute platforms, including AWS, CPU/GPU infrastructure, autoscaling, workload scheduling, resource quotas, and capacity planning; research environments and developer platforms, including containers, Jupyter, package and dependency management, artifact repositories, experiment tracking, and self-service tooling; AI workload enablement, including LLM inference and evaluation, agentic workflows, retrieval pipelines, model-serving infrastructure, and distributed processing; or reliability and operations, including observability, service-level objectives, incident response, resilience, backup and recovery, and operational readiness.

Responsibilities

  • Own the architecture, technical roadmap, and day-to-day engineering of the team's AI research platform.
  • Design and operate secure, scalable cloud and CPU/GPU infrastructure, including clusters, workload scheduling, storage, networking, capacity planning, performance, and cost.
  • Build reproducible, self-service research environments and platform automation using standardized container images, GPU software stacks, dependency and artifact management, infrastructure-as-code, CI/CD, and orchestration.
  • Partner with researchers to translate requirements from LLM, agentic AI, model evaluation, retrieval, inference, and accelerator benchmarking projects into dependable platform capabilities, and prepare research prototypes for downstream integration through packaging, service interfaces, and operational-readiness reviews.
  • Assess and onboard new AI infrastructure technologies, cloud services, accelerators, and developer tooling through practical benchmarks, architecture reviews, and controlled pilots.
  • Maintain reliable, well-controlled platforms through observability, incident response, patching and lifecycle management, access and data controls, risk and control evidence, operational documentation, and runbooks.

Desired Qualifications

  • Experience supporting AI/ML research or development teams and operating platforms for GPU-intensive, LLM, agentic, or other distributed AI workloads.
  • Experience with Kubernetes or managed container platforms, GPU software stacks, cluster schedulers or distributed-compute frameworks such as Slurm or Ray, observability platforms, and cloud cost optimization.
  • Experience delivering infrastructure in a regulated enterprise and working with cybersecurity, architecture, technology risk, and audit stakeholders.
  • Familiarity with finance or financial use cases.

About the Company

JP Morgan Chase

Runs a consumer bank and an investment bank

JPMorgan Chase runs the largest bank in the United States, which serves households and small businesses as Chase and large companies, governments, and investors as J.P. Morgan. During the 2008 financial crisis it bought the failing investment bank Bear Stearns and lender Washington Mutual, and in 2023 it took over First Republic Bank after regulators seized it. Chase takes deposits and earns interest on credit cards, mortgages, and car loans, while the investment side earns fees for advising on mergers, raising money for companies, trading stocks and bonds, and managing wealth. Formed in a 2000 merger, JPMorgan Chase traces its roots to 1799 and is based in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1799

Recently Posted Jobs

Explore more opportunities at JP Morgan Chase

See more jobs