Full-Time
SR Principal Software Engineer
LLM Engineering
JP Morgan Chase
10,001+ employees
Global financial services with diversified offerings
Compensation Overview
$204.3k - $325k/yr
Palo Alto, CA, USA + 3 more
More locations: Seattle, WA, USA | Chicago, IL, USA | New York, NY, USA
In Person
On-site roles in Palo Alto, Seattle, Chicago, New York, and Jersey City.
Master's, PhD
 AI & Machine Learning |
|---|
 Software Engineering |
|---|
Get referred to JP Morgan Chase
See people who can refer or advise you
- Formal training or certification on software engineering concepts and 10+ years of applied experience.
- 8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral).
- Demonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., SageMaker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI.
- Experience building LLM and GNN serving platforms in large‑scale environments typical of major tech firms.
- Hands‑on experience building LLM inference engines using Triton Inference Server and vLLM, including autoscaling, caching, and throughput optimization.
- Advanced proficiency in Python and optimization techniques applied to deep learning frameworks (PyTorch, TensorFlow, Hugging Face Transformers).
- Deep understanding of LLMOps/MLOps (e.g., MLflow, SageMaker Pipelines, Kubeflow) with a track record of implementing best practices at scale.
- Demonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs.
- Strong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes.
- Expertise in inference optimization and distributed systems for large models focused on high‑throughput, low‑latency applications, including system design, testing, and operational stability for enterprise AI platforms.
- Excellent communication skills with proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services, and the ability to influence both technical and non‑technical stakeholders to deliver value across functions at scale.
- Advises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on‑premises environments, aligning initiatives to business outcomes.
- Defines and implements MLOps and LLMOps strategies for end‑to‑end model lifecycle management, including training, versioning, deployment, monitoring, and governance.
- Drives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures.
- Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale.
- Creates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions.
- Establishes best practices for automation, CI/CD, and infrastructure‑as‑code using containerization and orchestration technologies.
- Partners closely with data science, platform engineering, and SRE teams to productionize models on AWS, ensuring observability, reliability, and cost efficiency.
- Leads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high‑throughput, low‑latency serving at scale.
- Oversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement.
- Translates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross‑functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect.
- Master’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
- Practical cloud‑native experience, including containerization (Docker), orchestration (Kubernetes), and infrastructure‑as‑code (Terraform, CloudFormation).
- Expertise in security, compliance, and governance for AI/ML deployments in regulated environments.
- Experience in trust and safety or fraud prevention domains; familiarity with payments platforms is a plus.
- Track record of contributions to open‑source LLM projects or peer‑reviewed research and/or experience presenting at industry conferences or leading technical communities.
- Familiarity with hardware acceleration strategies across GPUs, TPUs, and specialized inference runtimes.
- Experience in building java based applications
A global financial services firm offering investment banking, asset management, private equity, financial services, and consumer banking to individuals and institutions. It works by providing advisory, lending, trading, and financing services through a worldwide network, earning revenue from interest, fees, and trading commissions, and using its data and the JPMorgan Chase Institute to analyze economies. It stands apart from peers due to its size, full-range services across consumer and corporate markets, extensive market access, and in-house data-driven insights. Its goal is to deliver comprehensive financial products with integrity and growth while supporting clients and communities through data-backed analysis and targeted programs.
Company Size
10,001+
Company Stage
IPO
Headquarters
New York City, New York
Founded
1959
Get referred to JP Morgan Chase
See people who can refer or advise you
Simplify's Take
What believers are saying
- 2Q26 profit hit $21.2 billion; markets revenue rose 35%, and fees rose 30%.
- SpaceX IPO and dealmaking lifted investment banking activity to its strongest since 2021.
- August 2026 technology M&A council targets JPMorgan's highest-value clients and future fee pools.
What critics are saying
- August 20, 2026 SEBI barred Copthall Mauritius after alleged Sensex closing-auction manipulation.
- August 2026 Jersey City WARN notices reached 541 cuts, signaling continued operational churn.
- Regulatory breaches in India and U.S. could trigger fines, trading limits, and reputational damage.
What makes JP Morgan Chase unique
- JPMorgan Chase led global investment banking fees in 2026, with 9.3% wallet share.
- Its 2Q26 franchise spans consumer, payments, markets, and wealth across 100 markets.
- August 21, 2026 hire David Fishman deepens technology M&A and sector coverage.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Health Insurance
Flexible Work Hours
Paid Sick Leave
Paid Holidays
Growth & Insights and Company News
6 month growth
↓ -5%1 year growth
↓ -5%2 year growth
↓ -5%JPMorgan Chase has filed its fifth layoff notice in New Jersey this year, affecting 63 employees at its Jersey City office. The latest cuts, effective between 19 August and 15 November, bring the total number of redundancies at the location to 541 this year. Previous notices were filed in February (120 employees), March (134 employees), May (51 employees), and July (172 employees). A company spokesman stated the layoffs are part of regular business management, noting that JPMorgan regularly reviews staffing needs and adjusts accordingly. The notices were filed under the federal WARN Act, which requires employers with 100 or more employees to provide at least 60 days' advance notice before mass layoffs.
JPMorgan downgrades Popmart to underweight, cuts target price to HK$120 from HK$165. 2026-08-20 20:16:28 JPMorgan Chase downgraded Popmart (09992.HK) to underweight from neutral today, cutting its target price to HK$120 from HK$165. The bank highlighted that Q2 marked a true inflection point, with revenue declining 11% year-over-year - the first single-quarter decline since 2023. First-half revenue reached 17.2 billion yuan, up 24% annually but below JPMorgan's forecast. The bank predicts Q3 revenue will drop over 35% year-over-year, narrowing to around 20% in Q4. Disclaimer: The information on this page may come from third-party sources and is for reference only. It does not represent the views or opinions of Gate and does not constitute any financial, investment, or legal advice. Virtual asset trading involves high risk. Please do not rely solely on the information on this page when making decisions. For details, see the Disclaimer. In-Depth Analysis
JPMorgan hiring Bank of America's David Fishman as head of technology M&A, memo says. By Thomson Reuters Aug 21, 2026 | 11:25 AM By Milana Vinn NEW YORK, Aug 21 (Reuters) - JPMorgan Chase is hiring veteran dealmaker David Fishman from Bank of America as part of a newly formed investment banking group to focus on key clients in the technology sector, according to a memo seen by Reuters. Fishman will join JPMorgan later this year as head of North America technology mergers and acquisitions, according to the memo from co-heads of technology investment banking Chris Grose and Greg Mendelson, as well as Global Head of M&A Charlie Bouckaert. JPMorgan is elevating Vineet Seth, the head of technology M&A in North America, to vice chair of investment banking, and both Fishman and Seth will also serve on the bank's Technology M&A Leadership and Advisory Council. The grouping is being formed to support the bank's most important technology clients, the memo added, without elaborating. A JPMorgan spokesperson confirmed the memo's contents. Bank of America declined to comment. Fishman was at Bank of America for almost 16 years, according to his LinkedIn profile. He most recently served as co-head of technology, media and telecommunications (TMT) investment banking, but resigned from the bank earlier this week, according to sources familiar with the matter. The move is the latest in a series of recent departures of senior investment bankers from Bank of America. Reuters and others reported this month that Mike Joo, co-head of investment banking, and Amy Lissauer, head of activism and raid defense, would leave Bank of America. Barclays said this week it had hired Joo and he would start as co-chief executive of its investment bank in early 2027. Lissauer, considered among the top bankers for defending companies against shareholder agitation, is joining JPMorgan later this year. Bank of America's technology practice has also had several exits. Ed Liu was named this month as global head of TMT investment banking at Deutsche Bank. He will join the German bank in November. Reuters also reported on August 4 that Citigroup hired Rohan Sen from Bank of America to lead its coverage of the technology services sector. Bank of America has hired over 40 managing directors this year, including Jason Rowe from Goldman Sachs, who became co-head of technology investment banking, and Gary Kirkham, who was a senior partner and head of technology at boutique bank Centerview Partners before rejoining Bank of America. (Reporting by Milana Vinn in New York; Editing by David French and Rod Nickel)
CryptoPotato 20 hours ago 132 HSBC and Standard Chartered executed the first live tokenized deposit transaction on SWIFT's blockchain-based ledger, the two banks said on August 19, six weeks after the network opened to an initial cohort of 17 banks. Payment messages moved between HSBC's Tokenized Deposit Service (TDS) and Standard Chartered's own tokenized deposit infrastructure, with the resulting obligations recorded on both banks' systems. SWIFT's ledger worked as an orchestration layer, matching and netting the obligations between the two institutions before final settlement ran through existing payment rails. "HSBC's interoperability transaction with Standard Chartered via SWIFT is a landmark moment for the promise of tokenised deposits," said Lewis Sun, Head of Digital Currencies at HSBC. Mark Willis, Head of Emerging Payments, Transaction Services and Digital Assets at Standard Chartered, noted that "tokenized deposits are a key pillar of Standard Chartered's digital assets strategy, which aims to build end-to-end solutions." Ledger runs on Hyperledger Besu. SWIFT says the ledger MVP is built on open-source foundations, using an Ethereum Virtual Machine-compatible architecture based on Hyperledger Besu, and that it is designed to integrate with the broader digital asset ecosystem. SWIFT operates the ledger itself, handling orchestration of transaction workflows, validation of funding commitments, and coordination of interbank processes. Consensys built the conceptual prototype when Swift announced the project in September 2025. Seventeen banks from six continents are preparing to pilot live transactions, among them ANZ, BNP Paribas, BNY, Citi, DBS, MUFG, UBS, and Wells Fargo. CryptoPotato covered that SWIFT has experimented before with moving tokenized value across public and private blockchains. HSBC has put bank money on a ledger before, joining a S$400 million digital bond issuance with SGX and Temasek that cut primary settlement from five days to two. "With our new ledger capability, we're extending the trust and stability of established finance into the frontiers of digital money," said Thierry Chilosi, Chief Business Officer at Swift. Rival network targets 2027. American banks are building a competing rail. The Clearing House is developing a tokenized deposit network called The Bridge with JPMorgan Chase, Bank of America, Citigroup and Wells Fargo, targeted at the first half of 2027 and open to all US banks. Bank of America's Mark Monaco said clients are not "beating down the door" for tokenized deposits yet. SWIFT moves the equivalent of world GDP every two to three days across more than 200 markets. The cooperative says 75% of payments on its network reach beneficiary banks within 10 minutes. The post HSBC and Standard Chartered run first live Tokenized Deposit transfer on SWIFT's blockchain ledger appeared first on cryptopotato. BitRss shares this Content always with License. Screenshot generated in real time with SneakPeek Suite * homepage * analysis * HSBC and Standard Chartered run first live Tokenized Deposit transfer on SWIFT's blockchain ledger.
JPMorgan Chase shares fell approximately 1% to $353.71 on Thursday as Treasury yields surged despite an expanded bond-buyback programme from the Treasury Department. The 10-year yield rebounded towards 4.69%, whilst the 30-year pushed through 5.22%. The bank's second-quarter results showed strong performance, with markets revenue up 35%, investment-banking fees rising 30%, and equity-markets revenue jumping 86%. The bank generated $16.9 billion in quarterly profit excluding significant items. However, shares are trading 12.82% above their $313.51 estimated value. With the bank approaching a $1 trillion valuation and near record highs, analysts suggest the stock offers little room for disappointment amid rising bond yields.