B

Bank of Montreal

Runs Canadian and US banks for people and firms

Principal AI & Cloud Engineer

Full-TimeUpdated on 10/24/2026Deadline 12/1/26
$120k - $250k+ Commission structure + Performance-based incentives + Discretionary bonuses
Senior
Bachelor's, Master's, PhD
San Francisco, CA, USA+1 moreMore locations: Chicago, IL, USA
In Person
DevOps & InfrastructurePlatform Engineering, Cloud Engineering

About the job

Requirements
  • A Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or a related field is required.
  • At least 7 years of experience building large-scale distributed cloud infrastructure is required.
  • At least 5 years of hands-on experience with Azure or AWS is required.
  • Proven experience with AI/ML infrastructure, including GPU clusters, Kubernetes, CI/CD, and observability, is required.
  • Strong skills in infrastructure as code (IaC), Terraform or Bicep, Kubernetes, networking, and security are required.
  • Expertise in cloud-native patterns, including containers, service mesh, and serverless, is required.
  • Familiarity with MLOps/LLMOps infrastructure, including model serving, feature stores, and vector databases, is required.
  • Programming experience with Python for infrastructure automation and with either Go or TypeScript for tooling is required.
  • Understanding of frontend/backend integration for AI services is required.
Responsibilities
  • Define reference and production-grade cloud solutions for AI/GenAI, with Azure/AWS preferred and multi-cloud awareness.
  • Build reusable, secure, and observable components, including APIs, SDKs, microservices, and pipelines.
  • Operationalize large language models and retrieval-augmented generation systems with strong controls and Responsible AI guardrails.
  • Drive platform roadmaps that enable faster delivery, lower risk, and measurable business outcomes.
  • Design, build, and operate cloud-native AI infrastructure for machine learning and generative AI workloads, including compute (GPU/CPU clusters, autoscaling, and spot-instance strategies), networking (Azure Virtual Network, Private Link, peering, and multi-region high availability/disaster recovery), storage and databases (data lakes, relational databases, and vector databases), and security (identity and access management, Key Vault-backed secrets management, encryption, and policy as code).
  • Implement observability and reliability for AI infrastructure, including metrics for latency, throughput, GPU utilization, and cost; logging and tracing with OpenTelemetry; and service-level objectives and indicators for infrastructure services.
  • Build continuous integration/continuous delivery and GitOps pipelines for infrastructure as code and AI platform components.
  • Drive FinOps for AI infrastructure through GPU rightsizing, caching, inference optimization, and cost governance.
  • Enable frontend and backend services for AI platforms, including secure APIs, microservices, and event-driven architectures.
  • Integrate custom model runtimes, including TensorRT-LLM, vLLM, and Triton/KServe.
  • Provide infrastructure support for retrieval-augmented generation systems, including embeddings, chunking, and retrieval pipelines.
  • Ensure scalable serving infrastructure for large language models and machine learning models, including caching and token optimization.
  • Define and evolve cloud AI infrastructure reference architecture, including container orchestration with Kubernetes, service mesh, ingress, serverless and event-driven patterns for AI pipelines, and multi-region, high-availability/disaster-recovery, compliance-ready designs.
  • Establish standards and best practices for containerization, infrastructure as code, and secure networking for AI systems.
  • Implement defense in depth for AI infrastructure, including least-privilege identity and access management, private networking, key management service/Key Vault, software bills of materials, and image signing.
  • Ensure compliance and Responsible AI controls at the infrastructure level, including data residency, encryption, lineage, and audit readiness.
  • Lead infrastructure discovery and solution design with stakeholders.
  • Operate platforms using site reliability engineering principles, including error budgets, incident response, and chaos testing.
  • Mentor engineers and create reusable infrastructure-as-code modules, templates, and golden paths.
Desired Qualifications
  • Azure and AWS cloud experience are preferred; multi-cloud awareness is valued.
  • Experience optimizing GPUs using CUDA/NCCL or TensorRT-LLM is preferred.
  • Experience with observability tools such as Prometheus, Grafana, and OpenTelemetry is preferred.
  • Experience with event streaming such as Kafka or Azure Event Hubs, and real-time systems, is preferred.
  • Experience with AI platform products such as Azure Machine Learning, MLflow, KServe, and Hugging Face is preferred.

About the company

B

Bank of Montreal

View
cbWebsite

Bank of Montreal, known as BMO, runs a Canadian bank and a large American bank, serving households and businesses on both sides of the border. Until the Bank of Canada opened in 1935, it acted as the Canadian government's banker. People use its branches and apps for accounts, mortgages, credit cards, and investments, while companies borrow from it and turn to its BMO Capital Markets arm to raise money and trade securities. BMO makes money on the gap between the interest it charges on loans and pays on deposits, plus fees from managing wealth and advising on deals. Bank of Montreal was founded in 1817 as Canada's first bank, and it keeps its legal head office in Montreal and its executive offices in Toronto, Canada.

Company Size

10,001+

Company Stage

IPO

Headquarters

Toronto, Canada

Founded

1817

Get referred to Bank of Montreal

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • Profits are climbing: before one-time items, BMO earned C$2.86 billion in the quarter ending July 2026, up 19%.
  • Expansion means jobs out West: in March 2026, BMO announced plans for 130-plus new California branches within five years.
  • Payouts are steady: BMO has paid a dividend every year since 1829, the longest record of any Canadian company.

What critics are saying

  • Cost cuts reach staff: BMO reported a C$202 million severance charge in February 2026 as headcount fell 678 to 53,035.
  • The U.S. arm earns less: its 8.6% return on equity trailed BMO's overall 13% in the quarter ending April 2026.
  • Compliance lapses draw fines: Canada's consumer watchdog fined BMO C$4 million in February 2026 for overcharging 101,091 customers.

What makes Bank of Montreal unique

  • Business lending comes first: 56% of BMO's loans in April 2026 went to companies and governments, 28% to mortgages.
  • It is a big American bank too: its U.S. arm ranked 16th in the country by assets in June 2026.
  • Chicago is its second hub: 81 of BMO's 926 job openings in October 2026 were there, behind only Toronto's 241.

Help us improve and share your feedback! Did you find this helpful?

Benefits

  • Health Insurance
  • Tuition Reimbursement
  • Accident and Life Insurance
  • 401(k) Retirement Plan
  • Professional Development Budget
  • Hybrid Work Options

Company News

MarketScreener
Oct 26th, 2026
Phillips Edison & Company Closes $350 Million Three-Year Unsecured Term Loan

CINCINNATI, Oct. 26, 2026 -- Phillips Edison & Company, Inc. , one of the nation’s largest owners and operators of high-quality, grocery-anchored neighborhood shopping centers, today announced...

CodeGoTech
Oct 22nd, 2026
BMO names Tim Cox as US CEO as Darrel Hackett retires nov. 1.

BMO names Tim Cox as US CEO as Darrel Hackett retires nov. 1. BMO taps its U.S. general counsel and chief regulatory officer Tim Cox to lead its American operations as Darrel Hackett steps down November 1. BMO, the Chicago-anchored U.S. arm of Canada's Bank of Montreal, is preparing for a significant leadership transition at the top of its American operations. Tim Cox, the bank's U.S. general counsel and chief regulatory officer, has been named to succeed Darrel Hackett as U.S. chief executive officer, with the handover set to take effect November 1, when Hackett formally retires from the role. The appointment places a lawyer and regulatory specialist at the helm of one of North America's largest cross-border banking institutions at a moment when the regulatory environment for major banks in the United States is anything but settled. From the legal suite to the corner Office. Cox's ascension is notable precisely because of the path he has taken to reach it. Ascending from the dual role of general counsel and chief regulatory officer to the chief executive seat is a relatively uncommon trajectory in major banking, where the top position has historically been populated by career commercial bankers, capital markets veterans, or retail-focused operators. Cox's background positions him as an executive who has spent considerable time navigating the complex intersection of law, compliance, and institutional strategy - experience that carries heightened relevance as United States regulators continue to scrutinize large domestic and foreign-chartered banks on matters ranging from capital adequacy to consumer protection and anti-money-laundering frameworks. In an era when legal and regulatory risk has become as consequential to a bank's bottom line as credit risk or interest rate exposure, elevating a chief regulatory officer to the top post sends a deliberate signal about institutional priorities. BMO's board and senior leadership appear to be betting that deep regulatory fluency will be a strategic advantage as the bank seeks to deepen its U.S. footprint - a presence that expanded substantially following BMO's acquisition of Bank of the West in 2023, a deal that added hundreds of branches across the western United States and dramatically increased the institution's domestic asset base. Hackett's Legacy and the Timing of Departure. Darrel Hackett's retirement brings to a close a tenure that saw BMO's U.S. operations navigate the post-pandemic economic cycle, the integration of a landmark acquisition, and a markedly more volatile interest rate environment than any large bank had encountered in decades. His November 1 departure date provides a clean calendar transition, allowing Cox a full quarter to settle into the role before year-end planning cycles and the bank's fiscal reporting obligations come into focus. The orderly nature of the succession - an internal promotion rather than an external search - also reflects a degree of strategic continuity that investors and counterparties typically read favorably. The source reporting also references Aron Levine in the context of this leadership transition, suggesting that changes at the U.S. leadership level extend beyond the chief executive seat itself. While the precise scope of Levine's role in the reorganization has not been fully detailed in available reporting, his inclusion underscores that this is a broader recalibration of BMO's U.S. management structure rather than a simple one-for-one swap at the top. What the appointment signals for BMO's U.S. Strategy. BMO's U.S. ambitions have been among the most closely watched expansion stories in North American banking over the past several years. The Bank of the West integration placed BMO in direct competition with regional and super-regional banks across California and other high-growth western markets, while simultaneously increasing the complexity of its regulatory obligations under federal and state supervisory frameworks. Managing that complexity - maintaining strong relationships with the Office of the Comptroller of the Currency, the Federal Reserve, and state-level regulators - is precisely the domain in which Cox has built his career. The choice to promote from within the legal and compliance function also reflects a broader industry recognition that regulatory credibility is not a peripheral concern but a core competitive differentiator. Banks that can demonstrate proactive regulatory engagement, robust governance structures, and institutional transparency are increasingly better positioned to pursue acquisitions, expand product lines, and absorb supervisory scrutiny without operational disruption. Cox, having served in the dual capacity of general counsel and chief regulatory officer, is presumed to bring exactly that kind of institutional credibility to the chief executive role. What this means. BMO's decision to elevate Tim Cox from chief regulatory officer to U.S. chief executive officer is more than a routine succession announcement. It represents a considered institutional bet that regulatory expertise and legal acumen are now front-line strategic competencies for a major bank operating in the United States. As Darrel Hackett hands over the reins on November 1, the bank enters a new leadership chapter shaped by compliance-first thinking at the very top of its American hierarchy. For peer institutions watching closely, the message is clear: in the current environment, knowing how to navigate Washington may matter as much as knowing how to grow a loan book. Elena rosato. Italian fintech analyst. Covers EU payment regulation and the Mediterranean banking sector. § Comments Open discussion no account needed

Yahoo Finance
Oct 21st, 2026
BMO names Tim Cox US chief as Darrel Hackett retires, with $1.5T in assets

BMO has named Tim Cox as its next US chief executive, succeeding Darrel Hackett, who retires from the role on November 1. Cox is currently the bank's US general counsel and chief regulatory officer. Hackett, one of the most prominent Black US banking leaders, will become executive vice chair and senior adviser. Cox will join the bank's executive committee, chair the US management committee, and report to chief executive officer Darryl White. The change follows BMO's plan to open 130 branches in California and 15 in Arizona by 2031. The bank, which counts itself as the eighth-largest in North America with $1.5 trillion in assets, expanded on the West Coast by buying Bank of the West in 2023. Cox joined BMO in 2010 and became US general counsel in 2022.

ABF Journal
Oct 21st, 2026
FGI Finance Supports LTP Sports Group with $65MM ABL Facility

LTP Sports Group, a wholesale distributor of bikes, parts and accessories, sought a finance partner that shares its commitment to genuine partnerships and

Stockhouse
Oct 20th, 2026
Evolve Royalties secures $75M BMO credit facility to grow copper royalty portfolio

Evolve Royalties has arranged a revolving credit facility of up to $75 million with BMO. The company, which focuses only on copper royalties, plans to use the money to add royalty and streaming deals. Evolve provides capital to mining companies in exchange for a share of future revenues. This gives it exposure to copper production without mine operating and construction costs. Chief executive officer Joseph de la Plante expects supply to fall short of demand as electric vehicles, data centres and electrification lift consumption, while ageing mines and few new discoveries limit output. His team previously founded Nomad Royalties, which Sandstorm acquired in 2022. Evolve went public in December.