B

BNY

Safeguards and moves assets for investors

Vice President - AI / Machine Learning Software Engineer

Site Reliability EngineeringPosted on Nov 13
Full-time$83k - $178k

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
  • Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
  • Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
  • A solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
  • Proficiency in Ansible, Python, and Shell scripting for automation, tooling, and operational support tasks.
  • Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
  • Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
  • Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
  • Understanding of identity and access management, including secure access controls such as Azure AD.
  • Willingness to participate in on-call rotations and provide occasional weekend support as needed.

Responsibilities

  • Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
  • Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
  • Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
  • Build, maintain, and optimize automation scripts and tooling using Ansible, Python, and Shell scripting to improve efficiency and reliability.
  • Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
  • Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
  • Create and maintain technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
  • Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
  • Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

About the Company

BNY

Safeguards and moves assets for investors

BNY safeguards financial assets and runs investment services for institutions, investment firms and wealthy clients around the world. Its custody business keeps clients' securities safe and handles the records and transactions needed to administer investment funds. Banks and brokers use its systems to settle trades, manage collateral and send payments, while its investment and wealth businesses manage portfolios and advise clients. It earns servicing and management fees as well as interest on loans and securities funded by client deposits. BNY traces its roots to the Bank of New York, founded by Alexander Hamilton in 1784, and is headquartered in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1784

Recently Posted Jobs

Explore more opportunities at BNY

See more jobs