AI Infrastructure Support Engineer - AI Infrastructure Support

At BNY, our culture allows us to run our company better and enables employees’ growth and success.As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide. 

Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. 

We’re seeking a future team member for the role of Vice President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA Location. 

In this role, you'll make an impact in the following ways: 

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
• Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
• Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
• Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
• Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
• Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
• Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

To be successful in this role, we’re seeking the following:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
• Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
• Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
• Proficiency in Ansible,  Python and Shell scripting for automation, tooling, and operational support tasks.
• Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
• Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
• Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
• Understanding of identity and access management, including secure access controls such as Azure AD.
• Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
• Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
• Willingness to participate in on-call rotations and provide occasional weekend support as needed.

At BNY, our culture speaks foritself, checkout the latest BNY news at:

BNY Newsroom 

BNY LinkedIn 

Here’s a few of our recent awards:

• America’s Most Innovative Companies, Fortune, 2025
• World’s Most Admired Companies, Fortune 2025
• “Most Just Companies”, Just Capital and CNBC, 2025

 
Our Benefits and Rewards: 

BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter. 

BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.