Inactive
M

Microsoft

Builds workplace software, PCs and cloud services

Principal Software Engineering Manager - AI Frameworks

Engineering LeadershipPosted on Oct 2
Full-timeRemote in USA$142.8k - $304.2k /yrRemote

About the Job

Requirements

  • A bachelor's degree in Computer Science or a related technical field and 6 or more years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing a Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Responsibilities

  • Lead and develop a team of engineers across multiple layers of the AI software stack while staying technically engaged in architecture, design reviews, debugging, and critical implementation decisions for large-scale training and inference.
  • Set technical vision and execution strategy for developer infrastructure, build and release systems, model performance benchmarking, optimization, and production deployment across GPUs and Microsoft hardware.
  • Prioritize and oversee building, benchmarking, profiling, debugging, validating, and optimizing training and inference workloads from developer workflows through production release.
  • Establish best practices for build reliability, system observability, regression monitoring, release quality, impact measurement, developer velocity, time to deployment, and hardware efficiency.
  • Partner with research, product, infrastructure, and hardware teams to deliver scalable, production-ready AI performance improvements.
  • Advance build, release, and validation automation, including AI-assisted workflows and closed-loop systems that identify issues, recommend or implement fixes, and verify outcomes, while aligning investments with organizational goals, platform roadmaps, and Azure capital expenditure objectives.
  • Build an engineering culture through coaching, feedback, hiring, and career development, enabling the team to operate with increasing autonomy and impact.

Desired Qualifications

  • A master's degree in Computer Science or a related technical field and 10 or more years of software engineering experience, including 6 or more years in engineering management; or a bachelor's degree in Computer Science or a related technical field and 12 or more years of software engineering experience, including 6 or more years in engineering management; or equivalent experience.
  • Four or more years of people management experience.
  • A strong foundation in software engineering principles, computer architecture, GPU architecture, and hardware acceleration for neural networks, with hands-on experience in developer infrastructure such as build systems, dependency management, Bazel or comparable tools, continuous integration and delivery, release engineering, and developer productivity.
  • Experience leading teams responsible for end-to-end performance analysis and optimization of large language models, AI systems, or high-performance computing workloads, including GPU profiling and performance analysis tools, and shipping validated builds through release pipelines into production.
  • Ability to lead cross-team initiatives, align stakeholders, and translate research or platform capabilities into scalable, production-ready solutions.
  • People leadership experience, including hiring, coaching, performance management, and career development, with a record of building high-performing, inclusive teams.
  • Working knowledge of AI and machine learning systems across training, inference, evaluation, and benchmarking, and experience with at least one modern deep learning framework such as PyTorch, TensorFlow, or ONNX Runtime; ability to reason about the interaction of models, frameworks, runtimes, hardware, and developer infrastructure across the end-to-end lifecycle.
  • Familiarity with GPU software stacks and acceleration technologies such as CUDA, ROCm, or Triton, sufficient to guide technical direction and evaluate tradeoffs.
  • Experience designing advanced automation for build, test, release, benchmarking, and production validation workflows, including AI-assisted tooling and closed-loop systems that use observed results to drive subsequent actions.

About the Company

Microsoft

Builds workplace software, PCs and cloud services

Microsoft builds workplace software, operating systems and cloud infrastructure for consumers, businesses and government agencies, from small organizations to global enterprises. Microsoft 365 combines Word and Excel with Teams communication and Copilot AI features, while Windows runs PCs and Surface supplies the company's own computers. Azure rents computing capacity, storage and databases to build and run web applications. Microsoft also sells Xbox consoles and games, collecting revenue through software licenses, subscriptions, usage charges and product sales. Founded in 1975 by Bill Gates and Paul Allen, Microsoft is headquartered in Redmond, Washington.

Company size
10,001+
Company stage
IPO
Headquarters
Redmond, WA
Founded
1975

Recently Posted Jobs

Explore more opportunities at Microsoft

See more jobs