M

Microsoft

Builds workplace software, PCs and cloud services

Software Engineer 2 - AI Infrastructure

Applied Machine LearningConfirmed live in the last 24 hours
Full-time$102.1k - $219.2k /yr

About the Job

Requirements

  • A Bachelor's degree in Computer Science or a related technical field and 2 or more years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Preferred: A Master's degree in Computer Science or a related technical field and 3 or more years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a Bachelor's degree in Computer Science or a related technical field and 5 or more years of such experience; or equivalent experience.
  • Knowledge of distributed systems, scalable architecture, API design, ML/AI fundamentals and practical applications, and experience delivering AI-based solutions.
  • Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, and LangChain.
  • Communication and collaboration abilities.
  • Problem-solving and decision-making under ambiguity.
  • Strategic thinking and adaptability.

Responsibilities

  • Design and build scalable, reliable architectures meeting high-performance requirements for AI systems, including inference backends and API interfaces, applying distributed systems principles.
  • Debug and optimize existing components across the stack, resolving issues quickly and delivering critical fixes while maintaining system integrity.
  • Collaborate with internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
  • Identify technical approaches that unlock new possibilities; architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
  • Work across the full stack, from infrastructure to APIs, to deliver end-to-end solutions.

Desired Qualifications

  • Optional experience with the OpenAI API or Azure OpenAI.

About the Company

Microsoft

Builds workplace software, PCs and cloud services

Microsoft builds workplace software, operating systems and cloud infrastructure for consumers, businesses and government agencies, from small organizations to global enterprises. Microsoft 365 combines Word and Excel with Teams communication and Copilot AI features, while Windows runs PCs and Surface supplies the company's own computers. Azure rents computing capacity, storage and databases to build and run web applications. Microsoft also sells Xbox consoles and games, collecting revenue through software licenses, subscriptions, usage charges and product sales. Founded in 1975 by Bill Gates and Paul Allen, Microsoft is headquartered in Redmond, Washington.

Company size
10,001+
Company stage
IPO
Headquarters
Redmond, WA
Founded
1975

Recently Posted Jobs

Explore more opportunities at Microsoft

See more jobs