L

LinkedIn

Runs a social network for careers and hiring

Senior Staff Software Engineer - AI Infrastructure

Applied Machine LearningConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A Bachelor of Science or Bachelor of Arts degree in Computer Science or a related technical field, or equivalent technical experience.
  • At least 5 years of industry experience in software design, development, and algorithm-related solutions.
  • At least 5 years of experience programming in object-oriented languages such as Python, C++, Java, Go, Rust, or Scala.
  • At least 2 years of experience as an architect or in a technical leadership position.
  • At least 5 years of industry experience leading or building deep learning systems.
  • Hands-on experience developing distributed systems or other large-scale systems.
  • Preferred: A Master of Science or PhD in Computer Science or a related technical discipline.
  • Preferred: At least 10 years of experience in software design, development, and algorithm-related solutions, including at least 5 years in a technical leadership position.
  • Preferred: At least 10 years of experience in an object-oriented programming language such as Python, C++, Java, Go, Rust, or Scala.
  • Preferred: At least 5 years of experience with large-scale distributed systems and client-server architectures.
  • Preferred: Experience building machine learning applications, large language model serving, or GPU serving.
  • Preferred: Co-authorship or maintainer experience on an open-source project.
  • Preferred: Expertise in machine learning infrastructure, including MLFlow, Kubeflow, and large-scale distributed systems.
  • Preferred: Expertise in deep learning frameworks and tensor libraries such as PyTorch, TensorFlow, and JAX/FLAX.
  • Suggested: Machine learning algorithm development.
  • Suggested: Machine learning and deep learning.
  • Suggested: Information retrieval or recommendation systems.
  • Suggested: Technical leadership.

Responsibilities

  • Own technical strategy for broad or complex requirements, using forward-looking approaches that extend beyond the direct team and solve large, open-ended problems.
  • Design, implement, and optimize large-scale distributed serving or training for personalized recommendation and large language models.
  • Improve system observability and understandability, focusing on developer productivity and system sustenance.
  • Mentor other engineers, define the team’s technical culture, and help build a fast-growing team.
  • Work with the open-source community and participate in and influence projects such as vLLM, PyTorch, GNNs, DeepSpeed, and Hugging Face.
  • Serve as tech lead for multiple concurrent key AI Infrastructure initiatives and define the future of AI Platforms.
  • Design and implement high-performance data I/O for AI training infrastructure.
  • Work with open-source teams to identify and resolve issues in libraries such as Hugging Face, Horovod, and PyTorch.
  • Enable distributed training over models with hundreds of billions of parameters; debug and optimize deep-learning training; and provide advanced support for internal AI teams on model parallelism, tensor parallelism, and Zero++.
  • Assist with and guide development of containerized pipeline orchestration infrastructure, including developing and distributing stable base container images, providing advanced profiling and observability, and updating internally maintained deep-learning frameworks and companion libraries such as TensorFlow, PyTorch, DeepSpeed, GNNs, Flash Attention, and PyTorch Lightning.
  • Build low-latency, high-performance applications serving large and complex language and personalization models.
  • Build compute-efficient infrastructure on native cloud and enable GPU-based inference for varied use cases, CUDA-level performance optimizations, and on-device and online training.
  • Support serving at scale, including tens of thousands of queries per second, multiple terabytes of data, billions of model parameters, experimentation with hundreds of new machine-learning models per quarter using thousands of features, and GPU inference at scale.

About the Company

LinkedIn

Runs a social network for careers and hiring

LinkedIn runs a social network for working life, where people keep an online record of their careers and look for jobs, and where employers recruit, advertise, and sell to professionals. It became the world's largest professional network, and in 2016 Microsoft bought it in what was then Microsoft's biggest acquisition. Members fill profiles with their work history and skills, post in a news feed, and apply for openings, while recruiters search those profiles and message candidates through LinkedIn Recruiter. LinkedIn charges employers for these hiring tools and for ads aimed by job title or industry, and members pay for Premium subscriptions. Reid Hoffman co-founded LinkedIn in 2002, and it is based in Sunnyvale, California.

Company size
10,001+
Company stage
Acquired
Total funding
$477.4M
Headquarters
Sunnyvale, CA
Founded
2002

Recently Posted Jobs

Explore more opportunities at LinkedIn

See more jobs