B

ByteDance

Builds content apps, business software and AI

Senior Software Engineer - GPU Systems

Systems Software EngineeringConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USANo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Computer Engineering, or Electrical Engineering, or equivalent practical experience.
  • At least 3 years of professional programming experience in C or C++ for low-level, embedded, kernel, driver, runtime, or performance-critical software.
  • A solid understanding of computer architecture, operating systems, concurrency, memory hierarchies, DMA, interrupts, and device I/O.
  • Hands-on experience with GPU or accelerator software in at least one layer, such as kernel drivers, runtimes, firmware, libraries, collective communication, or performance tooling.
  • Demonstrated ability to diagnose system failures using traces, logs, profilers, debuggers, counters, and controlled experiments.
  • Experience delivering and maintaining production-quality features across hardware and software teams.

Responsibilities

  • Design, implement, and maintain production GPU system software, including kernel-driver, runtime, firmware-interface, host-management components, debugging tracing and profiling tools, and GPU system performance measurement tools.
  • Own accelerator features from proof of concept and architecture through implementation, pre-silicon or emulation validation, bring-up, qualification, and deployment.
  • Debug complex failures involving GPUs, CPUs, memory, PCIe or interconnects, IOMMU, firmware, operating systems, runtimes, and distributed workloads.
  • Profile workloads and remove bottlenecks in initialization, memory movement, scheduling, synchronization, communication, recovery, and device utilization.
  • Build automated tests, telemetry, dashboards, health checks, and diagnostic tools that make failures reproducible and regressions visible.
  • Partner with silicon, firmware, compiler, library, machine-learning framework, platform, validation, and production teams to deliver compatible system behavior.
  • Improve resilience through error detection, isolation, retry, reset, repair, graceful degradation, and clear operational procedures.
  • Review low-level designs and code, document hardware/software contracts, and share practical performance and debugging methods with peers.

Desired Qualifications

  • Experience with CUDA, ROCm, Level Zero, OpenCL, Triton, CUTLASS, or comparable accelerator programming and runtime environments.
  • Knowledge of GPU scheduling, memory management, virtualization, PCIe, coherent interconnects, NUMA, or multi-GPU topology.
  • Experience with pre-silicon development, board bring-up, firmware communication, baseboard management controllers, or fleet qualification.
  • Familiarity with distributed training or inference and topology-aware communication libraries.

About the Company

ByteDance

Builds content apps, business software and AI

ByteDance builds content and creation apps for consumers, alongside collaboration software and AI services for businesses. Its video platforms connect viewers with creators, while CapCut gives people tools to edit and publish videos. The group also develops Lark for workplace communication and shared documents, and its Seed research teams build language, image, video, and speech models used in consumer apps and sold through BytePlus cloud services. It earns money from advertising, commerce services, paid software subscriptions, and usage of its enterprise technology. ByteDance was founded in 2012 and has its operational headquarters in Beijing, China.

Company size
10,001+
Company stage
Private
Total funding
$35.1B
Headquarters
Haidian, China
Founded
2012

Recently Posted Jobs

Explore more opportunities at ByteDance

See more jobs