B

ByteDance

Builds content apps, business software and AI

Senior Software Engineer - AI Infrastructure, Developer Tooling

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USANo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
  • At least 4 years of software engineering experience.
  • Strong proficiency in Python and TypeScript or JavaScript.
  • Experience with at least one systems-level language: C++, Rust, or Go.
  • Practical experience integrating large language models into applications, including prompt engineering, context management, and output parsing.
  • Understanding of agent patterns, including tool use, multi-turn reasoning, and error recovery.
  • Familiarity with code-specific large language model tasks such as generation, summarization, and analysis.

Responsibilities

  • Design and scale retrieval pipelines, including vector search, BM25, and hybrid retrieval strategies.
  • Build and optimize embedding pipelines, chunking strategies, and re-ranking systems.
  • Develop query understanding and rewriting components to improve retrieval relevance.
  • Manage vector database infrastructure at production scale.
  • Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics.
  • Implement tool-use patterns, including function calling, code execution sandboxing, and file system interaction.
  • Develop context management strategies for long-form code understanding.
  • Design and maintain evaluation frameworks for retrieval quality and agent task completion.
  • Build custom benchmark suites for real-world coding task assessment.
  • Create reproducible testing infrastructure with automated regression detection.

Desired Qualifications

  • A master's or Ph.D. in Computer Science, Machine Learning, or a related field.
  • Contributions to open-source developer tooling, retrieval systems, or coding assistants.
  • Experience with AST parsing, code analysis tools, or language servers.
  • Familiarity with rendering pipelines or cross-platform framework architecture.
  • Experience deploying and optimizing machine learning models in production for latency, cost, and reliability.

About the Company

ByteDance

Builds content apps, business software and AI

ByteDance builds content and creation apps for consumers, alongside collaboration software and AI services for businesses. Its video platforms connect viewers with creators, while CapCut gives people tools to edit and publish videos. The group also develops Lark for workplace communication and shared documents, and its Seed research teams build language, image, video, and speech models used in consumer apps and sold through BytePlus cloud services. It earns money from advertising, commerce services, paid software subscriptions, and usage of its enterprise technology. ByteDance was founded in 2012 and has its operational headquarters in Beijing, China.

Company size
10,001+
Company stage
Private
Total funding
$35.1B
Headquarters
Haidian, China
Founded
2012

Recently Posted Jobs

Explore more opportunities at ByteDance

See more jobs