T

Tencent

Global tech conglomerate: social, gaming, cloud

Senior Researcher - Speech Synthesis and Multimodal LLM

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeTokyo, JapanNo salary listed

About the Job

Requirements

  • A Ph.D. in Computer Science, Electrical Engineering, Signal Processing, or a closely related field is required.
  • A strong foundation in speech and audio processing and modern generative models, including diffusion, flow matching, autoregressive, or codec-based approaches, is required.
  • Hands-on experience extending large language models to speech or audio modalities, such as speech tokenizers, multimodal adapters, or speech-text joint training, is required.
  • Proficiency in Python and deep learning frameworks such as PyTorch is required.
  • A track record of publications at top-tier venues such as ICML, NeurIPS, ICLR, ACL, ICASSP, or Interspeech is required.
  • Mandarin Chinese and business-level Japanese or English are required.

Responsibilities

  • Research and develop advanced speech synthesis and generation algorithms, such as text-to-speech, voice conversion, and sound or music generation, based on large language models and multimodal or omnimodal large language models.
  • Develop and optimize speech and audio synthesis systems for online applications, improving effectiveness, efficiency, and scalability.
  • Explore and advance full-duplex and streaming multimodal large language model capabilities in speech understanding, generation, and real-time spoken interaction.
  • Collaborate cross-functionally with research and engineering teams to take work from prototyping through production.

Desired Qualifications

  • Experience with full-duplex or streaming spoken dialogue systems and real-time interaction modeling is a plus.
  • Experience with distributed training is a plus.

About the Company

Tencent

Global tech conglomerate: social, gaming, cloud

Tencent is a Chinese tech group that runs major consumer platforms, online gaming, music and video streaming, fintech services, and cloud/enterprise software. Its products include Weixin/WeChat and QQ for messaging and social features with integrated payments, Tencent Cloud for AI and cloud infrastructure, and a large portfolio of games (in-house titles and stakes in studios like Riot Games and Epic Games). It differentiates itself through a massive global user base, a broad, interconnected ecosystem, and deep investments across gaming, media, fintech, and cloud, creating synergies across consumer and enterprise offerings. Its goal is to connect people and businesses through a comprehensive digital platform, expanding its services and AI-powered tools at scale.

Company size
10,001+
Company stage
IPO
Headquarters
Shenzhen, China
Founded
1998

Recently Posted Jobs

Explore more opportunities at Tencent

See more jobs