LLM/MLLM Algorithm Engineer

Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa. About TikTok TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day. To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve. Join us. About the team The Data-Ecommerce-Platform Governance-Smart Audit Algorithm Team focuses on the development of large models in NLP, CV, and multimodal domains. The team aims to establish state-of-the-art (SOTA) models while delving deeply into these areas to optimize algorithms for e-commerce data, thereby enhancing business outcomes. By refining algorithms and collaborating with business operations, the team strives to govern the quality and ecosystem of ByteDance's e-commerce products comprehensively. This includes addressing issues such as risks, violations, and low-quality content, while also fostering an e-commerce ecosystem. The ultimate goal is to maximize platform governance efficiency and effectiveness. Job Responsibilities - Large language Model Algorithm Development: Build domain-specific large language models (LLM/MLLM) for e-commerce, integrating domain knowledge to rapidly apply models to business scenarios. - E-commerce Governance Optimization: Understand e-commerce governance scenarios deeply to improve merchant/product/video/live-stream/IPR governance through algorithm optimization. Develop state-of-the-art intelligent review systems capable of “knowing why to reject” decisions. - Model Enhancement: Handle tasks like data construction, foundational model enhancement, instruction fine-tuning, chain-of-thought (CoT) , and parameter-efficient fine-tuning (PEFT) to achieve optimal model performance in the e-commerce domain. - Problem Solving for Governance Applications: Address challenges such as long text/sequence modeling, few-shot learning, content moderation, violation detection, and policy recommendation using large models and multimodal approaches. - Model Development and Optimization: Research and optimize e-commerce-specific NLP and multimodal large models to improve multilingual, multi-task, and multi-modal algorithm performance across various e-commerce scenarios.

Qualifications

Minimum qualifications - Strong Technical Background: Solid foundation in machine learning and familiarity with cutting-edge AI technologies. Preference for candidates with high-quality academic publications or competition experience. - Big Data Proficiency: Familiarity with big data frameworks and applications like MapReduce/Spark is preferred. - Model Training Expertise: Experience with training and deploying TensorFlow/PyTorch models. Knowledge of training acceleration methods such as mixed precision training and distributed training is a plus. - Model Compression and Inference Optimization: Understanding of research and techniques for model compression and inference acceleration, including quantization, pruning, distillation, and TensorRT optimization. Preferred Qualifications Expertise in One of the Following Areas: - Computer Vision (CV) & Multimodal: In-depth knowledge in fields such as image search, classification, segmentation, detection, OCR, graph neural networks, multimodal learning, unsupervised/self-supervised learning, etc. Experience in CV/multimodal large model projects is preferred, especially for e-commerce scenarios like video/product multimodal modeling. Strong practical abilities, with achievements in competitions such as Kaggle, COCO, ImageNet, ActivityNet, ICPC, etc. Publications in top-tier conferences (e.g., CVPR, ICCV, ECCV) are a plus. - Natural Language Processing (NLP): Expertise in areas such as pretraining, NLU, multilingual and cross-lingual learning, NLG, transfer learning, and semi-supervised learning. Experience in LLM-related projects and applying them to unify e-commerce NLP tasks is a plus. Strong practical abilities, with achievements in competitions like Kaggle, GLUE, Super GLUE, CLUE, etc. Publications in top-tier conferences (e.g., ACL, EMNLP) are a plus. TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.