T

Toss

Fintech super-app for payments and banking

AI Platform Engineer - Recommendation

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeSeoul, South KoreaNo salary listedIn-person

About the Job

Requirements

  • Experience with model-serving frameworks such as Triton and vLLM, including performance tuning and operational reliability.
  • Understanding of GPU internals and the operation of LLM models, with practical operational experience.
  • Interest in automation, monitoring, and orchestration to improve experimentation and operational efficiency.
  • Ability to technically define unstructured problems and solve them systematically.

Responsibilities

  • Operate serving frameworks such as vLLM, Dynamo, and Triton, and improve their performance.
  • Build and monitor stable real-time serving environments for large-scale LLM and embedding models.
  • Continuously improve system performance with consideration for resource efficiency, inference speed, and scalability.
  • Work on orchestration and automation to respond to model-serving incidents and ensure deployment stability.

Desired Qualifications

  • Experience optimizing and operating large-scale LLM or embedding models for training or serving.
  • Experience optimizing LLM models to improve performance for use in services.
  • Experience building generalized platforms for AI/ML models.
  • Experience operating models in high-performance serving or large-scale traffic environments.
  • Experience quickly adopting new technology trends and incorporating them into a team.

About the Company

Toss

Fintech super-app for payments and banking

Toss is a South Korean financial services platform that started as a peer-to-peer money transfer service and has grown into a digital 'super app' for personal finance. Its products are accessed through one mobile interface that unifies bank accounts, credit cards, loans, investments, and other financial services, including its own Toss Bank and Toss Securities. It differentiates itself by offering a broad, integrated ecosystem—combining digital banking, asset management, and brokerage services under one roof and running its own banking and securities units. Its goal is to become the leading consumer finance platform in South Korea while expanding its user base globally.

Company size
1,001-5,000
Company stage
Series G
Total funding
$1.5B
Headquarters
Seoul, South Korea
Founded
2011

Recently Posted Jobs

Explore more opportunities at Toss

See more jobs