C

Coupang

Sells goods online with its own overnight delivery

Staff Software Engineer - AI Platform, GenAI & Agent Infrastructure

AI Application Engineering +1Posted on Nov 12
Full-timeSeoul, South KoreaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in computer science, software engineering, or a related field is required.
  • At least 5 years of experience building backend or platform services is required.
  • Strong proficiency in major programming languages such as Java, Kotlin, or Python is required.
  • Experience designing and operating cloud-native services on AWS is required.
  • A solid understanding of distributed systems, APIs, microservices, and backend architecture is required.
  • Experience with databases, caching systems, and event-driven architecture is required.
  • Strong problem-solving and debugging skills are required.
  • Ability to quickly learn and apply new technologies across diverse technical domains is required.

Responsibilities

  • Design and develop core services for AgentHub, the internal enterprise agent platform.
  • Build tools, APIs, and service frameworks that enable AI agents to interact with internal systems and business workflows.
  • Design scalable architecture to support multi-agent orchestration and business process automation.
  • Develop and maintain integrations with major internal collaboration tools, including GitHub, GitLab, Jira, Confluence/Wiki, and SharePoint, as well as internal APIs and databases.
  • Implement environments where agents can search and process internal knowledge sources and reason based on that information.
  • Build a secure data access layer and permission-based search services.
  • Operate and optimize LLM gateway platforms such as Portkey and LiteLLM.
  • Integrate and manage major foundation models, including AWS Bedrock, Anthropic Claude, OpenAI, and Google Gemini.
  • Implement model routing, observability, usage governance, and cost optimization.
  • Establish platform standards for the reliability, scalability, and security of AI services.
  • Build retrieval-augmented generation services using vector databases and internal knowledge repositories.
  • Design indexing pipelines, embedding services, and semantic search functionality.
  • Improve the response quality, accuracy, latency, and operational efficiency of AI systems.
  • Monitor and reliably operate production AI services in cloud environments.
  • Develop observability frameworks covering model usage, response speed, token consumption, and service health.
  • Resolve complex incidents in production environments and strengthen platform resilience.
  • Establish platform engineering best practices and lead operational automation.

Desired Qualifications

  • Experience building or operating generative AI applications in production environments.
  • Experience with foundation models such as AWS Bedrock, OpenAI API, Anthropic Claude, and Gemini.
  • Experience operating LLM gateway solutions such as Portkey, LiteLLM, or Kong AI Gateway.
  • Understanding of prompt orchestration, tool/function calling, and agent architectures.
  • Experience with related frameworks such as LangGraph, LangChain, CrewAI, AutoGen, or OpenAI Agents SDK.
  • Experience designing agent workflows and multi-agent systems.
  • Understanding of MCP (Model Context Protocol) and tool integration patterns.
  • Experience with vector databases such as OpenSearch, Pinecone, Weaviate, Milvus, or pgvector.
  • Experience building enterprise search, knowledge management, or RAG systems.
  • Understanding of embeddings, semantic search, reranking, and performance evaluation methodologies.
  • Experience with Kubernetes, Docker, Terraform, and infrastructure as code.
  • Experience building and operating observability and monitoring systems.
  • Experience designing AI platforms that meet enterprise security and compliance requirements.

About the Company

cb

Coupang

Sells goods online with its own overnight delivery

Coupang runs one of South Korea's largest online stores, selling groceries, electronics, household goods and fashion to consumers and small businesses. Rather than relying on outside carriers, it delivers most orders through its own warehouses and drivers, and its Rocket Delivery service brings millions of items to doorsteps overnight or the same day. Shoppers order through the Coupang app or website, and the company earns money from its own retail sales, commissions and fulfillment fees from outside sellers, and a paid membership. Coupang was founded in Seoul in 2010 and is headquartered in Seattle, with most of its operations and staff in South Korea.

Company size
10,001+
Company stage
IPO
Headquarters
Seattle, WA
Founded
2010

Recently Posted Jobs

Explore more opportunities at Coupang

See more jobs