T

Telnyx

Cloud-based voice, messaging, and wireless services

Forward Deployed Engineer

AI Application Engineering +1Confirmed live in the last 24 hours
Full-timeSeoul, South KoreaNo salary listed

About the Job

Requirements

  • A Computer Science degree or equivalent experience is required.
  • At least 3 years of experience building and shipping production software, including coding used by real users, on-call work, and debugging production issues, is required.
  • Proficiency in multiple programming languages among Python, Node.js/TypeScript, and Go is required; TypeScript is used for Telnyx Edge Compute functions and stateful actors.
  • Practical understanding of production model failure modes, including provider rate limits and quotas, timeout and retry behavior, streaming, token accounting and cost attribution, and concurrency-related failures, is required.
  • Experience deploying containerized services on Kubernetes, including secrets management, configuration, and upgrades, is required.
  • Experience instrumenting observability using Prometheus, Grafana, OpenTelemetry, Graylog, ELK, or equivalent tools is required, including knowing what to monitor and alert on and how to assess system health.
  • High-concurrency experience with Kafka, message queues, or event streams at scale is required, including understanding consumer lag, backpressure, hot partitions, and rebalance stalls, and mitigation through partitioning, consumer groups, and parallelism.
  • Experience building APIs from scratch is required, including OpenAPI specifications, REST or GraphQL design, authentication, rate limiting, versioning, and idempotency.
  • Event-driven thinking and cloud-native instincts are required.
  • Exposure to SIP, WebRTC, or real-time voice or messaging systems is required.
  • The candidate must be self-sufficient, able to read code and documentation, ask customers for information, and make sound engineering decisions independently.
  • Customer-facing engineering experience is required, including conducting discovery with customer engineers and presenting to executives.
  • The candidate must be able to translate reported technical failures into root causes.
  • The candidate must be comfortable working at customer sites and participating in high-stakes technical conversations.
  • Excellent written and verbal communication in English and Korean is required, including the ability to lead whiteboard sessions, live troubleshooting, and escalations with customer engineering teams.
  • The candidate must be based in Seoul or willing to relocate.
  • The candidate must be legally authorized to work in South Korea or eligible for sponsorship.

Responsibilities

  • Embed with enterprise customers to understand their communications workflows, artificial intelligence use cases, and integration challenges.
  • Build and deploy custom implementations, including artificial intelligence voice assistants, Telnyx APIs for voice, messaging, fax, and wireless, and WebRTC solutions.
  • Run open-weight large language models in customer environments through Telnyx Inference using an OpenAI-compatible API, or deploy self-hosted model stacks such as Llama, Mistral, EEVE-Korean, Polyglot-KR, and other Korean-language sovereign models behind a serving engine when air-gapped or sovereign-cloud requirements demand it.
  • Deploy and operate LiteLLM as a model gateway in customer environments, providing a unified OpenAI-compatible interface across self-hosted open-weight models and hosted providers, with routing, load balancing, retries and fallbacks, rate limits, and per-team virtual keys.
  • Instrument and govern large language model usage through the gateway, including cost tracking and budgets, caching, logging and observability using OpenTelemetry, Langfuse, or similar tools, and guardrails.
  • Implement production observability for shipped systems, including metrics, logs, traces, dashboards, and alerting using tools such as Prometheus and Grafana, OpenTelemetry, Graylog, ELK, or the customer's existing stack.
  • Design model-routing strategies for real-time voice workloads that balance latency, cost, and quality and provide fallback behavior when a provider degrades.
  • Evaluate the build-versus-buy trade-offs between self-hosted open-weight models and hosted frontier APIs, while keeping customer application code portable across both.
  • Adapt models to customer domains by building prompt and retrieval-augmented generation pipelines and evaluation harnesses for Korean and English use cases and Korea/APAC regulatory environments, including PIPA, data localization, and PSC cloud security regulations.
  • Lead proofs of concept, pilots, and production launches from initial design through go-live.
  • Own customer outcomes and remain engaged until solutions are live and stable.
  • Collaborate directly with Product and Engineering to shape the roadmap using field insights from South Korea and the broader Southeast Asia region.
  • Create clear technical documentation and runbooks and maintain solutions suitable for handoff.
  • Troubleshoot and resolve complex integration issues alongside customer teams.

Desired Qualifications

  • Experience with artificial intelligence voice assistants, speech-to-text or text-to-speech, or large-language-model-based conversational systems is desirable.
  • Experience building evaluation sets for a specific domain is desirable.
  • Hands-on production experience with a large language model gateway such as LiteLLM, Portkey, Kong AI Gateway, or an in-house OpenAI-compatible proxy is desirable, including configuration-driven model definitions, routing and fallback rules, and virtual key management.
  • Familiarity with open-weight models and trade-offs between regional and multilingual models, including Korean-language models such as EEVE-Korean, Polyglot-KR, and Kanana, and Korean sovereign artificial intelligence initiatives from Naver, KT, and SK Telecom AI, is desirable.
  • Production experience with inference serving engines such as vLLM, SGLang, or TGI, or Ollama for lightweight on-premises deployment, and experience sizing GPU capacity based on key-value cache footprint, concurrent batch size, context length, and video random-access memory, is desirable.
  • SQL proficiency, including Postgres, MySQL, or Oracle, is desirable.
  • Experience with extract, transform, and load processes and data wrangling is desirable.
  • Experience designing and automating continuous integration and continuous delivery pipelines is desirable.
  • A background in telecommunications, CPaaS, or high-growth software as a service is desirable.
  • Experience with sovereign or on-premises cloud deployments and Korean/APAC regulatory frameworks is desirable, including PIPA, PSC cloud security guidelines, Korea data localization under the Location-Based Information Act, FSC cloud guidelines for financial services, and APAC cross-border data transfer frameworks.
  • A security mindset, including familiarity with identity and access management, encryption, and audit logging, is desirable.

About the Company

Telnyx

Cloud-based voice, messaging, and wireless services

Telnyx provides cloud-based communication services for businesses, including voice, messaging, wireless, and fax, accessed through its Mission Control Portal. It operates on a pay-as-you-go model where customers are billed for usage such as calls, texts, and data. The company differentiates itself by owning and operating a global IP network, which improves performance, reliability, and security, along with extensive support resources for customers. Its goal is to enable businesses of all sizes to communicate reliably and securely over the internet through scalable, usage-based services.

Company size
201-500
Company stage
Seed
Total funding
$1M
Headquarters
Austin, TX
Founded
2009

Recently Posted Jobs

Explore more opportunities at Telnyx

See more jobs