T

Telnyx

Cloud-based voice, messaging, and wireless services

Forward Deployed Engineer

AI Application Engineering +1Confirmed live in the last 24 hours
Full-timeHong KongNo salary listed

About the Job

Requirements

  • A Computer Science degree or equivalent experience is required.
  • At least 3 years of experience building and shipping production software is required, including writing code used by real users, being on call, and debugging production issues; consulting experience qualifies if these conditions are met.
  • Proficiency in multiple programming languages among Python, Node.js/TypeScript, and Go is required; TypeScript is used for Telnyx Edge Compute functions and stateful actors.
  • Practical understanding of production model failure modes, including provider rate limits and quotas, timeout and retry behavior, streaming, token accounting and cost attribution, and concurrency-related failures.
  • Experience deploying containerized services on Kubernetes, including secrets management, configuration, and upgrades.
  • Experience wiring observability using Prometheus and Grafana, OpenTelemetry, Graylog, ELK, or equivalent, including defining monitoring, alerts, and healthy service indicators.
  • High-concurrency experience with Kafka, message queues, or event streams at scale, including understanding consumer lag, backpressure, hot partitions, rebalance stalls, partitioning, consumer groups, and parallelism.
  • Experience building APIs from scratch, including OpenAPI specifications, REST or GraphQL design, authentication, rate limiting, versioning, and idempotency.
  • Event-driven thinking and cloud-native instincts are required.
  • Exposure to SIP, WebRTC, or real-time voice or messaging systems is required.
  • Ability to work independently, read code and documentation, consult customers, and make sound engineering judgments without an engineering team behind the role.
  • Customer-facing engineering experience, including leading discovery with customer engineers and presenting to executives.
  • Ability to diagnose root causes from reports that something is not working.
  • Comfort working at customer sites and participating in high-stakes technical conversations.
  • Excellent written and verbal communication in English and Chinese (Cantonese and/or Mandarin), including whiteboard sessions, live troubleshooting, and escalations with customer engineering teams.
  • Must be based in Hong Kong or willing to relocate, and legally authorized to work in Hong Kong or eligible for sponsorship.

Responsibilities

  • Embed with enterprise customers to understand communications workflows, AI use cases, and integration challenges firsthand.
  • Build and deploy custom implementations, including AI Voice Assistants, Telnyx APIs for Voice, Messaging, Fax, and Wireless, and WebRTC.
  • Run open-weight LLMs in customer environments through Telnyx Inference using GLM, Kimi, DeepSeek, Qwen, and MiniMax via an OpenAI-compatible API, or deploy self-hosted stacks such as Llama, Mistral, CKIP-LLO, FlagAlpha, or other Cantonese- or Chinese-language sovereign models behind a serving engine when air-gapped or sovereign-cloud requirements demand it.
  • Deploy and operate LiteLLM as a model gateway in customer environments, providing a unified OpenAI-compatible interface across self-hosted open-weight models and hosted providers, with routing, load balancing, retries and fallbacks, rate limits, and per-team virtual keys.
  • Instrument and govern LLM usage through the gateway using cost tracking and budgets, caching, logging and observability such as OpenTelemetry or Langfuse, and guardrails so customers can monitor and control AI workloads.
  • Implement production observability for shipped systems, including metrics, logs, traces, dashboards, and alerting using tools such as Prometheus and Grafana, OpenTelemetry, Graylog, ELK, or the customer's existing stack.
  • Design model-routing strategies for real-time voice workloads that balance latency, cost, and quality and provide fallback behavior when a provider degrades.
  • Make build-versus-buy recommendations for self-hosted open-weight models versus hosted frontier APIs and keep customer application code portable across both.
  • Adapt models to customer domains by building prompt and retrieval-augmented generation pipelines and evaluation harnesses for English, Cantonese, and Mandarin use cases and Hong Kong/APAC regulatory environments, including PDPO, data localization, and Mainland China cross-border data transfer.
  • Lead proofs of concept, pilots, and production launches from whiteboard through go-live.
  • Stay engaged until customer solutions are live and stable, and own customer outcomes.
  • Collaborate directly with Product and Engineering to shape the roadmap based on field insights from Hong Kong and the broader Greater China/APAC region.
  • Create clear technical documentation and runbooks, and maintain solutions for handoff.
  • Troubleshoot and resolve complex integration issues alongside customer teams.

Desired Qualifications

  • Experience with AI voice assistants, speech-to-text, text-to-speech, or LLM-based conversational systems.
  • Experience building evaluation sets for a specific domain.
  • Hands-on production experience with an LLM gateway such as LiteLLM, Portkey, Kong AI Gateway, or an in-house OpenAI-compatible proxy, including configuration-driven model definitions, routing and fallback rules, and virtual key management.
  • Familiarity with open-weight models and the trade-offs between regional and multilingual models, including Cantonese/Chinese-language models and Greater China sovereign AI initiatives.
  • Experience with an inference serving engine behind a gateway, such as vLLM, SGLang, or TGI for production serving, or Ollama for lightweight on-premises deployments, and sizing GPU capacity for self-hosted models based on KV-cache footprint, concurrent batch size, and context length against VRAM.
  • SQL proficiency with Postgres, MySQL, or Oracle.
  • ETL and data-wrangling experience.
  • CI/CD pipeline design and automation.
  • Background in telecommunications, CPaaS, or high-growth SaaS.
  • Experience with sovereign or on-premises cloud deployments and Hong Kong/APAC regulatory frameworks, including PDPO, Hong Kong data localization, Mainland China PIPL and CSL cross-border data transfer requirements, Office of the Government Chief Information Officer cloud guidelines, or APAC cross-border data transfer frameworks.
  • Security mindset covering identity and access management, encryption, and audit logging.

About the Company

Telnyx

Cloud-based voice, messaging, and wireless services

Telnyx provides cloud-based communication services for businesses, including voice, messaging, wireless, and fax, accessed through its Mission Control Portal. It operates on a pay-as-you-go model where customers are billed for usage such as calls, texts, and data. The company differentiates itself by owning and operating a global IP network, which improves performance, reliability, and security, along with extensive support resources for customers. Its goal is to enable businesses of all sizes to communicate reliably and securely over the internet through scalable, usage-based services.

Company size
201-500
Company stage
Seed
Total funding
$1M
Headquarters
Austin, TX
Founded
2009

Recently Posted Jobs

Explore more opportunities at Telnyx

See more jobs