OKX

Venture capital for blockchain startups

Big Data Engineer

Platform EngineeringConfirmed live in the last 24 hours

Full-timeSingaporeNo salary listed

About the Job

Requirements

At least 5 years of experience building large-scale data platforms using Hadoop, Spark, Flink, or equivalent technologies.
Deep expertise in distributed storage and compute systems such as MaxCompute, Hologres, ClickHouse, and Hive.
Strong software engineering skills in Java, Scala, or Python, and experience with API-first design.
Hands-on experience with task scheduling systems such as Airflow, DolphinScheduler, or in-house equivalents.
A solid understanding of multi-cloud architectures and cost governance.
Familiarity with LLM integration patterns, including tool calling, retrieval-augmented generation pipelines, and context management.

Responsibilities

Design, build, operate, and evolve large-scale distributed data systems and core big data compute and storage infrastructure.
Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy.
Improve reliability and performance across batch and real-time pipelines.
Develop and expose Model Context Protocol tool interfaces so AI agents can interact with platform APIs.
Build scheduling and cost-optimization agents that automatically tune resource allocation and alert severity.
Instrument platform telemetry to support AI-driven service-level agreement monitoring and anomaly detection.
Design context retrieval pipelines, including retrieval-augmented generation and vector search, for SQL code and configuration knowledge bases.
Own the internal data development platform, including integrated development environment integrations, code review automation, and deployment tooling.
Build API-first tools for backfill and ingestion automation, designed for future Model Context Protocol integration.
Collaborate with data warehouse and service teams to define platform contracts.
Establish service-level agreement benchmarks, cost metrics, and latency dashboards as AI optimization targets.
Build automated incident response and root-cause analysis pipelines.
Define and enforce infrastructure policies across multi-cloud environments.
Build a scheduling agent to configure task dependencies, select engines, balance cost and performance, and set alert tiers.
Build an operations agent to detect pipeline latency, performance degradation, and schema drift, and trigger remediation.
Build an incident response agent to trace service-level agreement breaches to root cause, assign accountability, and generate post-mortems.
Design and maintain the cross-platform Model Context Protocol tool interfaces used by platform agents.

Desired Qualifications

Experience with Model Context Protocol or similar agent-tool frameworks.

OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.

Who We Are

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom.

OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves.

Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er.

OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.

About The Opportunity

We are building the foundational data infrastructure that powers one of the world's leading crypto exchanges. As a Big Data Platform Engineer, you will design, build, and evolve the core platform services that enable hundreds of data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative — embedding LLM-driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously.

What You’ll Be Doing

Platform Core: Design and operate large-scale distributed data systems
Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark)
Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy
Drive reliability and performance improvements across batch and real-time pipelines

AI Integration: Build the AI-native platform layer
Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs
Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity
Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection
Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases

Tooling & DX: Evolve the developer experience
Own the internal data development platform — IDE integrations, code review automation, deployment tooling
Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration
Collaborate with data warehouse and service teams to define platform contracts

Ops & Governance: Drive operational excellence
Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets
Build automated incident response and root-cause analysis pipelines
Define and enforce infrastructure policies across multi-cloud environments

AI Agent Ownership — Platform Tier

Scheduling Agent: auto-configure task dependencies, engine selection, cost/performance trade-offs, and alert tiers
Operations Agent: detect pipeline latency, performance degradation, and schema drift; trigger remediation
Incident Response Agent: trace SLA breaches to root cause, assign accountability, generate post-mortems
MCP Tool Layer: design and maintain the cross-platform tool interfaces that all agents call into

What We Look For In You

5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent)
Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive)
Strong software engineering skills in Java, Scala, or Python; experience with API-first design
Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents)
Solid understanding of multi-cloud architectures and cost governance
Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management
Experience with MCP or similar agent-tool frameworks is a strong plus
Passion for building systems that make other engineers 10x more productive

Perks & Benefits

Competitive total compensation package
L&D programs and education subsidy for employees' growth and development
Various team building programs and company events
Wellness and meal allowances
Comprehensive healthcare schemes for employees and dependants
More that we love to tell you along the process!

Notice:

All official OKX vacancies are published on this website. While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. If in doubt, please apply directly through our official careers website.

Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice.

About the Company

OKX

Venture capital for blockchain startups

OKX Ventures acts as the investment arm of the OKX cryptocurrency exchange, funding and supporting blockchain, DeFi, and Web3 projects. It invests across a wide range of areas—from infrastructure and middleware to applications and games—aiming to strengthen the crypto ecosystem. The firm provides capital and access to OKX’s network of partners and advisors to help portfolio companies grow and succeed. Notable holdings include Polygon, Solana, and Avalanche, reflecting a strategy focused on projects with potential to impact the crypto industry at large. OKX Ventures differentiates itself through its crypto-native perspective, extensive industry network, and active involvement in portfolio development, rather than just providing funding. Its goal is to identify promising projects and help them scale, contributing to a more robust and innovative blockchain ecosystem.

Company size: 5,001-10,000
Company stage: Not listed
Total funding: $1.1B
Headquarters: Singapore, Singapore
Founded: 2017

Recently Posted Jobs

Explore more opportunities at OKX

See more jobs