Full-Time

Data Platform Engineer

US

Confirmed live in the last 24 hours

Onehouse

Onehouse

51-200 employees

Cloud-native managed lakehouse service

Data & Analytics

Mid, Senior, Expert

Sunnyvale, CA, USA

Required Skills
Airflow
Apache Flink
Apache Spark
Java
Requirements
  • 3+ years of experience in building and operating data pipelines in Apache Spark or Apache Flink
  • 2+ years of experience with workflow orchestration tools like Apache Airflow, Dagster
  • Proficient in Java, Maven, Gradle and other build and packaging tools
  • Experience managing large-scale data on cloud storage
  • Great problem-solving skills and eye for details
  • Operational excellence in monitoring, deploying, and testing job workflows
  • Open-minded, collaborative, self-starter, fast-mover
Responsibilities
  • Be the thought leader around all things data engineering within the company - schemas, frameworks, data models
  • Implement new sources and connectors to seamlessly ingest data streams
  • Building scalable job management on Kubernetes to ingest, store, manage and optimize petabytes of data on cloud storage
  • Optimize Spark or Flink applications to flexibly run in batch or streaming modes based on user needs, optimize latency vs throughput
  • Tune clusters for resource efficiency and reliability to keep costs low while meeting SLAs

Onehouse provides a powerful blend of usability and scalability through its cloud-native managed lakehouse service, leveraging Apache Hudi technology. This approach not only enhances data management capabilities by harmonizing the benefits of warehouses and data lakes but also ensures broad interoperability across various table formats, compute engines, and cloud providers. Working at this company places employees at the forefront of data architecture innovation, offering ample opportunities for growth and leadership in a dynamically evolving tech landscape.

Company Stage

Series A

Total Funding

$33M

Headquarters

Menlo Park, California

Founded

2021

Growth & Insights
Headcount

6 month growth

-3%

1 year growth

32%

2 year growth

280%