O

Onehouse

Fully managed data lakehouse service platform

Software Engineer - Distributed Data Systems

Backend EngineeringConfirmed live in the last 24 hours
Full-timeSunnyvale, CA, USA

About the Job

Requirements

  • Strong object-oriented design and coding skills in Java and/or C/C++, preferably on a UNIX or Linux platform.
  • Experience with the inner workings of distributed multi-tiered systems, algorithms, and relational databases.
  • Ability to approach ambiguous or undefined problems, think abstractly, and articulate technical challenges and solutions.
  • Ability to prioritize feature development and technical debt with urgency and speed.
  • Ability to solve complex programming and optimization problems.
  • Ability to quickly prototype optimization solutions and analyze large or complex data.
  • Clear communication skills.

Responsibilities

  • Productionize the next generation of the data technology stack by building software and data features that process ingested data.
  • Work on Apache Hudi's transactional engine and optimize it for diverse customer workloads.
  • Deepen the team's expertise in database internals, query engines, storage, and/or stream processing.
  • Design concurrency control and transactional capabilities that maximize throughput for competing writers.
  • Design and implement indexing schemes optimized for incremental data processing and analytical query performance.
  • Design systems that scale and streamline metadata and data access from different query and compute engines.
  • Improve the efficiency of distributed data processing algorithms over a Kubernetes cluster by increasing performance and lowering cost.
  • Use data from existing systems to identify inefficiencies and quickly build and validate prototypes.
  • Collaborate with engineers to implement, deploy, and safely roll out optimized solutions in production.

Desired Qualifications

  • Experience working with database systems, query engines, or Spark codebases.
  • Experience in optimization mathematics, including linear programming and nonlinear optimization.
  • Publications on optimizing large-scale data systems in top-tier distributed systems conferences.
  • PhD degree with at least 2 years of industry experience solving and delivering high-impact optimization projects.

About the Company

Onehouse

Fully managed data lakehouse service platform

Onehouse provides a fully managed data lakehouse on open storage that supports multiple table formats like Apache Hudi, Iceberg, and Delta Lake. It works by letting customers specify the data to organize and optimize, while the service automatically handles data management tasks such as clustering, compaction, masking, encryption, and change data capture, deployable in minutes. It differentiates itself with open-storage lakehouse principles, format flexibility, automated optimization, security features, and a pay-as-you-go model that lowers data-management costs. The goal is to make data management simpler and cheaper while enabling fast access for BI, real-time analytics, and AI/ML workloads.

Company size
51-200
Company stage
Series B
Total funding
$68M
Headquarters
Sunnyvale, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Onehouse

See more jobs