Full-Time

Senior Query Optimizer Software Engineer

Posted on 8/27/2024

Voltron Data

Voltron Data

51-200 employees

Modular data systems for analytics solutions

Data & Analytics
Enterprise Software

Compensation Overview

$175k - $210kAnnually

+ Equity Awards

Senior, Expert

Remote in USA

Category
Backend Engineering
Software Engineering
Required Skills
Apache Spark
SQL
Postgres
Apache Thrift
Requirements
  • Building and/or using open source query optimization frameworks like Apache Calcite, Apache Spark Catalyst, Postgres Query Optimizer, and/or others.
  • Developing in C++, especially using modern C++.
  • Utilizing serialization libraries like FlatBuffers, Protobuf, Thrift, MessagePack, and/or others.
  • Working on non-SQL systems and non-SQL computational abstractions.
Responsibilities
  • Spending time learning about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components.
  • Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.
  • Learning and embracing the Apache development process.
  • Becoming familiar with our SQL parser and query optimizer.
  • Benchmarking queries and exploring the effects of different query optimization techniques using our query optimizer.
  • Making changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development.
  • Adding new query optimization rules.
  • Making improvements to decision making in the cost based optimization based on metadata availability for the tables being queried.
  • Integrating non-SQL operations to the optimization framework.
  • Working with client interfacing engineers to understand performance bottlenecks in customer queries.
  • Proposing and implementing improvements to the query parsing and optimization framework.
  • Integrating with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways.

Voltron Data provides solutions in the data systems sector, focusing on modular and composable data systems that adapt to changing technology. Their products enhance existing systems using open industry standards, allowing users to work in their preferred programming languages while accessing the same data across various engines. The company aims to make accelerated computing more accessible for analytics by offering customizable tech stacks that improve performance and reduce costs. This approach helps clients save time and money while meeting the demand for standardization in data systems. Voltron Data serves developers, analysts, and data scientists, providing resources like guides and code to help them effectively use their services. Their goal is to create adaptable data systems that evolve with technological advancements.

Company Stage

Seed

Total Funding

$107M

Headquarters

Mountain View, California

Founded

2021

Growth & Insights
Headcount

6 month growth

11%

1 year growth

16%

2 year growth

10%
Simplify Jobs

Simplify's Take

What believers are saying

  • Acquisition of Claypot AI enhances real-time AI processing capabilities.
  • Ibis 8.0 release positions Voltron Data as a leader in cross-platform analytics.
  • Theseus launch addresses demand for high-performance data processing solutions.

What critics are saying

  • Recent CEO change may affect strategic direction and morale.
  • 50% staff layoffs could lead to operational challenges.
  • Integration of Claypot AI may pose alignment challenges with existing systems.

What makes Voltron Data unique

  • Voltron Data focuses on modular and composable analytics building blocks.
  • The company enhances existing systems with open industry standards.
  • Voltron Data offers accelerated computing for analytics with hardware standards.

Help us improve and share your feedback! Did you find this helpful?

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries

Unlimited PTO

Medical, Dental, and Vision

Retirement [USA Only]

Home Office Budget

Continuing Education Budget

INACTIVE