Simplify Logo

Full-Time

Senior Query Optimizer Software Engineer

Confirmed live in the last 24 hours

Voltron Data

Voltron Data

51-200 employees

Modular data systems for analytics solutions

Data & Analytics
Enterprise Software

Compensation Overview

$175k - $210kAnnually

+ Equity Awards

Senior, Expert

Remote in USA

Category
Backend Engineering
Software Engineering
Required Skills
Apache Spark
SQL
Postgres
Apache Thrift
Requirements
  • Building and/or using open source query optimization frameworks like Apache Calcite, Apache Spark Catalyst, Postgres Query Optimizer, and/or others.
  • Developing in C++, especially using modern C++.
  • Utilizing serialization libraries like FlatBuffers, Protobuf, Thrift, MessagePack, and/or others.
  • Working on non-SQL systems and non-SQL computational abstractions.
Responsibilities
  • Spending time learning about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components.
  • Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.
  • Learning and embracing the Apache development process.
  • Becoming familiar with our SQL parser and query optimizer.
  • Benchmarking queries and exploring the effects of different query optimization techniques using our query optimizer.
  • Making changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development.
  • Adding new query optimization rules.
  • Making improvements to decision making in the cost based optimization based on metadata availability for the tables being queried.
  • Integrating non-SQL operations to the optimization framework.
  • Working with client interfacing engineers to understand performance bottlenecks in customer queries.
  • Proposing and implementing improvements to the query parsing and optimization framework.
  • Integrating with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways.

Voltron Data provides modular and composable data systems designed for developers, analysts, and data scientists. Their solutions enhance existing systems by integrating open industry standards, allowing users to work in their preferred programming languages while accessing the same data across various engines. The company focuses on making accelerated computing more accessible for analytics, offering customizable tech stacks that improve performance and reduce costs. This approach aligns with the growing demand for standardization in data systems, particularly with the rise of open-source projects and standards like Arrow for in-memory data representation. Voltron Data serves a diverse clientele and generates revenue through technical resources, guides, and support to help clients effectively utilize their services. Their goal is to create adaptable data systems that evolve with technological advancements.

Company Stage

Series A

Total Funding

$132M

Headquarters

Mountain View, California

Founded

2021

Growth & Insights
Headcount

6 month growth

-4%

1 year growth

-1%

2 year growth

0%
Simplify Jobs

Simplify's Take

What believers are saying

  • Winning the 2022 Digital Innovator Award from Intellyx highlights Voltron Data's industry recognition and potential for continued innovation.
  • The release of Ibis 8.0 and enterprise support for Ibis showcases Voltron Data's commitment to enhancing developer tools and open-source projects.
  • Strategic acquisitions and partnerships, such as with Claypot AI and DataStax, position Voltron Data for significant growth and influence in the data systems market.

What critics are saying

  • The rapidly evolving data systems market requires constant innovation, posing a challenge for Voltron Data to maintain its competitive edge.
  • Dependence on open industry standards may limit Voltron Data's ability to differentiate its offerings from other companies adopting similar standards.

What makes Voltron Data unique

  • Voltron Data's focus on modular and composable data systems allows seamless integration with existing tech stacks, unlike competitors who often require complete system overhauls.
  • Their commitment to open industry standards like Apache Arrow ensures compatibility and flexibility across various data engines, setting them apart from proprietary solutions.
  • The acquisition of Claypot AI and the launch of Theseus demonstrate Voltron Data's dedication to leveraging cutting-edge technologies like GPUs for real-time AI and large-scale data processing.

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries

Unlimited PTO

Medical, Dental, and Vision

Retirement [USA Only]

Home Office Budget

Continuing Education Budget