Simplify Logo

Full-Time

Technical Lead

Data Engines

Posted on 7/1/2024

Voltron Data

Voltron Data

51-200 employees

Modular data systems for analytics solutions

Data & Analytics
Enterprise Software

Compensation Overview

$205k - $250kAnnually

+ Equity Awards

Senior, Expert

Remote in USA

Category
Data Engineering
Data & Analytics
Required Skills
Data Structures & Algorithms
SQL
Data Analysis
Requirements
  • Experience with data processing engines or frameworks
  • Experience in distributed and multi-threaded systems
  • Experience in HW resource management including memory and thread pools
  • Working with SQL and non-SQL systems and their computational abstractions
  • Developing in C++, especially using modern C++
  • Developing for multiple types of hardware (i.e. CPU, GPU)
  • Experience leading and managing a software development team
Responsibilities
  • Spending time learning about the Apache Arrow, the compute primitives we use in Theseus, the query parser and optimizer and other foundational components.
  • Diving into the data processing engine architecture, how all the different components interact with each other and how data flows through the compute graph.
  • Understanding memory management mechanics, including spilling memory from GPU, to Host and Disk.
  • Learning and embracing the software development culture at Voltron Data.
  • Profiling single node and distributed queries executions and analyzing the engine telemetry to better understand how the engine works and how to solve distributed engine issues.
  • Diving deep into the various distributed relational algebra algorithms to understand how they work and how they can be improved.
  • Working with the team on fixing bugs, implementing simple optimizations or code refactoring projects.
  • You would start to transition into a leadership role, first by leading a project with one or two more people.
  • You will be in charge of your own team of 3 to 6 people.
  • You will be expected to manage team tasks and projects, set priorities and help drive towards timelines as necessary.
  • You will have the opportunity to provide mentorship and technical guidance to your team members and also communicate project statuses to the upper management or across other teams.
  • Management responsibilities are not expected to take all of your time, so you will still have time to work on interesting and challenging projects.
  • Proposing and implementing core architecture improvements to the engine.
  • Working on challenging tasks such as language agnostic user defined functions, multi-query concurrency, and multi-tenancy.
  • Integrating the engine with other components and features developed by other teams in the company to provide enterprise grade customer experiences.

Voltron Data provides modular and composable data systems designed for developers, analysts, and data scientists. Their solutions enhance existing systems by integrating open industry standards, allowing users to work in their preferred programming languages while accessing the same data across various engines. The company focuses on making accelerated computing more accessible for analytics, offering customizable tech stacks that improve performance and reduce costs. This approach aligns with the growing demand for standardization in data systems, particularly with the rise of open-source projects and standards like Arrow for in-memory data representation. Voltron Data serves a diverse clientele and generates revenue through technical resources, guides, and support to help clients effectively utilize their services. Their goal is to create adaptable data systems that evolve with technological advancements.

Company Stage

Series A

Total Funding

$132M

Headquarters

Mountain View, California

Founded

2021

Growth & Insights
Headcount

6 month growth

-2%

1 year growth

2%

2 year growth

1%
Simplify Jobs

Simplify's Take

What believers are saying

  • Winning the 2022 Digital Innovator Award from Intellyx highlights Voltron Data's industry recognition and potential for continued innovation.
  • The release of Ibis 8.0 and enterprise support for Ibis showcases Voltron Data's commitment to enhancing developer tools and open-source projects.
  • Strategic acquisitions and partnerships, such as with Claypot AI and DataStax, position Voltron Data for significant growth and influence in the data systems market.

What critics are saying

  • The rapidly evolving data systems market requires constant innovation, posing a challenge for Voltron Data to maintain its competitive edge.
  • Dependence on open industry standards may limit Voltron Data's ability to differentiate its offerings from other companies adopting similar standards.

What makes Voltron Data unique

  • Voltron Data's focus on modular and composable data systems allows seamless integration with existing tech stacks, unlike competitors who often require complete system overhauls.
  • Their commitment to open industry standards like Apache Arrow ensures compatibility and flexibility across various data engines, setting them apart from proprietary solutions.
  • The acquisition of Claypot AI and the launch of Theseus demonstrate Voltron Data's dedication to leveraging cutting-edge technologies like GPUs for real-time AI and large-scale data processing.

Help us improve and share your feedback! Did you find this helpful?

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries

Unlimited PTO

Medical, Dental, and Vision

Retirement [USA Only]

Home Office Budget

Continuing Education Budget

INACTIVE