Simplify Logo

Full-Time

Staff Software Engineer

Distributed Data Systems

Confirmed live in the last 24 hours

Databricks

Databricks

5,001-10,000 employees

Unified data platform for analytics and AI

Data & Analytics
Enterprise Software
AI & Machine Learning

Compensation Overview

$192k - $260kAnnually

+ Annual Performance Bonus + Equity

Senior, Expert

Mountain View, CA, USA

Category
Backend Engineering
FinTech Engineering
Software Engineering
Required Skills
Data Science
Data Structures & Algorithms
Apache Spark
Java
Scala
Hadoop
C/C++
Requirements
  • BS in Computer Science, related technical field or equivalent practical experience.
  • Optional: MS or PhD in databases, distributed systems.
  • 8+ years of production level experience in either Java, Scala or C++.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop).
Responsibilities
  • Building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.
  • Developing the de facto open source standard framework for big data (Apache Spark™).
  • Delivering reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends.
  • Creating a storage management system that combines the scale and cost-efficiency of data lakes with the performance and reliability of a data warehouse.
  • Making it simple to orchestrate and operate tens of thousands of data pipelines.
  • Building the next generation query optimizer and execution engine that's fast, tuning free, scalable, and robust.

Databricks provides a unified platform that combines data lakes and data warehouses, known as lakehouse architecture, allowing organizations to manage, analyze, and gain insights from their data effectively. The platform is designed for a variety of users, including data engineers, data scientists, and business analysts, and is applicable across multiple industries such as finance, healthcare, and technology. Databricks offers features like automated ETL processes, secure data sharing, and high-performance analytics, which help streamline data management and analysis. Additionally, it supports machine learning and AI workloads, enabling users to build and deploy models at scale. Unlike many competitors, Databricks operates on a subscription-based model, generating revenue through platform access and professional services. The company's goal is to empower organizations to leverage their data for better decision-making and insights.

Company Stage

Series I

Total Funding

$4.2B

Headquarters

San Francisco, California

Founded

2013

Growth & Insights
Headcount

6 month growth

7%

1 year growth

25%

2 year growth

76%
Simplify Jobs

Simplify's Take

What believers are saying

  • The $1 billion acquisition of Tabular is likely to enhance Databricks' data management capabilities and market reach.
  • The development and launch of the DBRX generative AI model, with a $10 million investment, underscores Databricks' dedication to leading in AI technology.
  • High-profile investments from figures like Nancy Pelosi indicate strong confidence in Databricks' growth potential.

What critics are saying

  • The integration of Tabular's team and technology could face challenges, potentially disrupting operations.
  • The competitive landscape in AI and data analytics is intense, with major players like Google and Microsoft posing significant threats.

What makes Databricks unique

  • Databricks' acquisition of Tabular, founded by the creators of Apache Iceberg, strengthens its position in the open lakehouse market.
  • The launch of DBRX, an open-source LLM that outperforms GPT-3.5 and Llama 2, showcases Databricks' commitment to cutting-edge AI innovation.
  • Strategic partnerships, such as with AVEVA for industrial AI, highlight Databricks' ability to integrate and enhance diverse technological ecosystems.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Extended health care including dental and vision

Life/AD&D and disability coverage

Equity awards

Flexible Vacation

Gym reimbursement

Annual personal development fund

Work headphones reimbursement

Employee Assistance Program (EAP)

Business travel accident insurance

Paid Parental Leave