Simplify Logo

Full-Time

Engineering Manager

Mosaic AI Runtime

Posted on 6/3/2024

Databricks

Databricks

5,001-10,000 employees

Unified data platform for analytics and AI

Data & Analytics
Enterprise Software
AI & Machine Learning

Compensation Overview

$192k - $260kAnnually

+ Bonus + Equity

Senior

New York, NY, USA

Category
Engineering Management
Software Development Management
Required Skills
Sales
Tensorflow
Pytorch
Marketing
Requirements
  • 2+ years of experience managing software development engineers developing ML systems and/or services
  • 4+ years of hands-on experience with the internals of deep learning frameworks (e.g. PyTorch, TensorFlow) and GenAI models (e.g. GPT, StableDiffusion)
  • 4+ years of experience contributing to the architecture and design of large scale distributed training on GPUs (e.g., Nvidia, AMD) and alternative deep learning accelerators
  • Strong sense of software design and usability of ML systems
  • Experience applying software engineering methodologies and best practices including coding standards, code reviews, build processes, testing, and security.
  • Prior history of contributing to or developing open source projects is a bonus but not a requirement
Responsibilities
  • Directly manage a team of software development engineers: assigning and reviewing work, evaluating performance, providing feedback, and mentoring for career development
  • Oversee and audit the design and implementation of the deep learning training software developed by the team
  • Establish software development best practices, and lead by example in applying them
  • Develop the broader engineering organization and culture through hiring, mentoring, and feedback
  • Drive roadmap planning, execution, and coordination across functions: other engineering teams, research, customer support, marketing, and sales

Databricks provides a unified platform that combines data lakes and data warehouses, known as lakehouse architecture, allowing organizations to manage, analyze, and gain insights from their data effectively. The platform is designed for a variety of users, including data engineers, data scientists, and business analysts, and is applicable across multiple industries such as finance, healthcare, and technology. Databricks offers features like automated ETL processes, secure data sharing, and high-performance analytics, which help streamline data management and analysis. Additionally, it supports machine learning and AI workloads, enabling users to build and deploy models at scale. Unlike many competitors, Databricks operates on a subscription-based model, generating revenue through platform access and professional services. The company's goal is to empower organizations to leverage their data for better decision-making and insights.

Company Stage

Series I

Total Funding

$4.2B

Headquarters

San Francisco, California

Founded

2013

Growth & Insights
Headcount

6 month growth

9%

1 year growth

25%

2 year growth

80%
Simplify Jobs

Simplify's Take

What believers are saying

  • The $1 billion acquisition of Tabular is likely to enhance Databricks' data management capabilities and market reach.
  • The development and launch of the DBRX generative AI model, with a $10 million investment, underscores Databricks' dedication to leading in AI technology.
  • High-profile investments from figures like Nancy Pelosi indicate strong confidence in Databricks' growth potential.

What critics are saying

  • The integration of Tabular's team and technology could face challenges, potentially disrupting operations.
  • The competitive landscape in AI and data analytics is intense, with major players like Google and Microsoft posing significant threats.

What makes Databricks unique

  • Databricks' acquisition of Tabular, founded by the creators of Apache Iceberg, strengthens its position in the open lakehouse market.
  • The launch of DBRX, an open-source LLM that outperforms GPT-3.5 and Llama 2, showcases Databricks' commitment to cutting-edge AI innovation.
  • Strategic partnerships, such as with AVEVA for industrial AI, highlight Databricks' ability to integrate and enhance diverse technological ecosystems.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Extended health care including dental and vision

Life/AD&D and disability coverage

Equity awards

Flexible Vacation

Gym reimbursement

Annual personal development fund

Work headphones reimbursement

Employee Assistance Program (EAP)

Business travel accident insurance

Paid Parental Leave

INACTIVE