Engineering Manager
Release and Deployment Infrastructure
Updated on 11/30/2023
Unified, open platform for enterprise data
Company Overview
Databricks is on a mission to simplify and democratize data and AI, helping data teams solve the world’s toughest problems. As the world’s first and only lakehouse platform in the cloud, Databricks combines the best of data warehouses and data lakes to offer an open and unified platform for data and AI.
Data & Analytics
Company Stage
Series I
Total Funding
$4.7B
Founded
2013
Headquarters
San Francisco, California
Growth & Insights
Headcount
6 month growth
↑ 12%1 year growth
↑ 39%2 year growth
↑ 108%Locations
Mountain View, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
AWS
Data Analysis
Docker
Google Cloud Platform
Jenkins
Airflow
Microsoft Azure
Puppet
Terraform
Kubernetes
Ansible
Chef
CategoriesNew
DevOps & Infrastructure
Requirements
- BS (or higher) in Computer Science, or a related field
- 5+ years of experience building and leading a team of engineers working in a related system
- Passion for building highly scalable and reliable infrastructure
- Experience with cloud APIs and technologies e.g. a public cloud such as AWS, Azure, and/or GCP
- Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc.
- Can ensure the team builds high quality and reliable infrastructure services; experience being responsible for testing, quality, and SLAs of a product; previous experience building and leading teams in a complex technical domain, such as on distributed data systems or database internals
- Ability to attract, hire, and coach engineers who meet the Databricks hiring standards - can up level existing team via hiring top-notch senior talent, growing leaders and helping struggling members; can gain trust of the team and guide their careers
- Comfort working on cross-functional projects with the ability to deeply understand product and customer personas
Responsibilities
- Build and lead a talented engineering team that develops critical infrastructure needed to build and deploy our Databricks Runtime releases in a controlled and efficient manner
- Partner with our development teams to improve efficiency of release life cycle development activities
- Lead our release team by overseeing Databricks Runtime Releases to ensure high quality delivery of our standard, machine learning and Photon runtimes
- Oversee sustained recruitment of top-tier talent, fostering a well-organized and synergistic team structure, and collaborating effectively with internal and external stakeholders
- Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities
Desired Qualifications
- Experience with Apache Spark™, Delta Lake, and MLflow
- Experience with infrastructure automation tools such as Ansible, Chef, or Puppet
- Knowledge of data engineering best practices and data processing frameworks