D

Databricks

Builds cloud software for data analysis and AI

Senior Software Engineer - Infrastructure

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • At least 5 years of production-level software engineering experience and strong proficiency in Python.
  • Expert-level proficiency in Terraform, or Pulumi; Pulumi is preferred.
  • Hands-on experience with AWS, Azure, or GCP; Kubernetes; and Docker and containerization concepts.
  • Experience building and troubleshooting integrations between infrastructure, data pipelines, and observability platforms.
  • Advanced knowledge of GitHub Actions and GitHub Runners.
  • Understanding of observability pillars (logging, metrics, and tracing) and hands-on experience with Datadog, Prometheus, or ELK.
  • Proficiency running distributed systems using concepts such as Kafka or messaging queues.
  • Ability to operate with minimal guidance, own ambiguous projects, and execute independently toward a vision set by technical leads.

Responsibilities

  • Design and deploy production-grade infrastructure on AWS using Terraform or Pulumi.
  • Manage and scale containerized workloads using AKS (Azure Kubernetes Service) or EKS, focusing on cluster security and resource efficiency.
  • Architect deployment pipelines using GitHub Actions and manage GitHub-hosted and self-hosted runners for specialized build requirements.
  • Create underlying infrastructure so new internal applications have security, logging, and metrics enabled by default.
  • Build internal command-line interface tools, artificial intelligence plugins, and automation scripts to streamline developer workflows and improve operational efficiency.
  • Collaborate with stakeholders across Security, Engineering, Infrastructure, and Support to deliver projects with business outcomes.
  • Participate in code reviews, document solutions and failure-triage playbooks, and mentor junior engineers on owned platforms.
  • Own and drive the evolution of core infrastructure and observability platforms; build resilient, scalable, and automated infrastructure; and ensure the AWS environment is cost-optimized, secure, and highly available.

Desired Qualifications

  • Pulumi proficiency is preferred.

About the Company

Databricks

Builds cloud software for data analysis and AI

Databricks builds cloud software that businesses use to organize data, analyze it, and develop AI applications. Its lakehouse architecture brings the flexible storage of a data lake together with the querying and management tools of a data warehouse. Data engineers prepare and update datasets, analysts build reports, and developers train models or create applications in a shared workspace with controls over who can use the data. The platform runs on Amazon, Microsoft, and Google clouds, and customers pay for computing usage or commit to longer contracts for discounted rates. Databricks was founded in 2013 and is headquartered in San Francisco, California.

Company size
10,001+
Company stage
Late Stage VC
Total funding
$32.1B
Headquarters
San Francisco, CA
Founded
2013

Recently Posted Jobs

Explore more opportunities at Databricks

See more jobs