Berkshire Hathaway

Diversified holding company across insurance, utilities

Data Platform Engineering Manager

Engineering LeadershipConfirmed live in the last 24 hours

Full-timeSan Francisco Bay Area, CA, USA

About the Job

Requirements

A bachelor's degree in Computer Science, Management Information Systems, Data Engineering, or a related discipline is required.
At least 10 years of experience in database administration, data engineering, or data platform operations is required.
At least 5 years in a team lead, supervisory, or management role with direct people-management responsibility is required.
Hands-on experience across more than one database platform is required, including depth in SQL Server, Azure SQL, and Managed Instance, plus working experience with at least one of Postgres, MySQL, Cosmos, or Mongo.
Experience with database redundancy and high availability, such as Always On or geo-replication, is required.
Cloud data platform experience with Azure SQL, Fabric, or Databricks, and ETL/ELT experience are required.
Experience with infrastructure as code and automation tooling, including Terraform, Azure DevOps, and PowerShell, as well as automating database provisioning and schema deployment, is required.
Expert-level knowledge of SQL Server 2016–2022, Azure SQL, and Managed Instance is required.
Working knowledge of Microsoft Fabric is required.
Familiarity with relational and NoSQL platforms beyond the Microsoft stack, including Postgres, MySQL, Cosmos, and Mongo, is required to evaluate and recommend suitable data stores for workloads.
Knowledge of ETL/ELT patterns and tools, including Azure Data Factory, SSIS, Fabric pipelines, HVR, and Databricks, and of medallion and lakehouse patterns, is required.
Knowledge of Terraform, Azure DevOps, Git-based workflows, PowerShell, and Python is required, as is repository and GitOps fluency sufficient to review and direct the team's infrastructure-as-code contributions.
Knowledge of Dynatrace monitoring, NYDFS Part 500, SOC audit compliance, and PII handling is required.
Ability to communicate technology decisions and trade-offs to Director, VP, and Analytics leadership is required.
Ability to author clear, defensible, and financially grounded standards, runbooks, change records, performance feedback, and investment proposals is required.
Ability to communicate status, risks, and team capacity proactively and in writing to the Director is required.
Ability to bridge technical data concepts and business outcomes for non-technical stakeholders is required.
Participation in the scheduled on-call rotation, including responding to critical incidents, system alerts, and operational emergencies outside normal business hours, is mandatory.
A master's degree is preferred.
Two or more of the Microsoft Fabric Analytics Engineer (DP-600), Azure Data Engineer Associate (DP-203), or Azure Database Administrator Associate (DP-300) certifications are strongly preferred; equivalent certifications in non-Microsoft data platforms are equally valued.

Responsibilities

Lead the team responsible for the enterprise data platform and be accountable for its performance, reliability, security, scalability, and cost efficiency.
Oversee selection, implementation, operation, and continuous improvement of technologies that store, process, and move organizational data.
Develop and strengthen the team's capabilities across relational, NoSQL, and analytical data platforms.
Lead day-to-day platform operations, including 24x7 support and incident response, and ensure delivery through infrastructure-as-code and GitOps practices aligned with the Autonomous Composable Development model.
Directly supervise Database engineers, including day-to-day direction, workload prioritization, performance management, one-on-ones, and reviews aligned to the IC level framework.
Develop the team's depth across relational, NoSQL, and analytical platforms and raise automation, infrastructure-as-code, and GitOps proficiency.
Close the gap between defined standards and demonstrated team practice.
Manage on-call rotation scheduling and escalation coverage.
Surface risks, gaps, and disagreements in writing when identified and resolve cross-team blockers directly with peer leaders, escalating only what cannot be settled at that level.
Own the operational data store estate, including OLTP and NoSQL across MS SQL, Cosmos, and equivalents, and recommend the appropriate store for each workload.
Own transformation and data movement using ADF and Airflow, and replace the existing HVR and SSIS approaches.
Operate the analytical data platform, including OneLake and its Bronze, Silver, and Gold tiers, to the same standards as the relational estate.
Select technology within each category and remain accountable for the reliability, performance, and cost of the selected technologies.
Manage data platform cost, licensing, and capacity according to organizational guidelines.
Define standards for GitOps schema management, infrastructure-as-code provisioning, and lifecycle automation; author and review T-SQL, PowerShell, and infrastructure-as-code templates using Terraform and Azure DevOps for database provisioning and schema deployment.
Move the team's work from manual execution to self-service, including database change management through Liquibase or equivalent tooling and automated environment refreshes.
Ensure the team's participation in cross-team automation initiatives, including timely delivery of post-configuration requirements, provisioning inputs, and integration constraints to partner engineering teams.
Champion Claude and large language model tooling for schema documentation, data lineage, query optimization, and automation, and mentor engineers on advanced usage.
Remain hands-on in designing, implementing, and administering the data platform estate, including Azure SQL, Managed Instance, SQL Server, and relational, NoSQL, and analytical platforms adopted over time; serve as the final technical escalation point for complex incidents.
Own redundancy planning, high-availability design, and failover execution across the estate, including Always On availability groups, geo-replication, and tested failover procedures.
Validate high availability and disaster recovery through regular testing and drive remediation of single points of failure.
Define monitoring standards on Dynatrace and oversee performance, availability, and capacity monitoring across the data platform estate; lead complex performance tuning and bottleneck resolution.
Participate in the 24x7 on-call rotation, review post-incident reports, and drive remediation to closure.
Implement and enforce enterprise data classification, PII handling, retention, and audit compliance requirements within the data platform estate; partner with Security on data security aligned with NYDFS Part 500 and SOC requirements.
Ensure team adherence to documentation and change-management standards, and review and approve change records before implementation.
Lead tooling evaluations and vendor assessments; coordinate with the Director on capacity planning, budgeting, and staffing.
Represent the data platform in cross-functional work with DevOps, Application Engineering, Security, and Analytics, and resolve technical boundaries between teams directly.
Communicate technology trade-offs and platform risk to Director and VP levels, and author proposals for investments involving significant budget or operational risk.

Desired Qualifications

Experience using Claude or other large language models for data engineering is preferred.
A track record of designing and operating data systems in regulated industries is preferred.

Salary Range: 174250 to 222020 (Currency: USD) (Pay period: per-year-salary)

Berkshire Hathaway Homestate Companies, Workers Compensation Division, is looking for a Data Platform Engineering Manager to lead the team responsible for the organization's enterprise data platform and is accountable for its performance, reliability, security, scalability, and cost efficiency. This individual oversees the selection, implementation, operation, and continuous improvement of the technologies that store, process, and move data across the organization.

The position requires broad expertise across relational, NoSQL, and analytical data platforms, with responsibility for developing and strengthening these capabilities within the team. The Manager leads day-to-day platform operations, including 24x7 support and incident response, and ensures delivery through Infrastructure as Code (IaC) and GitOps practices aligned with the Autonomous Composable Development (ACD) model.

ESSENTIAL RESPONSIBILITIES

TEAM LEADERSHIP AND DEVELOPMENT

Directly supervises Database engineers day-to-day direction, workload prioritization, performance management, 1:1s, and reviews aligned to the IC level framework.

Accountable for developing the team’s depth across relational, NoSQL, and analytical platforms, and for raising automation, IaC, and GitOps proficiency.

Accountable for closing the gap between defined standards and demonstrated team practice.

Manages on-call rotation scheduling and escalation coverage.

Surfaces risks, gaps, and disagreements in writing at the time they are identified rather than after work is underway.

Resolves cross-team blockers directly with peer leaders and escalates only what cannot be settled at that level.

DATA PLATFORM OWNERSHIP

Owns the operational data store estate: OLTP and NoSQL across MS SQL, Cosmos, and equivalents. Recommends the right store for a given workload rather than defaulting to a single engine.

Owns transformation and data movement: ADF, Airflow, and the replacement of the HVR and SSIS approaches currently in place.

Operates the analytical data platform — OneLake and the Bronze, Silver, and Gold tiers — to the same standards as the relational estate.

Selects technology within each category, and is accountable for the reliability, performance, and cost of what is chosen.

Manages data platform cost, licensing, and capacity per organizational guidelines.

AUTOMATION AND DELIVERY

Defines standards for GitOps schema management, IaC provisioning, and lifecycle automation. Authors and reviews T-SQL, PowerShell, and IaC templates (Terraform, Azure DevOps) for database provisioning and schema deployment.

Accountable for moving the team’s work from manual execution to self-service — including database change management through Liquibase or equivalent tooling, and the automation of environment refreshes.

Responsible for the team’s participation in cross-team automation initiatives, including timely delivery of post-configuration requirements, provisioning inputs, and integration constraints to partner engineering teams.

Champions Claude and LLM tooling for schema documentation, data lineage, query optimization, and automation; mentors engineers on advanced usage.

DATABASE OPERATIONS, RESILIENCE AND PERFORMANCE

Remains hands-on in the design, implementation, and administration of the data platform estate — Azure SQL, Managed Instance, SQL Server, and the relational, NoSQL, and analytical platforms adopted over time. Serves as the final technical escalation point for complex incidents.

Owns redundancy planning, high availability design, and failover execution across the estate, including Always On availability groups, geo-replication, and tested failover procedures. Validates HA/DR through regular testing and drives remediation of single points of failure.

Defines monitoring standards on Dynatrace and oversees performance, availability, and capacity monitoring across the data platform estate. Leads complex performance tuning and bottleneck resolution.

Participates in the 24x7 on-call rotation. Reviews post-incident reports and drives remediation to closure.

STANDARDS, COMPLIANCE AND CROSS-TEAM LEADERSHIP

Implements and enforces enterprise data classification, PII handling, retention, and audit compliance requirements within the data platform estate; partners with Security on data security aligned with NYDFS Part 500 and SOC requirements.

Ensures team adherence to documentation and change management standards; reviews and approves change records before implementation.

Leads tooling evaluations and vendor assessments; coordinates with the Director on capacity planning, budgeting, and staffing.

Represents the data platform in cross-functional work with DevOps, Application Engineering, Security, and Analytics, and resolves technical boundaries between teams directly.

Communicates technology trade-offs and platform risk to Director and VP levels; authors proposals for investments involving significant budget or operational risk.

QUALIFICATIONS

EDUCATION, LICENSES AND CERTIFICATIONS

Bachelor’s degree in Computer Science, Management Information Systems, Data Engineering, or related discipline required. Master’s preferred.

Two or more strongly preferred: Microsoft Fabric Analytics Engineer (DP-600), Azure Data Engineer Associate (DP-203), Azure Database Administrator Associate (DP-300). Equivalent certifications in non-Microsoft data platforms are equally valued.

EXPERIENCE

10+ years in database administration, data engineering, or data platform operations.

5+ years in a team lead, supervisory, or management role with direct people-management responsibility.

Hands-on experience across more than one database platform — required. Depth in SQL Server, Azure SQL, and Managed Instance, plus working experience with at least one of Postgres, MySQL, Cosmos, or Mongo.

Database redundancy and high availability (Always On, geo-replication, or equivalent).

Cloud data platform experience (Azure SQL, Fabric, or Databricks) and ETL/ELT.

IaC and automation tooling (Terraform, Azure DevOps, PowerShell). Experience automating database provisioning and schema deployment.

Clause or LLM usage for data engineering preferred.

Track record designing and operating data systems in regulated industries preferred.

TECHNICAL/FUNCTIONAL KNOWLEDGE

Expert-level SQL Server 2016–2022, Azure SQL, and Managed Instance. Working knowledge of Microsoft Fabric.

Familiarity with relational and NoSQL platforms beyond the Microsoft stack — Postgres, MySQL, Cosmos, Mongo — sufficient to evaluate and recommend the right store for a given workload.

ETL/ELT patterns and tooling (Azure Data Factory, SSIS, Fabric pipelines, HVR, Databricks) and medallion and lakehouse patterns.

Terraform, Azure DevOps, Git-based workflows, PowerShell, and Python. Repository and GitOps fluency sufficient to review and direct the team’s IaC contributions.

Dynatrace monitoring. Advanced Claude/LLM usage for data engineering and automation.

NYDFS Part 500, SOC audit compliance, and PII handling.

LANGUAGE ABILITY AND COMMUNICATION

Presents technology decisions and trade-offs to Director, VP, and Analytics leadership.

Authors standards, runbooks, change records, performance feedback, and investment proposals that are clear, defensible, and financially grounded.

Communicates status, risks, and team capacity to the Director proactively and in writing, without requiring prompting.

Bridges technical data concepts and business outcomes for non-technical stakeholders.

ON-CALL REQUIREMENTS

This position is required to participate in a scheduled on-call rotation. On-call responsibilities include responding to critical incidents, system alerts, and operational emergencies outside of normal business hours. Active participation in the on-call program is a mandatory condition of employment and will be evaluated as part of performance reviews.

WHAT WE OFFER

Work From Home Program (up to 2 days per week upon eligibility)

Modern Office Setting

Free On-Site Fitness Facility

Free On-Site Garage Parking

Paid Time Off

Paid Holidays

Retirements Savings Match

Group Health Insurance (Medical, Dental, and Vision)

Hospital Indemnity Insurance

Life and AD&D Insurance

Long Term Disability Insurance

Accident and Critical Illness Insurance

Flexible Savings Accounts

Paid Community Volunteer Day

Employee Assistance Program

Tuition Reimbursement Program

Employee Referral Program

Diversity, Equity and Inclusion Program

With more than 50 years in business, BHHC has grown from a regional organization to a national insurance group, offering insurance products from coast to coast. Relationships are the cornerstone of our culture, and we believe in doing the right thing. That means we invest in our business in every way possible to deliver on our mission and demonstrate that people are what powers our success. Our commitment to financial strength and integrity means our customers can rest assured that we will be there when it counts.

At BHHC we embrace diversity and foster an environment where our people can be their authentic selves. Our differences make us stronger and better together, which fosters a harmonious workplace—something we truly value. We’ve created an approachable and collaborative atmosphere. Here you’ll find a welcoming workplace where everyone can feel valued, supported, and inspired to do great work. Together, we raise the bar by being curious, remaining customer-focused, and operating with integrity.

About the Company

Berkshire Hathaway

Diversified holding company across insurance, utilities

Berkshire Hathaway is a diversified holding company that owns and manages a portfolio of businesses across insurance, utilities, manufacturing, and retail. It generates revenue from the profits of its subsidiaries and from investment income from its large portfolio of stocks and bonds. Its operations include providing property and casualty insurance, operating utility companies, manufacturing goods, and owning retail brands such as Borsheim's Fine Jewelry. Its goal is to build long-term shareholder value by sustaining cash flow and value across a broad mix of high-quality companies and investments.

Company size: 11-50
Company stage: IPO
Headquarters: Omaha, NE
Founded: 1839

Recently Posted Jobs

Explore more opportunities at Berkshire Hathaway

See more jobs