V

Vanna Health

Care coordination for severe mental illness.

Senior Data Engineer - Platform

Data EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USA$180k - $220k /yrRemote

About the Job

Requirements

  • Typically seven or more years building production software or data systems, including several years owning data infrastructure or pipelines end to end, from design through operation.
  • Hands-on production experience with at least one distributed data processing engine at scale, such as Spark or Databricks, Snowflake, BigQuery, Flink, Dask or Ray, rather than single-machine pandas; ability to identify what belongs on one machine, make large jobs fast and memory-predictable, and describe a job with before-and-after numbers.
  • Strong Python and SQL skills, including the ability to explain why a query's result is reliable and what validation was performed.
  • Experience designing systems on a major cloud, with AWS preferred, including storage, compute, networking, identity and access management, and cost; production engineering discipline in automated testing, continuous integration/continuous delivery, infrastructure as code, code review, observability and incident response.
  • Experience leading technical work by setting direction for a project or team and mentoring other engineers.
  • Experience investigating data problems upstream and tracing them to their source.
  • Daily use of AI coding agents in engineering work, with an example of detecting an incorrect AI result on real data and explaining how it was caught.

Responsibilities

  • Shape the data platform roadmap with data leadership, own delivery of led work, and keep stakeholders informed of progress, risks and trade-offs.
  • Set technical direction for data engineering through design and code-review standards, mentoring, and unblocking engineers and contractors working on the platform.
  • Own the platform architecture on Databricks and AWS, including ingestion, storage, compute, access control and environments; write design documents and make build-versus-buy decisions.
  • Own connectivity to partners and systems as tested, versioned software, including payer claims, eligibility and attribution files over SFTP and S3, private networking, clinical and event feeds using FHIR and HL7, and data exchanged with the care platform.
  • Decide where and how jobs run; improve speed, memory predictability and cost through compute choices, serverless versus clusters, right-sizing, and moving single-machine Python workloads to distributed compute.
  • Own orchestration and deployments, treating infrastructure and pipelines as code with Terraform, GitLab CI/CD, automated tests and release practices.
  • Make the platform reliable and observable; detect failed, skipped or unusually slow jobs before downstream impact, and improve earlier detection and automatic recovery.
  • Make data usable by AI through governed metric definitions, Genie spaces and MCP servers so colleagues and AI agents use trusted data.
  • Validate incoming data against expectations, including row counts, date spans, expected fields and historical coverage.
  • Automate recurring manual work and use AI agents so routine data operations run automatically, escalating only when judgment is needed.
  • Participate in a shared data operations rotation, kept light through automation.
  • Protect protected health information through access controls, auditing, de-identification and secure data exchange in partnership with security leadership.
  • Provide analytics engineering with a reliable platform for building the gold tier on time and at a sensible cost.
  • Represent data engineering with partners, vendors and colleagues, and share learnings.

Desired Qualifications

  • AWS experience is preferred among experience designing systems on a major cloud.
  • Experience with Databricks, Delta Lake, Unity Catalog and dbt.
  • Experience with Databricks Genie, MCP servers, or other ways of exposing governed data to AI agents.
  • Healthcare data experience, including claims (837/835), eligibility (834), FHIR, HL7 v2 and hospital event feeds, or experience in another regulated setting such as HIPAA or SOC 2.
  • Experience with workflow orchestration such as Databricks Workflows or Temporal, event-driven ingestion and serverless compute.
  • Experience leading or managing engineers, or a clear interest in growing into a data engineering lead.

About the Company

Vanna Health

Care coordination for severe mental illness.

Vanna Health supports people with serious mental illnesses by coordinating care across the health system and partnering with payers, providers, and community-based organizations to improve outcomes and lower costs. Its approach blends technology with hands-on care, employing roles like full stack engineers, care coordinators, and care team leaders to connect patients with services and manage care plans. Unlike peers that focus on a single setting, Vanna Health’s model emphasizes collaboration across stakeholders and long-term patient outcomes, backed by a team drawn from healthcare startups, analytics, and legal fields. The goal is to help individuals with serious mental illnesses live meaningful, healthy lives by reducing barriers to care and delivering sustainable, value-based support.

Company size
51-200
Company stage
Series A
Total funding
$52M
Headquarters
San Francisco, CA
Founded
2021

Recently Posted Jobs

Explore more opportunities at Vanna Health

See more jobs