S

Swoop.com

AI-driven omnichannel healthcare marketing platform

Senior Data Engineer

Data EngineeringUpdated on Nov 14
Full-timeRedwood City, CA, USA$205k - $240k /yrHybrid

About the Job

Requirements

  • At least 5 years of experience building production data pipelines and platforms.
  • Deep fluency in Python (PySpark) and SQL, including tuning Spark jobs at scale.
  • Skills and willingness to work on services around the data layer using Java and Spring Boot.
  • Hands-on experience with distributed compute (Spark/EMR), streaming (Kinesis), and object storage (S3).
  • Solid Postgres fundamentals, including query optimization, indexing, replication, replica routing, and recognizing database bottlenecks.
  • Experience with Iceberg and Trino, or similar technologies.
  • Comfort with CI/CD and Terraform.
  • Experience building with AI, such as frontier models, agentic coding tools, or self-built tools.
  • A track record of working across teams such as product and operations.
  • Take ownership of platform reliability, cost, accessibility, and compliance.
  • Treat security and PII/PHI handling as core engineering work.
  • Create documentation, tools, and skills that help engineers and analysts work more efficiently.
  • Ship iteratively and instrument shipped work.
  • Exercise sound judgment in prioritizing competing urgent work.

Responsibilities

  • Own the data platform end-to-end, covering ingestion, transformation, storage, query, and access, and drive its roadmap as company data needs grow.
  • Build and evolve batch and streaming pipelines on PySpark/EMR, Kinesis, Lambda, and Step Functions, ingesting from Postgres, Salesforce, third-party vendors, and product event streams into an Iceberg-based lake.
  • Design warehouse SCD tables, event tables, and conventions for engineers and analysts adding new data.
  • Partner with product, engineering, analytics, and operations stakeholders to turn data requests into well-scoped, reliable pipelines, and create documentation and tooling to enable self-service.
  • Own data-system security and compliance, including audit logging, access control, and temporary-access workflows.
  • Optimize backend query performance where the data layer meets product code, including read-replica routing, indexing, caching, and IO instrumentation in Java/Spring services.
  • Lead investigations and remediation of data infrastructure issues, including IOPS spikes, pipeline failures, schema drift, and late data, and make fixes durable.
  • Use AI for pipeline scaffolding, schema work, and ad-hoc investigations, and ship internal AI tooling for other teams.
  • Mentor engineers and analysts across the company on working with the data platform.

About the Company

Swoop.com

AI-driven omnichannel healthcare marketing platform

Swoop provides AI-powered omnichannel marketing solutions for healthcare, helping pharmaceutical brands reach patient and healthcare provider audiences across channels like programmatic ads, TV, and social media. Its platform uses machine learning, real-world data, and privacy-preserving methods to build precise audiences without exposing personal health information, with products such as Predictive Audiences, HCP targeting, conversational AI for brand sites, and Swoop Piper for simulating focus groups. The company differentiates itself through a healthcare-only focus, patented audience technologies, and strict HIPAA-compliant data practices that prioritize privacy. Its goal is to connect pharmaceutical manufacturers and life sciences brands with the right audiences to raise disease awareness, support treatment adherence, and improve patient outcomes across multiple channels.

Company size
501-1,000
Company stage
Debt Financing
Total funding
$13.4M
Headquarters
Boston, MA
Founded
2011

Recently Posted Jobs

Explore more opportunities at Swoop.com

See more jobs