S

Swoop.com

AI-driven omnichannel healthcare marketing platform

Senior Data Engineer

Data EngineeringUpdated on Nov 13
Full-timeToronto, ON, CanadaCA$195k - CA$228k /yrHybrid

About the Job

Requirements

  • At least 5 years of experience building production data pipelines and platforms.
  • Deep Python (PySpark) and SQL fluency, including tuning Spark jobs at scale.
  • Ability and willingness to work on services around the data layer using Java and Spring Boot.
  • Hands-on experience with distributed compute using Spark/EMR, streaming with Kinesis, and object storage with S3.
  • Solid Postgres fundamentals, including query optimization, indexing, replication, replica routing, and identifying database bottlenecks.
  • Experience with Iceberg and Trino, or similar technologies.
  • Comfort with CI/CD and Terraform.
  • Experience building with AI, including frontier models, agentic coding tools, or other AI tools.
  • Track record of working across teams such as product and operations.
  • Ownership of platform reliability, cost, accessibility, and compliance.
  • Treating security and PII/PHI handling as core engineering responsibilities.
  • Ability to create documentation, tools, and skills that help engineers and analysts work more efficiently.
  • Bias for iterative delivery and instrumenting shipped work.
  • Good judgment about prioritization when multiple issues are urgent.

Responsibilities

  • Own the data platform end-to-end, including ingestion, transformation, storage, query, and access, and drive its roadmap as the company's data needs grow.
  • Build and evolve batch and streaming pipelines on PySpark/EMR, Kinesis, Lambda, and Step Functions, ingesting from Postgres, Salesforce, third-party vendors, and product event streams into an Iceberg-based lake.
  • Design warehouse SCD tables, event tables, and conventions that other engineers and analysts follow when adding data.
  • Partner with product, engineering, analytics, and operations stakeholders to turn data requests into well-scoped, reliable pipelines, and write documentation and tooling that enable self-service.
  • Own data-system security and compliance, including audit logging, access control, and temporary-access workflows.
  • Optimize backend query performance where the data layer meets product code, including read-replica routing, indexing, caching, and IO instrumentation in Java/Spring services.
  • Lead investigations and remediation of data infrastructure issues, including IOPS spikes, pipeline failures, schema drift, and late data, and make fixes durable.
  • Use AI for pipeline scaffolding, schema work, and ad hoc investigations, and ship internal AI tooling for other teams.
  • Mentor engineers and analysts across the company on working with the data platform.

About the Company

Swoop.com

AI-driven omnichannel healthcare marketing platform

Swoop provides AI-powered omnichannel marketing solutions for healthcare, helping pharmaceutical brands reach patient and healthcare provider audiences across channels like programmatic ads, TV, and social media. Its platform uses machine learning, real-world data, and privacy-preserving methods to build precise audiences without exposing personal health information, with products such as Predictive Audiences, HCP targeting, conversational AI for brand sites, and Swoop Piper for simulating focus groups. The company differentiates itself through a healthcare-only focus, patented audience technologies, and strict HIPAA-compliant data practices that prioritize privacy. Its goal is to connect pharmaceutical manufacturers and life sciences brands with the right audiences to raise disease awareness, support treatment adherence, and improve patient outcomes across multiple channels.

Company size
501-1,000
Company stage
Debt Financing
Total funding
$13.4M
Headquarters
Boston, MA
Founded
2011

Recently Posted Jobs

Explore more opportunities at Swoop.com

See more jobs