Principal Data Engineer
Posted on 11/30/2023
INACTIVE
Well

201-500 employees

Personalized health experience app
Company Overview
Well's mission is to transform healthcare through our unique impact to our members' health and happiness. Well's product, a consumer health engagement platform, integrates concierge services, behavioral health, telemedicine, care management and wellness services to drive sustained engagement, lower costs and improve the health of members.
AI & Machine Learning
Consumer Goods
Social Impact
Financial Services

Company Stage

Series B

Total Funding

$297.7M

Founded

2019

Headquarters

Chapel Hill, North Carolina

Growth & Insights
Headcount

6 month growth

21%

1 year growth

21%

2 year growth

21%
Locations
Cambridge, MA, USA • Carrboro, NC, USA • New York, NY, USA • Minneapolis...
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Microsoft Azure
Redshift
Python
Airflow
BigQuery
Apache Spark
SQL
Apache Kafka
Tableau
AWS
Hadoop
Looker
Data Analysis
Snowflake
CategoriesNew
Data & Analytics
Requirements
  • 2+ years experience with Google BigQuery
  • 2+ years experience with data ETL and onboarding tools such as AWS Glue, Azure DataFactory, LakeHouse, Cloud Composer or Matillion
  • 10+ years experience in engineering data pipelines using data processing frameworks such as BigQuery, Databricks, Snowflake, Redshift, Spark, Hadoop, Kafka, Kinesis, Azure SQL Data Warehouse, etc on large scale data sets
  • A high degree of aptitude in hands-on programming with SQL, preferably in constructing sophisticated data pipelines that rely on SQL with experience using various nontrivial SQL features
  • Aptitude in software development, ideally including Python
  • Experience in functional programming languages such as Haskell, Scala, O’Caml, F#, Clojure is particularly valued
  • Substantial experience with Event Bus into Data Lake style architectures
  • Experience building production-hardened data pipelines, with consideration for performance, scalability, reliability, correctness, provenance, privacy, security and repeatability, ideally in high risk/high compliance domains such as healthcare, KYC or banking
  • Ability to partner with stakeholders to leverage tools, business intuition, and attention to detail for data validation and understanding of data testing concepts
  • Experience working with healthcare data such as those from insurance claims, electronic health records, and wearables
  • Experience using orchestration tools like Airflow or Prefect a plus
Responsibilities
  • Grasp the architectural agenda of our CTO and VP of Engineering, translating the key needs into our Data Engineering practices
  • Develop, maintain and improve data processing pipelines with a hands on approach, while mentoring and guiding other team members
  • Develop, articulate and apply internal best data architecture, transformation and curation practices throughout Well’s solutions and toolsets - well architected, trusted & accurate, scalable, stable, repeatable, responsive performance and secure
  • Functionally understand, document and take ownership of our existing data pipelines, spanning key technologies including Glue, Kinesis Firehose, BigQuery, napkin and Tableau/Looker
  • Collaborate with product managers, data scientists, data analysts and engineers to define event schemas that can be seamlessly integrated into data processes and are functionally usable for the organization
  • Work closely with engineers and data scientists across departments to scale existing infrastructure and processes to improve reliability and efficiency
  • Act as an in-house data expert who champions standards for data quality, data architecture, best practices, tool selection and pipeline construction
  • Establish and enforce methodology to verify data quality, supervise daily job execution, and tackle roadblocks to ensure all SLAs are surpassed.
Desired Qualifications
  • Experience using orchestration tools like Airflow or Prefect a plus