Facebook pixel

Principal Data Engineer
Posted on 3/3/2023
Remote • United States
Experience Level
Desired Skills
Apache Spark
Data Analysis
Data Structures & Algorithms
Google Cloud Platform
Microsoft Azure
  • Passionate about data and technology
  • You love data of all sorts
  • You are very familiar with AWS data solutions
  • Strong background in data pipelining, distributed data processing, software engineering components, and data modeling concepts
  • Looking for opportunities to simplify, automate tasks, and build reusable components reusable across multiple use cases and teams
  • Familiar with workflow management platforms like Airflow
  • Advance in Spark processing, Python or Scala scripting
  • Advanced in SQL, scripting (Linux, Unix) Understand the access patterns for the data
  • You will be working with terabytes of healthcare data, developing a petabytes-scale data platform and innovative data solutions in collaboration with Software Engineers, Data Architects, Delivery and Analytical teams
  • Designing data structures (i.e. de-normalized, Change Data Capture, nested structures, etc.) that are optimized against process and data skew when dealing with large data sets, and that are highly supportive of concurrency
  • Designing data pipelines and data solutions optimized for different business use cases, and design data partitioning and bucketing strategies accordingly
Desired Qualifications
  • 10+ plus years of the relevant data engineering hands-on experience building various data pipelines
  • 3+ years of experience in Spark
  • 5+ years with private & public cloud deployment (AWS, Azure, GCP, Triton, or similar)
  • 3+ year experience building microservices architecture using containerization technologies like docker, packer or Kubernetes
  • Solid knowledge of API, back-end server components and performance optimization
  • Experience with CI/CD Tools (Gitlab) for deployment automation of critical platform components
  • Bachelor's Degree in Computer Science, a technical or business discipline preferred
  • : Master's Degree, or equivalent experience
  • : Experience working with healthcare datasets

201-500 employees

Health data exchange platform
Company Overview
HealthVerity's mission is to transform the healthcare industry by creating a high-governance, privacy-compliant way for the healthcare industry to connect and exchange real-world data across the broadest ecosystem, enabling longitudinal patient journeys, frictionless access to data and better patient outcomes.
  • Medical, dental, & vision
  • 401k
  • Stock options
  • Flexible location
  • Generous PTO
  • Mentorship program
  • Professional development