Senior Data Engineer
Posted on 8/31/2023
Tendo

51-200 employees

Clinical insight software company
Locations
Philadelphia, PA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Confluence
Data Analysis
JIRA
Git
SQL
Python
NoSQL
CategoriesNew
Data & Analytics
Requirements
  • 5+ years of experience in data engineering
  • Extensive experience in the design, build, and maintenance of data ETL pipelines
  • Extensive knowledge of coding in Python or Scala with focus on data processing
  • Experience using Apache Spark (PySpark or Scala)
  • Experience with AWS technology stack (S3, Glue, Athena, EMR, etc.)
  • Experience with data and entity relationship modeling to support data warehouses and analytics solutions
  • Deep understanding of relational and non-relational databases (SQL/NOSQL)
  • Comfortable working with unstructured and semi-structured data (Web scraping)
  • Experience working in a professional software environment using source control (git), an issue tracker (JIRA, Confluence, etc.), continuous integration, code reviews, and agile development process (Scrum/Lean)
  • Basic data privacy and security principles
Responsibilities
  • Collaborate with Data Scientists and Business Intelligence Analysts to ensure efficient and effective data processing and analysis
  • Optimize data infrastructure and processes to ensure optimal performance and scalability
  • Develop and maintain data documentation and data lineage
  • Stay current with emerging technologies and industry trends related to data engineering
Desired Qualifications
  • Knowledge of, or experience with, healthcare data standards such as HL7, FHIR, ICD, SNOMED, LOINC
  • Experience with Delta Lake and/or Databricks
  • Experience with machine learning workflows and data requirements for use with ML frameworks
  • Experience validating data quality, preferably with test automation
  • Experience with containerization using Docker
  • Base Salary Range
  • $97,750-$132,250
  • This salary range is offered with the understanding that final compensation is based on a number of factors including geography and experience. Tendo also offers an equity package, annual es, and benefits
  • Benefits
  • For full time employees, Tendo also offers full health benefits (medical, dental, and vision), flexible spending and health savings accounts, company paid life insurance, company paid short-term and long-term disability, company equity, voluntary benefits, 401(k), company paid holidays, flexible time off, and an employee wellness program (“Breathe”)