Senior Data Engineer
Posted on 8/31/2023
Locations
Philadelphia, PA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Confluence
Data Analysis
JIRA
Git
SQL
Python
NoSQL
CategoriesNew
Data & Analytics
Requirements
- 5+ years of experience in data engineering
- Extensive experience in the design, build, and maintenance of data ETL pipelines
- Extensive knowledge of coding in Python or Scala with focus on data processing
- Experience using Apache Spark (PySpark or Scala)
- Experience with AWS technology stack (S3, Glue, Athena, EMR, etc.)
- Experience with data and entity relationship modeling to support data warehouses and analytics solutions
- Deep understanding of relational and non-relational databases (SQL/NOSQL)
- Comfortable working with unstructured and semi-structured data (Web scraping)
- Experience working in a professional software environment using source control (git), an issue tracker (JIRA, Confluence, etc.), continuous integration, code reviews, and agile development process (Scrum/Lean)
- Basic data privacy and security principles
Responsibilities
- Collaborate with Data Scientists and Business Intelligence Analysts to ensure efficient and effective data processing and analysis
- Optimize data infrastructure and processes to ensure optimal performance and scalability
- Develop and maintain data documentation and data lineage
- Stay current with emerging technologies and industry trends related to data engineering
Desired Qualifications
- Knowledge of, or experience with, healthcare data standards such as HL7, FHIR, ICD, SNOMED, LOINC
- Experience with Delta Lake and/or Databricks
- Experience with machine learning workflows and data requirements for use with ML frameworks
- Experience validating data quality, preferably with test automation
- Experience with containerization using Docker
- Base Salary Range
- $97,750-$132,250
- This salary range is offered with the understanding that final compensation is based on a number of factors including geography and experience. Tendo also offers an equity package, annual es, and benefits
- Benefits
- For full time employees, Tendo also offers full health benefits (medical, dental, and vision), flexible spending and health savings accounts, company paid life insurance, company paid short-term and long-term disability, company equity, voluntary benefits, 401(k), company paid holidays, flexible time off, and an employee wellness program (“Breathe”)