Facebook pixel

Senior Data Engineer
Updated on 1/27/2023
Locations
Philadelphia, PA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Data Analysis
Docker
Google Cloud Platform
Airflow
Linux/Unix
Redshift
SQL
Python
NoSQL
Requirements
  • Bachelor's degree or higher in a quantitative/technical field (Computer Science, Statistics, Engineering)
  • Minimum two years work experience in related field required
  • Working knowledge of data design, architecture and warehousing
  • Understanding of data management fundamentals and data storage principles
  • Knowledge of distributed systems as it pertains to data storage and cloud computing (AWS or GCP)
  • Understanding and administration of AWS, Docker and Linux-based systems
  • Experience in custom ETL design, implementation and maintenance
  • Experience in large scale data processing using traditional and distributed systems with tools like Airflow, Spark, EMR/Athena, or similar
  • Strong working knowledge of SQL/NoSQL, relational databases and Python is required (2+ years experience)
  • Hey, we know not everybody checks all the boxes, so if you're interested, please apply because you could be just what we're looking for!
Responsibilities
  • Design and implement data pipelines that produce reliable data for various data consumption use cases
  • Help manage Marketing data platforms which include Iterable, Census and AWS Redshift
  • Manage aspects of dataset design, creation, and curation
  • Build and own the automation and monitoring of frameworks that showcase reliable, accurate, easy to understand metrics and operational KPI's to stakeholders
  • Considerably improve data pipeline quality and performance
  • Drive design, building, and launching of new data models and data pipelines in production systems
  • Be the SME for the data, pipeline design, and other related big data and programming technologies
  • Proactively identify reliability and data quality problems and drive triaging and remediation processes
  • Partner with data producers in understanding data sources, enable data contracts, and define the data models that drives analytics
  • Evaluate various technologies and platforms (open source and proprietary)
  • Execute proof of concepts on new technology and tools to pick the best tools and solutions
  • Implement data governance practices such as metadata management, data lineage, and data catalogs
Perpay

11-50 employees

Financial outcomes & borrowing all-in-one platform
Company Overview
Perpay’s mission is to build simple, transparent, and inclusive financial products that challenge typical channels of credit and improve the lives of members. The company believes that everyone deserves access to financial peace of mind and has developed an all-in-one platform to provide underserved consumers to make purchases, pay over time, and build credit.
Benefits
  • Competitive salary + company equity
  • 401k with company match
  • Medical / Dental / Vision insurance
  • Pre-tax Public Transportation benefit
  • Relocation assistance
  • Student loan company match
  • Gym subsidy with City Fitness
  • Cell phone plan
  • Paid parental leave
  • Unlimited PTO
  • Optional work from home (WFH) up to 4 weeks per year