Lead Data Engineer
P3506
Updated on 5/17/2023
Locations
Northbrook, IL, USA • Remote • Chicago, IL, USA • Portland, OR...
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Google Cloud Platform
Hadoop
Git
Java
Airflow
Microsoft Azure
MongoDB
Tableau
Python
NoSQL
Power BI
Requirements
  • 5+ years proven ability of professional data development experience
  • 3+ years proven ability of developing with Hadoop/HDFS
  • 3+ years developing experience with either Java or Python
  • 3+ years experience with PySpark/Spark
  • 3+ years experience with Airflow
  • Full understanding of ETL concepts
  • Exposure to VCS (Git, SVN)
  • Strong understanding of Agile Principles (Scrum)
  • Exposure to NoSQL (Mongo, Cassandra)
  • Exposure to Service Oriented Architecture
  • Exposure to cloud platforms (Azure/GCP/AWS)
  • Exposure to BI tooling e.g Tableau, PowerBI, Cognos
  • Proficient with relational data modeling and/or data mesh principles
  • Continuous Integration/Continuous Delivery
Responsibilities
  • Lead the design of and develop Cloud and Hadoop based solutions
  • Perform unit and integration testing
  • Participate in implementation of BI visualizations
  • Collaborate with architecture and lead engineers to ensure consistent development practices
  • Provide mentoring to junior engineers
  • Participate in retrospective reviews
  • Participate in the estimation process for new work and releases
  • Collaborate with other engineers to solve and bring new perspectives to complex problems
  • Drive improvements in people, practices, and procedures
  • Embrace new technologies and an ever-changing environment
84.51 Degrees
Retail data science, insights, and media platform