Lead Data Engineer
P3506
Updated on 5/17/2023
Locations
Northbrook, IL, USA • Remote • Chicago, IL, USA • Portland, OR...
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Google Cloud Platform
Hadoop
Git
Java
Airflow
Microsoft Azure
MongoDB
Tableau
Python
NoSQL
Power BI
Requirements
- 5+ years proven ability of professional data development experience
- 3+ years proven ability of developing with Hadoop/HDFS
- 3+ years developing experience with either Java or Python
- 3+ years experience with PySpark/Spark
- 3+ years experience with Airflow
- Full understanding of ETL concepts
- Exposure to VCS (Git, SVN)
- Strong understanding of Agile Principles (Scrum)
- Exposure to NoSQL (Mongo, Cassandra)
- Exposure to Service Oriented Architecture
- Exposure to cloud platforms (Azure/GCP/AWS)
- Exposure to BI tooling e.g Tableau, PowerBI, Cognos
- Proficient with relational data modeling and/or data mesh principles
- Continuous Integration/Continuous Delivery
Responsibilities
- Lead the design of and develop Cloud and Hadoop based solutions
- Perform unit and integration testing
- Participate in implementation of BI visualizations
- Collaborate with architecture and lead engineers to ensure consistent development practices
- Provide mentoring to junior engineers
- Participate in retrospective reviews
- Participate in the estimation process for new work and releases
- Collaborate with other engineers to solve and bring new perspectives to complex problems
- Drive improvements in people, practices, and procedures
- Embrace new technologies and an ever-changing environment
Retail data science, insights, and media platform