Facebook pixel

Principal Data Engineer
Confirmed live in the last 24 hours
Locations
United States
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Apache Kafka
Data Analysis
Data Science
Development Operations (DevOps)
Leadership
Microsoft Azure
REST APIs
SQL
Terraform
Python
Requirements
  • 8+ years of experience in a data engineering role building end-to-end ETL/ELT pipelines
  • Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
  • Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc
  • Experience with data warehouses, data lakes, and their underlying infrastructure
  • Proficiency in Python, SQL, RESTful API development
  • Experience with cloud computing platforms such as Azure, AWS
  • Experience data observability and monitoring tooling such as Monte Carlo, Great Expectations, SodaSQL, Databand, etc
  • Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs
  • Experience with data governance, schema design, and schema evolution
  • Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
  • Experience with Infrastructure as code tools such as Terraform
Responsibilities
  • Takes a hands-on role at piloting and developing tools in addition to enhancing existing platforms that power Gopuff's data teams
  • Architect and implement large-scale data processing systems that enable analytics, data science, and machine learning in a multi-cloud environment
  • Develop best practices for data collection, storage, and processing that impact company-wide data strategy across Gopuff's data lakes and data warehouses
  • Partner with software and analytics engineering teams to establish data contracts to improve data quality at every stage of the data lifecycle
  • Participate in design and architectural review sessions with data engineers and software engineering partners
  • Conduct code reviews and knowledge-sharing sessions across data engineering and partner teams
  • Collaborate with engineering and product leadership to translate business requirements into technical solutions
  • Partner with engineering teams to model foundational event schemas
Gopuff

10,001+ employees

Delivery service for daily essentials
Company Overview
Gopuff's mission is to make daily life effortless. Gopuff is the go-to delivery solution for immediate everyday needs. The company is building a modern food delivery service.
Benefits
  • Comprehensive medical, dental, and vision insurance
  • Optional FSAs and HSA plans
  • 401(k)
  • Commuter benefits
  • Supplemental employee, spouse and child life insurance to all eligible employees
  • Gopuff employee discount
  • Career growth opportunities
  • Internal rewards programs
  • Annual performance appraisal and bonus
Company Core Values
  • Make moves
  • Change the game
  • Sit down, be humble
  • Be the Goat
  • Win together