Facebook pixel

Data Engineer
General Application
Posted on 5/2/2022
INACTIVE
Locations
San Francisco, CA, USA • Remote
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
AWS
Data Analysis
Google Cloud Platform
Microsoft Azure
SQL
Terraform
Python
Requirements
  • Develop a vision and roadmap to improve our engineering stack
  • Help to sequence and de-risk projects to ensure timely delivery of value
  • Collaborate with product and other cross-functional stakeholders to co-create an impactful customer experience
  • Experience working with large scale data:
  • Writing batch and streaming data pipelines
  • Orchestrating data processing jobs via ETL
  • Dealing with schema evolution, data validation, and pipeline robustness
  • Experience in Python and SQL
  • Building infrastructure in a cloud environment
  • Leveraging the capabilities of GCP, AWS, or Azure cloud platforms
  • Utilizing the infrastructure-as-code paradigm with tools such as Terraform
  • Experience working in cross-functional teams that put customer requirements first
  • Adaptability and openness to changes and challenges
  • A positive, can-do attitude to work
  • Clear communication skills that resonate with engineers, cross functional stakeholders, and executives
  • A track record of mentorship and growing other engineers
  • Deep experience in building data platforms and infrastructure with a seasoned understanding of design tradeoffs
  • A track record of incrementally delivering engineering solutions that have real customer impact
  • An excellent understanding of developer experience as it relates to data, and a strong desire to build an easy-to-use platform by all engineers
  • Data orchestration systems such as Airflow, Google Workflows, etc
  • Spark, Apache Beam, and other distributed data processing frameworks
  • Geospatial data and algorithm domains
  • Logging infrastructure and event processing pipelines
  • Instrumenting observability and cost monitoring into data infrastructure
  • Building beautiful APIs for developer access to the data platform
  • Agile software development methods
  • Microservice architecture
Responsibilities
  • Work as an integral member of a cross-functional team focused on improving the customer/developer experience. For example:
  • Building an orchestration layer for batch ETL to take raw data and convert it to useful information
  • Working cross-functionally to standardize events and logs and build a coherent data warehouse
  • Optimize distributed data processing frameworks to ensure efficient and fast computation of geospatial data
  • Build real-time data pipelines to help customers understand the cost of their data purchases as a part of a checkout process
  • You will be a subject matter expert that will help your team develop data products end-to-end
  • Participate in an on-call rotation to ensure our systems remain up 24/7
Planet
Satellite imaging for Earth
Company Overview
Planet is an aerospace and data analytics company that builds small satellites and delivers information about the changing planet.