Facebook pixel

Senior Data Engineer
Remote Friendly
Confirmed live in the last 24 hours
Locations
San Francisco, CA, USA • Remote in USA • New York, NY, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
BigQuery
Apache Kafka
Data Analysis
Hadoop
Scala
Snowflake
SQL
Apache Beam
Python
NoSQL
Requirements
  • 4+ years of professional experience with Python (or similar)
  • 1+ years of professional experience with Spark
  • Experience of building ETL off of databases (such as RDBMS, distributed datastore) and data warehouses (such as Snowflake, BigQuery)
  • Strong understanding of distributed systems architecture and data processing
  • Strong understanding of major database systems e.g. Relational, NoSQL, etc
  • Experience with API design and optimization, building performant machine-to-machine services
  • Hustle, curiosity, humility
Desired Qualifications
  • Bachelor's/Master's degree in Computer Science or related fields
  • Strong understanding of distributed messaging systems such as Kafka, Solace etc
  • Cloud experience - preferably with AWS
  • Proficiency in one of the large-scale data processing frameworks; such as Scala, Apache Beam, Hadoop or Dask, or working with data lakes using SQL or other data query languages
  • Self-directed, thrives in ambiguity and willing to collaborate cross-team
Unit21

51-200 employees