Facebook pixel

Senior Data Engineer
Posted on 2/17/2023
INACTIVE
Locations
Remote
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Apache Kafka
Data Analysis
Data Science
Development Operations (DevOps)
Docker
Hadoop
Java
Airflow
Postgres
Redshift
Scala
Snowflake
Tableau
Terraform
Apache Flink
Kubernetes
Python
Looker
Power BI
Requirements
  • 4+ years of experience building data infrastructure and platforms using streaming frameworkssuch as Kafka/Kinesis/Flink/Spark Structured Streaming, etc
  • 5+ years of experience using CI/CD tools to build and deploy projects
  • 5+ years of experience working with DevOps tools such as Docker, Kubernetes, AKS, Helm, Terraform, etc to own end-to-end deployment of Data Engineering projects
  • 5+ years of experience with one or more language/framework such as Python/Scala/Spark/PySpark/Java/Hadoop
  • 4+ years experience with scaling production systems, ideally in a start-up environment
  • Experience working with workflow management tools such as Airflow/Luigi/Dagster
  • Experience with OLAP datastores such as Clickhouse, Apache Pinot, Druid
  • Experience with PostgreSQL, as well as MPP databases such as Redshift
  • Experience with cloud-based architectures on AWS, GCE, or similar
  • Experience working with data systems, data warehouse solutions, and ETL/ELT
  • Experience with various data visualization tools such as Redash/Superset/Tableau/Looker/Power BI
  • Bachelor's degree in Computer Science or related technical field or equivalent practical experience
Responsibilities
  • Build efficient, high quality, integrated and increasingly real-time ETL/ELT pipelines to organize, collect, standardize and integrate data that facilitate more complete, accurate and consistent data for insights and reporting
  • Partner with engineering, data science, and business stakeholders to build data insights and help them to achieve their business goals
  • Deliver data capabilities and new data products to accelerate investments in data and democratize data across the enterprise
  • Provide production support for data tools and data needs across the business
  • Research and implement cutting edge solutions to solve challenges related to ETL/ELT, data processing, and analytics
Desired Qualifications
  • Experience working with Databricks/Qubole/Snowflake or similar platforms using Spark/PySpark/Scala
  • Application and front end development experience
Roadie

51-200 employees

On-the-way delivery network