Facebook pixel

Data Engineer
Posted on 5/27/2022
INACTIVE
Locations
San Francisco, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Hive
Apache Spark
Apache Kafka
Data Analysis
Data Science
Hadoop
Java
Redshift
Scala
Snowflake
SQL
Python
Requirements
  • 3+ years of experience working with a distributed framework like Spark, Flink, Kafka Streams, Dask, or Hadoop
  • 1+ years of experience with ETL job orchestration, preferably with a feature-rich tool such as Airflow, Argo, or Rundeck
  • 2+ years of experience working with Scala, Python, Java, or C#
  • 2+ years ensuring the reliability of software and the integrity of large data stores in a production environment
  • Exposure to a variety of databases and no-SQL appliances (Redshift, Snowflake, Druid, Dynamo, Cassandra, Kafka, Elastic Search, Hive, etc.)
Responsibilities
  • Work on pipelines ingesting greater than 1gb per second
  • Design, implement, and own software solutions for ingesting and exposing high volume data feeds
  • Coordinate with engineering, analytics, and other teams to assess the cost and value of existing and potential projects
  • Research and evaluate new technologies in the big data space to guide our continuous improvement
  • Collaborate with multifunctional engineers across the company to help tune the performance of large data applications to drive cost savings
Match Group

1,001-5,000 employees

Dating platform conglomerate
Company Overview
Match Group's mission is to spark meaningful connections for every single person worldwide. The company operates platforms including Tinder, Hinge, Okcupid, and more.
Benefits
  • Medical/Dental/Vision Insurance
  • Charitable Matching Program
  • Retirement Matching Funds
  • Training and Education Allowance
  • Performance Bonuses
  • Mental Health Counseling