Facebook pixel

Senior Software Engineer
Data Infrastructure, Open to remote
Posted on 8/23/2022
INACTIVE
Locations
San Francisco, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Apache Kafka
Data Analysis
Data Science
Docker
Google Cloud Platform
Hadoop
Java
Microsoft Azure
Redshift
Scala
Snowflake
SQL
Kubernetes
Python
Requirements
  • 5+ years of experience in data engineering on distributed frameworks such as Spark, Flink, Kafka Streams, Storm, Hadoop etc
  • Proven experience with ETL job orchestration, preferably with a feature-rich tool such as Airflow, Argo, or Rundeck
  • Strong proficiency with any of the following programming languages - Java, Scala or Python
  • Experience with a variety of databases and no-SQL appliances (Redshift, Databricks, Snowflake, Druid, Dynamo, Cassandra, Kafka, Elastic Search, Hive, etc.)
Responsibilities
  • Collaborate with engineers in conceptualizing, planning and executing medium-sized data engineering initiatives working with a variety of stakeholders
  • Work with internal engineering and product teams to identify opportunities for improvements or feature enhancements to our data platforms and to improve overall engineering efficiency
  • Work on pipelines ingesting data greater than 1gb per second
  • Design and build data platforms and frameworks for processing high volumes of data, in real time as well as batch, that will be used across engineering teams
  • Drive self-serve capabilities for the engineering teams to easily onboard their critical data workloads onto our platforms
  • Coordinate with engineering, analytics, and other teams to assess the cost and value of existing and potential projects
  • Research and evaluate new technologies in the big data space to guide our continuous improvement
  • Collaborate with multifunctional engineers across the company to help tune the performance of large data applications to drive cost savings
  • Work on initiatives to ensure stability, performance and reliability of our data infrastructure
Desired Qualifications
  • Experience building real time data pipelines using Flink or Spark
  • Experience with distributed systems and microservices
  • Experience with Kubernetes and building Docker images
  • Experience with any public cloud environment - AWS, Azure, GCP
Match Group

1,001-5,000 employees

Dating platform conglomerate
Company Overview
Match Group's mission is to spark meaningful connections for every single person worldwide. The company operates platforms including Tinder, Hinge, Okcupid, and more.
Benefits
  • Medical/Dental/Vision Insurance
  • Charitable Matching Program
  • Retirement Matching Funds
  • Training and Education Allowance
  • Performance Bonuses
  • Mental Health Counseling