Simplify Logo

Full-Time

Sr. Data Infrastructure Engineer

Search & Discovery

Posted on 3/22/2024

Slickdeals

Slickdeals

201-500 employees

Aggregates and curates deals and discounts

Data & Analytics
Consumer Goods

Senior, Expert

San Mateo, CA, USA

Category
DevOps & Infrastructure
DevOps Engineering Management
Database Administration
Cloud Engineering
Required Skills
Kubernetes
Python
Airflow
Apache Flink
Apache Spark
Apache Kafka
Java
AWS
Go
Hadoop
Data Analysis
Requirements
  • 8+ years or more relevant professional experience
  • Experience with large-scale open source data processing frameworks such as Spark, Kafka, Airflow, Flink, Hudi, etc. (5+ yrs)
  • Experience managing Kubernetes clusters and running distributed applications in a Kubernetes environment
  • Knowledge of the open source landscape with judgment on when to choose open source versus build in-house
  • Strong knowledge of data concepts, including experience in using a big data warehouse
  • Expertise with modern programming languages (Python, Java, C++, GoLang, etc.)
  • Experience with enterprise software, including on-prem and/or cloud environments
  • Deep knowledge of data quality, data profiling and cleansing techniques
  • Experience with data infrastructure design and implementation capabilities
  • Experience working with AWS or similar cloud infrastructure (5+ yrs)
  • Able to debug complex issues in large-scale distributed systems
  • Passion for building infrastructure that is reliable, easy to use, and easy to maintain
  • Excellent communication and collaboration skills
Responsibilities
  • Work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval)
  • Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion
  • Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads
  • Develop and deploy high-quality software using modern tooling and frameworks
  • Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence
  • Scale and operationalize big data technologies like Spark, Kafka, Presto, Flink, and Hadoop in both on-premise and AWS environments
  • Ensure data infrastructure offers reliable, high-quality data with consistent SLAs, sound monitoring, alerting, incident response, and continual investment to reduce tech debt
  • Write code and documentation, participate in code reviews, and mentor other engineers

Slickdeals is a community-driven platform that aggregates and curates the best deals, coupons, and discounts from various retailers, leveraging human intelligence to save consumers money. The platform can be accessed online or through its free Android or iOS app, browser extension for Chrome, Firefox, and Edge, and Slickdeals Cashback rewards program.

Company Stage

N/A

Total Funding

N/A

Headquarters

Los Angeles, California

Founded

1999

Benefits

Equity, become a Slickdeals stakeholder

401(k) matching above the industry standard

Platinum level of medical, dental and vision coverage

Fully flexible work environment

Amazing collaborative (but fully optional) work spaces with a host of amenities

Active DEIB Council & ERGs

Bring Your Dog to Work

Education Reimbursement

INACTIVE