Full-Time

Sr. Data Infrastructure Engineer

Slickdeals

Slickdeals

201-500 employees

Community-driven platform for vetting and sharing deals

Data & Analytics
Consumer Goods

Senior

San Mateo, CA, USA

Required Skills
Kubernetes
Python
Airflow
Apache Flink
Apache Spark
Apache Kafka
Java
AWS
Go
Hadoop
Data Analysis
Requirements
  • 8+ years or more relevant professional experience.
  • Experience with large-scale open source data processing frameworks such as Spark, Kafka, Airflow, Flink, Hudi, etc. (5+ yrs)
  • Experience managing Kubernetes clusters and running distributed applications in a Kubernetes environment.
  • Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.
  • Strong knowledge of data concepts, including experience in using a big data warehouse.
  • Expertise with modern programming languages (Python, Java, C++, GoLang, etc.).
  • Experience with enterprise software, including on-prem and/or cloud environments.
  • Deep knowledge of data quality, data profiling and cleansing techniques.
  • Experience with data infrastructure design and implementation capabilities.
  • Experience working with AWS or similar cloud infrastructure (5+ yrs)
  • Able to debug complex issues in large-scale distributed systems.
  • Passion for building infrastructure that is reliable, easy to use, and easy to maintain.
  • Excellent communication and collaboration skills.
Responsibilities
  • Work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval)
  • Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion
  • Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads
  • Develop and deploy high-quality software using modern tooling and frameworks
  • Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence
  • Scale and operationalize big data technologies like Spark, Kafka, Presto, Flink, and Hadoop in both on-premise and AWS environments
  • Ensure data infrastructure offers reliable, high-quality data with consistent SLAs, sound monitoring, alerting, incident response, and continual investment to reduce tech debt
  • Write code and documentation, participate in code reviews, and mentor other engineers

Slickdeals, a leading shopping site in the U.S., leverages the power of community and human intelligence to ensure consumers get the best deals, with its 12 million users vetting and voting for top products from renowned retailers. The company has saved its users a staggering $10 billion, demonstrating its significant competitive advantage in the market. Its culture of collaboration, coupled with technical tools like a free app, browser extensions, and a cashback rewards program, make it an engaging and rewarding place to work.

Company Stage

N/A

Total Funding

N/A

Headquarters

San Mateo, California

Founded

1999

Growth & Insights
Headcount

6 month growth

4%

1 year growth

-19%

2 year growth

-16%

Benefits

Equity, become a Slickdeals stakeholder

401(k) matching above the industry standard

Platinum level of medical, dental and vision coverage

Fully flexible work environment

Amazing collaborative (but fully optional) work spaces with a host of amenities

Active DEIB Council & ERGs

Bring Your Dog to Work

Education Reimbursement