About Slickdeals:
On a mission to bring the joy of discovering a great deal to shoppers, Slickdeals thrives on the active participation of its 12-million-strong community. Users share, upvote, and uncover the best prices on popular products from trustworthy brands.
With a robust track record of 24 years in business, marked by profitability and a thriving community that has saved more than $10 billion, Slickdeals is currently undergoing a transformation. As we evolve into a daily shopping destination for millions more, joining Slickdeals presents an exciting opportunity for entrepreneurially-minded builders to create an innovative deal discovery platform.
The Purpose:
We are building a new search, discovery, and shopping graph platform that powers the suite of Slickdeals product lines. We’re looking for top-notch search engineering talents in the area of information retrieval, search indexing, Elasticsearch, Lucene, algorithms, relevance & ranking, data mining, machine learning, data analysis & metrics, query processing, multi-lingual search and multi-modal search.
In this role, you will be part of our unique Search and Discovery team. We are looking for someone with expertise in information retrieval and a passion for creating exceptional search experiences. The ideal candidate will have a strong technical background and a deep understanding of search algorithms and systems. As an individual contributor to the Search and Discovery Team, you will play a crucial role in enhancing our search and recommendation capabilities and driving the discovery of deals and content for our users. You will be building products using technologies such as AWS SageMaker, Tensforflow, Pytorch, LLM, Elastic Search, REST web services, SQS/Kafka, Vector Database, HBase, Machine Learning, and more.
What You’ll Do:
- This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work with product and engineering team to design and develop use cases for Search, Discovery, Recommendation and Personalization.
- Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion
- Build features to tune processing pipeline for fast data ingestion and indexing depending on customer’s needs and workloads.
- Develop and deploy high-quality software using modern tooling and frameworks
- Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence
- Scale and operationalize big data technologies like Spark, Kafka, Presto, Flink, and Hadoop in both on-premise and AWS environments
- Ensure data infrastructure offers reliable, high-quality data with consistent SLAs, sound monitoring, alerting, incident response, and continual investment to reduce tech debt
- Write code and documentation, participate in code reviews, and mentor other engineers
What We’re Looking For:
- 8+ years or more relevant professional experience.
- Experience with large-scale open source data processing frameworks such as Spark, Kafka, Airflow, Flink, Hudi, etc. (5+ yrs)
- Experience managing Kubernetes clusters and running distributed applications in a Kubernetes environment.
- Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.
- Strong knowledge of data concepts, including experience in using a big data warehouse.
- Expertise with modern programming languages (Python, Java, C++, GoLang, etc.).
- Experience with enterprise software, including on-prem and/or cloud environments.
- Deep knowledge of data quality, data profiling and cleansing techniques.
- Experience with data infrastructure design and implementation capabilities.
- Experience working with AWS or similar cloud infrastructure (5+ yrs)
- Able to debug complex issues in large-scale distributed systems.
- Passion for building infrastructure that is reliable, easy to use, and easy to maintain.
- Excellent communication and collaboration skills.
LOCATION: San Mateo
Hybrid schedule visiting our San Mateo office three days a week (Tues-Thurs).