Director of Data Engineering
Confirmed live in the last 24 hours
Locations
Canada • Remote
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
AWS
BigQuery
Data Structures & Algorithms
Elasticsearch
Jupyter
Postgres
Redshift
Ruby
Snowflake
Kubernetes
Quality Assurance (QA)
Requirements
- You have 10+ years of experience in software engineering, working in data ingestion pipeline, search engineering and/or machine learning
- Proven experience with building, coaching, and leading high-performing engineering teams
- You've set up and managed data pipelines to ingest 3rd party data, clean and normalize it, and use machine learning techniques to match it to existing internal data
- We're currently using Databricks, so some familiarity with that would be nice, but isn't required. Knowledge of similar tools (Snowflake, Redshift, BigQuery, etc) is also totally fine
- You're familiar with basic search ranking techniques and algorithms. You've managed an Elasticsearch and/or AWS OpenSearch cluster
- You're comfortable with machine learning QA/eval tools and techniques
- You know your way around a Jupyter Notebook
- You have experience working with large, multi-terabyte datasets and are comfortable with high-scale data ingestion, transformation, analysis, and prediction tools
- You take pride in delivering exceptionally high quality in terms of data accuracy, performance, and reliability
- You're eager to contribute your ideas and experiences to help Affinity continuously improve as a product and company
Responsibilities
- Work with the product organization and company leadership to create a vision for how to best leverage technology to help our customers get access to the data they need in a way that is valuable, flexible, and user-friendly
- Build Affinity's core data ingestion pipeline which will ingest data on organizations and people from a wide variety of 3rd party data sources. Data then needs to be cleaned and matched to our existing internal data
- Build out and manage Affinity's search stack
- Build out relationship intelligence tools to help our customers leverage the value of their existing relationships and understand how to best grow their networks to meet their goals
- Drive complex technical, architecture, design, and product discussions
Desired Qualifications
- Experience managing managers
- Experience using Databricks
- Experience with Elasticsearch, AWS, Kubernetes, Postgres, or Ruby
CRM intelligence platform
Company Overview
Affinity's mission is to create a world where anyone can cultivate and fully harness their network to succeed. The company has created a platform that structures and analyzes millions of data points across emails, calendars, and third-party sources to offer users the tools they need to automatically manage their most valuable relationships, prioritize important connections, and discover untapped opportunities.
Benefits
- Daily lunches
- Commuter passes
- Flexible PTO
- Free events
- Health insurance
Company Core Values
- We are playmakers
- We are obsessed with learning
- We care personally
- We take pride in what we do
- We are radically open-minded