Senior Data Engineer
ShyftLabs
Senior Data Engineer
ShyftLabs
Data-driven decision-making platform for organizations
At ShyftLabs, we live and breathe data. Since 2020, we’ve been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable business impact. We’re growing fast and we’re looking for passionate problem-solvers who are ready to turn big ideas into real outcomes.
The Customer Data Platform team builds the systems that turn first-party data into unified customer profiles and audiences that marketers can act on. Our platform processes customer, event and transaction data from enterprise warehouses, resolves identities, and delivers audiences to the major advertising and engagement platforms. The work directly shapes how leading retailers and brands reach their customers, and every decision must respect privacy.
As a Senior Data Engineer, you will own the core data pipelines of the platform from end to end. You will set technical direction for how we ingest, model and activate customer data at scale on Snowflake and BigQuery. You will partner with product, engineering and client teams to turn business needs into reliable, cost-efficient data systems.
Design, build and own batch and incremental pipelines that process millions of customer profiles and billions of events per day across Snowflake and BigQuery.
Define the data models for unified customer profiles, identity resolution and audiences, and keep them correct, fast and cost-efficient.
Lead the design of activation pipelines to external advertising and engagement platforms, with strong guarantees for retries, incremental syncs and audience accuracy.
Own data quality end to end: data contracts, automated tests, freshness SLAs, monitoring and incident response.
Build privacy and governance into the platform: PII protection, consent, deletion requests and multi-tenant data isolation.
Raise the engineering bar through design docs, code reviews and mentorship, and turn client and business needs into a clear technical roadmap.
Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
5+ years of experience in building and running production data pipelines.
Experience with advanced SQL and data modelling on Snowflake, BigQuery or a similar cloud data warehouse.
Experience in programming with Python or a similar language.
Strong knowledge of ELT patterns on Snowflake (Snowpipe, Streams and Tasks, dbt) and of data modelling for large warehouse tables.
Experience with customer data platforms, identity resolution or data activation in marketing or retail.
Experience with query optimization and cost management on Snowflake and BigQuery at large scale.
Experience with workflow orchestration (e.g., Airflow, Dagster, Temporal) and streaming systems (e.g., Kafka, Pub/Sub).
Experience with LLM-based tools or agents that work over structured data.
Knowledge of privacy regulations (PIPEDA, GDPR, CCPA) and privacy-by-design practices.
Experience with cloud infrastructure on AWS or GCP, with Docker, Kubernetes and Terraform.
A record of technical leadership and mentorship.
Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).
ShyftLabs helps organizations adopt a data-first approach to decision making by establishing repeatable data practices and governance that turn data into timely insights. Its offering designs and implements data-driven decision workflows and analytics pipelines so teams access trustworthy data with clearly defined metrics and actions. Unlike tools that provide dashboards alone, ShyftLabs builds end-to-end processes that standardize how data is measured, analyzed, and used in decisions. Its goal is to help organizations move faster and make better choices, staying ahead of the competition.
Explore more opportunities at ShyftLabs