S

ShyftLabs

Data-driven decision-making platform for organizations

Forward Deployed Data Architect

Data EngineeringConfirmed live in the last 24 hours
Full-timeToronto, ON, CanadaCA$160k - CA$190kRemote

About the Job

Requirements

  • At least 8 years of overall experience in data engineering, data architecture, or related technical roles, including strong hands-on experience designing and delivering production-grade data platforms.
  • Proven experience in a client-facing technical role, such as Data Architect, Solutions Architect, Technical Consultant, or Lead Data Engineer, working directly with enterprise customers or stakeholders.
  • Strong hands-on expertise with Azure Databricks, including designing and implementing scalable enterprise data solutions.
  • Deep understanding of Delta Lake, including data management, processing patterns, and performance optimization.
  • Experience with Unity Catalog, including data governance, access controls, lineage, and enterprise data management.
  • Strong proficiency in SQL and Python/PySpark for data processing, transformation, and pipeline development.
  • Hands-on experience with Apache Airflow for orchestration and dbt Core for data transformation, testing, and modeling.
  • Experience designing ingestion pipelines across APIs, relational databases, files, and other enterprise data sources.
  • Familiarity with Databricks-native ingestion technologies, including Lakeflow Connect and Auto Loader.
  • Strong understanding of Medallion Architecture, data products, semantic modeling, and data quality frameworks.
  • Experience with CI/CD, Git, automated testing, monitoring, and production data pipeline management.
  • Demonstrated ability to review and challenge technical architectures, code, data models, and engineering deliverables while providing constructive, actionable feedback.
  • Experience translating business requirements into technical specifications, architectural designs, and implementation roadmaps.
  • Ability to evaluate technical trade-offs and communicate recommendations clearly to technical teams, business stakeholders, and client leadership.
  • Experience working with external technology partners, third-party delivery teams, or distributed engineering organizations.
  • Strong communication, presentation, stakeholder management, and problem-solving skills.
  • Ability to manage competing priorities, navigate ambiguity, and build trusted relationships with clients while maintaining technical credibility.

Responsibilities

  • Work directly with client stakeholders to understand business objectives, technical requirements, existing data environments, and architectural challenges, then translate them into practical, scalable data architecture solutions.
  • Design and recommend modern data platform architectures using Azure Databricks, Delta Lake, and cloud-based data engineering technologies, aligned with client objectives and enterprise standards.
  • Facilitate technical workshops, discovery sessions, and architecture reviews to assess current-state environments, identify gaps, evaluate solution options, and define target-state architectures.
  • Develop, validate, and review data engineering solutions using SQL, Python/PySpark, Apache Airflow, and dbt Core, balancing architectural oversight with practical implementation expertise.
  • Establish architecture and implementation standards for ingestion pipelines integrating APIs, databases, files, and cloud data sources using Databricks-native capabilities such as Lakeflow Connect and Auto Loader.
  • Define and promote reusable architectural patterns, implementation guidelines, and engineering best practices across client projects and distributed delivery teams.
  • Design and guide implementation of Bronze, Silver, and Gold data layers to support reliable ingestion, standardized transformations, curated data products, and downstream analytics.
  • Establish practices for Unity Catalog, data access controls, lineage, semantic modeling, data discoverability, and enterprise data governance.
  • Review partner and engineering team deliverables, including architecture designs, code, data models, and pipelines, ensuring alignment with requirements, performance expectations, security standards, and long-term maintainability.
  • Define standards for data validation, automated testing, pipeline monitoring, error handling, and operational readiness to ensure reliable production data products.
  • Guide implementation of Git-based workflows, automated testing, CI/CD pipelines, and controlled deployment practices across development, testing, and production environments.
  • Evaluate platform performance, processing efficiency, scalability, and cloud consumption, and recommend improvements balancing technical requirements with business value.
  • Encourage effective use of AI-assisted development tools and specification-driven engineering practices while maintaining architectural integrity, code quality, and delivery standards.
  • Provide technical direction, resolve architectural questions, and facilitate collaboration between client stakeholders, internal engineers, and external technology partners.
  • Communicate architectural decisions, implementation trade-offs, dependencies, risks, and recommendations to technical and non-technical stakeholders.
  • Maintain architectural ownership throughout the project lifecycle, from discovery and solution design through implementation, deployment, and ongoing optimization.

About the Company

ShyftLabs

Data-driven decision-making platform for organizations

ShyftLabs helps organizations adopt a data-first approach to decision making by establishing repeatable data practices and governance that turn data into timely insights. Its offering designs and implements data-driven decision workflows and analytics pipelines so teams access trustworthy data with clearly defined metrics and actions. Unlike tools that provide dashboards alone, ShyftLabs builds end-to-end processes that standardize how data is measured, analyzed, and used in decisions. Its goal is to help organizations move faster and make better choices, staying ahead of the competition.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Canada
Founded
2018

Recently Posted Jobs

Explore more opportunities at ShyftLabs

See more jobs