B

BDO Canada

Provide assurance, tax, and consulting services

Senior Data Engineer - Databricks Focused

Data EngineeringUpdated on Nov 11
Full-time$84k - $128k

About the Job

Requirements

  • A Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline is required, along with a strong foundation in data structures, algorithms, and distributed systems.
  • At least 5 years of hands-on data engineering experience, including at least 3 years of direct experience with Databricks, Apache Spark, and cloud data platforms, is required.
  • Proven success deploying and maintaining large-scale data solutions in production environments is required.
  • In-depth knowledge of the Microsoft Azure ecosystem is required, including experience with Azure Data Lake, Azure Databricks, Azure Synapse, and Azure DevOps.
  • Strong proficiency with Databricks is required, including hands-on experience with Delta Lake, Apache Spark, data pipeline orchestration, and production performance and reliability optimization.
  • Advanced programming skills in Python and/or Scala and practical experience with data engineering libraries and frameworks are required.
  • A solid understanding of CI/CD practices is required, with experience designing and maintaining pipelines using tools such as GitHub Actions, Azure DevOps, or Jenkins.
  • Familiarity with infrastructure-as-code tools such as Terraform or ARM templates for automating environment provisioning and deployment is required.
  • Strong written and verbal communication skills are required to engage effectively with data scientists, engineers, business partners, and executive leadership, explain technical concepts to non-technical audiences, and influence decision-making.

Responsibilities

  • Design, build, and optimize robust data pipelines using Databricks, Delta Lake, and Apache Spark.
  • Develop scalable ETL processes for structured and unstructured data while ensuring data quality and reliability.
  • Implement data integration solutions across cloud and on-premises sources using Databricks and Azure Data Lake.
  • Automate data ingestion, transformation, and validation workflows.
  • Monitor, troubleshoot, and enhance data pipeline performance and reliability.
  • Ensure compliance, security, and operational excellence across data workflows.
  • Serve as the primary technical lead for client engagements focused on data engineering and analytics solution delivery.
  • Translate business requirements into scalable data architectures and operational plans.
  • Collaborate with cross-functional teams to integrate data solutions into production environments.
  • Mentor junior team members and promote adoption of data engineering and cloud analytics best practices.
  • Convert business requirements and analytics prototypes into robust, scalable data solutions.
  • Apply data modeling and transformation techniques to support analytics and machine learning initiatives.
  • Document data pipelines and contribute to internal knowledge sharing.

Desired Qualifications

  • Professional certifications such as Databricks Certified Data Engineer or Microsoft Certified Azure Data Engineer Associate are preferred.
  • Experience with data governance, data security, and compliance frameworks is preferred.
  • Consulting experience and client management skills are preferred.

About the Company

BDO Canada

Provide assurance, tax, and consulting services

BDO Canada provides professional services to clients in Canada and around the world, including assurance (auditing), tax advisory, and consulting. Their teams across 100 offices in Canada and 1,800 offices in 164 countries work with clients from various sectors to address financial and business needs. Services are delivered by professional experts who collaborate with clients to review finances, optimize taxes, improve operations, and manage risk, using industry knowledge and global resources. What sets BDO Canada apart is its large, country-wide network combined with a global footprint, plus a people-focused approach to talent experience that has earned recognition like Canada’s Top 100 Employers. The company aims to help clients meet domestic and international challenges by providing reliable, multi-disciplinary support across assurance, tax, and advisory services.

Company size
1,001-5,000
Company stage
Not listed
Total funding
Not listed
Headquarters
Toronto, Canada
Founded
1921

Recently Posted Jobs

Explore more opportunities at BDO Canada

See more jobs