Lead Data Engineer

Job Description

Please Note that this is a 4 Day Work from Office Role in Central London & 1 Day work from Home

Key Responsibilities

• Feature development, issue resolution, and daily monitoring on cloud delta lakehouse data platform.
• Operate as part of an agile technical team participating in all agile team ceremonies such as daily stand up meetings and backlog refinement sessions.
• Lead Architectural decisions, mentor junior engineers and contribute to establishing engineering standards, documentation, and reusable frameworks.

Experience

• Overall 10+yrs experience in data engineering.
• At least five years of experience working in a data warehouse solution landscape.
• Proven ability to lead complex data initiatives and drive architectural decisions.
• Experienced with agile delivery methodologies, ideally SCRUM/Kanban.
• Be able to assume ownership of data issues, perform investigation and root cause analysis, and implement remediation through code and data changes.
• Understanding of data warehouse testing strategies and quality assurance processes.
• Good understanding of git branching strategies and code management.
• Good understanding of technical release management processes in Azure DevOps.
• Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency within teams.

Qualifications

• A bachelor's or master's degree in computer science, data management, information systems industry approved; relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)

Additional Information

Tech Stack

• SQL Server, SSIS, T-SQL

• ADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lake