Data Platform Engineering Manager

As the Data Platform Engineering Manager in the cyber data team, you will play a crucial role in the development, management, and optimisation of our self-served cyber data infrastructure. You will lead technical decisions and be responsible for a team of data platform engineers to provide a reliable and robust data platform, enabling seamless acquisition, storage, processing and analysis of security data for operational, analytics, machine learning and Gen AI purposes. The data platform lies at the heart of our security detection strategy, serving wider security teams.

Data Architecture: Design, build and management of realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.

Data Integration and Transformation: Implement and manage the automated frameworks for integrating data from various security sources into the security lake. Also, the data transformation frameworks to move data between the raw, trusted, and curated data layers.

Data Security and Compliance: Implement and enforce data security standard methodologies, ensuring the protection of sensitive information and compliance with relevant regulations.

Automation and DevOps: Implement various automations and DevOps practices to streamline the deployment, configuration, and management of data platform components.

In addition to the above core accountabilities, I am also responsible for,

• Contributing to and supporting the ongoing recruitment and talent development process for cyber data team at Tesco
• Providing reporting and insight to the cyber security leadership team and other senior representatives of the business
• The management of service providers and teams I work with inside and outside of Tesco

Relevant experience as an Engineering Manager, leading teams and managing data projects at scale

Solid programming experience with programming languages like Python or Java along with proficiency in SQL

Experience working with cloud platforms (e.g., Azure) and big data technologies like Spark, Flink etc.,

Solid grasp of Kubernetes, CI/CD and Terraform

Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow

Hiring, developing, and retaining cyber data platform talent

Ability to deliver clear input, guide, empower the team to achieve desired outcomes

Developing working relationships with various teams and at all levels of seniority to facilitate the adoption of the data infrastructure