U

UBDS Group

Global Capability Centre for cloud, cybersecurity

Senior Data Engineer

Data EngineeringPosted on Nov 17
Full-timeLondon, UK

About the Job

Requirements

  • Strong experience as a Data Engineer or Senior Data Engineer within cloud-based environments.
  • Hands-on experience developing and supporting data solutions using Microsoft Azure.
  • Experience designing and building ETL/ELT pipelines and data integration workflows.
  • Experience working with Azure data services and cloud-based storage technologies.
  • Understanding of Microsoft Purview and data governance principles.
  • Experience with CI/CD pipelines, deployment automation, and version control.
  • Knowledge of Azure infrastructure, networking, identity, and security fundamentals.
  • Experience implementing secure, scalable, and maintainable data solutions.
  • Strong understanding of data modelling, transformation, and integration principles.
  • Good software engineering practices, including testing, documentation, and code quality.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Experience working within Agile, multidisciplinary delivery teams.
  • Strong communication and stakeholder engagement skills.
  • Candidates must successfully complete Baseline Personnel Security Standard (BPSS) checks and required pre-employment screening.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and integration solutions using Microsoft Azure.
  • Build and support cloud-based data services, storage, and processing capabilities.
  • Develop automated data ingestion, transformation, and processing workflows.
  • Implement data governance and management practices aligned with Microsoft Purview.
  • Support data quality, lineage, classification, and appropriate access controls.
  • Develop and maintain CI/CD pipelines to automate data platform deployments.
  • Support Azure infrastructure configuration and secure deployment of data services.
  • Apply Infrastructure as Code and modern DevOps engineering practices.
  • Develop and maintain integrations between data platforms, applications, and cloud services.
  • Support the secure deployment and integration of cloud-based analytics and data processing capabilities.
  • Optimise data pipelines for performance, scalability, reliability, and cost efficiency.
  • Troubleshoot complex data processing, integration, and deployment issues.
  • Collaborate with Architects, Engineers, and stakeholders to translate requirements into effective technical solutions.
  • Contribute to technical design, code reviews, engineering standards, and documentation.
  • Work within Agile delivery teams, supporting iterative development and continuous improvement.

Desired Qualifications

  • Experience with Azure Data Factory, Azure Databricks, or Microsoft Fabric.
  • Experience with Azure Data Lake Storage and Azure SQL.
  • Experience with Python, SQL, and PySpark.
  • Experience with Microsoft Purview data cataloguing, lineage, and governance.
  • Experience with Terraform, Bicep, or other Infrastructure as Code tooling.
  • Experience with Azure DevOps or GitHub Actions.
  • Experience with data lake, lakehouse, and modern data platform architectures.
  • Experience with data security, encryption, and access management.
  • Experience supporting cloud-based analytics or AI-enabled data platforms.
  • Experience delivering solutions within Government, Defence, or other regulated environments.
  • Relevant Microsoft Azure or data engineering certifications.

About the Company

UBDS Group

Global Capability Centre for cloud, cybersecurity

UBDS Group delivers end-to-end digital lifecycle services for public and private sector clients, focusing on cloud, cybersecurity, data, and AI, with a Global Capability Centre in Bengaluru that supports global operations. Its offerings include UBDS Digital, Rayo for AWS services, and 3B Data Security, delivered through long-term partnerships with Microsoft, AWS, Zscaler, and Cloudflare, backed by a multinational delivery team. It differentiates itself with a GCC-based model, a multi-brand portfolio, enterprise-scale partnerships, and a certified B Corp commitment to social and environmental goals like Net Zero by 2027. Its goal is to be a trusted, long-term partner for digital transformation, delivering sustained value and responsible growth while expanding its global delivery footprint.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Bengaluru, India
Founded
2025

Recently Posted Jobs

Explore more opportunities at UBDS Group

See more jobs