M

Made Tech

Lead Data Engineer

Data EngineeringUpdated on Nov 13
Full-timeUnited Kingdom£80k - £96k /yr

About the Job

Requirements

  • Demonstrate having played a key role in delivering a production-ready data platform on at least one occasion.
  • Be proficient in Python and at least one public cloud platform such as AWS, Azure, or Google Cloud Platform.
  • Be able to build and manage large-scale data transformation workflows.
  • Be proficient in managing personally identifiable information and sensitive information while ensuring compliance with data legislation.
  • Understand test-driven development and have experience implementing testing strategies, including unit testing, integration testing, and data quality assessments.
  • Understand fundamental software principles, particularly SOLID and DRY.
  • Have experience with version control systems such as GitHub or Bitbucket.
  • Know contemporary data architectures, including data lakes, data warehouses, and data lakehouses.
  • Be able to organize and transform diverse data types into standardized, unified schemas.
  • Understand serverless, code-driven data transformation pipelines and traditional batch-oriented extract, transform, and load systems.
  • Have hands-on experience in one or more technology areas such as analytics and platform frameworks, transformation and orchestration tools, database technologies, libraries and schema management, storage formats, or containerization.
  • Have a solid understanding of DevOps to support ownership of cloud infrastructure and multiple environments.
  • Have experience deploying data platforms and pipelines.
  • Have strong experience in infrastructure as code, preferably Terraform.
  • Have experience establishing continuous integration and continuous delivery pipelines to ensure code quality and support rapid, iterative releases.
  • Have experience implementing logging, monitoring, and vulnerability checks.
  • Be able to discuss cost estimates accurately when designing, deploying, and managing services.
  • Have experience interpreting business and data landscapes to guide delivery and product managers, recognize client requirements, and work alongside other disciplines such as business analysts and user researchers.
  • Be able to discuss DataOps utilities across orchestration, analytics, and data integration.
  • Have a proven track record in agile delivery environments and be able to work in Kanban, XP, or Scrum frameworks.
  • Be able to foster organic account growth through a commercial mindset and engagement with senior stakeholders.
  • Be able to work in cross-functional teams.
  • Have a desire to upskill and share knowledge with a team and within the organization.
  • Be able to mentor, manage, and develop talent within the organization.
  • Be eligible for UK Security Check clearance; eligibility requires five years of continuous UK residency and five years of employment history, or a history extending back to full-time education.

Responsibilities

  • Design and implement efficient, secure, and maintainable data storage and pipeline solutions as a lead member of multidisciplinary delivery teams.
  • Define, shape, and implement cloud-native data strategies and security-first engineering.
  • Help public sector teams unlock the strategic value of their data by designing scalable data solutions.
  • Advise on data-driven approaches using public cloud services such as AWS, Azure, and Google Cloud Platform.
  • Contribute to recruitment efforts and take on line-management responsibilities as appropriate.
  • Work with the wider team in some cases to identify account growth opportunities.
  • Share knowledge, coordinate presentations, and represent the data capability internally and externally.

Desired Qualifications

  • Collaborate within multidisciplinary digital and technology teams and encourage practices such as pair programming.
  • Have experience with specialized data platforms focused on domains such as financial or geospatial data.
  • Have experience in the public sector, including facilitating data sharing and use across government departments.
  • Partner with data scientists to transition advanced data deliverables, such as machine learning models, into production environments.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Made Tech

See more jobs