Full-Time

Lead Data Engineer

Posted on 11/26/2024

Thoughtworks

Thoughtworks

10,001+ employees

Technology consultancy for digital transformation

Data & Analytics
Consulting
Enterprise Software

Senior

Manchester, UK

Position requires onsite presence in Manchester.

Category
Data Engineering
Data & Analytics
Required Skills
NoSQL
Data Science
SQL

You match the following Thoughtworks's candidate preferences

Employers are more likely to interview you if you match these preferences:

Degree
Experience
Requirements
  • You have experience in leading the system design and implementation of technical solutions.
  • Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems.
  • You have a deep understanding of data modeling and experience with modern data engineering tools and platforms.
  • You have experience in writing clean, high-quality code using the preferred programming language.
  • You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting.
  • You have experience with data visualization techniques and can communicate the insights as per the audience.
  • You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems.
  • You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.).
Responsibilities
  • You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration.
  • You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality.
  • You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
  • You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems.
  • You will collaborate with data scientists to design scalable implementations of their models.
  • You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
  • You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available.
  • You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
  • You will be responsible for data governance, data security and data privacy to support business and compliance requirements.
  • You will define the strategy for and incorporate data quality into your day-to-day work.

Thoughtworks helps businesses modernize and innovate by providing consultancy services that combine strategy, design, and software engineering. Their approach involves working closely with clients to understand their specific challenges and goals, allowing them to create tailored solutions that often include custom software development and system modernization. Unlike many competitors, Thoughtworks emphasizes a collaborative partnership with clients across various industries, including finance, healthcare, and retail, to deliver impactful results. The company's goal is to enable clients to thrive in the digital age by leveraging technology, data, and artificial intelligence to unlock new sources of value.

Company Stage

IPO

Total Funding

$727.6M

Headquarters

Chicago, Illinois

Founded

1993

Growth & Insights
Headcount

6 month growth

↑ 0%

1 year growth

↑ 3%

2 year growth

↓ -2%
Simplify Jobs

Simplify's Take

What believers are saying

  • Generative AI trend offers expansion opportunities for Thoughtworks' AI services.
  • Partnerships in cybersecurity align with growing global demand for security solutions.
  • Customer-centric design in payment systems enhances Thoughtworks' collaboration with Australian Payments Plus.

What critics are saying

  • Increased competition in AI and digital transformation may erode market share.
  • Rapid technological changes could outpace Thoughtworks' service updates, risking client satisfaction.
  • Economic downturns may reduce client budgets, impacting Thoughtworks' revenue.

What makes Thoughtworks unique

  • Thoughtworks combines strategy, design, and engineering for comprehensive digital transformation.
  • Recognized as a Visionary in Gartner's 2024 Magic Quadrant for Custom Software Development.
  • Strong global presence with diverse industry expertise, including finance and healthcare.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Hybrid Work Options

Professional Development Budget

Flexible Work Hours

INACTIVE