Full-Time

Lead Data Engineer

Scott Logic

Scott Logic

201-500 employees

Enterprise software design and delivery

No salary listed

Edinburgh, UK

Hybrid

Ad-hoc on-site work in London area; hybrid arrangement.

Category
Data & Analytics (2)
,
Required Skills
Python
JavaScript
Apache Spark
SQL
Data Engineering

Get referred to Scott Logic

See people who can refer or advise you

Requirements
  • Good experience with some of the technologies and approaches typical in modern data engineering and reporting. This includes storage, data pipelines to ingest and transform data, and querying and reporting of analytical data.
  • Technologies such as Python, Spark, SQL, PySpark, PowerBI.
  • Background in software engineering, including Front End technologies like JavaScript.
  • You are a problem-solver, pragmatically exploring options and finding effective solutions.
  • An understanding of how to design and build well-structured, maintainable systems.
  • Strong communication skills and a collaborative approach to work.
  • You embrace the chance to try new things, learn new skills and grow your experience.
Responsibilities
  • Data engineers create data platforms and pipelines, build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of machine learning models.
  • These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience.
  • You may be leading teams, setting technical direction, advising clients or solving tough engineering challenges.
  • You would also be expected to spend some time on-site with clients in the London area on an ad-hoc basis.
Desired Qualifications
  • Experience of relevant cloud services within AWS, Azure or Google Cloud Platform.
  • Experience working in an Agile environment.
  • Experience working with common vendor products such as Snowflake or Data Bricks.
  • Experience working with CI/CD tooling.

Scott Logic designs and builds software for large and demanding organisations across sectors like capital markets, commodities, and public services. Their approach combines innovation, experience, and pragmatism to deliver software projects that improve performance and yield measurable results for clients. The company works with clients to understand their needs, then designs, develops, and implements software solutions that connect systems, optimize processes, and deliver tangible benefits. What sets them apart is the mix of deep industry knowledge with practical, hands-on delivery and a focus on measurable outcomes rather than theory alone. Their goal is to help clients achieve better performance and efficiency through reliable software solutions built to the client’s exact requirements.

Company Size

201-500

Company Stage

N/A

Total Funding

N/A

Headquarters

Newcastle upon Tyne, United Kingdom

Founded

2005

Get referred to Scott Logic

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • AI adoption work can expand consulting demand across delivery organizations.[1][11]
  • Outcome-based metrics create advisory opportunities beyond traditional engineering services.[3][7]
  • Agentic workflows open new opportunities in software delivery and operations.[4][11]

What critics are saying

  • Junior engineer pathways are under pressure as entry work gets automated.[7]
  • Poor process redesign shifts bottlenecks to human review and approvals.[5][6]
  • Dependence on frontier model providers exposes clients to supply-chain disruption.[7]

What makes Scott Logic unique

  • Scott Logic positions AI as process redesign, not just tooling.[1][6]
  • It emphasizes human-in-the-loop delivery for quality and accountability.[9][11]
  • The firm combines engineering, culture, and organizational change expertise.[6][11]

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Life Insurance

Remote Work Options

Paid Vacation

Parental Leave

Gym Membership

Commuter Benefits

Company News

Scott Logic
Mar 4th, 2026
Scott Logic welcomes new CIO and bids farewell to CEO

Scott Logic welcomes new CIO and bids farewell to CEO. 4 March 2026 Simon Sear joins Scott Logic this March, strengthening its Executive Board in the new role of Chief Innovation Officer. Simon brings a wealth of experience from the technology consultancy sector, having previously held similar board-level roles at BJSS and most recently at Ascent (now Acuity Analytics). In his new role, Simon will help Scott Logic seize the opportunities ahead, particularly as Scott Logic Ltd. continue to invest in its AI capabilities and drive innovation across the business. After five years of leading Scott Logic, Steve Foreshew-Cain has elected to depart Scott Logic to pursue other opportunities. Steve took up the role of Scott Logic's CEO in January 2021, during the longest phase of the COVID lockdowns. Embracing the company's strong focus on its people, Steve guided Scott Logic out of the pandemic with policies that safeguarded colleagues while ensuring they could maintain the exceptional standard of delivery expected by its clients. His passion and focus on ethical business practice also brought Scott Logic its B Corporation recognition in 2023, one of the first technology consultancy firms in the UK to achieve the prestigious status. As Scott Logic transitioned into the post-pandemic era, Steve spearheaded the growth of its public sector client portfolio, drawing on his previous experience as Executive Director of the Government Digital Service. During Steve's leadership, he led the business through a significant period of growth, exceeding £50m in revenue for the first time in 2023. He leaves the company at the end of March and is working with the Executive Board to ensure a smooth transition. Scott Logic's Founder and Executive Chair, Gary Scott, continues to lead the company with the Executive Board - driving forward the company's ambitious strategy that will equip Scott Logic to harness AI in ways that strengthen the outcomes Scott Logic Ltd. deliver for its clients. It marks the beginning of its third decade - one Scott Logic Ltd. enter with clarity, ambition and confidence.

Scott Logic
Aug 8th, 2024
AI in Government - the central role of data

Scott Logic Limited recently partnered with the Institute for Government (IfG) to run a couple of private roundtable sessions exploring the opportunities and risks of harnessing AI in providing public services.

GlobalData
Apr 29th, 2024
Finastra supports ScotPayments with prevention of payments fraud

Finastra has announced the go-live of its Bacsactive-IP Confirmation of Payee (CoP) service with ScotPayments, a centralised payments platform that supports the digital transformation of public services in Scotland.

Scott Logic
Dec 15th, 2023
Our prompt injection playground has gone open source!

Back in late October, Scott Logic Ltd. revealed its prompt injection project, lovingly called 'Spy Logic', with a short video demo and an accompanying blog post.

Scott Logic
Nov 16th, 2023
OpenAI Outage November 2023

Here at Scott Logic, Scott Logic Ltd. has been working on an artificial intelligence chat bot called Scottbot.