Full-Time
Senior Data Engineer
Data Engineering
Posted on 9/4/2025
Thoughtworks
10,001+ employees
Global tech consultancy for digital transformation
No salary listed
Madrid, Spain
Hybrid
Hybrid model indicates a mixture of remote and in-person work.
 Data & Analytics (1) |
|---|
- Working with data excites you; You can build and operate data pipelines, and maintain data storage, all within distributed systems
- You have hands-on experience of data modeling and modern data engineering tools and platforms such as Airflow or Databricks
- You have experience in writing clean, high-quality code using the preferred programming language
- You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting using Snowflake (must have), Amazon S3, Azure Data Lake, Spark and/or Flink
- You have experience with data visualization techniques and can communicate the insights as per the audience
- You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
- You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)
- You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
- You will develop intricate data processing pipelines, addressing clients' most challenging problems.
- You will collaborate with data scientists to design scalable implementations of their models.
- You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
- You will use different distributed storage and computing technologies from the plethora of options available.
- You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
- You will collaborate with the team on the areas of data governance, data security and data privacy.
- You will incorporate data quality into your day-to-day work.
Thoughtworks is a global technology consultancy that helps organizations modernize and innovate by combining strategy, design, and software engineering. They work with clients to create adaptable technology platforms, digital products, and data- and AI-enabled solutions through tailored engagements. Their model centers on consultancy services, delivering project-based work, retainer arrangements, and long-term partnerships to implement custom software, modernize legacy systems, and execute data-driven strategies. Distinguishing factors include a 30-year track record, a broad, cross-industry client base, and an emphasis on end-to-end transformation rather than just technology delivery. The company's goal is to help clients thrive in the digital age by enabling sustainable growth and competitive advantage through integrated strategy, design, software, and analytics.
Company Size
10,001+
Company Stage
IPO
Headquarters
Chicago, Illinois
Founded
1993
Simplify's Take
What believers are saying
- Teneo JV on March 16, 2026, merges 1,800 advisers with 10,000 engineers for CEO AI outcomes.
- True Digital Academy partnership on March 31, 2026, co-develops AI curriculum for Thai enterprises.
- Groq partnership delivers 5X faster AI inference and lower costs for Australian call centers.
What critics are saying
- Accenture and Cognizant erode market share with larger teams and lower AI pricing.
- Talent attrition shrinks 10,000+ workforce 15-20% from AI project burnout.
- Teneo JV dilutes brand control, exposing AI/works™ IP for competitors.
What makes Thoughtworks unique
- Thoughtworks blends strategy, design, engineering, and AI for digital transformation.
- AI/works™ platform accelerates AI prototypes from strategy to production in weeks.
- Global CISO Nitin Raina’s security-by-design embeds security into project delivery.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Hybrid Work Options
Professional Development Budget
Flexible Work Hours
Growth & Insights and Company News
6 month growth
↑ 0%1 year growth
↑ 1%2 year growth
↑ 0%True Digital Academy join forces with global partner Thoughtworks to advance ai-ready workforce development, Leveraging international best practices to accelerate Thai businesses toward AI-First Organizations. March 31, 2026 - Bangkok True Digital Academy, a leader in workforce transformation and AI capability development for Thais and businesses, has announced a strategic partnership with Thoughtworks, a global technology consultancy that integrates strategy, design, engineering and AI to drive digital innovation and large-scale business transformation. This collaboration aims to empower Thai businesses in successfully transforming into "AI-First Organizations", integrating international best practices with deep expertise in AI skill development and technology, grounded in a profound understanding of local business challenges and the Thai context. This partnership shifts the learning paradigm from mere "Skill Development" to "AI Adoption" through the "Enterprise AI Adoption Turnkey" framework that enables the practical application of AI in organizational development across three core pillars: People, Technology, and Business, while elevates intensity of the curriculum, learning quality, and the integration of knowledge with insights and perspectives from global organizations. All of this is driven under True Digital Academy's comprehensive learning model, "PromptSphere," which features a standout "AI-Led Learning Ecosystem" designed to equip organizations with the tools to overcome all challenges in achieving AI transformation. This collaboration marks a significant milestone for True Digital Academy in strengthening its mission to enhance AI capability within Thai organizations. By synergizing with Thoughtworks, the partnership focuses on three key pillars: * Joint Curriculum and Learning Content Development: Under the standards and oversight of Thoughtworks' experts, the curriculum is designed to be cutting-edge, enterprise-relevant, and aligned with real-world business contexts. Thoughtworks plays a vital role in reviewing and co-developing programs, translating deep technical expertise into practical applications. * Case-Study and Real-World Experience Integration: Leveraging insights from global use cases across diverse industries and experiences with organizations at varying stages of AI readiness, this initiative helps enterprises accurately apply AI to their specific business contexts and workflows, as well as sharing world-class technology experts' perspectives to foster AI innovation and deliver tangible business results. * Systemic AI Capability Development covering people - technology - business: Supporting organizations in driving systematic change across the workforce, while ensuring a clear understanding of the pivotal role technology plays in business to achieve sustainable AI transformation. The focus remains on cultivating a culture of safety and human-centricity, bridging the gap between learning and real-world execution, and preparing organizations to build, manage, and scale AI applications effectively. Ms. Sarinra Wongsuppaluk, Chief Human Resources Officer, True Corporation Plc., said "True Corporation prioritizes workforce development and talent cultivation to drive both its organization and the nation toward future readiness. ThoughtWorks, Inc. believe that AI will not replace humans; rather, it will unlock human potential to create even greater innovations and results. It is, therefore, essential to build talents with 'Future-Ready Skills' - a combination of digital skills and human skills that enable people to thrive in an AI-driven world. True Digital Academy has been found to accelerate and upskill talent within True Corporation and across various organizations. Its key objective is to enhance the AI capabilities of the Thai workforce and enterprises. The partnership with a global ally like Thoughtworks sets a new benchmark for an advanced learning ecosystem, further supporting organizational AI transformation through True Digital Academy's comprehensive learning model. This initiative goes beyond upskilling; it encompasses the strategic selection and practical application of technology to ensure cost-effectiveness, tangible results, and a concrete positive impact on organizations throughout Thailand." Mr. Nils Michaelis, Managing Director - Growth, Thoughtworks, said "Accelerating Thailand's new competitive advantages means, the application of AI is no longer an option but a strategic economic necessity. Thoughtworks is committed to bringing its deep experience of working with leading global organizations in the Global 2000 to the Thai business sector. Integrating AI that works as the core of operational processes is the definitive key to truly unlocking productivity. By synergizing the expertise of True Digital Academy, a leader in workforce development, with Thoughtworks' comprehensive engineering excellence, ThoughtWorks, Inc. is poised to drive the creation of a future-ready workforce and cutting-edge technological innovations to propel Thailand's digital economy forward. Its shared goal is to translate theory to high-impact practice, elevating the AI capabilities of the Thai workforce to international standards. ThoughtWorks, Inc. aim to drive Thai enterprises toward AI Adoption and becoming AI-First Organizations in a tangible, scalable manner - creating transformative changes that contribute to the nation's sustainable development." Dr. Chonnikarn Jira, Head of True Digital Academy, said "True Digital Academy has collaborated with various organizations to enhance AI capability through 'PromptSphere,' its comprehensive learning model covering four core future skills: AI, Business, Tech, and Data, along with Enabler Skills in people and critical thinking. These experiences have provided ThoughtWorks, Inc. with deep insights into the challenges organizations face when bridging the gap between knowledge and the practical application of AI within a business context to achieve tangible results. This aligns with surveys on AI adoption in Thailand, which reveal that most organizations are still in the learning and experimentation phase, largely due to a lack of systematic guidance in maximizing AI's potential. Consequently, ThoughtWorks, Inc. partner with Thoughtworks to co-develop curriculum and elevate the quality of learning, fostering a deeper understanding of how to implement AI effectively through world-class expertise. This collaboration enriches True Digital Academy's learning ecosystem to advance AI workforce transformation, ensuring a more efficient integration into real-world organizational operations. Its goal is to promote comprehensive AI adoption across all dimensions including People - Technology - Business." Ms. Nattarinee Pattanakul, Delivery Principal, Thoughtworks, said "The combined strengths and potentials of Thoughtworks and True Digital Academy create a perfectly aligned synergy, creating a learning ecosystem that extends directly into practical application. This effectively addresses the specific needs of Thai enterprises in transforming into AI-First Organizations. We are committed to transferring our direct experience in driving AI transformation with global organizations, alongside sharing proven case studies and best practices. This will enable Thai enterprises to reduce experimentation time and accelerate AI adoption through a curriculum led by real-world practitioners, focusing on hands-on execution and systematically connecting knowledge to actual business contexts - spanning business strategy, technology, and new ways of working. We firmly believe that this partnership with True Digital Academy will be a vital engine in cultivating high-potential talent and elevating the competitive standards of Thai organizations for sustainable growth on the global stage." ******************** About True Digital Academy True Digital Academy, a leading workforce capability transformation institution under True Corporation, is dedicated to developing competencies for organizations, employees, entrepreneurs, students, and individuals to meet the changing demands in an era of digital transformation. For more information, please visit https://www.truedigitalacademy.com Thoughtworks is a global technology consultancy that integrates strategy, design, engineering and AI to drive digital innovation and large-scale business transformation. For more than 30 years, ThoughtWorks, Inc. has partnered with organizations around the world to solve complex business problems through modern technology, disciplined engineering and a deep focus on culture and capability. With more than 10,000 Thoughtworkers across 47 offices in 18 countries, ThoughtWorks, Inc. help enterprises modernize core systems, build and design digital products, harness data and scale AI responsibly. Its expertise spans product engineering, data and AI, cloud and platform modernization, customer experience and enterprise transformation. ThoughtWorks, Inc. is known for its leadership in software engineering excellence, agile ways of working and responsible technology practices. Thoughtworks serves many of the world's leading enterprises across financial services, retail, healthcare, automotive, energy and the public sector. ThoughtWorks, Inc. work alongside executive teams to turn strategy into working systems that deliver measurable business value. Media contacts External Communications, True Corporation Plc. [email protected] Thoughtworks Justine Manche VP, Brand and Communications Email: [email protected] Michelle Surendran Head of Public Relations for APAC and India Email: [email protected]
Top SaaS companies in Pune. * LogicMonitor * Druva * Mindtickle * Truein * ProMobi Technologies Baxter Planning is a service supply chain management company that offers a SaaS platform. The service supply chain is the sequence of events and tasks that must occur in the process of delivering a service to a client. Distinct from the physical supply chain that supports product-based businesses, the service supply chain focuses on coordinating processes. The Baxter Planning platform offers high process visibility and predictive analytics and is built to integrate with CRM and ERP systems. LogicMonitor's platform allows enterprises to monitor their entire IT infrastructure. The technology uses artificial intelligence to power automation capabilities and enable an early warning system that helps teams identify and address problems before they cause significant negative impacts. Zscaler offers zero trust security solutions to businesses, critical infrastructure organizations and government agencies. Clients use its platform to secure users, branches, applications, data and devices. The company has a major presence in India for research, development and support, with a Pune office in the Hinjewadi area. Mindtickle's revenue enablement platform is designed to support business growth through solutions that cover everything from onboarding and training to forecasting and deal planning. It comes with an AI-powered assistant known as Copilot that can automate tasks, roleplay customer interactions and quickly analyze calls to provide insights. Coupa Software's platform applies artificial intelligence to optimize spend management for businesses across industries ranging from banking and life sciences to retail and utilities. Pune is one of several locations in the Asia-Pacific region where the company has established a presence. Truein makes technology to simplify time and attendance management and optimize workforce utilization for businesses. Equipped with artificial intelligence and facial recognition capabilities, Truein's solutions are specifically designed for organizations that rely on contract and distributed workforces. Thoughtworks is a technology consultancy that provides numerous digital services. One of its offerings is custom software engineering, for which it recently earned a mention as a leading firm on Forrester's Modern Application Development Services list. Thoughtworks builds SaaS tools and other digital assets, partnering with top software enterprises including Google, Spotify and Microsoft to offer integrations. ProMobi Technologies offers a portfolio of SaaS products to help businesses address pain points. For example, BrewSurvey is the company's solution covering online and offline surveying. It allows users to build surveys that feature their branding and lets them view results through interactive charts and graphs. FloQast is a workflow automation platform designed to streamline accounting tasks such as reconciliations, documentation requests and recurring processes like financial reporting and payroll. Founded in Los Angeles, California, the company has expanded globally, with its first office in India located in Pune. Druva provides businesses with a SaaS platform that bolsters data protection. It comes with tools to identify cyber attacks as well as accelerate threat response and data recovery. Customers from industries such as energy, life sciences, financial services, logistics and media use Druva's cloud-based technology. IDeaS offers hospitality revenue management software that focuses on inventory optimization, forecasting and data-driven pricing. It serves enterprise clients like restaurant groups and hotel franchises. The company's revenue science uses AI, machine learning, data science and mathematics to provide client organizations with trends in the way revenue goes in and out. ReliaQuest is a cybersecurity specialist firm that focuses on threat detection and response. Its signature product is the SaaS platform GreyMatter, which facilitates automated threat detection, threat hunting and remediation. GreyMatter's stated aim is to take some of the more tedious elements of cybersecurity processes off the plates of human workers, and to offer a high level of protection for digital assets. ZocDoc is a healthcare software company that offers a SaaS platform for connecting patients with providers. It functions as a marketplace aggregator for doctors, allowing patients to select from a panel of in-network healthcare workers in their area. The platform additionally provides functionality for scheduling, insurance claims and telehealth appointments.
Teneo and Thoughtworks have launched an AI-focused joint venture to help companies manage business transformation in the agentic age. The partnership combines Teneo's 1,800-plus C-suite advisers with Thoughtworks' 10,000-plus engineers and AI delivery expertise. The venture aims to help companies turn AI strategy into measurable business outcomes within weeks rather than years. It leverages Thoughtworks' proprietary agentic development platform, AI/works™, and focuses on managing AI-driven opportunities whilst addressing risk, security, ethics and governance concerns. The service is designed to work directly with CEOs and executive teams, aligning strategy, operating model and technology execution. The partnership seeks to close the gap between AI ambition and results as companies invest heavily in AI infrastructure and modernisation.
Teneo and Thoughtworks launch new ai-focused joint venture. * March 16, 2026 * New York & London Teneo, the global CEO advisory firm, and Thoughtworks, a global technology consultancy that integrates design, engineering and AI, today announced the launch of a new AI-focused venture designed to help companies manage business transformation and turn AI ambition into measurable business outcomes. As AI reshapes every industry, technology is at the heart of how every business runs. This joint venture is built for this new era. It redefines senior strategic advice as AI-native with the ability to design, build and run AI-powered platforms, so insight turns into action and strategy becomes operational across the enterprise. The venture brings together Teneo's trusted advisory and global client network with Thoughtworks' more than 10,000 engineers and deep expertise in design, product engineering, data and AI. The goal is clear: help companies react in real time and capture value from AI investments that deliver business outcomes in weeks and months, not years. As companies invest heavily into AI infrastructure and modernization, many struggle to translate ambition into results. The new joint venture is built to close that gap. It will work directly with CEOs and executive teams to align strategy, operating model and technology execution across growth, productivity, modernization, risk, talent and reputation. "As CEOs navigate unprecedented macroeconomic, geopolitical and technological disruption, they must also become the primary architects of their companies' AI futures," said Paul Keary, CEO of Teneo. "Teneo has invested hundreds of millions of dollars into world-class talent and capabilities to develop the leading global CEO advisory firm. Now in partnership with Thoughtworks, we will bring to bear Teneo's services with Thoughtworks' AI leadership and deep engineering capability to help our clients navigate business transformation in the AI and agentic age." "AI transformation only works when strategy, culture and execution move together," Mike Sutcliff, CEO of Thoughtworks, said. "This venture unites CEO-level advisory with hands-on engineering and AI delivery. In three days, we can help clients align on new product concepts. In three weeks, we can build a working prototype. In three months, we can put new systems into production. That is the pace today's market demands." Built for CEO priorities The joint venture will build new, integrated services designed specifically for the CEO agenda. Operating with multidisciplinary teams of executive advisers, product leaders, engineers, designers and data and AI specialists, it will create solutions that unite strategy and execution from day one. Services will include: * Accelerating CEO priorities tied to growth, productivity, modernization and resilience * Scaling enterprise AI programs from strategy through deployment, including generative AI and advanced analytics * Strengthening stakeholder trust through AI-powered insights and engagement across investors, regulators, governments and customers * Managing geopolitical and market risk through real-time monitoring and scenario planning * Supporting financial resilience with digital tools to improve liquidity and guide restructuring * Transforming customer and employee experiences through modern product platforms * Redesigning operating models and leading enterprise change at scale "As companies navigate rapid shifts in technology and capital markets, AI represents both opportunity and disruption," said Alex Pigliucci, Teneo's Global Head of Enterprise Clients, who will lead the joint venture. "This partnership equips our advisory teams, and our clients, with the ability to combine strategy and execution in real time, particularly in critical moments such as acquisitions, restructurings and large-scale transformations." The joint venture will be established in New York, with global hubs across the Americas, Europe, Middle East and Asia-Pacific. It begins operations immediately, supported by Thoughtworks' ecosystem of leading technology partners including Amazon Web Services (AWS), Google, NVIDIA, Microsoft, Databricks and Mechanical Orchard to bring these new services to market at speed. Subscribe here to receive updates on the new AI-backed services produced through Teneo's partnership with Thoughtworks.
How ThoughtWorks, Inc. built a pharmaceutical research assistant with generative AI. Pharmaceutical companies' ability to conduct research effectively is fundamental to their success. But research is rarely an efficient process - it takes time, requires exploration and demands exemplary organization. This is an ongoing challenge for every pharmaceutical company - including one of its clients. To try and solve it, ThoughtWorks, Inc. were asked to explore how ThoughtWorks, Inc. might develop a research assistant that could help those inside the company to more easily find the information they need. Given this was largely an information retrieval challenge, ThoughtWorks, Inc. looked to generative AI as the key technology that would power the research assistant. With the right data in place and an easy to use interface, ThoughtWorks, Inc. believed it would be possible to accelerate and improve research for thousands of the client's employees. The use cases. ThoughtWorks, Inc. identified two distinct use cases for an AI research assistant - both at different ends of the research process and with very different types of data. While they are very different they nevertheless both demonstrate the various ways AI can be leveraged to help humans better manage complex information on a huge scale. * Research summaries and updates for managerial oversight. Governance of research is critical for pharmaceutical companies; it drives planning in everything from supply chain management to marketing and distribution. While there are mechanisms in place for this, it can be challenging for those in senior positions to have full oversight due to the complexity, speed and scale of research happening, even in one small corner of the organization. The AI research assistant could leverage unstructured data in existing reports and documentation to provide summaries to this group at a regular cadence, helping to answer questions around things like progress and milestones. * Structured data exploration. Computational biologists - who play an important role in driving pharmaceutical research - leverage forms of structured data (about, say chemical or protein structures) to innovate. ThoughtWorks, Inc. believed a research assistant could provide researchers with an additional way to explore data. A chat interface, for instance, would make it possible to ask questions about the data and explore avenues of experimentation or further exploration. How did you actually do it? At the center of the project was bringing together all the necessary data. For its first use case, this meant connecting an LLM to the client's sharepoint repository which contained all information about ongoing research across the organization. For the second, it was again about making it possible for the LLM to access the huge amount of chemical and pharmaceutical data inside the organization. What technology stack was used? The project actually began on Azure AI Search, but, owing to some business changes, ThoughtWorks, Inc. ended up moving to AWS Bedrock. This was largely due to the fact that the client had its own LLM marketplace/platform which ThoughtWorks, Inc. could leverage which was driven by Bedrock. It's also worth noting that the project took place before MCP (Model Context Protocol) arrived on the scene. While that has clearly had a huge impact on how easy it is to connect data sources to large language models, ThoughtWorks, Inc. had to use Databricks to facilitate database communication. What technical challenges did you encounter? One of the biggest challenges ThoughtWorks, Inc. faced was due to the specific and highly specialized domain knowledge - any general LLM simply doesn't have access to the terminology used by the client. To tackle this ThoughtWorks, Inc. created a kind of manual map of domain and client-specific terms. This was done with the input of computational biologists and other SMEs: they created a table that captured terms and what they referred to to ensure that the research assistant could cope with highly specific questions and prompts from users. Throughout the process ThoughtWorks, Inc. also had to pay attention to the quality of responses from the AI. Early on there were some issues, so ThoughtWorks, Inc. needed to go through a few phases of retraining. To do this ThoughtWorks, Inc. used few-shot prompting, which is a technique in which the LLM is offered a number of examples in the prompt to help it complete its task. While there are a number of alternative techniques, such as fine-tuning (in which the model is essentially reconfigured to produce better outputs), it does have some advantages: for instance, it's more efficient than fine-tuning (because it requires less labeled data) and more easily adapted to different tasks. What was the impact of the work? The Research Assistant significantly accelerated how domain experts in pharma R&D interact with complex datasets. Scientists could now retrieve insights across oncology, pathology, and predictive modeling pipelines using natural language - eliminating the need for SQL or programming skills. This shift not only reduced the time-to-insight from hours to minutes but also empowered cross-functional teams (program managers,oncologists,bioscientists) to self-serve critical data, improving collaboration and decision-making. * Increased data accessibility. The research assistant allowed researchers to query both structured and unstructured data (e.g., SharePoint, Databricks SQL) inside a single interface. * Reduced bottlenecks. The tool also helped offload repetitive data requests from engineering teams thanks to its automating summarization, visualization, and SQL generation features. * Scalable agent ecosystem. The modular, multi-agent architecture allowed ThoughtWorks, Inc. to quickly onboard new use cases without refactoring the core logic. * Improved data governance awareness. Through prompt augmentation and intent recognition, researcher queries remained within business guardrails and surfaced relevant domain metadata without any compliance or privacy risks. What did you learn? The project wasn't just a success for the client, it also helped ThoughtWorks, Inc. learn a lot about leveraging AI. For instance, it became clear just how important prompt engineering is. True, it's something that's often said, but actually seeing how small changes in structured domain prompts impact the accuracy and relevancy of SQL code from the LLM helps you develop a stronger understanding and even sensitivity to the way the tool works. ThoughtWorks, Inc. also found that including schema hints and business rules in the agent flow significantly improved the reliability of responses and that by decoupling intent recognition, SQL generation, and summarization into separate agents, ThoughtWorks, Inc. could rapidly evolve features and debug failures in isolation. A final, particularly crucial bit of learning was that human-in-the-loop feedback matters. Integrating user feedback loops helped fine-tune agent behaviors over time, which was especially necessary for ambiguous prompts or non-standard query patterns. Disclaimer: The statements and opinions expressed in this article are those of the author(s) and do not necessarily reflect the positions of Thoughtworks. Related blogs.