Prefect just bought Dagster, another big Airflow rival - and it's not a data pipeline story. What began as a rivalry over data workflows is becoming a bet on how AI agents should be run, governed and measured. Prefect, best known for the eponymous open-source data pipeline and workflow orchestrator, has announced that it's acquiring Dagster, one of the biggest alternatives to Apache Airflow alongside Prefect itself. The deal, which has yet to formally close, folds two of the most established Airflow challengers into a single company. Dagster, the open-source orchestrator, and Dagster+, the fully managed cloud incarnation, will keep their existing names, pricing, and product roadmaps, with some 40 people from the Dagster team moving over to Prefect as part of the deal. In a LinkedIn post published on Monday, Prefect founder and CEO Jeremiah Lowin explains that the acquisition is a bet on the various components an AI agent needs to run reliably: clearly defined goals, paired with the flexibility to improvise when its own decisions send it down a path nobody scripted. Dagster, according to Lowin, handles the goal-setting side by defining and tracking outcomes; Prefect handles the improvising by running the work itself; and FastMCP, Prefect's own tool for connecting agents to outside systems, controls what those agents are allowed to touchd along the way. For Lowin, the acquisition is all about creating scale. Two become one. That "scale" pitch comes some seven years after Prefect and Dagster competed, both emerging as challengers to Airflow, the default tool most teams used to schedule and run their data pipelines. Prefect set out to simplify and make production workflow orchestration more reliable for Python developers. Dagster, for its part, focused on making data pipelines easier to define, understand, and verify, placing greater emphasis on what a pipeline should produce rather than simply running a sequence of tasks. "For years, Prefect and Dagster have raised the bar for each other and our category. That competition produced two exceptional products and two of the strongest open-source communities in the data ecosystem." "For years, Prefect and Dagster have raised the bar for each other and our category," Lowin writes. "That competition produced two exceptional products and two of the strongest open-source communities in the data ecosystem." The strengths each company built for running pipelines are now being stretched to cover something bigger, with Prefect betting those same strengths are what agentic workloads will need next. The AI transition. Both companies have been repositioning around AI agents for a while. Back in 2024, Prefect 3.0 landed with an explicit focus on supporting agentic workflows. A year later, Dagster debuted Components, pitched as a way to build pipelines using reusable, YAML-based building blocks rather than hand-written Python. Shortly after, Dagster went further with Compass, a tool that lets analysts query data using plain-language prompts sent through Slack instead of writing SQL. None of that matches the reach of what Prefect built with FastMCP. The framework works with the Model Context Protocol (MCP), the open standard Anthropic released in late 2024, which lets AI models discover and call external tools and data, allowing developers to build MCP servers by writing plain Python functions instead of hand-coding the protocol directly. Prefect shipped FastMCP the same month that MCP itself launched, and Anthropic later adopted it as the official Python SDK for MCP. The deal has consequences beyond product strategy, though, starting with the people who built Dagster in the first place. Nick Schrock, who founded Dagster and moved from CEO to CTO in 2022 to make way for Pete Hunt, is named alongside Hunt in the official acquisition announcement as staying on to "serve as strategic advisors to Prefect" while remaining "active in the open-source community." However, Schrock's own blog post, published on Monday, reads far more like a clean break from Dagster. "I want to share that I'll be moving on from the project and company," Schrock writes. Schrock's departure closes one chapter for Dagster. The acquisition itself, however, opens another, with Prefect betting that the ideas both companies spent years developing for data orchestration will prove just as valuable as AI agents move into production. Landen Bailey, principal data engineer at ecommerce platform Redo, took to LinkedIn to reflect on the pairing - for years, he writes, Prefect and Dagster were the two "hipsters" companies turned to whenever they wanted a break from Airflow. Together, he argues, they now stand a better chance against the incumbent. "The potential this gives Prefect to mount a real challenge against Airflow's marketshare will be fun to watch," Bailey writes. "Individually, each tool struggled to stand up to the incumbent giant, but now there's a real chance to make a dent."

Prefect has acquired Dagster Labs, combining the two leading alternatives to Apache Airflow. The deal unites Prefect's workflow execution platform with Dagster's asset-based orchestration model, creating an integrated suite for data pipelines, machine learning operations, and AI agent infrastructure. Both products will maintain separate identities, open-source licences, and roadmaps. Dagster founders Nick Schrock and Pete Hunt will serve as strategic advisors. Pricing remains unchanged for both Prefect Cloud and Dagster+. The combined company will focus on agentic automation, upstream reliability, and flexible execution. Prefect's FastMCP protocol, which has been downloaded over 92 million times in the past month, serves as the default connection layer for AI agents. Prefect has operated profitably for the past year and will continue supporting both products long-term.