Value Engineer

How CockroachDB and IBM LinuxONE Rockhopper 5 power Resilient AI infrastructure. Published on July 7, 2026 Why does AI require a new approach to infrastructure? AI is changing enterprise infrastructure requirements by increasing demand for continuous data availability, high concurrency, and real-time decision-making. Customers expect uninterrupted experiences, and AI-driven systems depend on continuous, reliable access to current data. Even a few minutes of downtime can result in significant financial and reputational loss. As Cockroach Labs CEO Spencer Kimball CEO recently observed, "The tsunami of autonomous agents has arrived." Supporting those systems requires elastic infrastructure and software that can seamlessly scale and work together. Always-on infrastructure is becoming a prerequisite for enterprise AI. As organizations deploy AI assistants, autonomous workflows, and agentic applications into production, the underlying data platform must deliver consistent access to current data while scaling to unpredictable demand. From real-time payments to AI-driven applications, enterprises rely on critical services such as digital banking and wallets, payment processing, trading and order management, and identity and access management (IAM). IBM LinuxONE is IBM's enterprise-class Linux platform, designed for extreme reliability, security, and performance trusted by industries where downtime is not an option. CockroachDB's distributed SQL and integrated vector search capabilities provide the data foundation required for AI applications, supporting semantic retrieval, embeddings, agent memory, and transactional consistency. LinuxONE Rockhopper 5 delivers the resilient, secure, and scalable infrastructure needed to run those workloads in production. Why traditional infrastructure falls short for AI workloads. Traditional infrastructure was not designed for the scale, availability, and concurrency requirements of modern AI workloads. Commodity infrastructure fails frequently, and databases are forced to compensate with complex failover and recovery mechanisms. This leads to higher costs, increased operational burden, and systems that are reactive rather than resilient. Additionally, these systems scale linearly and lack true distributed capabilities. When operations and engineering teams try to address resilience, scale, and performance with disjointed point solutions, the result is disparate data sprawl with complex IT management capabilities. Beyond increasing operational overhead, fragmented architectures can slow application delivery and make it harder for teams to introduce new AI capabilities with confidence. Consolidating infrastructure and data services helps organizations reduce complexity while improving operational agility as workloads evolve. What is the Always-On Data Foundation? The Always-On Data Foundation combines CockroachDB and IBM LinuxONE Rockhopper 5 to provide a resilient data platform for enterprise AI and mission-critical workloads. Today, Cockroach Labs and IBM introduce this integrated architecture, powered by the newly announced LinuxONE Rockhopper 5. Replacing fragmented stacks with a tightly integrated combination of enterprise infrastructure and distributed SQL, this solution supports continuous availability and seamless elasticity. When database software is fundamentally aware of, and optimized for, its underlying hardware, it can intelligently distribute workloads to maximize resilience and throughput. This solution is purpose-built for enterprise AI workloads where infrastructure doesn't just support workloads, it actively enables intelligent, autonomous systems. The platform is engineered to meet the demands of real-time AI and agentic workloads. Vector Search Meets Distributed SQL for AI Workloads - AI applications need more than a resilient data layer: They need one that can handle semantic search, embeddings, and real-time vector retrieval alongside transactional data. This guide explores how distributed SQL enables unified AI data architecture without the complexity of managing separate vector stores. CockroachDB on LinuxONE Rockhopper 5 embeds AI-readiness directly into the foundation. By tightly integrating enterprise infrastructure with distributed SQL, it creates a system where the database is not just distributed but intelligent and context-aware. It is optimized to take advantage of the underlying hardware it runs on, and dynamically optimizes workload placement to ensure that AI models and agents always have fast, reliable access to data. The converged platform provides a resilient foundation for distributed AI workloads that require both continuous availability and transactional consistency. Rather than treating resilience as a separate operational concern, infrastructure and the database work together to help support reliable application behavior under changing demand. In the agentic era. AI agents are not passive; they continuously observe, decide, and act. They require: * Massive concurrency to operate at scale * Global consistency to make accurate decisions * Zero-downtime execution to avoid disruption in real-time processes The distributed SQL foundation for agentic scale - Agentic systems don't just need more compute, they need a data layer built to handle continuous, concurrent, autonomous activity at scale. Watch this webinar to see how distributed SQL meets the unique demands of agentic AI in production. What makes this architecture different? Combining enterprise infrastructure with distributed SQL removes traditional tradeoffs between resilience, scalability, and operational complexity. It's not about improving uptime, but removing downtime as a design concern. LinuxONE Rockhopper 5 and CockroachDB eliminate the trade-offs of traditional architectures by co-designing reliability into every layer: * Hardware designed to avoid failure: LinuxONE Rockhopper 5 Express brings highly efficient, enterprise-grade reliability (99.999999% availability) into an accessible form factor to consolidate systems and reduce physical failure rates. * Database designed to survive failure: CockroachDB operates as a natively distributed SQL layer, ensuring seamless elasticity and continuous availability even when regional disruptions occur. Ready for the agentic era. This hardware-software synergy eliminates traditional bottlenecks, delivering the real-time consistency and hyper-concurrency autonomous AI agents demand. This is not theoretical; it's the exact architecture, currently: * Scaling AI to handle trillions of objects * Controlling agent and data access for hundreds of millions of users * Powering mission-critical AI solutions designed to streamline efficiency Building resilient AI infrastructure across hybrid cloud. Resilient AI infrastructure depends on keeping applications close to their data while maintaining consistency across hybrid cloud, on-premises, and edge environments. This integrated foundation anchors a strategic hybrid cloud and data platform strategy. By deploying CockroachDB's natively distributed, PostgreSQL-compatible data services across the LinuxONE portfolio, organizations can position infrastructure and software directly adjacent to their applications. Historically, bridging on-premises environments, public clouds, and the edge meant accepting severe tradeoffs between latency, consistency, and security. This architecture eliminates those compromises, allowing enterprises to push compute and data closer to the application layer. It drastically reduces latency for real-time AI and agentic workflows, while maintaining strict global consistency and data sovereignty. CockroachDB runs on LinuxONE systems, including LinuxONE Rockhopper 5, to automatically distribute and replicate data across nodes and regions. The result is a system that's not just distributed, but intelligent and context-aware, dynamically optimizing workload placement to ensure AI agents have fast, reliable, and consistent access to data, even during site-level failures. Organizations gain the flexibility to modernize applications and execute high-concurrency AI initiatives securely on a unified and trusted infrastructure. As AI initiatives move from experimentation into production, resilient data infrastructure becomes a strategic advantage rather than simply an operational requirement. Organizations that can maintain consistent performance, continuous availability, and global data consistency are better positioned to deploy AI applications with confidence while supporting long-term business growth. Related announcement. Get started with CockroachDB on IBM LinuxONE. If downtime impacts your business, it's time to rethink the data infrastructure that supports it. Partner with IBM and Cockroach Labs to build resilient, secure, always-on platforms on LinuxONE Rockhopper 5. Learn how CockroachDB and IBM LinuxONE power resilient AI infrastructure. Contact Kyle Basile, Sr. Partner Sales Manager, IBM, at Cockroach Labs, [email protected]. Kyle Basile is Sr. Partner Sales Manager, IBM, at Cockroach Labs. Work With Me will email you updates about CockroachDB. You can unsubscribe at any time. Learn more about its privacy practices here.

Inside Cockroach Labs' AI playbook: the database reckoning. From Cockroach Labs' own floor at RoachFest London 2026: 1,000 AI-built internal apps, an AI support engine, and why agents have no natural ceiling. Between the main-stage keynote and a series of floor conversations at RoachFest London 2026, I got a far more detailed picture of how Cockroach Labs itself is thinking about the agentic AI wave than any single talk could cover. Pieced together, it reads less like a vendor pitch and more like a company narrating its own reckoning with what is coming. 1,000 ai-built apps in two months. The starting data point: Cockroach Labs built an internal tool called Micah in a single week back in February. It gives every employee a ready-made environment to build apps, with access to whichever data sources their credentials already permit, out of the box. Two months after launch, 1,000 internal applications had already been deployed - every one backed by a CockroachDB serverless database. Their working rule of thumb: one AI hour is roughly equivalent to one human week of output, and they consider that a conservative estimate. Scale that ratio across every company running the same playbook, and the proliferation curve gets steep fast - which is exactly the premise behind the next part of the story. Trillion agents, zero ceiling. One line stopped me cold on the floor: "There's no limit to this. There'll be 10 billion agents. There'll be 100 billion agents. And there'll be a trillion agents." The argument behind it: mobile saturated at roughly 8 billion humans - a hard ceiling set by the size of the population. Agents have no equivalent ceiling. Cockroach Labs is already seeing 10x traffic growth from AI agents, and each successive 10x is arriving faster than the last, far faster than the three-to-five years the first jump took. The practical consequence for infrastructure: monoliths hit a wall, and most enterprises are still not on distributed infrastructure. What is coming is described as a "swarm proliferation" of databases following a power-law distribution across every enterprise, as AI-generated apps spin up in minutes and each one needs its own data layer. This is the same rising-tide pattern I heard described elsewhere on the floor: training GPUs came first, inference flipped the balance, agents went from a speculative proposition to near-ubiquitous in coding workflows in under a year, and data infrastructure is next in line. Agents call tools, tools call APIs, and data infrastructure has to handle a new class of machine-driven traffic at a scale nobody has architected for yet. Cloud providers are already publishing breakdowns of human-driven versus bot/agent API traffic - this is measurable now, not a forecast. Mission-Critical, zero RPO. None of this matters if the database underneath cannot survive it. Cockroach Labs' pitch to mission-critical customers stays constant regardless of the AI framing: lose an entire region and still hit zero recovery point objective, hold cross-country global transactions with strong consistency, and keep elastic scalability firm at peak load. In the speaker's words, these are "very, very difficult problems to solve in a context of distributed relational data systems." The customer logos on screen - Booking.com, DoorDash, Roblox, OpenAI, SpaceX, Cisco - were running mission-critical workloads on this foundation long before the market understood it needed this level of resilience. A separate, more technical floor conversation walked through what that resilience actually costs to operate: topology and node configuration, data locality and its latency implications, what Raft consensus really means for an ops team's day-to-day, and where latency shifts during a large-scale outage. The reassurance offered was genuine rather than glib - once a team has climbed that learning curve, those concerns fade into the background and focus shifts back to shipping. The database cost iceberg. Most companies see only the tip of the database cost iceberg, and that is exactly why modernization stalls before it starts. An estimated 80% of database spend sits hidden below the surface - idle compute, storage, and network capacity quietly draining budget, plus human labor costs that are among the most significant line items in the total cost equation. Migration costs are high enough, and success rates uncertain enough, that many organizations simply do not move, sitting on mountains of legacy technical debt instead. The reframing on offer: a single database going from supporting hundreds of use cases to supporting thousands is a genuinely disruptive multiplier, but every inefficiency compounds if the underlying dynamics are not addressed first - infrastructure cannot keep scaling linearly the way it did in the 1990s. Storage virtualization: the next chapter. The most forward-looking technical thread covered CockroachDB's next storage architecture. A new, purpose-built storage layer is coming - echoing how Pebble replaced RocksDB - cutting write amplification, delivering roughly 10x throughput gains, reducing latency, and lowering storage costs by multiples. Compute-storage decoupling lets clusters auto-scale without moving data between nodes, and virtual clusters - already powering the serverless product since around 2020 - are being extended to enterprise and BYOC customers on dedicated infrastructure. The uncomfortable number behind the pitch: most operational databases run at just 5-15% utilization. Virtualization can push that above 50%, which is a direct cost reduction rather than a marginal efficiency gain. An emerging agent layer is planned to sit on top of this stack, covering migration tooling and fleet management - the same agent-native database architecture Spencer Kimball outlined on the main stage. AI support: 90%+ case resolution from the first email. The most striking individual statistic came from a conversation about turning years of CockroachDB support history - runbooks, filed tickets, engineer back-and-forths, symptoms, remediations - into a real-time AI knowledge engine. The idea: an AI agent queries that institutional knowledge the moment a customer's first support email lands, with no human engineer in the loop yet. The results: 40% of cases get the exact correct answer from the initial email alone, with cited evidence and a full remediation path. A second AI evaluates the first AI's output for quality control. More than 90% of the time, the result is at least a mostly correct, genuinely useful answer. The broader point volunteered alongside the number: this is not a database-specific story. AI in the support loop is coming for every industry that has years of distilled institutional knowledge sitting in ticket history, because it moves faster and holds an entire organization's accumulated knowledge at once. Fleet management and multiplying team leverage. The operational thread tying all of this together was a shift in how Cockroach Labs frames database ops: stop treating individual workloads as isolated problems and start managing the full estate as a fleet. Setting policy, economics, and capacity centrally dramatically amortizes costs at scale. AI becomes the ops engine for the grunt work no team would ever staff for, catching the "little threads" before they escalate into outages - while humans stay elevated to own policy and governance rather than executing every routine task themselves. The people-side framing was equally direct: you cannot hire your way out of a database estate that is growing faster than headcount ever will. The real unlock is multiplying the leverage of the team already in place - including, notably, finally tackling the backlog most teams currently cannot even reach because there was never enough capacity to get to it. AI agents as real-time guardrails. The most concrete safety pitch involved AI agents functioning as a real-time layer against operator error. The opening example was sobering: a trading app incident where a costly mistake led to someone being put on administrative leave - entirely preventable, in the speaker's view. The proposed fix borrows a "two-key" analogy from nuclear launch protocols: destructive database actions should require a second check, the same way turning two keys at once prevents a single person from acting alone. An agent with full cluster context can flag "this is a production cluster" or catch a query touching an index that is no longer in use, essentially for free and in real time - no waiting on a slow human review cycle. The same agent-as-monitor pattern extends to day-to-day operations: agents stepping into monitoring and advisory roles, catching slow queries and missing indexes before they escalate, and handling migration diagnosis proactively rather than after the fact. The stated payoff is freeing engineering teams to focus on the strategic decisions the business actually needs from them. The throughline. Every one of these conversations, taken separately, sounds like a different pitch: internal tooling, resilience, cost, storage architecture, support automation, ops, safety. Taken together, they describe one company using its own infrastructure as the test bed for a thesis it is also selling: that the AI wave does not arrive as a single product feature, it arrives as pressure on every layer of the database estate simultaneously, and the only architecture built to absorb that pressure is one that was already distributed before agents showed up asking for it. Related reading. I am Luca Berton, AI and Cloud Advisor. I work at the intersection of distributed systems, platform engineering, and enterprise AI deployments. Book a consultation.