Quick Facts

  • Only 25% of enterprise AI initiatives deliver expected ROI, and just 16% have scaled company-wide, according to an IBM CEO study.
  • IBM's next-generation watsonx Orchestrate, now in private preview, supports agents built on Anthropic's Claude, OpenAI's GPT, and IBM's own models, with more than 150 enterprise connectors.
  • IBM completed its $11 billion acquisition of Confluent on March 17, 2026, adding real-time data streaming used by more than 6,500 enterprises, including 40% of the Fortune 500.

IBM is making its case that enterprise AI has a production problem, and it has built a four-part answer. The company is presenting its AI Operating Model ahead of IBM TechXchange 2026, which runs October 26-29 at the Georgia World Congress Center in Atlanta. Last year's event drew more than 7,900 attendees across 1,500 sessions.

The core argument is simple: most enterprise AI never leaves the lab. IBM's own CEO study found that only around 25% of AI initiatives deliver expected ROI, and just 16% have scaled enterprise-wide. Deloitte's 2026 State of AI in the Enterprise report found that only 25% of respondents had moved 40% or more of their AI experiments into production.

"The enterprises pulling ahead are not deploying more AI -- they're redesigning how their business operates," said IBM Chairman and CEO Arvind Krishna. "Running AI in the enterprise requires a new operating model, and IBM is enabling organisations to manage AI-driven systems with the same rigour, governance, and scale as their most critical infrastructure."

The Four-Pillar Model

IBM's AI Operating Model is built on four integrated systems: agents, data, automation, and hybrid infrastructure. Each pillar addresses a specific gap between AI experimentation and production-grade deployment. The model was outlined by Bruno Aziza, IBM's group vice president of software, data, AI, automation and security, in IBM's AI Operating Model interview series with theCUBE Research.

Aziza flagged agent sprawl as the most immediate threat to governance. "That's going to be where governance breaks," he said. "The [number of agents] that's created by your employees will outpace what you can manage. So, you really need to build a platform that's going to allow you to catch up."

watsonx Orchestrate Repositioned as Agentic Control Plane

The centerpiece of IBM's production push is the next generation of watsonx Orchestrate, now in private preview. IBM entered Orchestrate into private preview on May 5, the same day its Sovereign Core product became generally available. The platform is now positioned as an agentic control plane, designed to manage hundreds of agents built by different teams across different frameworks.

Orchestrate is model-agnostic. IBM supports agents built on Anthropic's Claude, OpenAI's GPT, IBM's own models, or any combination, with consistent policy enforcement applied regardless of which underlying model runs the agent. Organizations can register and manage agents built on third-party frameworks, not just IBM-native tools.

The platform ships with more than 150 enterprise connectors covering Salesforce, SAP, Workday, ServiceNow, Microsoft 365, Oracle, Adobe, and AWS. Built-in observability dashboards give IT and compliance teams full audit trails of agent decisions and data access without custom monitoring builds on top.

Confluent Acquisition Powers Real-Time Data Layer

IBM's data pillar now includes Confluent, which IBM acquired for $11 billion on March 17, 2026. Confluent's streaming platform serves more than 6,500 enterprises and is used by 40% of the Fortune 500. The acquisition gives IBM's AI agents access to continuously refreshed data at production speed.

IBM CEO Krishna has noted that over 70% of enterprise data still sits inside internal systems. That data access gap is what IBM argues breaks most AI deployments before they scale. Rob Thomas, IBM's SVP Software and Chief Commercial Officer, framed the speed requirement plainly: "Transactions happen in milliseconds, and AI decisions need to happen just as fast."

Sovereignty Becomes a Runtime Requirement

IBM's hybrid infrastructure pillar addresses data residency directly. Research cited by IBM found that 68% of executives view data residency and sovereignty as a challenge. Dinesh Nirmal, IBM's SVP of Software, said the stakes have changed: "AI has made sovereignty a runtime requirement, not a policy statement."

The Sovereign Core product, which became generally available May 5, is IBM's answer to enterprises that cannot move sensitive workloads to public cloud environments. For founders and executives running software businesses with regulated customers, IBM's production-readiness push signals that the agent governance market is maturing fast, and the vendors building that infrastructure are placing large bets on enterprise lock-in through compliance and observability tooling.

Read more: IBM connects enterprise AI orchestration to production readiness ahead of TechXchange

This article was written by an AI agent. Spotted an error? Send a correction and we will fix it.