Quick Facts
- Stripe plans to acquire OpenRouter, which raised $113 million in Series B funding at a $1.3 billion valuation in May 2026.
- A well-trained model router can achieve 95% of GPT-4 performance while routing only 14-26% of requests to expensive models, cutting costs by 75-85%.
- IDC forecasts that by 2028, 70% of top AI-driven enterprises will use multi-tool architectures to dynamically manage model routing.
Stripe's planned acquisition of OpenRouter Inc. has forced a conversation enterprise IT leaders can no longer avoid. Dynamic model routing, the practice of automatically selecting which AI model handles each request based on cost, latency, quality, and business rules, is moving from niche practice to infrastructure priority.
The technology draws a direct parallel to software-defined wide-area networking. SD-WAN replaced static traffic routing with policy-driven, application-aware steering across distributed environments. Model routing applies the same logic one layer up the stack, replacing fixed model choices with real-time selection across a growing pool of AI providers.
The Scale of the Problem
Enterprise LLM API spending exceeded $8.4 billion in 2025. The AI inference market sits at $117.80 billion in 2026 and is projected to reach $312.64 billion by 2030, growing at a 19.2% compound annual rate.
The average enterprise now evaluates or operates seven distinct AI models simultaneously, according to F5's 2026 State of Application Strategy Report. That same report found 78% of organizations run their own inference services. Thirty-seven percent of enterprises use five or more models in production.
Managing that portfolio without automated routing is expensive. Research shows 60-80% of enterprise LLM costs come from just 20-30% of use cases. Most of those costs are avoidable.
What Routing Actually Does
An AI router sits between an application and multiple model providers. It evaluates each incoming request and assigns it to the model best suited for that specific task, not the most powerful model available.
Model routing and model cascading are distinct approaches. Routing maps a query directly to one model from the available pool. Cascading tries smaller, faster models first and escalates to larger models only when initial responses fall short. Both methods aim to match cost to complexity.
The results are measurable. RouteLLM, published at ICLR 2025, showed that a well-trained complexity router achieves 95% of GPT-4 performance while sending only 14-26% of requests to the expensive model. That translates to a 75-85% cost reduction on routed workloads. Wishroll, a consumer AI company, used task decomposition and routing to cut inference costs by 95% while scaling to one million users in 19 days.
The SD-WAN Lesson
SD-WAN adoption reached 87-90% of enterprises by 2024, making it a baseline capability rather than a competitive advantage. The technology succeeded because static network routing could not keep up with distributed applications, multiple clouds, and real-time performance requirements.
Model routing faces the same pressure from the same direction. A single AI interaction can span branch locations, multiple clouds, SaaS applications, data stores, and several models. Agents call services, retrieve data, trigger actions, and spawn new requests. Each step carries different requirements around latency, cost, and data residency.
"The era of picking a single model is over," said OpenRouter CEO and co-founder Alex Atallah. "Success now depends on continuously routing across a changing market."
IDC echoed that point. Even now, many teams spend significant time searching for the best model for a given use case, only to find that rankings shift within months. Static model selection creates technical debt in fast-moving markets.
The Risks of Getting It Wrong
Routing introduces real operational complexity. Microsoft's Azure Architecture Center warns that dynamic model selection can complicate cost forecasting, debugging, and performance analysis when different requests are handled by different models.
Without clear policy, visibility, and controls, dynamic decision-making can introduce unpredictability. The cheapest model may not meet accuracy requirements. The fastest model may not satisfy privacy constraints. Routing requires the same discipline SD-WAN required: real-time telemetry, centralized policy, and continuous validation.
OpenRouter's May 2026 Series B included investment from NVIDIA's NVentures, ServiceNow Ventures, and MongoDB Ventures alongside lead investor CapitalG. That investor list signals where enterprise infrastructure dollars are moving.
Read more: Dynamic model routing will follow the path blazed by software-defined wide-area networks
This article was written by an AI agent. Spotted an error? Send a correction and we will fix it.
