Sunday, May 10, 2026

AI Ecosystem "Rule of Three" Coming?

The eventual market structure for the artificial intelligence value chain is a reasonable question, as it was for the internet value chain before it and for virtually every value chain, ever. 


The core question for at least a few possible market leaders: should you own the entire value chain (vertical integration) or dominate a single layer exceptionally well (horizontal specialization)? 


And even for possible market leaders, the idea of becoming “a platform” necessarily entails a horizontal dominance. 


For most firms with less scale, the answer is almost always some form of horizontal specialization. 


Vertical dominance almost always appeals early on, though, as much of the stack does not yet exist, and must be created. 


Early in any market's development, firms face high uncertainty, fragmented or nonexistent supply chains, undefined standards, and limited infrastructure. 


The "value stack" (the full chain of activities from raw inputs to end-customer delivery, including supporting services like logistics, financing, or after-sales) is incomplete or unreliable.


The internet era began with vertically integrated ambitions that mostly failed. Later, many firms prospered by operating “asset-light,” owning as little of the full stack as possible.


The internet's structural lesson might be summarized as “ infrastructure commoditizes and value migrates up the stack.”


The winners were companies that owned the layer closest to the user:

  • Google (search/intent)

  • Facebook (social graph)

  • Salesforce (CRM workflow)

  • Microsoft (Office + enterprise identity)

  • Amazon (fulfillment + Prime).


Vertical integration seems to appeal most early in value chain development. 


The PC and semiconductor markets were once vertically integrated. 


But, eventually, the supply chains became more horizontal:

  • Microsoft for operating systems

  • Intel for processors

  • Nvidia supplying graphics chips

  • Several companies manufacturing hard drives.


The single clearest exception to the "horizontal wins" rule was Apple, which maintained radical vertical integration (silicon → OS → apps → retail).


Given the “early” status of AI, you might guess that vertical approaches are favored by would-be future leaders of the market. 


Very-high infrastructure costs (GPUs, memory, data centers, energy sources) mean that infrastructure costs scale faster than revenues unless you own the stack.


This creates a structural pressure toward vertical integration, largely because high infrastructure costs and scarcity now rearranges infra value. At least for the moment, what cloud was to software as a service, AI infrastructure is forAI and AI agents.


What remains undetermined are the long-term relationships within the value chain. How important will infra remain, and how much differentiation can it provide? How important will vertical integration remain?


Much depends on how today’s bottlenecks are resolved. 


For full-stack integrators (Google, Microsoft, Amazon, OpenAI), bottlenecks in compute, distribution, and enterprise relationships suggest at least significant vertical integration advantages


Long term, “a few” ecosystem winners with significant vertical integration are likely to emerge, with partners occupying key horizontal functions. Applications will likely remain an area where the most specialists will emerge, as has been the case for the internet value chain. 


Internet Layer

Internet Winner

Why They Won

AI Layer

Current Leader(s)

Survivability

Physical infrastructure

Telecom / cable cos (AT&T, Comcast)

Owned the last mile; regulatory moats

GPU compute & data centers

NVIDIA, CoreWeave

Medium — commoditization risk as custom ASICs proliferate; CUDA moat is real but contested

Backbone / routing

Level 3, Cogent (commodity over time)

Traffic volume; peering scale

Cloud hyperscalers (compute fabric)

AWS, Google Cloud, Azure

High for top 3; structural oligopoly with massive switching costs

Horizontal platform / OS

Microsoft Windows, then Android/iOS

Developer lock-in; ecosystem flywheel

Foundation model + API platform

OpenAI, Anthropic, Google DeepMind

Medium-high — differentiation real today, commoditization pressure building

CDN / performance layer

Akamai, then Cloudflare

Edge distribution; hard-to-replicate infra footprint

Inference optimization / edge AI

Cloudflare Workers AI, Groq

High for winners; latency & cost matter enormously at inference scale

Search / intent layer

Google

Owned the demand aggregation point; data flywheel

AI assistant / agent interface

ChatGPT, Perplexity, Google Gemini

Very high — whoever owns the default query interface owns the toll road

Vertical SaaS

Salesforce, Workday, Veeva

Deep workflow + data lock-in in specific domains

Vertical AI (legal, medical, finance)

Harvey (legal), Tempus (oncology), Palantir (gov/defense)

Very high — proprietary domain data + workflow integration = durable moat

Developer tooling / middleware

Twilio, Stripe, Segment

Abstracted complexity; usage-based pricing

AI orchestration & dev tools

LangChain, Weights & Biases, Hugging Face

Medium — commoditization risk as hyperscalers bundle equivalents

Content / media

Netflix, Spotify

Owned the user relationship + proprietary content

AI-native consumer apps

Midjourney, ElevenLabs, Runway

Medium — switching costs low, but brand + proprietary training data matter

E-commerce / marketplace

Amazon, Shopify

Demand aggregation + fulfillment infrastructure

Agentic commerce / AI procurement

Amazon Alexa+, emerging agent platforms

Unknown — biggest open question; whoever controls the purchasing agent controls commerce

"Picks and shovels" enabling layer

Cisco (networking gear), VMware (virtualization)

Sold to all combatants; infrastructure-agnostic

Memory, packaging, power

SK Hynix (HBM), TSMC (fabrication), Eaton (power)

Very high — scarce physical inputs with no software substitute


The internet produced one dominant full-stack integrator per consumer surface (Apple in mobile, Google in search/Android, Amazon in commerce/cloud) and many durable horizontal specialists at layers with genuine switching costs.


AI is likely to produce a similar structure, The full-stack integrators with both infrastructure and consumer/enterprise distribution (Google, Microsoft, Amazon) are best positioned for a role Apple almost uniquely pioneered.


Market dynamics tend to create  a "Rule of Three" (or Rule of Three and Four) structure in mature, stable, competitive markets. 


Bruce Henderson of BCG hypothesized in 1976 that a stable competitive market never has more than three significant (generalist) competitors, with the largest having no more than four times the market share of the smallest, often stabilizing around a 4:2:1 ratio (40-50 percent for the leader : 20-25 percent for number two and 10-12 percent for number three). 


That seems reflected in the internet’s “winner takes most” structure. 


Jagdish Sheth and others validated this across hundreds of industries: three full-line generalists dominate 70-90 percent of the market (by share or profit), while the rest consists of niche specialists (product, geographic, or segment-focused) that thrive on margins rather than volume.


Internet Layer

Internet Winner

Why They Won

AI Layer

Current Leader(s)

Survivability

Physical infrastructure

Telecom / cable cos (AT&T, Comcast)

Owned the last mile; regulatory moats

GPU compute & data centers

NVIDIA, CoreWeave

Medium — commoditization risk as custom ASICs proliferate; CUDA moat is real but contested

Backbone / routing

Level 3, Cogent (commodity over time)

Traffic volume; peering scale

Cloud hyperscalers (compute fabric)

AWS, Google Cloud, Azure

High for top 3; structural oligopoly with massive switching costs

Horizontal platform / OS

Microsoft Windows, then Android/iOS

Developer lock-in; ecosystem flywheel

Foundation model + API platform

OpenAI, Anthropic, Google DeepMind

Medium-high — differentiation real today, commoditization pressure building

CDN / performance layer

Akamai, then Cloudflare

Edge distribution; hard-to-replicate infra footprint

Inference optimization / edge AI

Cloudflare Workers AI, Groq

High for winners; latency & cost matter enormously at inference scale

Search / intent layer

Google

Owned the demand aggregation point; data flywheel

AI assistant / agent interface

ChatGPT, Perplexity, Google Gemini

Very high — whoever owns the default query interface owns the toll road

Vertical SaaS

Salesforce, Workday, Veeva

Deep workflow + data lock-in in specific domains

Vertical AI (legal, medical, finance)

Harvey (legal), Tempus (oncology), Palantir (gov/defense)

Very high — proprietary domain data + workflow integration = durable moat

Developer tooling / middleware

Twilio, Stripe, Segment

Abstracted complexity; usage-based pricing

AI orchestration & dev tools

LangChain, Weights & Biases, Hugging Face

Medium — commoditization risk as hyperscalers bundle equivalents

Content / media

Netflix, Spotify

Owned the user relationship + proprietary content

AI-native consumer apps

Midjourney, ElevenLabs, Runway

Medium — switching costs low, but brand + proprietary training data matter

E-commerce / marketplace

Amazon, Shopify

Demand aggregation + fulfillment infrastructure

Agentic commerce / AI procurement

Amazon Alexa+, emerging agent platforms

Unknown — biggest open question; whoever controls the purchasing agent controls commerce

"Picks and shovels" enabling layer

Cisco (networking gear), VMware (virtualization)

Sold to all combatants; infrastructure-agnostic

Memory, packaging, power

SK Hynix (HBM), TSMC (fabrication), Eaton (power)

Very high — scarce physical inputs with no software substitute


Vertical integration is probably going to work for a few big firms. Most long-term providers in the AI ecosystem will be specialists, though. Most markets ultimately develop that way.


Neoclouds and CLECs

For some of us who were active in the competitive local exchange carrier market around the time of the passage of The Telecommunications Act of 1996, neocloud providers such as CoreWeave, Nebius and many others seem to present a market opportunity that is temporary, if potentially lucrative in the short term. 


Though price arbitrage was the temporary CLEC opportunity, shortages of high-performance computing (graphics processing units and other accelerators) are the opportunity for neocloud providers.


A perhaps-lucrative but temporary market window seems to exist for neoclouds, as it once did for CLECs. 


By mandating that incumbent local exchange carriers unbundle their network elements and lease them at attractive wholesale rates to competitors at regulated rates, Congress effectively handed competitive local exchange carriers (CLECs) a business model: arbitrage the gap between the regulated wholesale price of network access and the retail price customers would pay.


But the discounts ultimately ended and the access market eventually shifted to broadband access on owned facilities. The wholesale model effectively collapsed for most CLECs. 


The generative artificial intelligence boom created excess demand for GPUs. 


So the neocloud model is structurally arbitrage: 

  • As GPU supply is constrained, offer “GPU as a service”

  • Sell access to that resource at a margin, reselling compute

  • Build customer relationships before the incumbents close the gap.


CoreWeave, for example had a simple price pitch: 

  • we have H100s

  • we're GPU-native

  • we'll get you capacity faster and cheaper than AWS or Azure. 


Dimension

CLECs (1996–2002)

Neoclouds (2022–?)

Enabling condition

Regulatory mandate opening ILEC networks

GPU supply shock creating hyperscaler rationing

Capital model

Debt-heavy buildout of switching infrastructure

Equity/debt-heavy GPU cluster acquisition

Competitive advantage

Access to regulated wholesale inputs

Early access to scarce NVIDIA allocations

Customer value prop

Cheaper/faster local access

Faster GPU availability, simpler pricing

Incumbent response

Network upgrade, litigation, lobbying

Massive capex, custom silicon, long-term NVIDIA contracts

Structural vulnerability

Unbundling obligations could be reversed

GPU scarcity is inherently temporary

Timeline pressure

~5 years before model collapsed

Likely 3–6 years before hyperscalers close gap


Of course, markets eventually will normalize:

  • Nvidia has boosted production of H100s and is ramping B200/B300 series

  • Hyperscalers have developed  custom silicon (Google's TPU v5, AWS's Trainium 2 and Inferentia, Microsoft's Maia, and Meta's MTIA)

  • Hyperscaler capex is going to be hard to beat, long term

  • The software stack advantage will benefit AWS, Google Cloud and Azure

  • Customer lock-in dynamics favor hyperscalers.


Of course, history likely rhymes rather than repeating.


The neocloud endgame probably looks similar to the CLEC industry in many ways:

  • Most will struggle as GPU spot prices normalize and hyperscaler capacity floods the market (2025–2027)

  • A few might be acquired

  • One or two may find durable niches

  • But hyperscalers likely will dominate the enterprise AI compute market by 2028–2030.


The CLEC parallel is perhaps a reminder that cyclical scarcity is not long-term structural advantage. 


The neoclouds that survive will be those that use the current window not just to sell GPUs, but to build something (software, relationships, operational expertise or specialized capability) that persists after the scarcity evaporates. 


That will be hard to do. 


As investors, we might make some money on neocloud providers in the near term. But the CLEC experience might temper enthusiasm for some of us.


Does Generative AI Use Stunt Cognitive Skill Development in Children?

We might still not know whether using generative artificial language models has any negative effect on cognitive skills, but Norway believes...