Google, Blackstone Create TPU "as a Service" Business

Google and Blackstone’s TPU-as-a-service venture is important for any number of reasons:

• it turns TPUs from a mostly Google-hosted product into a broader external infrastructure platform

• strengthens Google’s push to monetize its custom silicon

• gives AI customers a non-Nvidia acceleration path

• might clarify the neocloud business model. 

Blackstone is committing $5 billion in equity and an initial 500 MW of capacity coming online in 2027. 

The move tends to ratify the GPU as a service market and provides an alternative to the Nvidia ecosystem, at least in the “bare metal” portion of the business. 

The venture also might intensify pricing pressure and reduce differentiation in the inference market. 

The venture also tests the durability of the neocloud business itself. Today, a global scarcity of high-end AI training and inference compute creates the basis for the market.

Neoclouds originally emerged as stopgaps to address the GPU shortage, but their bare-metal economics are fragile, being based on what most believe are temporary shortages of capacity. 

Perhaps their long-term viability hinges on their ability to move up the stack into AI-native services, which puts them in direct competition with hyperscalers. And some will note how little protection the business has, given the thin profit margins and high continuing capital investment. 

source: McKinsey 

Neoclouds have a strong demand story, but their business model is structurally difficult because they combine very high capital intensity with fast hardware depreciation and aggressive price competition. The result is a market that can grow fast while still being hard to make sustainably profitable.

The core problem is that graphics processing units are expensive, and their resale or rental value falls quickly as new generations arrive. 

McKinsey notes that over a typical five-year depreciation horizon, GPU-hour pricing can decline by half or more, which forces providers to recover capital quickly or risk stranded assets.

So neoclouds must keep raising capital to buy the next wave of chips even while the prior fleet is losing value. This makes cash flow, financing terms, and utilization rates far more important than simple revenue growth.

GPU clouds are not just chip businesses; they are power, cooling, networking, and operations businesses as well. High energy costs, high-density racks, and increasingly complex cooling requirements raise operating expense and add execution risk.

Up to this point, neoclouds are heavily dependent on Nvidia for the chips, networking ecosystem, and much of the software stack.

Google will test that thesis.

A big reason neoclouds emerged was that they could undercut hyperscalers on price and provisioning speed, sometimes by large margins. But hyperscalers are responding.

That means the initial “GPU scarcity arbitrage” is not a durable moat by itself.

The strategic tension is that investors often want neoclouds to move up the stack into managed services, orchestration, inference platforms, or sector-specific solutions. Those layers can improve retention and margins, but they also bring neoclouds into direct competition with hyperscalers that have deeper ecosystems and broader product bundles.

So the firms face a hard choice: stay close to bare-metal GPU rental, where margins are thin, or build higher-value services, where competition is tougher and sales cycles are longer.

That suggests a need to pioneer niche markets, such as sovereign compute and specialized workloads.