Thursday, October 24, 2024

High AI Capex is Worrisome, But "Winner Take All" is the Prize

It is not hard to find estimates of investment in U.S. artificial intelligence infrastructure (computing capabilities) in the range of $300 billion or more between 2023 and 2030. IDC analysts have suggested $300 billion in investments between 2023 and 2026.


Nor is it hard to find critics who worry about uncontrolled spending without a clear revenue model. On the other hand, leaders of firms attempting to become leaders in the generative AI model business are likely to keep in mind the “winner take all” dynamic we have seen in the recent internet era, where just one or a few firms emerged as leaders in new markets. 


They might point to:

  • Amazon's years of heavy investment to dominate e-commerce

  • Google's massive spending to establish search leadership

  • Cloud providers' huge datacenter investments

  • Meta's acquisition strategy in social media.


In fact, many markets show scant ability to support three providers, as the market leader has twice the share--and up to an order of magnitude more-share compared to  the number-two provider.


Market

Dominant Player

Market Share

Runner-up

Market Share

Search Engines

Google

91.9%

Bing

3.0%

Desktop Browsers

Chrome

65.72%

Safari

18.22%

Mobile Browsers

Chrome

66.17%

Safari

23.28%

Social Media

Facebook

2.9B users

YouTube

2.5B users

E-commerce

Amazon

37.8% (US)

Walmart

6.3% (US)

Video Streaming

YouTube

2.5B users

Netflix

231M subscribers

Music Streaming

Spotify

31%

Apple Music

15%

Ride-hailing (US)

Uber

68%

Lyft

32%

Cloud Services

AWS

32%

Azure

22%

Mobile OS

Android

71.8%

iOS

27.6%


So even if McKinsey estimates AI infrastructure spending will exceed $500 billion between 2023 and 2030, and even if many of those investments do nor produce the expected results, model suppliers have incentives to risk quite a lot, knowing that there is a small  prize for being second best. 


Gartner forecasts global AI infrastructure investments will surpass $250 billion annually by 2030. 


The OECD estimates investments in AI infrastructure across industries, will reach $1 trillion by 2030, across the OECD countries. Bloomberg predicts that the global AI infrastructure market will $700 billion by 2030.


On the other hand, most of that investment will be by end users and others in the value chain, not the generative AI model providers. 


And some estimates made in 2023 might be considered conservative in 2024. Morgan Stanley’s  "The Economics of AI” study, published in October 2023 suggested more than $200 billion in AI infrastructure investments by 2030, including:

  • Data centers: $125B

  • Networking infrastructure: $50B

  • Chip fabrication: $25B

  • Cooling systems: $10B.


Boston Consulting Group in December 2023 suggested there would be $235 billion cumulative investments in 

  • Data center buildout: 45%

  • Compute infrastructure: 35%

  • Power infrastructure: 20%. 


The Goldman Sachs "AI Infrastructure Report," published in September 2023 estimated $275 billion in  cumulative investment, including:

  • Semiconductor investment: $100B

  • Data centers: $115B

  • Power systems: $35B

  • Network upgrades: $25B. 


The caution, though, is that early estimates of the size of new technology markets often lead to overinvestment across the value chain. 


Study/Report

Date

Publisher

Key Conclusions

The Dot-Com Bubble Burst: Causes and Implications

2001

U.S. Securities and Exchange Commission (SEC)

Overinvestment in internet startups led to a speculative bubble that burst in 2000. Many companies were overvalued despite having no profitability.

Boom and Bust: The Telecommunications Investment Bubble

2002

Federal Reserve Bank of San Francisco

Overinvestment in telecom infrastructure during the late 1990s led to a major industry downturn, with unsustainable levels of capital spending.

The Case for Less Innovation

2017

Harvard Business Review

Many companies overinvest in unproven technologies without clear demand, resulting in failed projects and wasted resources.

Lessons from the Clean Tech Bubble

2016

MIT Energy Initiative

Overinvestment in cleantech (2005-2011) led to massive failures, with many companies being too early to market and receiving excessive venture capital.

Investing in Innovation: Creating a Research and Innovation Policy That Works

2010

The NESTA Foundation (UK)

Over-investment in R&D for new technologies can create inefficiencies and fail to produce proportional economic benefits if not managed strategically.

The Nanotechnology Investment Bubble

2005

Journal of Nanoparticle Research

Speculative investments in nanotechnology during the early 2000s led to unmet expectations, as many products were not commercially viable.

Unleashing Productivity: Overinvestment in Information Technology

2005

McKinsey Global Institute

Overinvestment in IT during the late 1990s and early 2000s did not yield expected productivity gains, with firms often adopting technology prematurely.

The Illusions of Overinvestment in AI

2021

Brookings Institution

Many companies overinvest in artificial intelligence without clear applications, leading to inflated expectations and unrealized returns.

The Biotechnology Bubble: When Science and Finance Collide

2004

Nature Biotechnology

Excessive capital flow into biotech during the 1990s led to overvaluation, with many firms failing to achieve meaningful breakthroughs.


In recent years we have also seen examples of overinvestment by many platform suppliers as well. 


Technology

Company/Industry

Year

Description of Over-Investment

Artificial Intelligence

IBM Watson

2011-2022

IBM invested billions in Watson AI for healthcare, but struggled to generate significant revenue and ultimately sold off the health assets

Virtual Reality

Meta (Facebook)

2014-present

Meta has invested over $36 billion in VR/AR technology with limited returns, facing skepticism about the metaverse vision

Blockchain

Various

2017-2018

Many companies rushed to invest in blockchain during the crypto boom, only to scale back or abandon projects when the hype died down

Autonomous Vehicles

Uber

2016-2020

Uber invested heavily in self-driving technology, spending over $1 billion before selling the unit after a fatal accident and regulatory challenges

3D Printing

3D Systems

2013-2015

The company aggressively acquired 3D printing startups, leading to over $1.3 billion in losses and a stock price crash when consumer adoption didn't materialize

Cloud Computing

HP

2011-2012

HP's $11 billion acquisition of Autonomy for cloud services led to an $8.8 billion write-down 


So the rationale for investing heavily to secure the leading position in the generative AI model business is a reflection of the possible “winner take all” character of application and platform markets, where the number-one provider dominates. 


And since market share and profit margin generally are related, the rewards for market leadership also are significant. In many capital-intensive markets, the profit margin of the top provider is double that of number two. 


And provider number two can have margins double that of provider number three.


No comments:

High AI Capex is Worrisome, But "Winner Take All" is the Prize

It is not hard to find estimates of investment in U.S. artificial intelligence infrastructure (computing capabilities) in the range of $300 ...