Monday, May 12, 2025

AI Boosts "Data Center to Data Center" Traffic, Not Home Broadband Needs

Current evidence and expert opinion suggests AI use is unlikely to dramatically increase home broadband data consumption in the near term, while driving new needs for bandwidth between data centers. While that might change in the future if new bandwidth-intensive applications develop, for the moment the impact of AI processing seems focused on "data center to data center" capacity.


For starters, AI query traffic Is comparable to that of search engine use. When consumers interact with AI (asking questions to an AI chatbot), the data exchanged is typically limited to short text queries and responses. That is similar in scale to current web searches, meaning the volume of data transferred to and from homes is not substantially greater than existing activities like Google searches.


In some ways, AI chatbots might also reduce some amount of web browsing,  if users rely on AI to summarize information instead of visiting multiple websites.


To the extent there is more processing, that happens within data centers, not across the access network.


Source/Study

Year

Key Findings on Home Data Consumption

Notes on Scope/Methodology

CircleID / POTs and PANs

2024

AI queries use similar bandwidth to search engines; may even reduce home data use by condensing information

Industry analysis, references Scientific American for energy use, not data volume 12

Dell’Oro Group

2023

AI’s main impact is network optimization, not increased home data use; future metaverse/AI combo could drive growth

Industry report, focuses on network-level effects 4

Fiber Broadband Association / Futurum Group

2024

AI is driving fiber deployment and network investment, but impact on household data volumes not specified

Industry survey, focus on infrastructure 3

BroadbandProviders UK

2024

AI can optimize home network usage and plans, improving efficiency rather than increasing consumption

Consumer-facing analysis, focus on network management 5


On the other hand, AI processing operations are very likely to increase the need for additional bandwidth between data centers. 


AI workloads, especially model training and large-scale inference, require the movement of massive datasets between data centers, cloud regions, and enterprise sites (sources: 1,3,4,6,7), so orders for fiber capacity have increased by an order of magnitude, with standard requests jumping from 8 to 12 fibers to 144 to 432 fibers per route in recent years, some analysts say. .


Traditional static wavelength provisioning also might be inadequate for AI’s dynamic and often bursty traffic patterns. AI training and inference workloads may require large-scale but temporary bandwidth, some argue.


Impact Area

Evidence or Argument

Source(s)

Bandwidth Demand

Orders for fiber have increased 10-50x; AI-driven data centers need petabit-scale data transfer

1,3,4,6,7

Latency & Symmetry

AI requires ultra-low latency, symmetrical speeds for real-time inference and distributed training

1,4,7

Network Agility

Shift from static to dynamic, automated provisioning; need for temporary, large-scale bandwidth

2

Data Center Placement

New builds in power-rich regions, requiring new long-haul and middle-mile routes

4,6,8

Bottleneck Risk

Insufficient fiber could cause congestion, limiting AI growth

4,7


Unlike traditional north-south (server to end user) traffic, AI data centers prioritize server-to-server (east-west) communication for parallel processing, requiring 2–4x more fiber density than traditional hyperscale facilities, observers note.


The bottom line is that additional bandwidth demand will be focused on “data center to data center”` portions of the network, not the access network.


No comments:

"Got AI?"

By now, every salesperson for every technology firm is probably being asked “do you have AI” by prospects. And most answers, in most cases, ...