Showing posts sorted by date for query typical speed. Sort by relevance Show all posts
Showing posts sorted by date for query typical speed. Sort by relevance Show all posts

Wednesday, September 2, 2026

AI Value Migration Should Resemble Prior Computing Trends

To the extent that the value of generative artificial intelligence models is based on computational power or speed, it is virtually inevitable that raw processing power will cease to be the driver of customer value as the differences in performance between models diminishes and as open source alternatives proliferate. 


We have seen that shift in many types of computing products. Inference costs, for example, dropped 600 times between 2020 and 2026, for example. The price of the cheapest available output tokens fell from roughly $0.13 per million tokens in mid-2024 into the $0.01-$0.03 range in 2025-2026, according to one study. 


In the personal computer industry, that meant marketing eventually shifted away from processor speed to other attributes, while the overall value shifted to applications. 


So we might well predict that the cost of using models will continue to drop, while model value also shifts. The likely outcome is that, as cheaper computation expanded the addressable markets for computation, so cheaper inference will grow the addressable use cases for inference. 

 

PC era

AI era

CPU cycles

Tokens

MHz/GHz

Model intelligence

RAM/storage

Context/knowledge

Faster processor

Better model

Cheaper computing

Cheaper inference

PC hardware commoditization

Model/token commoditization

Software captures value

Applications/agents capture value


If typical computing product models also apply, then value will migrate “up the stack.” Instead of evaluating inputs (processor speed; model power), we shift to evaluating outputs “what does it do for me?” or “what are the economic results?”). 


Eventually, we stop evaluating value in discrete ways, as capabilities are simply integrated into many other products. The analogy perhaps is electricity, an input used by many products, but not itself a user-relevant output. 


The implications for value in the AI value chain would seem to be clear as well. Over time, value gets produced beyond workflows or even outcomes. At some point, AI becomes invisible, as electricity supply is invisible. 


We assume its existence, as we assume networking exists, or computation exists. 


At that point, AI becomes infrastructure for other products, the way electricity, computation and networking are available for use by many types of products. 


It might take some time, but the PC analogy also suggests the evolution path for AI. When computation was scarce, computation itself was valuable.


When computation became abundant, software became valuable. When software became abundant, data, networks, platforms and workflows became increasingly valuable.


When intelligence becomes abundant, the scarce resource may become the ability to direct intelligence toward economically valuable outcomes, as arguably was true not only of PCs but also transistors and optical fiber networks. 


Scarcity is the driver. Early on, inference capability is scarce, so that drives the value metrics. Later, when inference is plentiful, scarcity shifts elsewhere: “what are the outcomes?”


On the other hand, the value of some frontier models should remain, as commodity PCs coexist and embedded processors coexist with graphics processing units and servers. One popular example might be smartphones. 


Smartphones illustrate that the physical device can remain the value-bearing product even after its underlying computing capabilities become commoditized. The reason is that the smartphone bundles computing with several other scarce things.


PCs remain “place based.” They sit on desks. We use them for work, learning or play. Smartphones are used ambiently and personally, with sensors, cameras and location awareness that make them a platform “for life.” 


Component

Historically scarce

Today

CPU

Computing power

Increasingly commoditized

Storage

Capacity

Increasingly cheap

Display

Resolution/size

Mature technology

Camera

Image quality

Still highly differentiated

Battery

Energy density

Still constrained

Radio

Connectivity

Increasingly standardized

Sensors

Capabilities

Cheap but useful

Software

Basic functionality

Ecosystem differentiator

Industrial design

Physical experience

Still differentiated

Network

Connectivity

Major source of utility

Ecosystem

Applications/services

Extremely valuable

Convenience

Always-available computing

Very valuable


The point is that value migrates toward whatever remains scarce. For PCs, scarcity migrated toward software and applications.


For smartphones, it migrated toward ecosystems, connectivity, design, cameras, convenience and network effects.


For AI, the scarce things might be context, proprietary data, customer relationships, trust, workflow integration, distribution and the ability to turn intelligence into economically valuable action.


Friday, July 24, 2026

AI ROI: Efficiency First, Effectiveness Longer Term

The distinction between efficiency and effectiveness is a foundational dichotomy in organizational life, and adoption of artificial intelligence will exhibit both tendencies, as most prior computing technologies have tended to do. 


As with earlier waves of information technology adoption, organizations initially justified investments in computers, enterprise software, and the internet through labor savings and operational efficiencies.


Over time, however, the greatest economic gains came from effectiveness:

  • creating entirely new products and services (such as online banking, e-commerce, cloud software, and digital media)

  • entering new geographic markets

  • serving customers in more personalized ways

  • accelerating research and product development

  • enabling new business models that were previously impractical.


AI appears to be following the same trajectory. 


While efficiency is often the primary driver for early-stage AI adoption: 

  • automating manual tasks

  • accelerating workflows

  • reducing overhead.


But most might agree that greater long-term outcomes are possible by focusing on AI effectiveness, or "doing the right things” (perhaps different things)  with AI. 


Dimension

Operating More Efficiently

Operating More Effectively

Goal

Reduce costs

Increase value created

Focus

Existing work

New opportunities

Typical metric

Cost, hours, headcount, error rate

Revenue, market share, innovation, customer satisfaction

Economic effect

Improve margins

Increase growth

Example

Automate invoice processing

Launch products previously impossible to build


Efficiency normally gets the early attention, as AI excels at removing human friction from repetitive tasks such as data entry, scheduling, routine coding, or basic customer service. 


Business Function

AI Application

Efficiency Gain

Example

Customer service

Chatbots and AI agents

Lower support costs, faster response

Klarna automates a large share of customer inquiries

Software development

Code generation

Faster coding and testing

GitHub Copilot, Microsoft

Manufacturing

Predictive maintenance

Less downtime

Siemens, GE

Finance

Invoice processing

Reduced manual accounting

SAP, Oracle AI

HR

Resume screening

Faster hiring workflows

Workday AI

Legal

Contract review

Reduced attorney review time

Harvey AI

Marketing

Content generation

Lower content production costs

Adobe Firefly

Supply chain

Demand forecasting

Lower inventory costs

PepsiCo, Walmart

Healthcare

Medical documentation

Reduced physician administrative burden

Microsoft Dragon Copilot

IT operations

AI help desks

Faster ticket resolution

ServiceNow


Executing established processes faster, cheaper and with fewer errors improves the throughput of a business. It can help lower operating costs. But does not necessarily change the nature of the business.


Effectiveness is about strategy and outcome; the pursuit of higher-value results. 


As organizations mature in their AI journey, the focus often shifts from "doing more with less" (efficiency) to "doing more of what matters" (effectiveness). 


Category

Definition

AI Implementation Example

Key Benefit

Efficiency (Doing things right)

Focuses on optimizing processes, speed, cost-reduction, and resource utilization.

Automating invoice processing; using predictive maintenance to reduce machine downtime.

Operational excellence, cost savings, time-to-market speed.

Effectiveness Doing the right things)

Focuses on achieving high-value outcomes, strategic goals, and solving the correct problems.

Using generative AI for creative brainstorming; AI-driven drug discovery; personalized patient diagnostics.

Competitive advantage, innovation, improved quality of output, solving complex challenges.


Long-term AI gains are likely to come from greater organizational effectiveness, as that has been the pattern for earlier computing innovations as well.


Business Function

AI Application

Effectiveness Gain

Business Outcome

Sales

Personalized prospecting

More customers reached

Higher revenue

Marketing

Hyper-personalization

Better conversion

Larger customer acquisition

Product development

AI-assisted design

More products launched

Faster innovation

R&D

Scientific discovery

More candidate molecules/materials

New products

Customer success

Predictive recommendations

Higher retention

Greater customer lifetime value

Consulting

Faster research

More client engagements

Revenue growth

Software

AI-native applications

Entirely new product categories

New businesses

Manufacturing

AI-assisted engineering

Better product quality

Competitive advantage

Education

Personalized tutoring

Better learning outcomes

New educational services

Financial services

AI investment analysis

Better decision quality

Higher returns


Analysts at McKinsey tend to find such returns are possible when enterprises implement AI, though both efficiency gains as well as effectiveness advantages can be seen. 


Finding

Interpretation

Source

Companies report both cost savings and revenue increases from AI

AI affects both efficiency and effectiveness

McKinsey Global AI Survey (McKinsey & Company)

Revenue gains are most common in marketing, sales, and product development

AI enables growth, not just automation

McKinsey (McKinsey & Company)

Enterprise-wide AI adoption correlates with substantially higher profit margins and returns on invested capital

Value comes from integrating AI into business strategy

McKinsey Operations Survey 2026 (McKinsey & Company)

AI-supported sales tools increased incoming orders by roughly 40% in one automotive transformation

AI improves commercial effectiveness

McKinsey Operations Survey (McKinsey & Company)

Software engineering productivity improved by up to 44% while enabling faster product delivery

AI boosts both efficiency and innovation

McKinsey Operations Survey (McKinsey & Company)

Why So Few Firms Can Point to AI-Driven Productivity Gains

Relatively few firms so far have been able to quantify artificial intelligence productivity gains . But that has been the case for computing...