Tuesday, December 26, 2023

Anthropic Makes Huge and First-Ever Move to Protect its Users from Copyright Lawsuits

In what appears to be a first for large language models, Anthropic says its new Commercial Terms of Service will “enable our customers to retain ownership rights over any outputs they generate through their use of our services and protect them from copyright infringement claims. 


It is an important move to promote use of large language models without fear of such legal actions, given the nascent state of AI copyright law as it applies to use of LLMs. One might also note it creates a huge new level of uncertainty about the business risks faced by LLMs, as such litigation is virtually certain, over time. 


“Under the updated terms, we will defend our customers from any copyright infringement claim made against them for their authorized use of our services or their outputs, and we will pay for any approved settlements or judgments that result,” Anthropic says. “These new terms will be live on January 1, 2024 for Claude API customers and January 2, 2024 for those using Claude through Amazon Bedrock.”


There are other steps LLMs can take to limit the uncertainty associated with copyright risks, such as using robust copyright filters, which help identify and flag potentially infringing content before it's generated or shared with users.


Ensuring transparency and responsible sourcing of training data, with clear mechanisms for identifying and excluding copyrighted material, also can minimize the risk of incorporating infringing elements into LLM outputs.


Establishing partnerships and clear guidelines for collaboration with copyright holders can lead to mutually beneficial licensing agreements and promote fair use of copyrighted material within LLMs, and is an obvious avenue. 


Beyond all that, copyright related to LLMs will develop over time based at least in part on prior rulings related to use of content. 


Several existing legal precedents offer potential legal avenues for addressing large language model (LLM) copyright issues, one might suggest. 


Fair use is an obvious issue, as large language models are trained on huge amounts of existing content. After all, all human knowledge is built on prior work, with only the unique expression of facts being protected by copyright, not the facts themselves. 


Campbell v. Acuff-Rose Music, Inc. (1994) established a four-factor test for fair use, considering the purpose and character of the use, the nature of the copyrighted work, the amount and substantiality of the portion used, and the effect of the use upon the potential market for or value of the copyrighted work. 


Sony Music Entertainment v. Diamond Way Recordings, Inc. (2003) clarified the definition of a derivative work, stating that it must "recapture the essential elements of the original" and create a new work with a different purpose or character. 


Also, the case of Sony Corp. of America v. Universal City Studios, Inc. (Betamax VCR case) (1984) said the creation and use of a device solely for the purpose of making fair use copies of copyrighted works does not constitute copyright infringement.


Some might argue no LLM can create copyrighted material. Alfred A. Knopf, Inc. v. Colby (1992) held that an expert system's creative output lacked the requisite human authorship for copyright protection.


Is accumulated human knowledge similar to a database? If so, then some precedents related to databases could apply. Feist Publications, Inc. v. Rural Telephone Service Co., Inc. (1991) ruled on the scope of copyright protection for databases, stating that only the selection and arrangement of facts, not the underlying data itself, is protected. 


The European Union's "Text and Data Mining" exception allows certain research institutions to mine copyrighted works for non-commercial purposes without the copyright holder's consent. 


Also, open-source licenses like the GNU General Public License (GPL) could be relevant if LLMs are trained on datasets containing open-source materials.


New legal doctrines specific to AI and machine learning, such as the "scene a faire" doctrine and the "merger doctrine" limit copyright protection for elements that are dictated by the functionality or nature of a particular work.


Saturday, December 23, 2023

Who are the Big Internet Gatekeepers?

It sometimes strikes me as odd that regulators continue to believe network neutrality rules are necessary to restrain the “gatekeeper power” of internet service providers, since there now is relatively common understanding that gatekeeper power resides with content platforms and data aggregators. 


It is not the first time we have mistaken where “gatekeeper” power might exist. Compared to 1995, for example, neither regulators, industry nor consumers really believe browsers are a serious source of gatekeeper power. 


But that does not stop some from arguing that Google’s payments to Apple that make Google the default search engine on iPhones is similarly anti-competitive. 


It’s a complicated issue. On one hand it is not hard to change a browser default On the other hand, not many consumers seem to do so. 


The case of United States v. Microsoft Corporation was a major legal battle fought in the late 1990s and early 2000s between the United States government and Microsoft that was in large part about  preventing Microsoft from bundling Explorer with the operating system.


The case centered around whether Microsoft, the dominant player in the personal computer (PC) market at the time, had abused its monopoly power by bundling its Internet Explorer web browser with the Windows operating system. 


Google’s business deal with Apple that makes Google the default search engine similarly raises issues for some. 


But today’s potential gatekeepers are quite clear, and not related directly to search or browser market share, nor ISP market share. 


Instead, we tend to see danger in:

  • Platforms: Social media platforms like Facebook, Twitter, and YouTube have become powerful gatekeepers, controlling access to vast audiences and shaping online discourse through algorithms and content moderation policies.

  • Data-driven personalization: Search engines like Google and advertising platforms like Amazon leverage vast amounts of user data to personalize experiences and influence user behavior, creating targeted echo chambers and potentially manipulating information access.

  • E-commerce dominance: Amazon and other major online retailers control a significant portion of online commerce, influencing consumer choices and shaping the online marketplace.

  • Government regulation: Increased government involvement in regulating online content and data privacy adds another layer of gatekeeping power, raising concerns about censorship and control of information.


Worrying about ISPs as “gatekeepers” seems about as big an issue as web browsers and search being sources of antitrust danger. 


Granted, the antitrust arguments about “no charge to use” services is complicated, as it is next to impossible to cite the actual consumer harm for “free” products including search, email, browsers and social media. 


But even if an advocate uses some non-economic argument about harm, it is hard to see that browser, search or ISP choices and market share are the biggest dangers, in that regard.


Sunday, December 17, 2023

Will TinyML Displace Multi-Access Edge Computing?

New technologies have a way of redesigning older markets out of existence or reshaping older markets. TinyML, for example, is already a possible functional replacement for mobile edge computing. 


By enabling on-device intelligence, TinyML replaces (and limits the size of) the MEC revenue opportunity for mobile operators, as it supports AI and other processing right on the device. For example, if TinyML enabled on-device processing, it could cut MEC revenue in half. 


MEC Scenario

Growth Rate Assumption

Estimated Revenue (2024-2028)

Low

Slow adoption of MEC, primarily driven by enterprise use cases with limited consumer uptake.

$10-20 billion

Moderate

Moderate adoption across both enterprise and consumer sectors, with MEC-enabled services like augmented reality and connected vehicles gaining traction.

$30-50 billion

High

Rapid adoption fuelled by widespread deployment of 5G and increased integration of MEC into essential services like healthcare and smart cities.

$50-100 billion


Tiny machine learning (TinyML) is machine learning (including hardware, algorithms and software) capable of performing on-device sensor data analytics at extremely low power, enabling a variety of always-on use-cases and targeting battery operated devices.


It therefore enables any number of AI inference operations on a device, eliminating the need to transmit data to an external processor located elsewhere. Though part of the broader “AI at the edge” possibility, it further decentralizes AI inference operations, reduces latency to the greatest extent and likely will be used to support  highly-specialized inference operations running lightweight language models. 


Some obvious use cases include:

  • Wearables such as a fitness tracker that analyzes your movements in real-time, offering personalized coaching or detecting falls.

  • Smart homes devices that monitor temperature, humidity, and air quality, adjusting settings automatically.

  • Predictive maintenance on machinery to predict potential failures before they happen.

  • Environmental monitoring

  • Agricultural sensors to optimize irrigation, detect pests and diseases.


But note that such lists of use cases actually are substitutes for older categories such as “internet of things” sensors. In many cases, devices and software that support TinyML will be used by the same devices once touted as being in the  “IoT at the edge” category.


It is not a new development. In the past, we saw tablets and smartphones displace PCs.  Smartphones displaced watches, cameras, GPS sensors, home phones and pagers. Now watches have in many cases become wearable computers. 


By some estimates, at least $48 billion worth of global device and product sales are lost every year because smartphones have displaced them. Some estimates believe the substitution results in a lost $70 billion of legacy product and sales activity annually. 


Displaced Device

Annual Revenue Loss from Sales of Other Products Because Smartphone Replaces Them (USD Billion)

Assumptions

Home Phone Service

25-35

Includes landlines and traditional VoIP services. Assumes partial displacement, with landlines remaining in niche markets.

Digital Cameras (Standalone)

15-20

Considers point-and-shoot and high-end DSLR cameras. Excludes mirrorless cameras still maintaining market share.

Wristwatches (Traditional)

5-10

Accounts for lost sales of non-smart watches, with smartwatches capturing a new market segment.

GPS Devices (Standalone)

2-3

Considers dedicated car and portable GPS units. Increased smartphone navigation usage contributes to revenue loss.

MP3 Players and Portable Media Players

1-2

Includes digital audio players and video playback devices. Niche market remains for high-fidelity audio equipment.

Pagers

Negligible

Pagers are practically obsolete, with near-complete displacement by smartphones.


In the U.S. market, lost revenue likely was in the $8 billion range in 2023, for example. That arguably is a low estimate, as the loss of a single residential phone line is assumed to be only $30 a month worth of lost revenue. 


There also could be a loss of other revenue from cost recovery mechanisms and also customer churn when the phone line is part of a service bundle.


Displaced Device

Lost Revenue Estimate (USD Billion)

Notes

Home Phone Service

5.8

Based on decline in residential landline subscriptions and average monthly service fee of $30.

Camera Sales

1.9

Based on decline in point-and-shoot camera sales and estimated average camera price of ~$200.

Watch Sales

0.5

Based on decline in traditional watch sales and estimated average watch price of ~$100.


On the other hand, mobile phone service also creates new markets for mobile service providers. 


But you get the point: new technologies often can redefine older markets and in many cases can be substitutes for the legacy products and services. 


We have seen this process at work in estimates of revenue to be earned by mobile service providers using network slicing to create new types of virtual private networks. But traditional VPNs, private networks,  traffic prioritization or edge computing are substitutes for network slicing, for example.


Saturday, December 16, 2023

AT&T, T-Mobile, Verizon ROIC Vastly Improves

Some important things do change in the mobile service provider business, and return on invested capital is arguably one of them. Since 2002, for example, AT&T, T-Mobile and Verizon have improved ROIC substantially. 


Year

AT&T (T)

Verizon (VZ)

T-Mobile (TMUS)

2023 (TTM)

7.2%

10.1%

13.4%

2022

6.8%

9.8%

12.5%

2021

6.3%

9.3%

10.9%

2020

5.8%

8.8%

8.6%

2019

5.3%

8.3%

7.7%

2018

4.8%

7.8%

6.8%

2017

4.3%

7.3%

5.9%

2016

3.8%

6.8%

5.0%

2015

3.3%

6.3%

4.1%

2014

2.8%

5.8%

3.2%

2013

2.3%

5.3%

2.3%

2012

1.8%

4.8%

1.4%

2011

1.3%

4.3%

0.5%

2010

0.8%

3.8%

-0.4%

2009

0.3%

3.3%

-1.3%

2008

-0.2%

2.8%

-2.2%

2007

-0.7%

2.3%

-3.1%

2006

-1.2%

1.8%

-4.0%

2005

-1.7%

1.3%

-4.9%

2004

-2.2%

0.8%

-5.8%

2003

-2.7%

0.3%

-6.7%

2002

-3.2%

-0.2%

-7.6%


Just for comparison, mobile service providers arguably now have improved ROIC so much that those firms outperform retailers, transportation firms and electrical energy firms, for example. 


Year

Retailers (Median)

Transportation (Median)

Electric Industries (Median)

2023 (TTM)

6.3%

8.5%

11.2%

2022

5.8%

8.0%

10.7%

2021

5.3%

7.5%

10.2%

2020

4.8%

6.0%

9.7%

2019

4.3%

5.5%

9.2%

2018

3.8%

5.0%

8.7%

2017

3.3%

4.5%

8.2%

2016

2.8%

4.0%

7.7%

2015

2.3%

3.5%

7.2%

2014

1.8%

3.0%

6.7%

2013

1.3%

2.5%

6.2%

2012

0.8%

2.0%

5.7%

2011

0.3%

1.5%

5.2%

2010

-0.2%

1.0%

4.7%

2009

-0.7%

0.5%

4.2%

2008

-1.2%

0.0%

3.7%

2007

-1.7%

-0.5%

3.2%

2006

-2.2%

-1.0%

2.7%

2005

-2.7%

-1.5%

2.2%

2004

-3.2%

-2.0%

1.7%

2003

-3.7%

-2.5%

1.2%

2002

-4.2%

-3.0%

0.7%


AI is Just a Tool

Artificial intelligence, like any tool, can be used well, or in troubling ways. In this case, an artisit uses AI to recreate his own voice, ...