Tuesday, January 2, 2024

Global AI Electricity Consumption is an Issue, But We'll Get Better at it


Over time, lots of things can be done to lessen AI energy consumption:
*  More efficient AI hardware
*  Cooling advancements including liquid immersion or indirect evaporative cooling
*  Model optimization: quantization, pruning, and knowledge distillation to reduce the complexity of AI models without sacrificing accuracy
*  Edge computing in several forms will help as well, including on-device computations
* Scheduling of AI operations to even out workloads should help as well

Renewable energy will help a bit, at least in terms of carbon footprint. 

No comments:

Why Advertise Where Few See the Ads? That's AI Challenge for Search Advertising

For some of you possibly old enough to remember where advertising spending used to occur, the pattern is quite different now. For example, i...