Tuesday, January 2, 2024

Global AI Electricity Consumption is an Issue, But We'll Get Better at it


Over time, lots of things can be done to lessen AI energy consumption:
*  More efficient AI hardware
*  Cooling advancements including liquid immersion or indirect evaporative cooling
*  Model optimization: quantization, pruning, and knowledge distillation to reduce the complexity of AI models without sacrificing accuracy
*  Edge computing in several forms will help as well, including on-device computations
* Scheduling of AI operations to even out workloads should help as well

Renewable energy will help a bit, at least in terms of carbon footprint. 

No comments:

Yes, Follow the Data. Even if it Does Not Fit Your Agenda

When people argue we need to “follow the science” that should be true in all cases, not only in cases where the data fits one’s political pr...