Prior to 2012, artificial intelligence improvement closely tracked Moore’s Law, with compute doubling every two years. Post-2012, compute has been doubling every 3.4 months, according to the Artificial Intelligence Index Report 2019.
The amount of computation used in the largest AI training runs has doubled every 3.4 months since 2012 (net increase of 300,000 times). The y-axis of the chart shows the total amount of compute, in petaflop/s-days, used to train selected results.
A petaflop-day (pf-day) consists of performing1015 neural net operations per second for one day, or a total of about 1020 operations.
No comments:
Post a Comment