We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction]. Since 2012, this metric has grown by more than 300,000x (a 2-year doubling period would yield only a 7x increase). Improvements in compute have been a key component of AI progress, so as long as this trend continues, it’s worth preparing for the implications of systems far outside today’s capabilities.
Related Posts
Can the AI industry persuade data center opponents by getting rid of NDAs?
On Equity, we debate the impact of data center moratoriums and whether the AI industry has a communication problem.
Crusoe sells troubled Wyoming data center project to Google
The deal highlights the challenges of developing massive AI data centers.