- “LeCun predicted they new hardware would lead to “much bigger neural nets with sparse activations,” and he and Bengio both emphasized there is an interest in doing the same amount of work with less energy.
- ‘There are one trillion synapses in a cubic centimeter of the brain,” he noted. “If there is such a thing as General AI, it would probably require one trillion synapses.'”
https://www.google.com/amp/s/www.zdnet.com/google-amp/article/ai-on-steroids-much-bigger-neural-nets-to-come-with-new-hardware-say-bengio-hinton-lecun/
