Numerous microarchitectural optimizations unlocked tremendous processing power for deep neural networks that in turn fueled the AI revolution. With the exhaustion of such optimizations, the growth of …
Full story: https://cacm.acm.org/research-highlights/hammingmesh-a-network-topology-for-large-scale-deep-learning/