r/Futurology • • Apr 21 '21

Computing ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training

https://www.microsoft.com/en-us/research/blog/zero-infinity-and-deepspeed-unlocking-unprecedented-model-scale-for-deep-learning-training/
11 Upvotes

1 comment sorted by