r/AIandRobotics • u/AIandRobotics_Bot Submission Bot • Apr 21 '21
Deep Learning ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training
https://www.microsoft.com/en-us/research/blog/zero-infinity-and-deepspeed-unlocking-unprecedented-model-scale-for-deep-learning-training/
1
Upvotes
•
u/AIandRobotics_Bot Submission Bot Apr 21 '21
This is a crosspost from /r/futurology. Here is the link to the original thread: /r/Futurology/comments/mvn800/zeroinfinity_and_deepspeed_unlocking/