DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
39.9k
Stars
4.5k
Forks
1.1k
Issues
442
Contributors
354
Watchers
deep-learningpytorchgpumachine-learningbillion-parametersdata-parallelismmodel-parallelisminferencepipeline-parallelismcompressionmixture-of-expertstrillion-parameterszero
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}