DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
38.2k
Stars
4.3k
Forks
1.0k
Issues
408
Contributors
351
Watchers
deep-learningpytorchgpumachine-learningbillion-parametersdata-parallelismmodel-parallelisminferencepipeline-parallelismcompressionmixture-of-expertstrillion-parameterszero
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}