DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
39.1k
Stars
4.4k
Forks
1.1k
Issues
423
Contributors
350
Watchers
deep-learningpytorchgpumachine-learningbillion-parametersdata-parallelismmodel-parallelisminferencepipeline-parallelismcompressionmixture-of-expertstrillion-parameterszero
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}