Documentation

The package is an PyTorch extension that faciliates efficient multi-worker decentralized data parallel training which fits in certain algorithm schemas.

^{Icon created by zero_wing - Flaticon}