distributed-llm

Release 0.4.1

Distributed LLM inference — pool GPUs across multiple devices to run models no single machine can handle

Homepage PyPI

Keywords
llm, inference, distributed, pipeline-parallelism, gpu-sharing, peer-to-peer, open-source
License
Apache-2.0
Install
pip install distributed-llm==0.4.1

Stats

Dependencies
10
Dependent packages
0
Dependent repositories
0
Total releases
1
Latest release
First release
SourceRank
4

Releases

0.4.1

Login to resync this project