py-inference-scheduler

A scheduler built to improve sampling for Large Language Model Reinforcement Learning


Keywords
inference, scheduling, ray, slurm, verl, slime, llm, router, rl, sampling, reinforcement, learning
License
Apache-2.0
Install
pip install py-inference-scheduler==0.1.0