PytorchConcurrentDataloader

Minimal version of the ConcurrentDataloader repository published to pip.

Setup

pip install pytorch-concurrent-dataloader

Usage

• replace torch.utils.data.DataLoader with pytorch_concurrent_dataloader.DataLoader
• pass new parameters for concurrent dataloading

from pytorch_concurrent_dataloader import DataLoader
dataloader = DataLoader(
    # pass old parameters as usual
    dataset=..., 
    batch_size=...,
    num_workers=...,
    # pass new parameters
    num_fetch_workers=...,
)