A Scrapy plugin to compress feeds with Zstandard (zstd).
pip install scrapy-zstd
Add scrapy_zstd.postprocessing.ZstdPlugin
to the postprocessing
list in the FEEDS
configurations.
FEEDS = {
"/path/to/file.csv.zst": {
"format": "csv",
"postprocessing": ["scrapy_zstd.postprocessing.ZstdPlugin"],
}
}