Export Scrapy spider stats to InfluxDB.

pip install scrapy-influxdb-exporter

Add the following settings to your Scrapy project settings file:

INFLUXDB_DATABASE = ...
INFLUXDB_HOST = ...
INFLUXDB_MEASUREMENT_NAME = ...
INFLUXDB_ORG = ...
INFLUXDB_TOKEN = ...
STATS_CLASS = "scrapy_influxdb_exporter.InfluxDBStatsCollector"

This project was inspired by scrapy-prometheus-exporter by @rangertaha and this article by @mikulskibartosz.

Contributions are welcome! To get started, please refer to our contribution guidelines.

If you encounter any problems while using this package, please open a new issue here.