elasticstats-scrapy
A scrapy extension to send crawl stats to elasticsearch index.
how to install
$ pip install elasticstats-scrapy
how to use
In order to use this extension, add following settings in settings.py
-
ELASTICSTATS_ENABLED -
ELASTICSEARCH_AUTH -
ELASTICSEARCH_SERVERS -
ELASTICSEARCH_USE_SSL -
ELASTICSEARCH_USERNAME -
ELASTICSEARCH_PASSWORD -
ELASTICSTATS_INDEX -
ELASTICSTATS_TYPE
After updating these settings, add the following line in you settings.py extensions setting like this
EXTENSIONS = {
'elasticstats.ElasticStatsSender': 900
}
Features
-
TODO
- update readme
-
Free software: MIT license
