Scrapy
Status mailer extension forSend an email when a crawler finishes or breaks.
Install
The quick way:
pip install scrapy-status-mailer
Or install from GitHub:
pip install git+git://github.com/light4/scrapy-status-mailer.git@master
Or checkout the source and run:
python setup.py install
settings.py
settings for send email
STATUSMAILER_RECIPIENTS = [] STATUSMAILER_COMPRESSION = 'gzip' # STATUSMAILER_COMPRESSION = None MAIL_FROM = '' MAIL_HOST = 'smtp.qq.com' MAIL_PORT = 465 MAIL_USER = '' MAIL_PASS = '' MAIL_TLS = True MAIL_SSL = True EXTENSIONS = { 'scrapy_status_mailer.StatusMailer': 80, } # all bots send email by default # BOTS_SEND_EMAIL = ['first_bot', 'second_bot']