scrapy-crawlera

Crawlera middleware for Scrapy


Keywords
crawler, crawler-detection, plugin, proxy, scraping, scrapy
License
BSD-3-Clause
Install
pip install scrapy-crawlera==1.7.2

Documentation

scrapy-zyte-smartproxy

PyPI Version Build Status Code Coverage

scrapy-zyte-smartproxy provides easy use of Zyte Smart Proxy Manager (formerly Crawlera) with Scrapy.

Requirements

  • Python 2.7 or Python 3.4+
  • Scrapy 1.4+

Installation

You can install scrapy-zyte-smartproxy using pip:

pip install scrapy-zyte-smartproxy

Documentation

Documentation is available online at https://scrapy-zyte-smartproxy.readthedocs.io/ and in the docs directory.