scrapy-proxyland-middleware

Middleware to easily implement Proxyland in Scrapy projects


Keywords
scrapy, middleware, proxy, Proxyland
License
MIT
Install
pip install scrapy-proxyland-middleware==1.0

Documentation

scrapy-proxyland-middleware

scrapy-proxyland-middleware on pypi
This middleware lets you use Proxyland for every request you process with Scrapy.

Settings

You need to specify your package credentials for Proxyland in your settings.py or settings object for this middleware to take effect.

PROXYLAND = {
    'username': 'package_username',
    'password': 'package_password'
}

You need to also enable ScrapyProxylandMiddleware as well as Scrapy's HttpProxyMiddleware.

DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxyland_middleware.ScrapyProxylandMiddleware': 350,
    'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 400,
}