pyCreeper
It is a distributed web crawler. Creepers are common in China. They feel like a web crawler: slow growth and and wide coverage.
A web crawler that is able to crawl dynamic web page.
pip install pycreeper==0.0.1
It is a distributed web crawler. Creepers are common in China. They feel like a web crawler: slow growth and and wide coverage.