Invana Bot
This project is moved and being actively developed at https://github.com/crawlerflow/crawlerflow
A micro-framework to crawl the web pages with crawlers configs. It can use MongoDB, Elasticsearch and Solr databases to cache and save the extracted data.
pip install web-crawler-plus==0.9.11
This project is moved and being actively developed at https://github.com/crawlerflow/crawlerflow