MetaCrawler
A lightweight Python crawling framework.
Installation
pip install metacrawler
Quick start
metacrawler startproject example
cd example
python run.py
cat output.json
Also see example.
Documentation
Tests
Run tox
or python tests.py
.
Changelog
See releases
License
See LICENSE