MetaCrawler

A lightweight Python crawling framework.

Installation

pip install metacrawler

Quick start

metacrawler startproject example
cd example
python run.py
cat output.json

Also see example.

Documentation

Read the Docs

Tests

Run tox or python tests.py.

Changelog

See releases

License

See LICENSE