A high-level Web Crawling and Web Scraping framework


Keywords
crawler, crawling, framework, hacktoberfest, python, scraping, web-scraping, web-scraping-python
License
BSD-3-Clause
Install
pip install Scrapy==2.16.0

Documentation

Scrapy

PyPI Version Supported Python Versions Ubuntu macOS Windows Coverage report Conda Version Ask DeepWiki

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.