Scrapy
A high-level Web Crawling and Web Scraping framework
Latest release 2.4.1 - Updated - 41.5K stars
mechanize
The Mechanize library is used for automating interaction with websites. Mechanize automatically s...
Latest release 2.8.2 - Updated - 4.12K stars
casperjs
A navigation scripting & testing utility for PhantomJS and SlimerJS
Latest release 1.1.4 - Updated - 7.29K stars
crawler
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server ...
Latest release 1.3.0 - Updated - 5.98K stars
github.com/gocolly/colly
Elegant Scraper and Crawler Framework for Golang
Latest release v2.1.1-0.20210605141920-2f0994161301 - Updated - 14.8K stars
scrape-it
A Node.js scraper for humans.
Latest release 5.3.2 - Updated - 3.74K stars
pyquery
A jquery-like library for python
Latest release 1.4.3 - Updated - 1.97K stars
parsel
Parsel is a library to extract data from HTML and XML using XPath and CSS selectors
Latest release 1.6.0 - Updated - 629 stars
requests-html
HTML Parsing for Humans.
Latest release 0.10.0 - Updated - 11.9K stars
scraperjs
A complete and versatile web scraper.
Latest release 1.2.0 - Updated - 3.58K stars
symfony/panther
A browser testing and web scraping library for PHP and Symfony.
Latest release v1.1.1 - Updated - 2.36K stars
embed/embed
PHP library to retrieve page info using oembed, opengraph, etc
Latest release v4.3.4 - Updated - 1.76K stars
scraper
HTML parsing and querying with CSS selectors
Latest release 0.12.0 - Updated - 503 stars
github.com/gocolly/colly/v2
Elegant Scraper and Crawler Framework for Golang
Latest release v2.1.1-0.20210605141920-2f0994161301 - Updated - 14.8K stars
us.codecraft:webmagic-core
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, cont...
Latest release 0.7.5 - Updated - 10K stars
us.codecraft:webmagic-extension
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, cont...
Latest release 0.7.5 - Updated - 10K stars
apify
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
Latest release 2.0.8-beta.15 - Updated - 3K stars
cfscrape
A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudf...
Latest release 2.1.1 - Updated - 2.46K stars
unfluff
A web page content extractor
Latest release 3.2.0 - Updated - 2.04K stars
VideoLibrary
libvideo is a fast, clean way to download YouTube videos. It is fully portable and has no depende...
Latest release 3.1.2 - Updated - 366 stars
machinepack-http
Send HTTP requests, scrape webpages, and stream data in your JavaScript/Node.js/Sails.js app with...
Latest release 8.0.0 - Updated - 4 stars
scrapy
Scrapy is an open source and collaborative framework for extracting the data you need from websit...
Latest release 2.5.0 - Updated - 41.5K stars
us.codecraft:webmagic-selenium
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, cont...
Latest release 0.7.5 - Updated - 10K stars
cloudscraper
A Python module to bypass Cloudflare's anti-bot page.
Latest release 1.2.56 - Updated - 1.01K stars
online-judge-tools
CLI tool to solve problems of competitive programming
Latest release 11.5.1 - Updated - 607 stars
headless-chrome-crawler
Distributed web crawler powered by Headless Chrome
Latest release 1.8.0 - Updated - 5K stars
github.com/MontFerret/ferret
Declarative web scraping
Latest release v0.16.0-rc.5 - Updated - 4.63K stars
artoo-js
The client-side scraping companion.
Latest release 0.4.4 - Updated - 1.02K stars
unfurl.js
Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based
Latest release 5.6.2 - Updated - 218 stars
humanparser
Parse a human name string into salutation, first name, middle name, last name, suffix. Parse an a...
Latest release 2.6.0 - Updated - 72 stars
License
Language
Keyword
Platform

Subscribe to an RSS feed of this search