php-curl-class/php-curl-class
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs.
Latest release 9.4.0 - Updated - 2.85K stars
rvest
Easily Harvest (Scrape) Web Pages
Latest release 0.3.6 - Updated - 1.27K stars
user-agents
A JavaScript library for generating random user agents.
Latest release 1.0.775 - Updated - 562 stars
apify
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
Latest release 2.0.8-beta.15 - Updated - 3K stars
helium
Lighter browser automation based on Selenium.
Latest release 3.0.8 - Updated - 2.63K stars
github.com/go-rod/rod
A Devtools driver for web automation and scraping
Latest release v0.101.7 - Updated - 1.76K stars
faster-than-requests
Faster & simpler requests replacement for Python
Latest release 21.03.03 - Updated - 669 stars
scrapy-fake-useragent
Use a random User-Agent provided by fake-useragent for every request
Latest release 1.4.4 - Updated - 463 stars
html-metadata
Scrapes metadata of several different standards
Latest release 1.7.1 - Updated - 109 stars
selectolax
Fast HTML5 parser with CSS selectors.
Latest release 0.3.4 - Updated - 430 stars
autoscraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Latest release 1.1.12 - Updated - 3.79K stars
@sanv/apify
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
Latest release 1.1.4 - Updated - 3K stars
grab
Web Scraping Framework
Latest release 0.6.41 - Updated - 1.7K stars
@adncorp/apify
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
Latest release 2.7.6 - Updated - 3K stars
apifier
Legacy Apifier runtime for JavaScript
Latest release 0.0.53 - Updated - 3K stars
github.com/ysmood/rod
A Devtools driver for web automation and scraping
Latest release v0.101.7 - Updated - 1.76K stars
scrapple
A framework for creating web content extractors
Latest release 0.3.0 - Updated - 423 stars
basketball-reference-web-scraper
A Basketball Reference client that generates data by scraping the website
Latest release 4.12.1 - Updated - 289 stars
github.com/infinitbyte/gopa
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Latest release v0.11.1-0.20210519084159-83de7c19f94a - Updated - 282 stars
wayback-machine-scraper
A command-line utility for scraping Wayback Machine snapshots from archive.org.
Latest release 1.0.8 - Updated - 220 stars
hockey-scraper
Python Package for scraping NHL Play-by-Play and Shift data.
Latest release 1.37.8 - Updated - 100 stars
saveddit
Bulk Downloader for Reddit
Latest release 2.2.1 - Updated - 75 stars
github.com/suntong/cascadia
Go cascadia package command line CSS selector
Latest release v1.2.5 - Updated - 72 stars
@apify/scraper-tools
Tools shared by Apify actor-scrapers.
Latest release 0.3.4 - Updated - 71 stars
frontend-master-downloader
Download video from frontenMaster
Latest release 2.0.0 - Updated - 67 stars
scrapy-wayback-machine
A Scrapy middleware for scraping Wayback Machine snapshots from archive.org.
Latest release 1.0.2 - Updated - 64 stars
crawlzone/crawlzone
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web se...
Latest release 3.0.0 - Updated - 53 stars
lisc
Literature Scanner
Latest release 0.2.0 - Updated - 38 stars
webmiddle
This module should be installed in any webmiddle application, as it provides the machinery to par...
Latest release 0.5.1 - Updated - 12 stars
@mnmkng/apify
The scalable web crawling and scraping library for JavaScript. Enables development of data extrac...
Latest release 0.13.14 - Updated - 3K stars
License
Language
Keyword
Platform

Subscribe to an RSS feed of this search