href_scraper

Scrape hrefs from a single webpage


Keywords
cli, cli-app, gem, links, scraping, scraping-websites
License
MIT
Install
gem install href_scraper -v 0.3.1

Documentation

href-scraper

Build Status Gem Version Gem

A ruby gem to get all the hrefs from a single URL(export as json)

Installation

Add this line to your application's Gemfile:

gem 'href_scraper'

And then execute:

$ bundle

Or install it yourself as:

$ gem install href_scraper

Usage

❯ href_scraper --url https://github.com
[
    "https://github.com/",
    "https://help.github.com/terms",
    "https://help.github.com/privacy",
    "https://enterprise.github.com/trial",
    "https://enterprise.github.com/contact",
    "https://help.github.com/terms",
    "https://help.github.com/privacy",
    "https://atom.io",
    "http://electron.atom.io/",
    "https://desktop.github.com/",
    "https://developer.github.com",
    "https://education.github.com/",
    "https://partner.github.com/",
    "https://community.github.com/",
    "https://github.com/about",
    "https://blog.github.com",
    "https://shop.github.com",
    "https://github.com/contact",
    "https://github.community",
    "https://help.github.com",
    "https://status.github.com/",
    "https://help.github.com/articles/github-security/",
    "https://services.github.com/"
]