get-site-urls
Get all of the URLs from a website.
Forked from alex-page/get-site-urls.
Install
npm install @cityssm/get-site-urlsUsage
import { 'getSiteUrls' } from "@cityssm/get-site-urls";
getSiteUrls( 'https://saultstemarie.ca' )
.then( links => console.log( links ) );
( async () => {
const links = await getSiteUrls( 'https://saultstemarie.ca' );
console.log( links );
/*
{
pages: [
'https://saultstemarie.ca',
'https://saultstemarie.ca/City-Hall.aspx',
'https://saultstemarie.ca/City-Hall/City-Council.aspx',
...,
'https://saultstemarie.ca/Contact-Us.aspx',
'https://saultstemarie.ca/Site-Map.aspx'
],
errors: [
'https://saultstemarie.ca/Broken-Link.aspx'
]
}
*/
})();Parameters
The function getSiteUrls() takes two parameters:
getSiteUrls( url, maxDepth );-
url- The URL to search. -
maxDepth- The maximum depth to search, default 1.
