This is a simple package for parsing robots.txt files. Based on http://www.robotstxt.org/orig.html
Homepage Repository Hackage DIGITAL Command Language Download
cabal install robots-txt-0.4.1.6
This is a simple package for parsing robots.txt files. Based on http://www.robotstxt.org/orig.html