soda

A generic pipeline based package for machine learning modelling which supports classification, regression and clustering.


Keywords
scraper, robot.txt, python
License
MIT
Install
pip install soda==0.0.1

Documentation

DeliciousSoda

DeliciousSoda is a webscraper for robot.txt files. Basic usage:

>>> from soda import DeliciousSoda
>>> s = DeliciousSoda("https://www.google.com")
>>> s.get_allowed()
['Allow: /search/about', 'Allow: /search/static', ...]

©️ 2019 by Ben Antonellis.

License: Apache 2.0, see LICENSE for more details.