sreddit
A simple tool for scraping information from subreddits.
Installation
To install, you can either Download the Pypi Package or,
pip install sredditTo upgrade to the latest version,
pip install --upgrade sredditUsage
srtitles
Gets all unique titles from a subreddit.
from sreddit import SubRedditTitles
scraper = SubRedditTitles(subreddit="subreddit_name")
scraper.run()srbodies
Gets all unique post bodies (i.e. descriptions) from a subreddit.
from sreddit import SubRedditBodies
scraper = SubRedditBodies(subreddit="subreddit_name")
scraper.run()Optional Arguments
| Argument | What it Does |
|---|---|
| keywords | Only includes content that has one or more of these keywords |
| show_progess | Whether or not to show scraping progress (i.e. number of titles found) in the terminal |
| make_db | If a database of the content found should be created after scraping |
| db_name | The name of the database to be created--must end in .db |
| scroll_time | Time to wait between scrolling down the page and finding elements. |
