flyonthewall

Forum scraper that returns relevant posts and attachments based on keywords provided as argument or in file.


Keywords
forum, scrape
License
MIT
Install
pip install flyonthewall==0.1a12

Documentation

flyonthewall

Parse 4chan boards and filter posts with relevant keywords

Must include keyword file in root directory: keywords.txt

keyword.txt format:

  • One keyword per line
  • If keyword has similar words to exclude, use comma-separated list separated from keyword by '|' character

Example keywords.txt:

stellar

lumens

str|strong,strength,stress,stretch,strap,straw,strangle

xlm

In above example, these words will be included in search:

  • stellar
  • lumens
  • str
  • xlm

And these words will be excluded from search:

  • strong
  • strength
  • stress
  • stretch
  • strap
  • straw
  • strangle