twitterframe
In the future, I want to add more flexibility with the preferred output. (i.e. JSON, SQL databases, etc.)
Project Currently: ON HOLD
Tweepy does not currently have the values from Twitter's API that I would like to use for the purpose of this project.
For example, if you click on the link for tweepy, it should bring you to Line 73 of the tweepy/models.py
script, where the class Status(Model):
and @classmethod
is located. The Status
object (which is just a Tweet
object) from Twitter's API should give you a set of attributes like the following from the Twitter Developer documentation.
Unforunately, if we refer back to tweepy, inside of the parse function, we can see that the key,value
pairings do not provide as many Tweet
object attributes as one may like to have. (That one being me.) And so what I am going to be working on in the mean time is a pull request to @tweepy, and add the attributes I want to see from Twitter's API.
Hopefully all goes well and i'll be able to use tweepy once again, and finish up this command-line-application, but in the mean time, please use my pre-alpha version from the Installation.
Installation and Usage:
- Coming soon.
Progress so far...
twitterframe
scrape
command is now functioning as it should be.
crawl
command will require a mandatory argument for how many tweets to get per request, and the rate limit for the TwitterAPI is reached, an exception is passed.
Ideas on new features and commands
scrape
and crawl
to show progress.
scrape
,
crawl
, etc.
scrape
would have the option to dump the tweets from user: @twitteruser, to either a CSV, an SQL database, etc.) (etc. is used quite liberally in my explanations of things in this README.)
Known issues
crawl
command is not pulling tweets by the specified times.
crawl
gets a Twitter error response: status code = 429 due to the application's rate limit on the amount of requests to be served.
listener
does not do anything. Yeah I know, big issue here.
tweepy
does not have enough attributes in the class methods to my liking.