close.consumer

gevent based Streaming API consumer


License
CC0-1.0
Install
pip install close.consumer==0.2.2

Documentation

Abstract base classes for a long running, streaming API consumer and a specific implementation that puts the data into a redis queue and processes it in batches.

Requires gevent. The example implementation depends on redis.

Coded initially to send batches of statuses from the Twitter Streaming API to an appengine webhook. May (or may not) be usable for other purposes.

Presumes the data coming down the pipe is Chunked Transfer Encoded.