streamcat
Examples
Encoding a JSON iterator into a stream:
def gen_records():
yield b'{"foo": "bar"}'
yield b'{"baz": [1, 2, 3]}'
stream = streamcat.iterator_to_stream(gen_records())
# `stream` can then be used just like any other `io.RawIOBase`
with open('/tmp/jsoncat', 'wb') as destination:
shutil.copyfileobj(stream, destination)Decoding a stream into a generator:
decoder = json.JSONDecoder()
with open('/tmp/jsoncat', 'rb') as source:
records = streamcat.stream_to_iterator(source, decoder)
for record in records:
print(record)
