Python Asynchronous I/O bindings (aio.h)
Version 0.3 Linux only
You should wait for the callback to finish before queuing more requests in a tight loop. pyaio could hang if you hit the max aio queue size.
Tuning
pyaio.aio_init(max threads, max aio queue, max thread sleep time)
Linux Defaults to 20 threads and 64 queue size. Pyaio will use 5cores and 4threads instead of those values if larger.
Reading
API
python
view = aio_read(fileno, file-offset, length, callback)
Example
import pyaio
import os
def aio_callback(buf, rcode, errno):
if rcode > 0:
print 'python callback %s' % buf
elif rcode == 0:
print "EOF"
else:
print "Error: %d" % errno
fd = os.open('/tmp/pyaio.txt', os.O_RDONLY)
pyaio.aio_read(fd, 10, 20, aio_callback)Writing
API
python
aio_write(fileno, buffer-object, file-offset, callback)
Example
import pyaio
import os
def aio_callback(rt, errno):
if rt > 0:
print "Wrote %d bytes" % rt
else:
print "Got error: %d" % errno
fd = os.open('/tmp/pyaio.txt', os.O_WRONLY)
pyaio.aio_write(fd, "Writing Test.......", 30, aio_callback)gevent Wrapper
For a file() like wrapper around aio_read and aio_write using gevent a 'buffer' keyword argument to aioFile controls its internal buffer size
from pyaio.gevent import aioFile
with aioFile('/tmp/pyaio.txt') as fr:
data = fr.read() # Entire File
with aioFile('/tmp/pyaio.txt', 'w') as fw:
fw.write(data)
