s3like

A small package that is used by COMP to read and write model results to S3 like object storage systems.


License
AGPL-3.0
Install
pip install s3like==1.5.0

Documentation

Compute Studio Storage

A light-weight package that is used by Compute Studio to read and write model results to Google Cloud Storage.

Setup

pip install cs-storage
export BUCKET=YOUR_BUCKET

Authenticate

gcloud auth login
gcloud auth application-default login

Use

import cs_storage

# run_model returns data that is compliant with the C/S outputs api.
local_result, task_id = run_model(**kwargs)
remote_result = cs_storage.write(task_id, local_result)
round_trip = cs_storage.read(remote_result)
assert local_result == round_trip

Test

py.test -v