Add ECS S3 support to dtool
- GitHub: https://github.com/jic-dtool/dtool-ecs
- PyPI: https://pypi.python.org/pypi/dtool-ecs
- Free software: MIT License
Features
- Copy datasets to and from ECS S3 object storage
- List all the datasets in a ECS S3 bucket
- Create datasets directly in ECS S3
Installation
To install the dtool-ecs package:
pip install dtool-ecs
Configuration
Create the file .config/dtool/dtool.json and add the ECS account details
using the format below:
{
"DTOOL_ECS_ENDPOINT_<BUCKET NAME>": "<ENDPOINT URL HERE>",
"DTOOL_ECS_ACCESS_KEY_<BUCKET NAME>": "<USER NAME HERE>",
"DTOOL_ECS_SECRET_ACCESS_KEY_<BUCKET NAME>": "<KEY HERE>"
}
For example:
{
"DTOOL_ECS_ENDPOINT_my-bucket": "http://blueberry.famous.uni.ac.uk",
"DTOOL_ECS_ACCESS_KEY_ID_my-bucket": "olssont",
"DTOOL_ECS_SECRET_ACCESS_KEY_my-bucket": "some-secret-token"
}
See the dtool documentation for more detail.
