Versioned Storage Python SDK
Proposed solution:
To enable block-based data versioning for nd data, a mix is created of:
How to:
index_store = ZarrIndexStore(INDEX_PATH)
store = VersionedFSStore(index_store, RAW_PATH)
z = zarr.open(store, mode="a")
# Commit
store.vc.commit()
# Push
store.vc.push()
# Create new branch
store.vc.create_new_branch(BRANCH_NAME)
# Checkout new branch
store.vc.create_new_branch(BRANCH_NAME)
Features:
- Multiple branches
- Multiple collaborators
- Can jump anytime to any historical point
- Data is not replicated and no extra reading writing cost
Every change is a now commit: