Experiment collection
A set of utilities for storing and organizing experiments
Install
pip install experiment-collectionYou can find another versions at releases or pypi.
Usage_example
Experiment - structure with experiment data;
ExperimentCollectionLocal - local experiment storage;
ExperimentCollectionRemote - remote experiment storage;
could combine data from multiply sources.
from experiment_collection import Experiment, ExperimentCollectionRemote
exps = ExperimentCollectionRemote('localhost:50051', 'main', 'token')
for i in range(10):
exp = Experiment('name_{}'.format(i))
exp.set_metrics({'lr': 0.1})
exp.set_params({'auc': 0.5})
exps.add_experiment(exp)
assert exps.check_experiment(exp)
# Delete latest experiment
exps.delete_experiment(exp)
assert not exps.check_experiment(exp)View all results. All metrics and params auto flatten into single columns.
exps.get_experiments()
name time params_auc metrics_lr
0 name_0 2020-09-30 23:56:39.932871 0.5 0.1
1 name_1 2020-09-30 23:56:40.216424 0.5 0.1
2 name_2 2020-09-30 23:56:40.620029 0.5 0.1
3 name_3 2020-09-30 23:56:40.916781 0.5 0.1
4 name_4 2020-09-30 23:56:41.240535 0.5 0.1
5 name_5 2020-09-30 23:56:41.567865 0.5 0.1
6 name_6 2020-09-30 23:56:41.861890 0.5 0.1
7 name_7 2020-09-30 23:56:42.177155 0.5 0.1
8 name_8 2020-09-30 23:56:42.507883 0.5 0.1
9 name_9 2020-09-30 23:56:42.818714 0.5 0.1
License
MIT License
Copyright (c) 2020 AsciiShell (Aleksey Podchezertsev)
