Releases: KevinMusgrave/powerful-benchmarker
Release list
v0.9.33
Version requirements
Requires pytorch-metric-learning 0.9.92, which also means pytorch 1.6 is required.
Updates
- Visualizer class can be specified in the config for the tester. For example, if you have umap installed and register
umap.UMAPunder the"visualizer"type, then you can do:
--tester~APPLY~2 {visualizer: {UMAP: {}}}
Plots will be saved in a saved_plots folder per split. When evaluating an ensemble, the plots will be saved in meta_logs/saved_plots
- Added ability to aggregate over a specific split, rather than having it hard-coded to val. The config option is
split_to_aggregate:
aggregator:
MeanAggregator:
split_to_aggregate: val-
0th model is saved as the "best" before training begins, so that there always exists a "best" model, in case the 0th model is never surpassed.
-
Update loss factory to be compatible with pytorch-metric-learning 0.9.92, so the nested objects (distances, reducers, weight regularizers, embedding regularizers, and weight init functions) can be specified in the config for the loss function.
-
Added
api_parserconfig option, which is null by default. In this default setting,BaseAPIParseris used. If you use a custom trainer, it will try to useAPI<name_of_your_trainer>, and if that doesn't exist, it will useBaseAPIParser. If you set theapi_parseroption, then that will be used:
api_parser:
your_custom_parser:-
Changed default folder locations in run.py. Before it was
/content, which wasn't a nice user experience for first time users. -
Added
log_data_to_tensorboardconfig option. It is True by default. Set it to False if you don't want to log data to tensorboard. This can be useful if your disk I/O is slow.