Fix ESR loss #73
Merged
Fix ESR loss #73
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
New notebook `bin/train/colab.ipynb` for training models on Google Colab.
* Parametric data and Hypernet * Validte data print path if fail * Affine instead of layer norm, batchnorm momentum * Tweak batchnorm momentum * Fix test so data doesn't clip
* Export for HyperConvNet, tests * Fix bool in CPP header
Closes #10 Energy-signal ratio loss metric of Eq. (10) of https://www.mdpi.com/2076-3417/10/3/766/htm
Closes #24 * Implement an LSTM model. * Config with some decent starting parameters as well as some hints. * Some improvements to the training script * Some refactoring to model exporting Squash of: * Better callbacks * Rearrange training input JSONs * np_to_wav, expose REQUIRED_RATE * LSTM model * Version bump to 0.3.0
Closes #36 * A conditional LSTM where the input signal is concatenated with the parametric inputs. * Example configurations with helpful tips commented. * Quality of life improvements in the trainer script including functionality for `ConcatDataset`-type validation datasets * Slicing of a single pair of WAV files into datasets at different parametric settings. Squash of: * Better callbacks * Rearrange training input JSONs * np_to_wav, expose REQUIRED_RATE * LSTM model * Version bump to 0.3.0 * Plot ConcatDatasets * Flatten datasets inside a ConcatDataset * CatLSTM * Tests * Config for CatLSTM * Better error message on invalid nx
* Fix export for parametric models * Version bump to 0.3.1
Smashing together a few things... * Implements the WaveNet architecture (#43) (and the parametric version, concatenating the knobs as additional inputs i.e. "CatWaveNet") * Speed up `ConcatDataset` access (#45) * Deprecate use of `"nx"` in dataset config (#44) * Increment version to 0.4.0 Commit notes: * WaveNet * Fix invalid broadcasting, rechannel needed * CatWaveNet * Faster lookup of data in ConcatDataset * Gated, exporting weights work * Fix bugs * Fix export for parametric models * Version bump to 0.3.1 * Exporting * Move bias from the input mixer to the dilated conv, which is always used. * Fix redundant conv in WaveNet head * Fix bugs; works with plugin * Automatically add nx to data config from model, check fewer than once per epoch * Refactor for multiple layer sets * Zero out through-connection for init (learn direct paths) * Layer send to head before 1x1, remove zeroing init * Fix bug: reintroduce out_length in head term * Fix receptive field w/ non-2 kernel sizes * Fix up WaveNet export * cpp headers for WaveNet and CatWaveNet * Improve docstring
* Tweak default parameters of LSTM configs * Pre-emphasis filtered loss (#42) * LSTM export C++ header * Improve printing on the training figures
* Input gain for data sets Adds parameter `input_gain` for data sets, default at 0 (unity) New test, passes. * Version bump
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Resolves #52 (...again)