v0.1.0a0.dev0

✨ New Features

• a205bc5 - Making the configs' properties relative paths. (commit by @SamuelLarkin)
• ded2b14 - move to torch 2.0 (commit by @roedoejet)
• 717fed0 - New assertions when loading configs. (commit by @SamuelLarkin)
• aaed3d5 - make installation more robust with fallbacks for compiled modules (commit by @joanise)
• e828331 - add ctc segmentation tool to everyvoice (commit by @roedoejet)
• fd1940e - replace repeated prepro warnings by a summary of missing symbols (commit by @joanise)
• b924bf7 - support cpu-only env in make-fresh-env.sh (commit by @joanise)
• dad4e48 - revamped make-everyvoice-env script (commit by @joanise)
• 4b756da - CLI: Creating a new CLI to view checkpoint's info. (commit by @SamuelLarkin)
• 8908fac - Record the model's architecture and configuration in logs (commit by @SamuelLarkin)
• fc5cac5 - fs2: add attention binarization loss (commit by @roedoejet)
• 4aad942 - gracefully handle an input filelist without a header line (commit by @joanise)
• 10558d2 - parameterize the Python version in make-everyvoice-env (commit by @joanise)
• 85a9a8a - Added lookuptables_from_config() (commit by @SamuelLarkin)
• 56e870d - Added model_kwargs to train_base_command() (commit by @SamuelLarkin)
• 44c88a1 - renamed lookuptables testcase (commit by @SamuelLarkin)
• 55b7865 - add ability to set validation interval (commit by @roedoejet)
• a8d9001 - quick hacky way to run fs2's unittests (commit by @SamuelLarkin)
• 969e02a - adding fs2's unittests (commit by @SamuelLarkin)
• b4fbace - added a typte to SUITE (commit by @SamuelLarkin)
• d5a4710 - added stubs for matplotlib & tqdm (commit by @SamuelLarkin)
• c0dce38 - python-3.10 type notation (commit by @SamuelLarkin)
• d08808e - using annotated to validate PossiblyRelativePath (commit by @SamuelLarkin)
• d7c7f44 - add contact information requirement (commit by @roedoejet)
• e3dd343 - Display an error message when the user provides the wrong config file (commit by @SamuelLarkin)
• 2681f40 - trimming white spaces in answers (PR #344 by @SamuelLarkin)
• 5bc4b87 - added unittest if the user provides invalid enum values (commit by @SamuelLarkin)
• 2b66c49 - ci to publish to pypi (commit by @SamuelLarkin)
• 84f19ac - create necessary changes for alpha release (commit by @roedoejet)
• 1a3221b - publish to pypi (commit by @SamuelLarkin)

🐛 Bug Fixes

• 6e9dde1 - docs: fix macro (commit by @roedoejet)
• 7dd78f5 - Changing path to absolute for missing members (commit by @SamuelLarkin)
• 4c429c9 - don't duplicate the CSV header line, and warn when it's not there (commit by @joanise)
• 5cfbd53 - skip short audios at the start to avoid errors with loudness (commit by @davidguzmanr)
• 4f751cb - change number of nodes to int (commit by @roedoejet)
• c2decdd - automatically remove a .wav extension from filenames (commit by @marctessier)
• a009014 - Relative paths for wavs issue #127 (commit by @SamuelLarkin)
• 3709e46 - tests: add other configs to e2e config to fix logger save dir bug (commit by @roedoejet)
• 4c5063d - Removed index.md from navigation (commit by @SamuelLarkin)
• a035dbb - reqs: bump to cuda 11.8 (commit by @roedoejet)
• e402b83 - remove kaldi pitch detection (commit by @roedoejet)
• 631e77b - add sox to install for github actions (commit by @roedoejet)
• 416a9b5 - only load audio as a string not path (commit by @roedoejet)
• 5763ee2 - remove MMS model due to privacy concerns (commit by @roedoejet)
• 39980b8 - add fix for hyphen and pipe in text (commit by @roedoejet)
• 2004a45 - remove trailing and leading silence (commit by @roedoejet)
• 2356b83 - make 'no' the default option in wizard (commit by @roedoejet)
• c9758f8 - add training loss back to progress bar (commit by @roedoejet)
• bc45a59 - fix tests for wizard (commit by @roedoejet)
• 8763bca - fp: fix feature prediction scheduler (commit by @roedoejet)
• a86a6b2 - docs: add index file again (commit by @roedoejet)
• 34d985e - if cuda 11.8 is now required, make that the fresh env default (commit by @joanise)
• 70994a1 - reqs: pin g2p to 2.0 dev version until release (commit by @roedoejet)
• cf99430 - fix memory pinning bug (commit by @roedoejet)
• 493bb6b - add missing fields in config files and fix synthesis on CPU (commit by @davidguzmanr)
• 230c6bf - speed up everyvoice -h by updating wav2vec2aligner submodule (commit by @joanise)
• 28f5c33 - previously processed files are skipped but not ignored (commit by @joanise)
• 0492207 - exit early when the filtered filelist is empty (commit by @joanise)
• 92b83d6 - config: fixes extra preprocessing and logs folders from being created (commit by @roedoejet)
• c28e736 - in case of error, let's sys.exit with a non-zero status (commit by @joanise)
• 3b8204a - ModelCheckpoint's every_n_train_steps & every_n_epochs should be mutually exclusive (commit by @SamuelLarkin)
• b9e7a52 - please watch your expensive imports (commit by @joanise)
• 4844191 - Deprecated feature in v2.X (commit by @SamuelLarkin)
• 181331f - ckpt: use serialized checkpoint (commit by @roedoejet)
• 742798c - Excluding sub_dir_callable when creating a TensorBoardLogger (commit by @SamuelLarkin)
• d50f303 - explicit the dependency of test_dataloader on test_preprocessing (commit by @joanise)
• a87bf85 - test: test_absolute_path should work even with TMPDIR=. (commit by @joanise)
• d166c12 - gracefully handle running out of columns (commit by @joanise)
• 7469559 - ensure all models are json serializable (commit by @roedoejet)
• 85d77ac - do not create unnecessary directories during inference (commit by @roedoejet)
• f4874f1 - preprocess always needs to recalculate pitch and energy (commit by @joanise)
• ebc8545 - correct license for third party file, and bump year (commit by @joanise)
• e210c06 - checkpoint: allow fine-tuning again for checkpoints without paths (commit by @roedoejet)
• c44e6ef - resume: resume checkpoint training from a mocked, temporary checkpoint (commit by @roedoejet)
• ede6297 - wizard config for multispeaker/lingual when relevant columns are found (commit by @joanise)
• 4118d8a - cpu: remove -inf padding which caused nans on cpu (commit by @roedoejet)
• 1155fb5 - reqs: mac-specific installation of torch and torchaudio (commit by @roedoejet)
• 536d75f - synthesis: fix synthesis on mac with multiple changes (commit by @roedoejet)
• cea3905 - test: set specific seed for synthesize test (commit by @roedoejet)
• f1746a2 - test: remove test_synthesize to pass ci (commit by @roedoejet)
• f82b19b - make the pandas version compatible with the matplotlib-stubs version (commit by @joanise)
• ebd78a1 - relative vocoder path (commit by @SamuelLarkin)
• 2fd9354 - finetune_checkpoint needs to be converted to absolute (commit by @SamuelLarkin)
• e4e4b5d - annotation errors (commit by @SamuelLarkin)
• 2c0c8b0 - missing member (commit by @SamuelLarkin)
• 095aeb3 - resuming from a gpu model on cpu or vice versa (commit by @SamuelLarkin)
• 9c3f670 - apply review fixes (commit by @roedoejet)
• 37c857c - only accept dirs for where the audio files are (commit by @joanise)
• 0045c6c - patch autocompletion of file args and opts (commit by @joanise)
• 0bfed5a - update submodules to patch file autocompletion (commit by @joanise)
• 1f625f8 - optim: update optimizer values to scale losses and increase learning rate (commit by @roedoejet)
• 05cdd09 - add doc fixes and config/train fixes (commit by @roedoejet)
• ec25471 - setup supported OS classifier (commit by @roedoejet)
• e475ba2 - setup: include submodules in setup tools (commit by @roedoejet)
• 6ae37f2 - missing space after question for contact info (commit by @SamuelLarkin)
• 29b78cc - aligner config checking and tensorboard arguments (commit by @MENGZHEGENG)
• 52a9e46 - extra preprocessed/ and logs_and_checkpoints/ (PR #311 by @SamuelLarkin)
• 11803e9 - pitch: allow audio to have no pitch (commit by @roedoejet)
• ffa450e - change silence trimming (commit by @roedoejet)
• 5f6c4d9 - update submodule to fix g2p imports (commit by @joanise)
• 71652a4 - use_effects is true (commit by @roedoejet)
• df44ccb - style: bump black to 24.3.0 to fix black's first CVE (commit by @joanise)
• 6244eb0 - sox_effects in preprocessing (commit by @MENGZHEGENG)
• 286e24d - test_update_schema fails when we bump the version (commit by @joanise)
• f99c8e7 - cli: update schemas should only save files based on maj/min (commit by @roedoejet)
• 2fa6097 - fs2: bump black to 24.3.0 to fix black's first CVE (PR #377 by @MENGZHEGENG)
• fd5ab98 - no need to publish to test pypi (commit by @roedoejet)

⚡ Performance Improvements

• 7556912 - update submodules to get their CLI loading speed-ups (commit by @joanise)
• 86d6bfb - defer imports to make CLI help lightning fast (commit by @joanise)
• c0cb6af - I guess it is going to be hard to keep help fast... (commit by @joanise)
• 5cdabda - There is no need to load all of pandas just to build a simple lookup table. (PR #202 by @SamuelLarkin)

♻️ Refactors

• 66ec197 - upgrade to lightning 2 (commit by @roedoejet)
• de7d4f5 - remove output optional argument to preprocess step (commit by @roedoejet)
• 00eb658 - use set instead of list (commit by @roedoejet)
• 1201d26 - cli: change new-dataset command to new-project (commit by @roedoejet)
• 1d8862d - remove dead code, add documentatino and doctests for utils (commit by @joanise)
• 05ada20 - update submodule to import _flatten at the source there too (commit by @joanise)
• 3efc443 - env: rename make-fresh-env.sh -> make-everyvoice-env (commit by @joanise)
• 4f22dc4 - cli: I removed the yaml export of the config as we're not exporting a proper EV config (commit by @roedoejet)
• f86d50e - Changed capture_stdout() to use redirect_stdout (commit by @SamuelLarkin)
• 838b854 - revamp how we load test suites to make it DRY (commit by @joanise)
• 504b7ff - address a whole bunch of mypy-raised issues (commit by @joanise)
• de38166 - move preprocessor helpers to helpers.py (commit by @joanise)
• 477614e - move class Preprocessor to preprocessor.py (commit by @joanise)
• 8c73385 - use built-in model_checkpoint_dump method (commit by @roedoejet)
• c76123b - change synthesize api to only specify the inputs (i.e. text or spec) (commit by @roedoejet)
• 66d943d - unify two slugify/path sanitization commands (commit by @roedoejet)
• 295b088 - test: explicitly call PreprocessingTest.preprocess() where needed (commit by @joanise)
• 801f7cc - python 3.10 style for files I am touching (commit by @joanise)
• ca7b9bd - move length trimming (commit by @roedoejet)
• 4dcf00c - fs2l: split subcommands into their own file (commit by @SamuelLarkin)

✅ Tests

• 88ef6e5 - update tests for header patch and make them quieter (commit by @joanise)
• e8496f2 - exercise incremental file processing (commit by @joanise)
• 047b8c3 - doh, forgot to add the new test data file (commit by @joanise)
• d1690c4 - exercise incremental attn too (commit by @joanise)
• 1154668 - minor improvements to test suites (commit by @joanise)
• fb149d2 - quiet the test_preprocessing.py test suite (commit by @joanise)
• 804d676 - add the --describe option to run_tests.py (commit by @joanise)
• fb52313 - enable running "everyvoice test fs2" (commit by @joanise)
• 8ec6b4f - test for the multispeaker/language effect on config files (commit by @joanise)
• 8e9a563 - minimal test case exercising imbalanced_sampler (commit by @joanise)
• b1996bf - add silence removal test to remove leading and trailing silence (commit by @roedoejet)
• 3af47ae - ensure version is pep440 compliant (commit by @roedoejet)

🔧 Chores

• 341d3f0 - point to pre-commit checked submodules (commit by @roedoejet)
• ab2cf96 - update submodules (commit by @roedoejet)
• 8deefd1 - update submodule (commit by @roedoejet)
• c0a75d8 - update submodule (commit by @roedoejet)
• 4890588 - update submodule (commit by @roedoejet)
• 7dd79b1 - update submodule (commit by @joanise)
• bb06431 - update submodules (commit by @roedoejet)
• b7e9915 - update submodule to get their mypy issue fixes (commit by @joanise)
• a3dce66 - update submodule (commit by @roedoejet)
• 45f1287 - update submodule (commit by @roedoejet)
• 71239db - allow prefactor commit type for partial refactoring work (commit by @joanise)
• ccd01e8 - update submodule (commit by @roedoejet)
• 09ab796 - update submodules (commit by @joanise)
• a046900 - update fs2's submodule (commit by @SamuelLarkin)
• 5930b54 - update submodules (commit by @joanise)
• 03eb27c - update submodule (commit by @roedoejet)
• c72227e - submodule update (commit by @SamuelLarkin)
• d000814 - submodule update (commit by @SamuelLarkin)
• 725f19e - submodule update (commit by @SamuelLarkin)
• 685a980 - update submodule (commit by @joanise)
• 3538b8a - update submodule (commit by @joanise)
• 8ff018c - update submodule (commit by @SamuelLarkin)
• c0f10c7 - submodule update (commit by @SamuelLarkin)
• 8c149f9 - submodule update (commit by @SamuelLarkin)
• 0510daf - submodule update (commit by @joanise)
• c441643 - submodule update (commit by @SamuelLarkin)
• 75ca553 - update submodules (commit by @joanise)
• e6421c1 - update submodules (commit by @roedoejet)
• 3be6198 - remove unused filelists (commit by @roedoejet)
• 6efaf73 - fs2: submodule update (commit by @SamuelLarkin)
• 74cd34e - HiFiGAN: submodule update (commit by @SamuelLarkin)
• 85d1490 - fs2: submodule update (commit by @SamuelLarkin)
• 1be0482 - update submodules to apply black bump (commit by @joanise)
• c9c7c2f - bump version to v0.1.0a0.dev0 (commit by @roedoejet)