Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom dataset #49

Merged
merged 24 commits into from
Sep 5, 2022
Merged

Custom dataset #49

merged 24 commits into from
Sep 5, 2022

Conversation

clementchadebec
Copy link
Owner

@clementchadebec clementchadebec commented Aug 30, 2022

New features:

  • Allow custom Dataset inheriting from torch.utils.data.Dataset to be passed as inputs in the training_pipeline.
def __call__(
        self,
        train_data: Union[np.ndarray, torch.Tensor, torch.utils.data.Dataset],
        eval_data: Union[np.ndarray, torch.Tensor, torch.utils.data.Dataset] = None,
        callbacks: List[TrainingCallback] = None,
    ):
  • Update tests and add a tutorial on custom datasets.

Minor changes

  • Unify data handling in FactorVAE with other models. (half of the batch is used for reconstruction and the other one for factorial representation)
  • Change model sanity check method in trainers (use loaders in check instead of datasets)
  • Update README

@clementchadebec clementchadebec marked this pull request as ready for review September 5, 2022 08:34
@clementchadebec clementchadebec merged commit 4c50f25 into main Sep 5, 2022
@clementchadebec clementchadebec deleted the custom_loaders branch September 5, 2022 09:31
Cmeo97 pushed a commit to Cmeo97/benchmark_VAE that referenced this pull request Nov 7, 2022
* add custom datasets

* make sanity check on loader

* add DatasetOutput class

* unify data loading with other models

* allow custom datasets as inputs

* update tests

* update tests

* add tutorial

* update gitignore

* update README

* clean up inerpolate and reconstruct

* add interpolate and reconstruct

* update README

* apply black

* small update in test

* remove not needed imports

* add install on main

* clean up notebook

* black

* remove DoubleBatchDataset

* remove DoubleBatchDataset

* black isort
louis-j-vincent pushed a commit to louis-j-vincent/benchmark_VAE that referenced this pull request Jan 24, 2023
* add custom datasets

* make sanity check on loader

* add DatasetOutput class

* unify data loading with other models

* allow custom datasets as inputs

* update tests

* update tests

* add tutorial

* update gitignore

* update README

* clean up inerpolate and reconstruct

* add interpolate and reconstruct

* update README

* apply black

* small update in test

* remove not needed imports

* add install on main

* clean up notebook

* black

* remove DoubleBatchDataset

* remove DoubleBatchDataset

* black isort
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Is this library compatible with custom datasets?
1 participant