feat: add hist module for plotting raw hdf5 files features distributions

[gcroci2]

Next step will be to implement the actual trasformations in the DeeprankDataset objects, see #237

[github-actions]

This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[DaniBodor]

Really nice! This is really useful to be able to see the values/distributions of the features. Next step will be actually implementing the transformation. Maybe this module should be renamed, because (at least for now) it is not actually transforming anything, just visualizing; would data_visualization.py be a good name?

Regarding my comment about _check_features: don't know whether it is worthwhile dealing with/fixing this now, depending on how we will proceed with using hdf5 files or not,
Whichever way you decide to go on it is fine, but if you don't change it now, maybe open a new issue about it so we don't forget?

[DaniBodor]

BTW, I haven't tested what the Dataframe and histogram outputs look like, but I assume you have and it looks as intended. Should I take a closer look at that as well?

[gcroci2]

Really nice! This is really useful to be able to see the values/distributions of the features. Next step will be actually implementing the transformation. Maybe this module should be renamed, because (at least for now) it is not actually transforming anything, just visualizing; would data_visualization.py be a good name?

I renamed transform.py to hist.py (it converts the hdf5 files to pandas for plotting and saving histograms), and the same for the test script. When we'll have a clearer pipeline for the transformations we can improve the naming again.

[gcroci2]

BTW, I haven't tested what the Dataframe and histogram outputs look like, but I assume you have and it looks as intended. Should I take a closer look at that as well?

I plotted the hists for all the features of the 140k datapoints and they look good, so don't worry :)

[DaniBodor]

Really nice! This is really useful to be able to see the values/distributions of the features. Next step will be actually implementing the transformation. Maybe this module should be renamed, because (at least for now) it is not actually transforming anything, just visualizing; would data_visualization.py be a good name?

I renamed transform.py to hist.py (it converts the hdf5 files to pandas for plotting and saving histograms), and the same for the test script. When we'll have a clearer pipeline for the transformations we can improve the naming again.

don't forget to rename the PR as well :)

[DaniBodor]

I think for the one-hot encoded values, it would be more useful to plot a single histogram that shows how many of each is present, rather than separate 0-1 histograms for each option.
This can also be a separate issue that we can tackle when we have time for it.

[gcroci2]

I think for the one-hot encoded values, it would be more useful to plot a single histogram that shows how many of each is present, rather than separate 0-1 histograms for each option. This can also be a separate issue that we can tackle when we have time for it.

Opened in #317 :)