You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Suggest adding a dump function to BaseDataset. This function will make the dataset more flexible. Users can first dump the dataset to a pkl file, and then reformat its structure to anther dataset type.
Users can dump the dataset like this:
dataset.dump('data_list.pkl')
Then, data_list can also be directly loaded
dataset.load('data_list.pkl')
Any other context?
No response
The text was updated successfully, but these errors were encountered:
I can support a dump function to save all data in self.data_list into a .pkl file.
And I also suggest supporting dataset wise dump functions to format self.data_list into the certain dataset format. It will benefit many dataset operations like transformation, separation.
HAOCHENYE
changed the title
[Feature] Support dumping function in datasets
[Feature] Support dumping datasets to pkl file
Mar 8, 2023
What's the feature?
Suggest adding a
dump
function toBaseDataset
. This function will make the dataset more flexible. Users can first dump the dataset to apkl
file, and then reformat its structure to anther dataset type.Users can dump the dataset like this:
Then,
data_list
can also be directly loadedAny other context?
No response
The text was updated successfully, but these errors were encountered: