Further optimization for read_parquet_glob
and read_pickle_distributed
that create 1 partition from 1 file
#6857
Labels
P2
Minor bugs or low-priority feature requests
pandas.io
Performance 🚀
Performance related issues and pull requests.
As an example, one can use the more complex implementation of
read_csv_glob
function, which can create several partitions from 1 file if necessary.However, we need to keep in mind the complexity of support, especially since these are additional public functions that are not available in pandas.
The text was updated successfully, but these errors were encountered: