Is your feature request related to a problem or challenge?
There bunch of places where
impl PartitionedFile {
/// Create a simple file without metadata or partition
pub fn new(path: String, size: u64) -> Self
is used, it requires the exact size of file, otherwise it is a crash like
Error: ParquetError(General("AsyncChunkReader::get_bytes error: Generic LocalFileSystem error: Out of range of file /tmp/test/part-00000-dbdc88ee-c30e-4d2c-bef1-ee966702c2ae-c000.snappy.parquet, expected: 8, actual: 0"))
Describe the solution you'd like
Create an aux constructor to avoid file size calculation for the user.
Describe alternatives you've considered
Not doing this
Additional context
None