the table does not load if the file path has a dot at start

[asfimport]

Please check the below code. If I uncomment line six then the table written to disk is loaded as an empty table.

Similar behavior is observed when the directory name starts with _. 

This was not the case in earlier versions.

 

import pyarrow.parquet as pq
 import pyarrow as pa
 import pathlib
 _path = pathlib.Path("abc").resolve()
 _path /= "xyz"
 _path /= ".lmn" # uncomment this has a 'dot' at start of the folder
 _path /= "file_name"
 pq.write_to_dataset(
     table=pa.table({"a": [1], "b": [2]}), 
     root_path=_path.as_posix()
 )
 t = pq.read_table(_path)
 print(t.to_pandas())

Environment: Windows 10
Reporter: Praveen Kulkarni
Assignee: Ben Kietzman / @bkietz

Related issues:

• [C++][Dataset] Do not check for ignore_prefixes in the base path (duplicates)

_{Note: This issue was originally created as ARROW-9675. Please see the migration documentation for further details.}