Fix for "KeyError: 'type' using fs.glob" #34

[lassevalentini]

Add return statement to handle folders being the prefix of another folder during ls operations. Fixes #34 for me.

I'm not super familiar with the code, but this fixes my issue and seems like it it was the original intention (as the self.ls seems pointless otherwise).

[martindurant]

Please check if #35 already fixes this for you.

[lassevalentini]

#35 fixes the issue for a small test sample I have constructed.

However, doing a glob on abfs://container/raw_financials/*/*.parquet or abfs://container/raw_financials/**.parquet on a directory structure with 15k folders yields nothing.

I've tested the same glob with this code, and it only yields ~600, which is not correct either, so my guess would be that there's a limit/timeout on some operations to azure rather than on the code itself.

[martindurant]

^ cc @AlbertDeFusco , maybe you need some more tests?

[AlbertDeFusco]

Certainly. I'm working on the large file/directory tests.

[lassevalentini]

Ill close this PR as it should be solved with #35 which is now merged.