Fix filenames with square brackets not loading

[thomasaarholt]

Fixes #1325. This way I won't rediscover the bug next year.

[ericpre]

It breaks the following:

import hyperspy,api as hs
hs.load('*.hspy')

[thomasaarholt]

Interesting, and good find. I’m a bit busy at the moment but I’ll see if I can find the time to try and find a solution.

[thomasaarholt]

I didn't realise previously that the asterix in ericpre's case referred to a wildcard used with glob. Writing this comment here to remind myself next time I look at it!

[tjof2]

@thomasaarholt perhaps try the following instead of glob.escape to keep it working with the star wildcard while escaping the brackets?

import re

def escape_square_brackets(text):
    rep = dict((re.escape(k), v) for k, v in {"[": "[[]", "]": "[]]"}.items())
    pattern = re.compile("|".join(rep.keys()))
    return pattern.sub(lambda m: rep[re.escape(m.group(0))], text)

For example, say I have two files in /home/data/ like this:

/home/data/afile[1x1].txt
/home/data/afile[1x2].txt

Then:

>>> path = "/home/data/afile[*].txt"
>>> glob.glob(path)
[]
>>> glob.glob(escape_square_brackets(path))
['/home/data/afile[1x2].txt', '/home/data/afile[1x1].txt']

Works OK I think @ericpre?

[tjof2]

That said, maybe you'd want to be able to turn the escaping on/off - what if you want to use "[" and "]" for regex in the path too? @francisco-dlp