[Bug] In some cases list with whitespace fails to parse

[omry]

Example:

$ python examples/tutorials/structured_configs/1_minimal/my_app.py '+param=[[a, 1, 2], [b, 2, 3]]'
no viable alternative at input '[[a, 1, 2], [': +param=[[a, 1, 2], [b, 2, 3]]
                                                                   ^

[nehalmamgain]

FYI, this issue still happens in Hydra 1.1.0

python app.py 'param=["string1", "string2"]'


  File "/usr/local/lib/python3.8/dist-packages/hydra/compose.py", line 28, in compose
    cfg = gh.hydra.compose_config(
  File "/usr/local/lib/python3.8/dist-packages/hydra/_internal/hydra.py", line 564, in compose_config
    cfg = self.config_loader.load_configuration(
  File "/usr/local/lib/python3.8/dist-packages/hydra/_internal/config_loader_impl.py", line 146, in load_configuration
    return self._load_configuration_impl(
  File "/usr/local/lib/python3.8/dist-packages/hydra/_internal/config_loader_impl.py", line 231, in _load_configuration_impl
    parsed_overrides = parser.parse_overrides(overrides=overrides)
  File "/usr/local/lib/python3.8/dist-packages/hydra/core/override_parser/overrides_parser.py", line 96, in parse_overrides
    raise OverrideParseException(
hydra.errors.OverrideParseException: no viable alternative at input '["string1",'

[jieru-hu]

hi @nehalmamgain
could you try this 'param=[string1, string2]'

more tips on how to do commandline override can be found here https://hydra.cc/docs/next/advanced/override_grammar/basic/

[nehalmamgain]

@jieru-hu Hi, that results in the same error.

hydra.errors.OverrideParseException: no viable alternative at input '[string1,'

'param=["string1","string2"]' or 'param=[string1,string2]' (without whitespace) works.

[jieru-hu]

thanks for trying it out @nehalmamgain
i'd suggest checking out the debugging tips in the doc I linked above. this is highly shell dependent.

[nehalmamgain]

@jieru-hu Thanks! I don't think the override or debugging section covers (removal of) whitespaces though.
I feel like this GH issue might be the only way for struggling users to find out.

[benrhodes26]

Bump. I hit this same error, and it's hard to avoid in my case as the hydra override is auto-generated (by weights and biases)