databricks-cli seems to be unable to use basic authentication with Account API when certain characters are used in a password

[oaulicino]

I have used databricks-cli recently and I noticed that using the basic authentication for the databricks-cli (as described at https://docs.databricks.com/en/dev-tools/cli/databricks-cli-ref.html#id2) fails if the password uses certain special characters such as @ or #.
I updated my password in the account console to something that would not include any of these characters and it started to work.
One thing to note is that the characters can be used in the password while using curl, so it really seems to be the databricks-cli that is the culprit.
Just to exemplify here, these were my troubleshooting steps:

1. This is what I would get with the more complex password:
   

2. And when I updated the password to something less complex (removing the above-mentioned characters):
   
   PS: As you can see, the problem went away.

3. What was confusing while I was troubleshooting was that I did not have the issue while using curl - the output below shows that I have 123 items:
   
   4: This one is what helped me, while troubleshooting, as I basically used a wrong password to see what the output would be, as you can see, it is the same as item 1 above.
   

[pietern]

Thanks for reporting.

I can reproduce the issue. The problem lies with the parser of the .databrickscfg file, which ignores everything after a # character. It doesn't matter if the password is quoted or not.

To circumvent, you can set the password in the DATABRICKS_PASSWORD environment variable, then still use the profile for the remainder of the settings, and it will work.

This is an issue with the Go SDK, so I filed databricks/databricks-sdk-go#594 to track it.

I'm closing it here because there is nothing we can do in the CLI to fix this issue.

[pietern]

@oaulicino We have fixed this in the upstream SDK for Databricks.

As soon as that is pulled into the CLI, the flow you were going through will work out of the box.