Cannot create external stream with SCRAM-SHA-256 in proton local. Okay in docker

[jovezhong]

Describe what's wrong

In the proton single binary, creating kakfa external stream with SCRAM-SHA-256 failed with message

Code: 36. DB::Exception: Failed to create kafka handle: No provider for SASL mechanism SCRAM-SHA-256: recompile librdkafka with libsasl2 or openssl support. Current build options: PLAIN. (BAD_ARGUMENTS)

How to reproduce

CREATE STREAM ext_stream(`raw` string)
SETTINGS type = 'kafka', brokers = 'arriving-grizzly-8171-us1-kafka.upstash.io:9092', topic = 'mar24_test_msg_key', security_protocol = 'SASL_SSL', sasl_mechanism = 'SCRAM-SHA-256', username = 'mask', password = 'mask'

Error message and/or stacktrace

Additional context

[yokofly]

In the proton single binary

this is proton-local, right?
proton-server is okay or not?

[jovezhong]

I hit the issue with proton local didn't try proton server

[yokofly]

the problem shall be proton-local it does not support external stream. same issue #411
I remember proton-local use another more slim/simple/short config, like it not support create stream.
https://pastebin.ubuntu.com/p/TFB3ZrFXgz/

[jovezhong]

I guess you can use proton local to create an external stream with PLAIN, not SCRAM-SHA-256. It seems that certain lib is missing in the binary. I will be surprised if proton local cannot be used to create normal stream. If that's the case, then proton local is too limited. Such unexpected SQL should be blocked in that mode. Or what's the use case for proton local?

[yokofly]

in the expected case: this tool is handy for local analysis, like selecting some info from a local CSV file.
but we are far from this because this is an experimental thing.

current case: create several random streams and demo how fast proton it is:)
https://www.timeplus.com/post/scary-fast