connector: fluvio-http-source, add an option to read data from a websocket

[digikata]

The http-source-connector can read data in many forms over http protocols to be produced into a fluvio cluster. But it doesn't understand websockets.

Add the option to read websockets to the connector.

Details at fluvio-community/http-source-connector#142

[pranoyk]

@digikata I would like to pick this up in case no one is working on it.

[digikata]

Hi @pranoyk, thank you for your interest in this issue. No one else is currently working on this. Feel free to give it a try. We are available for help here or at our discord

[pranoyk]

Hi @digikata, my apologies for starting late on this issue, I was pulled up at some other tasks.
I would need help running the code locally without installing the binary. I could not find any docs related to it.

[digikata]

Hi @pranoyk, no worries, thanks for taking your time to work with this project!

The http source connector project is structured in a cargo workspace so it has multiple crates in a workspace. You can build and test with cdk in the top project dir:

• cdk build -p http-source
• cdk test -p http-source --config crates/http-source/config-example.yaml

You still may need to install the dev environment as described in the fluvio connector dev docs overview.

I'll add this info a developers.md doc in the project too.

[pranoyk]

Hey @digikata, I am unable to spend an adequate amount of time on this. Hence, I won't be able to contribute to this for now. Maybe I will pick something else soon to contribute to this project.

[digikata]

closed by fluvio-community/http-source-connector#162 contributed by @avicam