Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support parallel connections in from tcp #4084

Merged
merged 25 commits into from Apr 15, 2024
Merged

Conversation

dominiklohmann
Copy link
Member

@dominiklohmann dominiklohmann commented Apr 2, 2024

The new internal and undocumented tcp-listen <endpoint> read <format> operator accepts multiple TCP connections on the specified endpoint, and for each creates a parser of the specified format, returning the events into the pipeline.

The from operator intelligently dispatches to the tcp-listen endpoint to allow listening from accepting multiple connections in parallel, which is not possible to implement through the connector APIs alone.

@dominiklohmann dominiklohmann added feature New functionality operator Source, transformation, and sink labels Apr 2, 2024
@dominiklohmann dominiklohmann changed the title Add the accept operator Support parallel incoming connections in from tcp Apr 2, 2024
@dominiklohmann dominiklohmann changed the title Support parallel incoming connections in from tcp Support parallel connections in from tcp Apr 2, 2024
@dominiklohmann dominiklohmann marked this pull request as ready for review April 3, 2024 15:56
@tobim
Copy link
Member

tobim commented Apr 5, 2024

When someone tries to connect to a TLS socket with the wrong handshake the pipeline terminates.
I believe this should not be the case.

tenzir "from tcp://127.0.0.1:4000 --tls --certfile ss.crt --keyfile ss.crt read json"
error: wrong version number (SSL routines)
 = note: TLS handshake failed

client:

echo '{"foo":"bar"}' | socat - TCP4:127.0.0.1:4000

dominiklohmann added a commit that referenced this pull request Apr 6, 2024
With recent improvements to `from tcp` from #4084 this script is no
longer needed.
dominiklohmann added a commit that referenced this pull request Apr 6, 2024
With recent improvements to `from tcp` from #4084 this script is no
longer needed.
dominiklohmann added a commit that referenced this pull request Apr 7, 2024
With recent improvements to `from tcp` from #4084 this script is no
longer needed.
dominiklohmann added a commit that referenced this pull request Apr 7, 2024
With recent improvements to `from tcp` from #4084 this script is no
longer needed.
@dominiklohmann dominiklohmann merged commit e0a8c60 into main Apr 15, 2024
51 checks passed
@dominiklohmann dominiklohmann deleted the topic/accept-decorator branch April 15, 2024 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New functionality operator Source, transformation, and sink
Projects
None yet
3 participants