Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add reader and writer to send points over sockets #3850

Open
wonder-sk opened this issue Aug 17, 2022 · 2 comments
Open

Add reader and writer to send points over sockets #3850

wonder-sk opened this issue Aug 17, 2022 · 2 comments

Comments

@wonder-sk
Copy link
Contributor

The idea is to create a reader and a writer that would pass point cloud data over sockets:

  • writer would try to connect to a specified port, serializing points to a byte stream
  • reader would start listening at a specified port, accepting any connections and decoding serialized points

This approach would enable connecting PDAL pipeline runs without a need to produce temporary files in between.

The idea is to be able to parallelize some processing on a single host, but thanks to sockets this could work also across different hosts.

@hobu
Copy link
Member

hobu commented Aug 17, 2022

serializing points to a byte stream

What does a serialized point byte stream look like? protobuf?

@wonder-sk
Copy link
Contributor Author

What does a serialized point byte stream look like? protobuf?

For the start I thought about something less fancy... The question is whether the protocol would need to be stable between PDAL versions. If not, how about just dumping content of FixedPointTable's buffer as is? (plus point layout info when connection is established) That could also save some encoding/decoding work if either side is using stream mode...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants