Skip to content

Efficent Transmission of Large Data

Past due by about 9 years 0% complete

Currently the serialization code inside of Remus creates numerous temporary strings, and does more copies than required. Combine this with no support of transmitting existing data files, without requiring the user to read the files, and we don't have support for really large data.

The goal is to be able to easily transmit large chunks of data, be it from …

Currently the serialization code inside of Remus creates numerous temporary strings, and does more copies than required. Combine this with no support of transmitting existing data files, without requiring the user to read the files, and we don't have support for really large data.

The goal is to be able to easily transmit large chunks of data, be it from already existing memory, or from a given file. If possible Remus will compress the data for wire transmission, decompressing on the worker without the user ever knowing. In the case of transmitting files, we will only read and send the data of files when the worker / server are on a remote machine.