Skip to content

CLI tool for interleaving 2 byte stream written in Rust

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

PicoJr/damascus

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Damascus

Interleave 2 byte streams with default payload fallback when one stream is shorter than the other.

damascus stream0 stream1 default

schema

Example

with files:

echo -ne "AA" > /tmp/as
echo -ne "BBBB" > /tmp/bs
echo -ne "CC" > /tmp/default
cargo run --release /tmp/as /tmp/bs /tmp/default
# writes "AABBCCBB" to stdout

here payload size = 2 bytes

Performance

with unix named pipes:

mkfifo /tmp/fifo1
mkfifo /tmp/fifo2
head -c 1K < /dev/zero > /tmp/default
seq 10000000 > /tmp/fifo1 &
seq 10000000 > /tmp/fifo2 &

payload size = 1KB

./target/release/damascus /tmp/fifo1 /tmp/fifo2 /tmp/default | pv > /dev/null
[1]  - 37875 done       seq 10000000 > /tmp/fifo2
[2]  + 37899 done       seq 10000000 > /tmp/fifo1
 150MiB 0:00:00 [1.35GiB/s] [   <=>

CPU: AMD Ryzen 7 3700X (16) @ 3.600GHz

Note: payload size (i.e. default size) massively impacts throughput:

payload size throughput
2 bytes ~50MiB/s
32 bytes 612MiB/s
64 bytes 1018MiB/s
500 bytes 1.25GiB/s
1KB 1.35GiB/s

License

This software is distributed under the terms of both the MIT license and the Apache License (Version 2.0):

About

CLI tool for interleaving 2 byte stream written in Rust

Topics

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages