Reliable Data Transfer over UDP

To run the code, obtain the data, and plot the running times, we used the following workflow after configuring RETRANSMISSION_TIMEOUT, WINDOW_SIZE, DATA_PAYLOAD_SIZE variables inside of constants.py file (current default values work fine for benchmark evaluation - no netem rules):

docker compose up -d

docker exec -it client bash
docker exec -it server bash

# in server container
cd objects
./generateobjects.sh
cd ../../app

# in client container
cd ../app

# run below 2 commands 30 times to collect tcp data
python3 tcp/main_tcp_server.py # in server container
(time python3 tcp/main_tcp_client.py) 2>> benchmark.txt # in client container

# run below 2 commands 30 times to collect rdt over udp data
python3 rdt_over_udp/main_rdt_over_udp_client.py # in client container
(time python3 rdt_over_udp/main_rdt_over_udp_server.py) 2>> benchmark.txt # in server container

cat code/benchmark.txt | awk '$1 == "real" { gsub(/0m/,"",$2); gsub(/[s]/,"",$2); print $2 }' | python3 plots.py # on host machine

code/tcp folder contains the tcp client and tcp server implementations.

code/tcp/constants.py defines the necessary constant variables for the tcp server and tcp client, and can be configured here. Such as server host and port numbers, number of files, and data payload size.

code/tcp/tcp_client.py defines the tcp client and its operations.

code/tcp/tcp_server.py defines the tcp server and its operations.

code/tcp/main_tcp_client.py is the main entrypoint of the tcp client and can be started using this file.

code/tcp/main_tcp_server.py is the main entrypoint of the tcp server and can be started using this file.

code/rdt_over_udp folder contains the rdt over udp client and rdt over udp server implementations and relevant helper files

code/rdt_over_udp/constants.py defines the necessary constant variables for the rdt over udp server and rdt over udp client, and can be configured here. Such as server host and port numbers, number of files, data payload size, sliding window size, and retransmission timeout threshold.

code/rdt_over_udp/rdt_over_udp_client.py defines the rdt over udp client and its finite state machine.

code/rdt_over_udp/rdt_over_udp_server.py defines the rdt over udp server and its finite state machine.

code/rdt_over_udp/main_rdt_over_udp_client.py is the main entrypoint of the rdt over udp client and can be started using this file.

code/rdt_over_udp/main_rdt_over_udp_server.py is the main entrypoint of the rdt over udp server and can be started using this file.

code/rdt_over_udp/package.py defines the package structure. It is explained further in our report.

code/rdt_over_udp/package_operations.py defines the operations applicable on a package object. It is explained further in our report.

code/run_*.sh files are bash scripts to run tcp and rdt over udp clients and servers 30 times for our experiments.

code/plots.py file is a python script to plot the time/frequency graph of running times of our tcp and rdt over udp implementations.

Install docker (and optionally compose V2 plugin - not the docker-compose!) and VSCode on your system. Run the docker containers as non-root users...

Common installation steps

Go to your favorite development folder on your local machine and run

   git clone https://github.com/cengwins/ceng435.git

Open this folder (ceng435) in VSCode

Open a terminal in VSCode, under the ceng435 directory where the Dockerfile resides run

   docker build -t ceng435 .

After the image is built you can directly run your containers or use docker compose pluging to run them:

RUN containers directly

You can run the following to get the server machine

   docker run -t -i --rm --privileged --cap-add=NET_ADMIN --name ceng435server -v ./code:/app:rw ceng435:latest bash

and the following for the client machine

   docker run -t -i --rm --privileged --cap-add=NET_ADMIN --name ceng435client -v ./code:/app:rw ceng435:latest bash

and you will be in your Ubuntu 22.04 Docker instance (python installed). Note that if you develop code in these Docker instances, if you stop the machine your code will be lost. That is why I recommend you to use Github to store your code and clone in the machine, and push your code to Github before shutting the Docker instances down. The other option is to work in the /app folder in your Docker instance is mounted to the "code" directory of your own machine.

IMPORTANT Note that the "code" folder on your local machine is mounted to the "/app" folder in the Docker instance (read/write mode). You can use these folders (they are the same in fact) to develop your code. Other than the /app folder, this tool does not guarantee any persistent storage: if you exit the Docker instance, all data will be lost.

After running the Ubuntu Docker, you can type "ip addr" to see your network configuration. Work on eth0.

Docker extension of vscode will be of great benefit to you.

In the server terminal, move to the "objects" folder and run

   ./generateobjects

to generate 10 small (10K) and 10 large (10M) objects together with their md5 checksums.

Some tc commands that may be of help to you can be found at https://man7.org/linux/man-pages/man8/tc-netem.8.html and https://www.cs.unm.edu/~crandall/netsfall13/TCtutorial.pdf

You will analyze the impact of delay, packet loss percentage, corrupt packet percentage, duplicate percentage, reorder percentage on the total time to download all 20 objects. You will plot figures for each parameter (delay, loss, ...) where the x-axis of the figure will have various values for these parameters and the y-axis will be the total time to download 20 objects. There will be two curves in each figure, one for TCP and the other curve for your UDP-based RDT implementation together with interleaving technique.

RUN containers using docker compose plugin

To start server and client containers:

docker compose up -d

To stop server and client containers:

docker compose down

Note that, if you orchestrate your containers using docker compose, the containers will have hostnames ("client" and "server") and DNS will be able to resolve them...

In one terminal, attach to the server container

docker exec -it server bash

In another terminal, attach to the client container

docker exec -it client bash

The local "code" folder is mapped to the "/app" folder in containers and the local "examples" folder is mapped to the "/examples" folder in the container. You can develop your code on your local folders on your own host machine, they will be immediately synchronized with the "/app" folder on containers. The volumes are created in read-write mode, so changes can be made both on the host or on the containers. You can run your code on the containers...

ogul1/reliable-data-transfer-over-udp

ErrorLooks like something went wrong!

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Languages

Error
Looks like something went wrong!

Packages