Feature Naming fixed to work on CIC-Dataset 2017-19

.gradle/buildOutputCleanup/cache.properties

@@ -0,0 +1,2 @@
+#Sun Dec 03 08:43:50 CST 2023
+gradle.version=4.2

build/distributions/CICFlowMeter-4.0/LICENSE.txt

@@ -0,0 +1,18 @@
+# Copyright (c) 2016 
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (CICFlowMeter), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+
+# For citation in your works and also understanding CICFlowMeter (formerly ISCXFlowMeter) completely, you can find below published papers:
+
+Arash Habibi Lashkari, Gerard Draper-Gil, Mohammad Saiful Islam Mamun and Ali A. Ghorbani, "Characterization of Tor Traffic Using Time Based Features", In the proceeding of the 3rd International Conference on Information System Security and Privacy, SCITEPRESS, Porto, Portugal, 2017
+
+Gerard Drapper Gil, Arash Habibi Lashkari, Mohammad Mamun, Ali A. Ghorbani, "Characterization of Encrypted and VPN Traffic Using Time-Related Features", In Proceedings of the 2nd International Conference on Information Systems Security and Privacy(ICISSP 2016) , pages 407-414, Rome , Italy
+
+# Contributors:
+Arash Habibi Lashkari: Researcher and Developer (Founder)
+Gerard Drapper: Researcher and Developer (Co-funder)
+muhammad saiful islam: Researcher and Developer (Co-funder)

build/distributions/CICFlowMeter-4.0/README.md

@@ -0,0 +1,94 @@
+The CICFlowMeter is an open source tool that generates Biflows from pcap files, and extracts features from these flows.
+
+CICFlowMeter is a network traffic flow generator available from here . It can be used to generate bidirectional flows, where the first packet determines the forward (source to destination) and backward (destination to source) directions, hence the statistical time-related features can be calculated separately in the forward and backward directions. Additional functionalities include, selecting features from the list of existing features, adding new features, and controlling the duration of flow timeout.
+
+NOTE: TCP flows are usually terminated upon connection teardown (by FIN packet) while UDP flows are terminated by a flow timeout. The flow timeout value can be assigned arbitrarily by the individual scheme e.g., 600 seconds for both TCP and UDP.
+
+For citation in your works and also understanding CICFlowMeter (formerly ISCXFlowMeter) completely, you can find below published papers:
+
+Arash Habibi Lashkari, Gerard Draper-Gil, Mohammad Saiful Islam Mamun and Ali A. Ghorbani, "Characterization of Tor Traffic Using Time Based Features", In the proceeding of the 3rd International Conference on Information System Security and Privacy, SCITEPRESS, Porto, Portugal, 2017
+
+Gerard Drapper Gil, Arash Habibi Lashkari, Mohammad Mamun, Ali A. Ghorbani, "Characterization of Encrypted and VPN Traffic Using Time-Related Features", In Proceedings of the 2nd International Conference on Information Systems Security and Privacy(ICISSP 2016) , pages 407-414, Rome , Italy
+
+--------------------------------------------------------------
+List of extracted features and descriptions:
+Feature Name				Description
+Flow duration			Duration of the flow in Microsecond
+total Fwd Packet		Total packets in the forward direction
+total Bwd packets		Total packets in the backward direction
+total Length of Fwd Packet	Total size of packet in forward direction
+total Length of Bwd Packet	Total size of packet in backward direction
+Fwd Packet Length Min 		Minimum size of packet in forward direction
+Fwd Packet Length Max 		Maximum size of packet in forward direction
+Fwd Packet Length Mean		Mean size of packet in forward direction
+Fwd Packet Length Std		Standard deviation size of packet in forward direction
+Bwd Packet Length Min		Minimum size of packet in backward direction
+Bwd Packet Length Max		Maximum size of packet in backward direction
+Bwd Packet Length Mean		Mean size of packet in backward direction
+Bwd Packet Length Std		Standard deviation size of packet in backward direction
+Flow Bytes/s			Number of flow bytes per second
+Flow Packets/s			Number of flow packets per second 
+Flow IAT Mean			Mean time between two packets sent in the flow
+Flow IAT Std			Standard deviation time between two packets sent in the flow
+Flow IAT Max			Maximum time between two packets sent in the flow
+Flow IAT Min			Minimum time between two packets sent in the flow
+Fwd IAT Min			Minimum time between two packets sent in the forward direction
+Fwd IAT Max			Maximum time between two packets sent in the forward direction
+Fwd IAT Mean			Mean time between two packets sent in the forward direction
+Fwd IAT Std			Standard deviation time between two packets sent in the forward direction
+Fwd IAT Total   		Total time between two packets sent in the forward direction
+Bwd IAT Min			Minimum time between two packets sent in the backward direction
+Bwd IAT Max			Maximum time between two packets sent in the backward direction
+Bwd IAT Mean			Mean time between two packets sent in the backward direction
+Bwd IAT Std			Standard deviation time between two packets sent in the backward direction
+Bwd IAT Total			Total time between two packets sent in the backward direction
+Fwd PSH flags			Number of times the PSH flag was set in packets travelling in the forward direction (0 for UDP)
+Bwd PSH Flags			Number of times the PSH flag was set in packets travelling in the backward direction (0 for UDP)
+Fwd URG Flags			Number of times the URG flag was set in packets travelling in the forward direction (0 for UDP)
+Bwd URG Flags			Number of times the URG flag was set in packets travelling in the backward direction (0 for UDP)
+Fwd Header Length		Total bytes used for headers in the forward direction
+Bwd Header Length		Total bytes used for headers in the backward direction
+FWD Packets/s			Number of forward packets per second
+Bwd Packets/s			Number of backward packets per second
+Packet Length Min 		Minimum length of a packet
+Packet Length Max		Maximum length of a packet
+Packet Length Mean 		Mean length of a packet
+Packet Length Std		Standard deviation length of a packet
+Packet Length Variance  	Variance length of a packet
+FIN Flag Count 			Number of packets with FIN
+SYN Flag Count 			Number of packets with SYN
+RST Flag Count 			Number of packets with RST
+PSH Flag Count 			Number of packets with PUSH
+ACK Flag Count 			Number of packets with ACK
+URG Flag Count 			Number of packets with URG
+CWR Flag Count 			Number of packets with CWR
+ECE Flag Count 			Number of packets with ECE
+down/Up Ratio			Download and upload ratio
+Average Packet Size 		Average size of packet
+Fwd Segment Size Avg 		Average size observed in the forward direction
+Bwd Segment Size Avg 		Average size observed in the backward direction
+Fwd Bytes/Bulk Avg		Average number of bytes bulk rate in the forward direction
+Fwd Packet/Bulk Avg		Average number of packets bulk rate in the forward direction
+Fwd Bulk Rate Avg 		Average number of bulk rate in the forward direction
+Bwd Bytes/Bulk Avg		Average number of bytes bulk rate in the backward direction
+Bwd Packet/Bulk Avg 		Average number of packets bulk rate in the backward direction
+Bwd Bulk Rate Avg		Average number of bulk rate in the backward direction
+Subflow Fwd Packets		The average number of packets in a sub flow in the forward direction
+Subflow Fwd Bytes		The average number of bytes in a sub flow in the forward direction
+Subflow Bwd Packets		The average number of packets in a sub flow in the backward direction
+Subflow Bwd Bytes		The average number of bytes in a sub flow in the backward direction
+Fwd Init Win bytes		The total number of bytes sent in initial window in the forward direction
+Bwd Init Win bytes		The total number of bytes sent in initial window in the backward direction
+Fwd Act Data Pkts		Count of packets with at least 1 byte of TCP data payload in the forward direction
+Fwd Seg Size Min		Minimum segment size observed in the forward direction
+Active Min			Minimum time a flow was active before becoming idle
+Active Mean			Mean time a flow was active before becoming idle
+Active Max			Maximum time a flow was active before becoming idle
+Active Std			Standard deviation time a flow was active before becoming idle
+Idle Min			Minimum time a flow was idle before becoming active
+Idle Mean			Mean time a flow was idle before becoming active
+Idle Max			Maximum time a flow was idle before becoming active
+Idle Std			Standard deviation time a flow was idle before becoming active
+
+--------------------------------------------------------------------------------------
+

build/distributions/CICFlowMeter-4.0/bin/CICFlowMeter

@@ -0,0 +1,172 @@
+#!/usr/bin/env sh
+
+##############################################################################
+##
+##  CICFlowMeter start up script for UN*X
+##
+##############################################################################
+
+# Attempt to set APP_HOME
+# Resolve links: $0 may be a link
+PRG="$0"
+# Need this for relative symlinks.
+while [ -h "$PRG" ] ; do
+    ls=`ls -ld "$PRG"`
+    link=`expr "$ls" : '.*-> \(.*\)$'`
+    if expr "$link" : '/.*' > /dev/null; then
+        PRG="$link"
+    else
+        PRG=`dirname "$PRG"`"/$link"
+    fi
+done
+SAVED="`pwd`"
+cd "`dirname \"$PRG\"`/.." >/dev/null
+APP_HOME="`pwd -P`"
+cd "$SAVED" >/dev/null
+
+APP_NAME="CICFlowMeter"
+APP_BASE_NAME=`basename "$0"`
+
+# Add default JVM options here. You can also use JAVA_OPTS and CIC_FLOW_METER_OPTS to pass JVM options to this script.
+DEFAULT_JVM_OPTS='"-Djava.library.path=../lib/native"'
+
+# Use the maximum available, or set MAX_FD != -1 to use that value.
+MAX_FD="maximum"
+
+warn () {
+    echo "$*"
+}
+
+die () {
+    echo
+    echo "$*"
+    echo
+    exit 1
+}
+
+# OS specific support (must be 'true' or 'false').
+cygwin=false
+msys=false
+darwin=false
+nonstop=false
+case "`uname`" in
+  CYGWIN* )
+    cygwin=true
+    ;;
+  Darwin* )
+    darwin=true
+    ;;
+  MINGW* )
+    msys=true
+    ;;
+  NONSTOP* )
+    nonstop=true
+    ;;
+esac
+
+CLASSPATH=$APP_HOME/lib/CICFlowMeter-4.0.jar:$APP_HOME/lib/log4j-core-2.11.0.jar:$APP_HOME/lib/slf4j-log4j12-1.7.25.jar:$APP_HOME/lib/jnetpcap-1.4.1.jar:$APP_HOME/lib/junit-4.12.jar:$APP_HOME/lib/commons-lang3-3.6.jar:$APP_HOME/lib/commons-math3-3.5.jar:$APP_HOME/lib/commons-io-2.5.jar:$APP_HOME/lib/weka-stable-3.6.14.jar:$APP_HOME/lib/jfreechart-1.5.0.jar:$APP_HOME/lib/guava-23.6-jre.jar:$APP_HOME/lib/tika-core-1.17.jar:$APP_HOME/lib/log4j-api-2.11.0.jar:$APP_HOME/lib/slf4j-api-1.7.25.jar:$APP_HOME/lib/log4j-1.2.17.jar:$APP_HOME/lib/hamcrest-core-1.3.jar:$APP_HOME/lib/java-cup-0.11a.jar:$APP_HOME/lib/jsr305-1.3.9.jar:$APP_HOME/lib/checker-compat-qual-2.0.0.jar:$APP_HOME/lib/error_prone_annotations-2.1.3.jar:$APP_HOME/lib/j2objc-annotations-1.1.jar:$APP_HOME/lib/animal-sniffer-annotations-1.14.jar
+
+# Determine the Java command to use to start the JVM.
+if [ -n "$JAVA_HOME" ] ; then
+    if [ -x "$JAVA_HOME/jre/sh/java" ] ; then
+        # IBM's JDK on AIX uses strange locations for the executables
+        JAVACMD="$JAVA_HOME/jre/sh/java"
+    else
+        JAVACMD="$JAVA_HOME/bin/java"
+    fi
+    if [ ! -x "$JAVACMD" ] ; then
+        die "ERROR: JAVA_HOME is set to an invalid directory: $JAVA_HOME
+
+Please set the JAVA_HOME variable in your environment to match the
+location of your Java installation."
+    fi
+else
+    JAVACMD="java"
+    which java >/dev/null 2>&1 || die "ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH.
+
+Please set the JAVA_HOME variable in your environment to match the
+location of your Java installation."
+fi
+
+# Increase the maximum file descriptors if we can.
+if [ "$cygwin" = "false" -a "$darwin" = "false" -a "$nonstop" = "false" ] ; then
+    MAX_FD_LIMIT=`ulimit -H -n`
+    if [ $? -eq 0 ] ; then
+        if [ "$MAX_FD" = "maximum" -o "$MAX_FD" = "max" ] ; then
+            MAX_FD="$MAX_FD_LIMIT"
+        fi
+        ulimit -n $MAX_FD
+        if [ $? -ne 0 ] ; then
+            warn "Could not set maximum file descriptor limit: $MAX_FD"
+        fi
+    else
+        warn "Could not query maximum file descriptor limit: $MAX_FD_LIMIT"
+    fi
+fi
+
+# For Darwin, add options to specify how the application appears in the dock
+if $darwin; then
+    GRADLE_OPTS="$GRADLE_OPTS \"-Xdock:name=$APP_NAME\" \"-Xdock:icon=$APP_HOME/media/gradle.icns\""
+fi
+
+# For Cygwin, switch paths to Windows format before running java
+if $cygwin ; then
+    APP_HOME=`cygpath --path --mixed "$APP_HOME"`
+    CLASSPATH=`cygpath --path --mixed "$CLASSPATH"`
+    JAVACMD=`cygpath --unix "$JAVACMD"`
+
+    # We build the pattern for arguments to be converted via cygpath
+    ROOTDIRSRAW=`find -L / -maxdepth 1 -mindepth 1 -type d 2>/dev/null`
+    SEP=""
+    for dir in $ROOTDIRSRAW ; do
+        ROOTDIRS="$ROOTDIRS$SEP$dir"
+        SEP="|"
+    done
+    OURCYGPATTERN="(^($ROOTDIRS))"
+    # Add a user-defined pattern to the cygpath arguments
+    if [ "$GRADLE_CYGPATTERN" != "" ] ; then
+        OURCYGPATTERN="$OURCYGPATTERN|($GRADLE_CYGPATTERN)"
+    fi
+    # Now convert the arguments - kludge to limit ourselves to /bin/sh
+    i=0
+    for arg in "$@" ; do
+        CHECK=`echo "$arg"|egrep -c "$OURCYGPATTERN" -`
+        CHECK2=`echo "$arg"|egrep -c "^-"`                                 ### Determine if an option
+
+        if [ $CHECK -ne 0 ] && [ $CHECK2 -eq 0 ] ; then                    ### Added a condition
+            eval `echo args$i`=`cygpath --path --ignore --mixed "$arg"`
+        else
+            eval `echo args$i`="\"$arg\""
+        fi
+        i=$((i+1))
+    done
+    case $i in
+        (0) set -- ;;
+        (1) set -- "$args0" ;;
+        (2) set -- "$args0" "$args1" ;;
+        (3) set -- "$args0" "$args1" "$args2" ;;
+        (4) set -- "$args0" "$args1" "$args2" "$args3" ;;
+        (5) set -- "$args0" "$args1" "$args2" "$args3" "$args4" ;;
+        (6) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" ;;
+        (7) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" ;;
+        (8) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" ;;
+        (9) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" "$args8" ;;
+    esac
+fi
+
+# Escape application args
+save () {
+    for i do printf %s\\n "$i" | sed "s/'/'\\\\''/g;1s/^/'/;\$s/\$/' \\\\/" ; done
+    echo " "
+}
+APP_ARGS=$(save "$@")
+
+# Collect all arguments for the java command, following the shell quoting and substitution rules
+eval set -- $DEFAULT_JVM_OPTS $JAVA_OPTS $CIC_FLOW_METER_OPTS -classpath "\"$CLASSPATH\"" cic.cs.unb.ca.ifm.App "$APP_ARGS"
+
+# by default we should be in the correct project dir, but when run from Finder on Mac, the cwd is wrong
+if [ "$(uname)" = "Darwin" ] && [ "$HOME" = "$PWD" ]; then
+  cd "$(dirname "$0")"
+fi
+
+exec "$JAVACMD" "$@"