From c600e3f288a4db4a5b5f6d47654f4e55e37aca54 Mon Sep 17 00:00:00 2001
From: dswd <schwerdel@informatik.uni-kl.de>
Date: Wed, 1 Jun 2016 21:49:54 +0200
Subject: [PATCH] Created Performance Measurements (markdown)

---
 Performance-Measurements.md | 84 +++++++++++++++++++++++++++++++++++++
 1 file changed, 84 insertions(+)
 create mode 100644 Performance-Measurements.md

diff --git a/Performance-Measurements.md b/Performance-Measurements.md
new file mode 100644
index 0000000..d1b6dd8
--- /dev/null
+++ b/Performance-Measurements.md
@@ -0,0 +1,84 @@
+### Test setup
+
+Sender node:
+  * Intel(R) Core(TM) i5-2540M CPU @ 2.60GHz
+  * 8 GiB Ram
+  * Intel 82579LM Gigabit Network
+  * Ubuntu 14.04 (Kernel 3.13.0-65-generic)
+
+Receiver node:
+  * Intel(R) Core(TM) i5-3450 CPU @ 3.10GHz
+  * 16 GiB Ram
+  * Realtek RTL8111/8168/8411 Gigabit Network
+  * Ubuntu 14.04 (Kernel 3.13.0-63-generic)
+
+VpnCloud version: `VpnCloud v0.5.0, protocol version 1, libsodium 1.0.10 (AES256: true)`
+
+The sender runs the following command:
+
+```
+$> ./vpncloud -t tap -l 3210 -c RECEIVER:3210 --ifup 'ifconfig $IFNAME 10.0.0.1/24 mtu 1400 up' &
+```
+
+and the receiver runs:
+
+```
+$> ./vpncloud -t tap -l 3210 -c SENDER:3210 --ifup 'ifconfig $IFNAME 10.0.0.2/24 mtu 1400 up' &
+$> iperf -s &
+$> top
+```
+
+For encrypted tests, `--shared-key test --crypto METHOD` is appended.
+
+For increased MTU tests `mtu 7000` is used in `--ifup`.
+
+### Throughput
+
+The throughput is measured with the following command:
+
+```
+$> iperf -c DST -t 30
+```
+
+The test is run in 3 steps:
+* Native throughput without VpnCloud (`DST` is the native address of the receiver)
+* Throughput via VpnCloud (`DST` is `10.0.0.2`)
+* Encrypted throughput via VpnCloud (`DST` is `10.0.0.2`)
+
+
+| Throughput test                         | Bandwidth     | CPU usage (one core) |
+| --------------------------------------- | ------------- | -------------------- |
+| Without VpnCloud                        | 923 Mbits/sec |  -                   |
+| Unencrypted VpnCloud                    | 881 Mbits/sec | 85% / 95%            |
+| Encrypted VpnCloud (ChaCha20)           | 820 Mbits/sec | 90% / 90%            |
+| Encrypted VpnCloud (AES256)             | 832 Mbits/sec | 85% / 85%            |
+| Unencrypted VpnCloud (MTU 7000)         | 942 Mbits/sec | 75% / 75%            |
+| Encrypted VpnCloud (ChaCha20, MTU 7000) | 923 Mbits/sec | 75% / 75%            |
+| Encrypted VpnCloud (AES256, MTU 7000)   | 926 Mbits/sec | 75% / 75%            |
+
+### Latency
+
+The latency is measured with the following command:
+```
+$> ping DST -c 30000 -i 0.001 -s SIZE -U -q
+```
+
+For all the test, the second best average RTT out of 5 runs is selected.
+The latency is assumed to be half of the RTT.
+
+
+| Payload size                  | 100 bytes       | 500 bytes       | 1000 bytes      |
+| ----------------------------- | --------------- | --------------- | --------------- |
+| Without VpnCloud              | 159 µs          | 167 µs          | 174 µs          |
+| Unencrypted VpnCloud          | 223 µs (+64 µs) | 233 µs (+66 µs) | 245 µs (+71 µs) |
+| Encrypted VpnCloud (ChaCha20) | 236 µs (+12 µs) | 250 µs (+17 µs) | 266 µs (+21 µs) |
+| Encrypted VpnCloud (AES256)   | 230 µs ( +7 µs) | 239 µs ( +6 µs) | 258 µs (+13 µs) |
+
+
+### Conclusion
+
+* VpnCloud achieves over 850 MBit/s with default MTU settings.
+* In encrypted mode, VpnCloud reaches over 800 MBit/s with default MTU settings.
+* With increased MTU, VpnCloud reaches over 900 Mbit/s, encrypted and unencrypted.
+* VpnCloud adds about 70µs to the latency.
+* Encryption adds an additional latency up to 20µs.