Initiator CPU Target CPU
Transfer
per TPUT((KB/
second s) %system %iowait %idle %system %iowait %idle
Random Read-#threads 4,8
Command used:- /etc/executables/sio_linux 100 100 256k 0 1024m 120 "#of threads( 4/8)" /dev/sdc -d
MTU 1500-NoTOE
2823 722698 14.06 13.09 72.84 3.96 0 96.03
2717 695654 18.75 15.46 65.77 4.17 0 95.82
MTU 9000-NoTOE
2867 733859 13.53 8.07 78.37 5.28 0 94.71
2940 752706 17.11 16.21 66.66 5.89 0 94.1
MTU 1500-withTOE
4305 1102207 12.08 2.51 85.22 3.36 0 96.59
4166 1066406 15.49 13.74 70.67 3.22 0 96.77
MTU 9000-withTOE
4059 1039155 13.48 5.33 81.02 3.19 0 96.8
4574 1171032 14.69 11.42 73.78 3.61 0 96.38
Random Write-#threads=8,12,16
Command Used:- /etc/executables/sio_linux 0 100 256k 0 1024m 120 "#of threads(8,12,16)" /dev/sdc
MTU 1500-NoTOE
1526 390594 13.13 23.72 63.14 11.65 0 88.34
1548 396338 12.63 22.44 64.91 11.27 0 88.72
1545 395476 12.52 18.54 68.91 11.17 0 88.82
MTU 9000-NoTOE
2453 628087 12.77 24.25 62.95 11.44 0 88.55
2405 615602 12.69 37.31 49.96 11.36 0 88.63
2354 602703 12.65 25.44 61.89 11.21 0 88.77
MTU 1500-withTOE
4252 1088527 5.86 8.77 85.15 12.16 0 87.83
4200 1075251 5.69 10.88 83.22 12.27 0 87.72
4103 1050249 5.53 9.15 85.1 12.3 0 87.68
MTU 9000-withTOE
4236 1084395 5.87 10.02 83.9 11.94 0 88.04
4347 1112887 6.01 14.45 79.35 12.19 0 87.8
4327 1107796 5.89 15.8 78.14 12.24 0 87.74
Sequential Read-#threads=16,32
Command used:- /etc/executables/sio_linux 100 0 256k 0 1024m 120 "#of threads( 16/32)" /dev/sdc -d
MTU 1500-NoTOE
2260 578517 10.76 2.55 86.68 4.24 0 95.75
2259 578261 10.79 71.86 17.33 4.2 0 95.79
MTU 9000-NoTOE
2382 609799 10.52 2.26 87.21 3.98 0 96.01
2380 609354 10.44 69.78 19.77 3.98 0 96.01
MTU 1500-withTOE
2764 707471 7.36 5.14 87.38 1.79 0 98.2
2767 708250 7.43 5.51 86.89 1.84 0 98.15
MTU 9000-withTOE
2747 703359 7.3 5.35 87.24 1.8 0 98.19
2746 703021 7.27 31.94 60.66 1.83 0 98.16
Sequential Write- #threads=8,12,16
Command Used:- /etc/executables/sio_linux 0 0 256k 0 1024m 120 "#of threads(8,12,16)" /dev/sdc -d
MTU 1500-NoTOE
1555 398154 12.84 25.27 61.87 11.47 0 88.51
1553 397596 12.64 15.17 72.17 11.25 0 88.74
1535 392955 12.68 27.28 60.02 11.39 0 88.6
MTU 9000-NoTOE
2463 630487 12.69 19.35 67.93 11.53 0 88.46
2418 618950 12.63 28.98 58.36 11.25 0 88.74
2356 603097 12.64 27.44 59.88 11.13 0 88.86
MTU 1500-withTOE
4247 1087304 5.8 8.93 85.03 12.17 0 87.82
4202 1075788 5.68 11.09 83.01 12.27 0 87.72
4107 1051452 5.56 9.22 84.99 12.3 0 87.68
MTU 9000-withTOE
4225 1081614 5.92 9.87 83.99 11.95 0 88.04
4327 1107702 5.95 14.93 78.94 12.19 0 87.8
4319 1105603 5.89 16.01 77.91 12.25 0 87.74
The number of threads were chosen based on the values which showed maximum performance. In some cases #threads=32 s
n some cases #threads=32 showed a very high value for %iowait. Hence those values were not collected. Instead output values were colle
d. Instead output values were collected for lesser number of threads.
Random Read
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Throughp Threads=4 722698 733859 1102207
ut(KBytes/ Number of
sec) Threads=8 695654 752706 1066406
Random write
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 390594 628087 1088527
Number of
Throughp Threads=12 396338 615602 1075251
ut(KBytes/ Number of
sec) Threads=16 395476 602703 1050249
Sequential Read
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Throughp Threads=16 578517 609799 707471
ut(KBytes/ Number of
sec) Threads=32 578261 609354 708250
Sequential write
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 398154 630487 1087304
Number of
Throughp Threads=12 397596 618950 1075788
ut(KBytes/ Number of
sec) Threads=16 392955 603097 1051452
MTU 9000 - With TOE Random Read
1400000
1039155 1200000
1000000
1171032 800000
600000
400000 Throughput(KBytes/sec)
200000 Number of Threads=4
0
Throughput(KBytes/sec)
Number of Threads=8
MTU 9000 - With TOE
1084395
1112887
1107796 Random Write
1200000
1000000
800000
600000
Throughput(KBytes/sec)
MTU 9000 - With TOE 400000 Number of Threads=8
200000
Throughput(KBytes/sec)
703359 0
Number of Threads=12
Throughput(KBytes/sec)
703021 Number of Threads=16
MTU 9000 - With TOE
Sequential Read
1081614 800000
700000
1107702 600000
500000
400000
1105603 300000
200000 Throughput(KBytes/sec)
100000 Number of Threads=16
0
Throughput(KBytes/sec)
Number of Threads=32
Sequential Write
1200000
1000000
800000
600000
Throughput(KBytes/sec)
400000 Number of Threads=8
200000 Throughput(KBytes/sec)
0 Number of Threads=12
Throughput(KBytes/sec)
Number of Threads=16
roughput(KBytes/sec)
umber of Threads=4
roughput(KBytes/sec)
umber of Threads=8
hroughput(KBytes/sec)
umber of Threads=8
hroughput(KBytes/sec)
umber of Threads=12
hroughput(KBytes/sec)
umber of Threads=16
roughput(KBytes/sec)
umber of Threads=16
roughput(KBytes/sec)
umber of Threads=32
Throughput(KBytes/sec)
Number of Threads=8
Throughput(KBytes/sec)
Number of Threads=12
Throughput(KBytes/sec)
Number of Threads=16
Random Read
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=4 2823 2867 4305
Number of
IOPS(256k) Threads=8 2717 2940 4166
Random write
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 1526 2453 4252
Number of
Threads=12 1548 2405 4200
Number of
IOPS(256k) Threads=16 1545 2354 4103
Sequential Read
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=16 2260 2382 2764
Number of
IOPS(256k) Threads=32 2259 2380 2767
Sequential write
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 1555 2463 4247
Number of
Threads=12 1553 2418 4202
Number of
IOPS(256k) Threads=16 1535 2356 4107
Random Read
MTU 9000 - With TOE
5000
4500
4059 4000
3500
3000
2500
4574 2000
1500 IOPS(256k) Number of
1000 Threads=4
500
0 IOPS(256k) Number of
Threads=8
MTU 9000 - With TOE Random Write
5000
4500
4236 4000
3500
3000
4347 2500
2000 IOPS(256k) Number of
1500 Threads=8
4327 1000
500 IOPS(256k) Number of
0
Threads=12
IOPS(256k) Number of
Threads=16
Sequential Read
MTU 9000 - With TOE 3000
2500
2747 2000
1500
2746 1000
IOPS(256k) Number of
500 Threads=16
0
IOPS(256k) Number of
Threads=32
Sequential Write
MTU 9000 - With TOE 5000
4500
4000
4225 3500
3000
2500
2000 IOPS(256k) Number of
4327
1500 Threads=8
1000
4319 500 IOPS(256k) Number of
0 Threads=12
IOPS(256k) Number of
Threads=16
OPS(256k) Number of
OPS(256k) Number of
OPS(256k) Number of
OPS(256k) Number of
OPS(256k) Number of
S(256k) Number of
S(256k) Number of
OPS(256k) Number of
OPS(256k) Number of
OPS(256k) Number of
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=4 14.06 13.53 12.08
Number of
Threads=8 18.75 17.11 15.49
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 13.13 12.77 5.86
Number of
Threads=12 12.63 12.69 5.69
Number of
Threads=16 12.52 12.65 5.53
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=16 10.76 10.52 7.36
Number of
Threads=32 10.79 10.44 7.43
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 12.84 12.69 5.8
Number of
Number of
Threads=12 12.64 12.63 5.68
Threads=16 12.68 12.64 5.56
Random Read(%system)
MTU 9000 - With TOE
20
18
13.48 16
14
12
14.69 10
8
6
4 Number of Threads=4
2
0 Number of Threads=8
Random Write(%system)
MTU 9000 - With TOE 14
12
5.87 10
8
6.01 6
4 Number of Threads=8
5.89 2
Number of Threads=12
0
Number of Threads=16
Sequential Read(%system)
MTU 9000 - With TOE
12
10
7.3 8
6
7.27 4
2
Number of Threads=16
0
Number of Threads=32
0
Number of Threads=32
Sequential Write(%system)
MTU 9000 - With TOE 14
12
5.92 10
8
6
5.95 4
5.89 Number of Threads=8
2
0 Number of Threads=12
Number of Threads=16
mber of Threads=4
mber of Threads=8
umber of Threads=8
umber of Threads=12
umber of Threads=16
Number of Threads=16
Number of Threads=32
Number of Threads=32
umber of Threads=8
umber of Threads=12
umber of Threads=16
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=4 3.96 5.28 3.36
Number of
Threads=8 4.17 5.89 3.22
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 11.65 11.44 12.16
Number of
Threads=12 11.27 11.36 12.27
Number of
Threads=16 11.17 11.21 12.3
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=16 4.24 3.98 1.79
Number of
Threads=32 4.2 3.98 1.84
MTU 1500 - NoTOE MTU 9000 - NoTOE MTU 1500 - With TOE
Number of
Threads=8 11.47 11.53 12.17
Number of
Threads=12 11.25 11.25 12.27
Number of
Threads=16 11.39 11.13 12.3
Random Read(%system)
MTU 9000 - With TOE
7
6
3.19 5
4
3.61 3
2
1 Number of Threads=4
0
Number of Threads=8
Random Write(%system)
MTU 9000 - With TOE
12.4
12.2
12
11.94 11.8
11.6
11.4
12.19 11.2
11 Number of Threads=8
10.8
12.24 10.6 Number of Threads=12
Number of Threads=16
Sequential Read(%system)
MTU 9000 - With TOE 4.5
4
4.5
4
3.5
1.8 3
2.5
2
1.83 1.5
1
0.5 Number of Threads=16
0
Number of Threads=32
Sequential Write(%system)
MTU 9000 - With TOE 12.4
12.2
12
11.95 11.8
11.6
11.4
12.19 11.2
11
10.8 Number of Threads=8
10.6
12.25 10.4 Number of Threads=12
Number of Threads=16
mber of Threads=4
mber of Threads=8
umber of Threads=8
umber of Threads=12
umber of Threads=16
umber of Threads=16
umber of Threads=32
umber of Threads=8
umber of Threads=12
umber of Threads=16