LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (http://www.linuxquestions.org/questions/linux-software-2/)
-   -   apache benchmarks (apache v13 / apache v20) ; large differences between benchmarking (http://www.linuxquestions.org/questions/linux-software-2/apache-benchmarks-apache-v13-apache-v20-%3B-large-differences-between-benchmarking-44579/)

markus1982 02-08-2003 10:53 AM

apache benchmarks (apache v13 / apache v20) ; large differences between benchmarking
 
Today I did some benchmarking on Apache v1.3.27 and Apache v2.0.44. All of those benchmarks were done on Debian 3.0-stable ... not much of I difference ... I thought, but here comes the weird stuff.

Benchmarks done with the ab of Apache v1.3.27:

Quote:

Apache v1.3.27
This is ApacheBench, Version 1.3d <$Revision: 1.67 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)


Server Software: Apache/1.3.27
Server Hostname: localhost
Server Port: 80

Document Path: /
Document Length: 1456 bytes

Concurrency Level: 1000
Time taken for tests: 10.371 seconds
Complete requests: 2000
Failed requests: 0
Broken pipe errors: 0
Total transferred: 3894996 bytes
HTML transferred: 3034304 bytes
Requests per second: 192.85 [#/sec] (mean)
Time per request: 5185.50 [ms] (mean)
Time per request: 5.19 [ms] (mean, across all concurrent requests)
Transfer rate: 375.57 [Kbytes/sec] received

Connnection Times (ms)
min mean[+/-sd] median max
Connect: 5 342 676.6 267 8074
Processing: 445 851 364.4 758 5041
Waiting: 392 851 364.5 758 5040
Total: 445 1193 827.8 1052 9174

Percentage of the requests served within a certain time (ms)
50% 1052
66% 1118
75% 1157
80% 1321
90% 1423
95% 1545
98% 2149
99% 5963
100% 9174 (last request)
Quote:

Apache v2.0.44
This is ApacheBench, Version 1.3d <$Revision: 1.67 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)


Server Software: Apache/2.0.44
Server Hostname: localhost
Server Port: 80

Document Path: /
Document Length: 1456 bytes

Concurrency Level: 1000
Time taken for tests: 5.506 seconds
Complete requests: 2000
Failed requests: 0
Broken pipe errors: 0
Total transferred: 3807495 bytes
HTML transferred: 2919280 bytes
Requests per second: 363.24 [#/sec] (mean)
Time per request: 2753.00 [ms] (mean)
Time per request: 2.75 [ms] (mean, across all concurrent requests)
Transfer rate: 691.52 [Kbytes/sec] received

Connnection Times (ms)
min mean[+/-sd] median max
Connect: 2 31 224.0 10 3042
Processing: 62 347 52.6 356 416
Waiting: 16 346 52.6 356 416
Total: 62 378 227.2 367 3393

Percentage of the requests served within a certain time (ms)
50% 367
66% 373
75% 382
80% 388
90% 393
95% 399
98% 405
99% 434
100% 3393 (last request)

Okay and now the exact same tests but with the ab of Apache v2.0.44:

Quote:

Apache v1.3.27
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.121 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)


Server Software: Apache/1.3.27
Server Hostname: localhost
Server Port: 80

Document Path: /
Document Length: 1456 bytes

Concurrency Level: 1000
Time taken for tests: 36.840408 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 3738000 bytes
HTML transferred: 2912000 bytes
Requests per second: 54.29 [#/sec] (mean)
Time per request: 18420.204 [ms] (mean)
Time per request: 18.420 [ms] (mean, across all concurrent requests)
Transfer rate: 99.08 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 16 221.6 0 2999
Processing: 105 12722 5436.8 13969 22873
Waiting: 30 8768 5414.0 7343 19634
Total: 105 12738 5438.6 13973 22877

Percentage of the requests served within a certain time (ms)
50% 13973
66% 16914
75% 17005
80% 17056
90% 17238
95% 19651
98% 22700
99% 22795
100% 22877 (longest request)
Quote:

Apache v2.0.44
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.121 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)


Server Software: Apache/2.0.44
Server Hostname: localhost
Server Port: 80

Document Path: /
Document Length: 1456 bytes

Concurrency Level: 1000
Time taken for tests: 36.863370 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 3798000 bytes
HTML transferred: 2912000 bytes
Requests per second: 54.25 [#/sec] (mean)
Time per request: 18431.684 [ms] (mean)
Time per request: 18.432 [ms] (mean, across all concurrent requests)
Transfer rate: 100.59 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 16 221.6 0 2999
Processing: 343 11661 5936.1 13019 21774
Waiting: 37 7813 5365.0 6495 18710
Total: 343 11678 5939.9 13019 21774

Percentage of the requests served within a certain time (ms)
50% 13019
66% 15945
75% 16051
80% 16067
90% 18776
95% 21750
98% 21769
99% 21771
100% 21774 (longest request)
I did not do any optimization for these two benchmarks, just configure, make and make install nothing more!



So which version should I trust ?
ab of Apache v13 or ab of Apache v20 ?


All times are GMT -5. The time now is 07:09 PM.