Ruby API Framework Benchmarks

Benchmark Notes

Sinatra 1.4.4
Rails 4.0.1
Rails-API 0.1.0

Rails-API disabled Mailer and Sockets

Each app connected to a MySQL database via ActiveRecord with an empty Accounts table; each app's root path responded with "#{Account.count} accounts detected."

Each app was configured to use Thin as its web server.

Benchmark command: siege -r 1000 -b http://localhost:3000

Rails

Transactions:		       15000 hits
Availability:		      100.00 %
Elapsed time:		       39.67 secs
Data transferred:	        0.29 MB
Response time:		        0.04 secs
Transaction rate:	      378.12 trans/sec
Throughput:		        0.01 MB/sec
Concurrency:		       14.98
Successful transactions:       15000
Failed transactions:	           0
Longest transaction:	        0.13
Shortest transaction:	        0.01

Rails-API

Transactions:		       15000 hits
Availability:		      100.00 %
Elapsed time:		       38.29 secs
Data transferred:	        0.29 MB
Response time:		        0.04 secs
Transaction rate:	      391.75 trans/sec
Throughput:		        0.01 MB/sec
Concurrency:		       14.98
Successful transactions:       15000
Failed transactions:	           0
Longest transaction:	        0.14
Shortest transaction:	        0.00

Sinatra

Transactions:		       15000 hits
Availability:		      100.00 %
Elapsed time:		       14.65 secs
Data transferred:	        0.29 MB
Response time:		        0.01 secs
Transaction rate:	     1023.89 trans/sec
Throughput:		        0.02 MB/sec
Concurrency:		       14.86
Successful transactions:       15000
Failed transactions:	           0
Longest transaction:	        0.13
Shortest transaction:	        0.00

Care to share the code or adding padrino to this test suite? :)