raid.it test suite run times. Is your test suite this fast? https://github.com/jasonroelofs/raidit

2012-06-06.txt

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 45678

# Running [unit] tests:

.............SS.........................................S..S............S..S..........................

Fabulous tests in 0.018752s, 5439.4198 tests/s, 6985.9215 assertions/s.

102 tests, 131 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 18995

# Running [Rails controller] tests:

...S...........

Fabulous tests in 0.082555s, 181.6971 tests/s, 339.1678 assertions/s.

15 tests, 28 assertions, 0 failures, 0 errors, 1 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
...............................................

5 scenarios (5 passed)
47 steps (47 passed)
0m0.355s

real	0m5.133s
user	0m4.469s
sys	0m0.639s

2012-06-16.txt

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 55869

# Running [unit] tests:

......................................................................SS.........SS.......S...S..........................

Fabulous tests in 0.029219s, 4141.1410 tests/s, 5612.7862 assertions/s.

121 tests, 164 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 64857

# Running [Rails controller] tests:

...S.................

Fabulous tests in 0.129175s, 162.5702 tests/s, 309.6574 assertions/s.

21 tests, 40 assertions, 0 failures, 0 errors, 1 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.................................................................................

9 scenarios (9 passed)
80 steps (80 passed)
0m0.698s

real	0m5.940s
user	0m5.252s
sys	0m0.670s

2012-07-03.txt

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 29866

# Running [unit] tests:

............................................................................................SS............SS.........SSS.S...............................

Fabulous tests in 0.044788s, 3416.0936 tests/s, 5425.5604 assertions/s.

153 tests, 243 assertions, 0 failures, 0 errors, 8 skips
Run options: --seed 34006

# Running [Rails controller] tests:

..S.....SS........................

Fabulous tests in 0.182403s, 186.4004 tests/s, 361.8362 assertions/s.

34 tests, 66 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.......................................................................................................................................................................

16 scenarios (16 passed)
164 steps (164 passed)
0m1.147s

real	0m6.562s
user	0m5.855s
sys	0m0.689s

2012-07-17

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 4984

# Running [unit] tests:

.......................................................................................SS........S..S.....S.SSS...................................

Fabulous tests in 0.045314s, 3221.9623 tests/s, 6024.6282 assertions/s.

146 tests, 273 assertions, 0 failures, 0 errors, 8 skips
Run options: --seed 31082

# Running [Rails controller] tests:

.......S.SS.........................

Fabulous tests in 0.217528s, 165.4959 tests/s, 330.9919 assertions/s.

36 tests, 72 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
......................................................................................................................................................................................................................

17 scenarios (17 passed)
203 steps (203 passed)
0m1.342s

real	0m6.938s
user	0m6.197s
sys	0m0.722s

2012-08-04.txt

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 49660

# Running [unit] tests:

................................................................................S..S.............SSS.S..................................

Fabulous tests in 0.044163s, 3079.5009 tests/s, 5660.8473 assertions/s.

136 tests, 250 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 153

# Running [Rails controller] tests:

...S......S.S.................................

Fabulous tests in 0.233594s, 196.9229 tests/s, 368.1601 assertions/s.

46 tests, 86 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
...............................................................................................................................................................................................................................................................

23 scenarios (23 passed)
247 steps (247 passed)
0m1.652s

real	0m7.317s
user	0m6.478s
sys	0m0.760s

2012-08-16.txt

-- Note: Added bcrypt to User, only running on two tests though as it's super slow, obviously

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 12007

# Running [unit] tests:

.....................................................................................S..S.............SSS.S.......................................

Fabulous tests in 0.377766s, 386.4826 tests/s, 706.7867 assertions/s.

146 tests, 267 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 58376

# Running [Rails controller] tests:

........S..SS.........................................

Fabulous tests in 0.355249s, 152.0061 tests/s, 278.6778 assertions/s.

54 tests, 99 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
..........................................................................................................................................................................................................................................................................................................

27 scenarios (27 passed)
287 steps (287 passed)
0m2.043s

real	0m8.283s
user	0m7.481s
sys	0m0.787s

2012-09-06.txt

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 40153

# Running [unit] tests:

............................................................................................................S..S................SS.SS.................................................

Fabulous tests in 0.134484s, 1353.3208 tests/s, 2334.8502 assertions/s.

182 tests, 314 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 17611

# Running [Rails controller] tests:

.........S...SS............................................

Fabulous tests in 0.434064s, 135.9247 tests/s, 269.5455 assertions/s.

59 tests, 117 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.....................................................................................................................................................................................................................................................................................................................................................................................................................

38 scenarios (38 passed)
394 steps (394 passed)
0m2.919s

real	0m9.083s
user	0m8.289s
sys	0m0.775s

2012-09-15.txt

-- Note: Now have 2 cucumber test suites as I've added some javascript related logic and Poltergeist for testing it, thus the rather increased test times.

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 1941

# Running [unit] tests:

....................................................................................................................S.S.................SS.SS....................................................

Fabulous tests in 0.150227s, 1284.7225 tests/s, 2289.8680 assertions/s.

193 tests, 344 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 64409

# Running [Rails controller] tests:

....S........S.S................................................

Fabulous tests in 0.575784s, 111.1528 tests/s, 236.1997 assertions/s.

64 tests, 136 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress
Using the default profile...
......................................................................................................................................................................................................................................................................................................................................................................................................................................

40 scenarios (40 passed)
411 steps (411 passed)
0m3.416s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress
Using the default profile...
.......................................

4 scenarios (4 passed)
39 steps (39 passed)
0m5.556s

real	0m18.612s
user	0m14.711s
sys	0m1.630s

2012-12-28.txt

# The final two runs are using ActiveRecord / Postgres as the memory backend and are split up by the same @javascript tag to allow easy comparison between In Memory and Postgres.

roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 48783

# Running tests:

.........................................................................................................................................................................................................................

Fabulous tests in 0.131890s, 1645.3105 tests/s, 2926.6813 assertions/s.

217 tests, 386 assertions, 0 failures, 0 errors, 0 skips
Run options: --seed 13426

# Running [Rails Controller] tests:

.......................................................................................

Fabulous tests in 0.822315s, 105.7989 tests/s, 223.7585 assertions/s.

87 tests, 184 assertions, 0 failures, 0 errors, 0 skips
Run options: --seed 41663

# Running [Repository] tests:

...................................................................

Fabulous tests in 0.439667s, 152.3881 tests/s, 386.6563 assertions/s.

67 tests, 170 assertions, 0 failures, 0 errors, 0 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

46 scenarios (46 passed)
483 steps (483 passed)
0m3.588s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
................................................................................................

8 scenarios (8 passed)
92 steps (92 passed)
0m9.085s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress REAL_DB=true
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

46 scenarios (46 passed)
483 steps (483 passed)
0m8.180s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress REAL_DB=true
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
................................................................................................

8 scenarios (8 passed)
92 steps (92 passed)
0m9.824s

real  0m55.436s
user	0m42.902s
sys	0m5.642s