Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
raid.it test suite run times. Is your test suite this fast? https://github.com/jasonroelofs/raidit
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 45678
# Running [unit] tests:
.............SS.........................................S..S............S..S..........................
Fabulous tests in 0.018752s, 5439.4198 tests/s, 6985.9215 assertions/s.
102 tests, 131 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 18995
# Running [Rails controller] tests:
...S...........
Fabulous tests in 0.082555s, 181.6971 tests/s, 339.1678 assertions/s.
15 tests, 28 assertions, 0 failures, 0 errors, 1 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
...............................................
5 scenarios (5 passed)
47 steps (47 passed)
0m0.355s
real 0m5.133s
user 0m4.469s
sys 0m0.639s
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 55869
# Running [unit] tests:
......................................................................SS.........SS.......S...S..........................
Fabulous tests in 0.029219s, 4141.1410 tests/s, 5612.7862 assertions/s.
121 tests, 164 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 64857
# Running [Rails controller] tests:
...S.................
Fabulous tests in 0.129175s, 162.5702 tests/s, 309.6574 assertions/s.
21 tests, 40 assertions, 0 failures, 0 errors, 1 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.................................................................................
9 scenarios (9 passed)
80 steps (80 passed)
0m0.698s
real 0m5.940s
user 0m5.252s
sys 0m0.670s
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 29866
# Running [unit] tests:
............................................................................................SS............SS.........SSS.S...............................
Fabulous tests in 0.044788s, 3416.0936 tests/s, 5425.5604 assertions/s.
153 tests, 243 assertions, 0 failures, 0 errors, 8 skips
Run options: --seed 34006
# Running [Rails controller] tests:
..S.....SS........................
Fabulous tests in 0.182403s, 186.4004 tests/s, 361.8362 assertions/s.
34 tests, 66 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.......................................................................................................................................................................
16 scenarios (16 passed)
164 steps (164 passed)
0m1.147s
real 0m6.562s
user 0m5.855s
sys 0m0.689s
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 4984
# Running [unit] tests:
.......................................................................................SS........S..S.....S.SSS...................................
Fabulous tests in 0.045314s, 3221.9623 tests/s, 6024.6282 assertions/s.
146 tests, 273 assertions, 0 failures, 0 errors, 8 skips
Run options: --seed 31082
# Running [Rails controller] tests:
.......S.SS.........................
Fabulous tests in 0.217528s, 165.4959 tests/s, 330.9919 assertions/s.
36 tests, 72 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
......................................................................................................................................................................................................................
17 scenarios (17 passed)
203 steps (203 passed)
0m1.342s
real 0m6.938s
user 0m6.197s
sys 0m0.722s
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 49660
# Running [unit] tests:
................................................................................S..S.............SSS.S..................................
Fabulous tests in 0.044163s, 3079.5009 tests/s, 5660.8473 assertions/s.
136 tests, 250 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 153
# Running [Rails controller] tests:
...S......S.S.................................
Fabulous tests in 0.233594s, 196.9229 tests/s, 368.1601 assertions/s.
46 tests, 86 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
...............................................................................................................................................................................................................................................................
23 scenarios (23 passed)
247 steps (247 passed)
0m1.652s
real 0m7.317s
user 0m6.478s
sys 0m0.760s
-- Note: Added bcrypt to User, only running on two tests though as it's super slow, obviously
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 12007
# Running [unit] tests:
.....................................................................................S..S.............SSS.S.......................................
Fabulous tests in 0.377766s, 386.4826 tests/s, 706.7867 assertions/s.
146 tests, 267 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 58376
# Running [Rails controller] tests:
........S..SS.........................................
Fabulous tests in 0.355249s, 152.0061 tests/s, 278.6778 assertions/s.
54 tests, 99 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
..........................................................................................................................................................................................................................................................................................................
27 scenarios (27 passed)
287 steps (287 passed)
0m2.043s
real 0m8.283s
user 0m7.481s
sys 0m0.787s
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 40153
# Running [unit] tests:
............................................................................................................S..S................SS.SS.................................................
Fabulous tests in 0.134484s, 1353.3208 tests/s, 2334.8502 assertions/s.
182 tests, 314 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 17611
# Running [Rails controller] tests:
.........S...SS............................................
Fabulous tests in 0.434064s, 135.9247 tests/s, 269.5455 assertions/s.
59 tests, 117 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --format progress
Using the default profile...
.....................................................................................................................................................................................................................................................................................................................................................................................................................
38 scenarios (38 passed)
394 steps (394 passed)
0m2.919s
real 0m9.083s
user 0m8.289s
sys 0m0.775s
-- Note: Now have 2 cucumber test suites as I've added some javascript related logic and Poltergeist for testing it, thus the rather increased test times.
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 1941
# Running [unit] tests:
....................................................................................................................S.S.................SS.SS....................................................
Fabulous tests in 0.150227s, 1284.7225 tests/s, 2289.8680 assertions/s.
193 tests, 344 assertions, 0 failures, 0 errors, 6 skips
Run options: --seed 64409
# Running [Rails controller] tests:
....S........S.S................................................
Fabulous tests in 0.575784s, 111.1528 tests/s, 236.1997 assertions/s.
64 tests, 136 assertions, 0 failures, 0 errors, 3 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress
Using the default profile...
......................................................................................................................................................................................................................................................................................................................................................................................................................................
40 scenarios (40 passed)
411 steps (411 passed)
0m3.416s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress
Using the default profile...
.......................................
4 scenarios (4 passed)
39 steps (39 passed)
0m5.556s
real 0m18.612s
user 0m14.711s
sys 0m1.630s
# The final two runs are using ActiveRecord / Postgres as the memory backend and are split up by the same @javascript tag to allow easy comparison between In Memory and Postgres.
roelofs@Trillian:~/Development/raidit (master)
] time rake
Run options: --seed 48783
# Running tests:
.........................................................................................................................................................................................................................
Fabulous tests in 0.131890s, 1645.3105 tests/s, 2926.6813 assertions/s.
217 tests, 386 assertions, 0 failures, 0 errors, 0 skips
Run options: --seed 13426
# Running [Rails Controller] tests:
.......................................................................................
Fabulous tests in 0.822315s, 105.7989 tests/s, 223.7585 assertions/s.
87 tests, 184 assertions, 0 failures, 0 errors, 0 skips
Run options: --seed 41663
# Running [Repository] tests:
...................................................................
Fabulous tests in 0.439667s, 152.3881 tests/s, 386.6563 assertions/s.
67 tests, 170 assertions, 0 failures, 0 errors, 0 skips
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
46 scenarios (46 passed)
483 steps (483 passed)
0m3.588s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
................................................................................................
8 scenarios (8 passed)
92 steps (92 passed)
0m9.085s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags ~@javascript --format progress REAL_DB=true
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
46 scenarios (46 passed)
483 steps (483 passed)
0m8.180s
/Users/roelofs/.rvm/rubies/ruby-1.9.3-p327-turbo/bin/ruby -S bundle exec cucumber features --tags @javascript --format progress REAL_DB=true
Using the default profile...
WARNING: Nokogiri was built against LibXML version 2.8.0, but has dynamically loaded 2.7.8
................................................................................................
8 scenarios (8 passed)
92 steps (92 passed)
0m9.824s
real 0m55.436s
user 0m42.902s
sys 0m5.642s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.