Skip to content

Instantly share code, notes, and snippets.

@jaredhirsch
Created December 20, 2012 18:56
Show Gist options
  • Save jaredhirsch/4347710 to your computer and use it in GitHub Desktop.
Save jaredhirsch/4347710 to your computer and use it in GitHub Desktop.
10 runs, all platforms, implicit waits **re-enabled**
win/chrome: 9/10 success
1 mysterious health-check failure
#4:
health-check: mysterious failure similar to IE failures.
https://saucelabs.com/tests/7738aee799934079ae4ee20202a5a383#
-- I really think we need to get rid of that checking body for a class stuff.
win/ff: 8/10 success
3 personatestuser outage (irrelevant to wait-related stability)
1 stale element reference error
#7:
sign-in, change-password, add-pri-to-sec: failed due to personatestuser outage
awesome: we didn't bother spinning up a browser VM, just croaked right off the bat.
#3:
cancel-account: stale element reference error. this is likely due to using implicit waits.
https://saucelabs.com/tests/934ba366a5194d2eb222c196e923ed64#
win/ie9: 6/10 success. 1 of those was infrastructure, though.
2 missed click
2 mysterious health-check failure
1 personatestuser fail (irrelevant)
1 possible sauce error (irrelevant--very odd error message in raw log)
#86:
returning-user: missed click on persona button
https://saucelabs.com/tests/eeeebf902b044fb18512a20b6f146bab#
#83:
change-password: uncaught wd bug, didn't cause failures though
health-check: mystery fail again
https://saucelabs.com/tests/272bd2d571f449b6a943b56f71232c29#
sign-in: personatestuser fail
#79
change-password: possible sauce error?
https://saucelabs.com/tests/1a8d3c6536ee4844854fdee9194766e6#
#78
health-check: mystery failure
https://saucelabs.com/tests/aa103b7c17cb4b78bed69a4f4df0e794
new-user-primary: missed click on 'sign in with eyedeeme' button
https://saucelabs.com/tests/ed4a29a38bb44cbabc37458d473ee899
win/ie8: 0/10 success rate. As with no-implicit-waits case, these are remarkably consistent.
3 we are very sorry
2 dialog hangs after creating eyedeemee account
#10
new-user-primary-test.js.5: we are very sorry
https://saucelabs.com/tests/10e468c6608f4a5ea132babc4e857b53
add-primary-to-secondary.js.8: we are very sorry
https://saucelabs.com/tests/5c1ae30cdc56428f8c76675084a43faa
add-primary-to-primary.js.3: we are very sorry
https://saucelabs.com/tests/ebd24a82185445048adf6e06f3faf390
health-check-tests.js.12: eyedeeme account created, dialog hung with white screen. that's a new bug.
https://saucelabs.com/tests/a713672e220446acbe09ade0646aae39
returning-user.js.3: eyedeeme account created, dialog hung with white screen. that's a new bug.
https://saucelabs.com/tests/efadb8ab72954c7aa3b68d0b5b27f637
#9
new-user-primary-test.js.5: we are very sorry
https://saucelabs.com/tests/162c0cd26d5a4bc1be96bbc725b2260e
add-primary-to-secondary.js.8: we are very sorry
https://saucelabs.com/tests/14238959cade41a6bd221bd006c36375
add-primary-to-primary.js.3: we are very sorry
https://saucelabs.com/tests/2ec57db2a8fd4fcb80115241db8e4d40
health-check-tests.js.12: dialog hung
https://saucelabs.com/tests/9c2bb79a41ba4e64845d62463b549fd3
returning-user.js.3: dialog hung
https://saucelabs.com/tests/04f01fce0e97404db70659c54a38f076
** NOTE - These first 2 look exactly like the marvelously consistent
** 10 failures with implicit waits disabled. I'm not going to
** spend the time to double-check, but will assume uniform
** causes of failure.
#8
change-password-test.js.5: sign in using our personatestuser: succeeds
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#7
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#6
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#5
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#4
add-primary-to-secondary.js.1: setup all the things: succeeds
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#3
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#2
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
#1
add-primary-to-primary.js.3: signup a new account with a primary: succeeds
add-primary-to-secondary.js.8: add a primary email to the account: succeeds
health-check-tests.js.12: switch back to main window, look for the email in acct mgr, then log out: succeeds
new-user-primary-test.js.5: switch back to main window and verify we're logged in: succeeds
returning-user.js.3: startup, create primary acct on personaorg: succeeds
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment