https://engineering.gusto.com/eliminating-flaky-ruby-tests/ It is human nature to ignore alarms when there is a history of false signals coming from a system.
- builds were needlessly retried,
- trust in our test suite was eroded, and
- frustration with our CI system grew among the team.
- Non-deterministic tests led to slower iteration velocity because we couldn’t rely on our build results, and