> Could we build a retriggerbot that smashes the retry button three times
> before bothering any humans about failed tests?
>
> Hitting retry is often the first troubleshooting step people take; I've
> heard tests may be retried something like ten times by different people,
> each of whom was taking a reasonable enough "first debugging step"
> without noticing that other people have also done the same.
Not an Ubuntu developer but I do work as a quality manager. Not sure
whether my list post will be accepted, so I'm copying you.
The assumption underlying your suggestion is that tests that
intermittently fail do so because of intermittent failures in the test
environment rather than due to actual bugs that manifest themselves only
intermittently (such as race conditions).
This is fine if you have evidence that the assumption holds in a
sufficiently large majority of cases.
HTH, Jan
--
ubuntu-devel mailing list
ubuntu-devel@lists.ubuntu.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
