Sunday 15 May 2022

Re: autopkgtest missed regression for kinetic

On Sun, May 15, 2022 at 12:57:34PM -0700, Steve Langasek wrote:
> This is because the test failure is not a regression.

> * autopkgtest for devhelp/41.2-2: amd64: Not a regression, arm64: Not a regression, armhf: Test in progress, ppc64el: Not a regression, s390x: Not a regression

> The test has never passed; it has had neutral results and failing results,
> but by policy, proposed-migration does not treat neutral->fail as a
> migration-blocking regression, only pass->fail. Neutral test results are
> informational only.

Having said this, I am just this moment looking at cases where britney is
treating neutral->fail as a regression. I still believe the intended policy
is as I described, but one way or another there appear to be some bugs here
in the implementation ;)

--
Steve Langasek Give me a lever long enough and a Free OS
Debian Developer to set it on, and I can move the world.
Ubuntu Developer https://www.debian.org/
slangasek@ubuntu.com vorlon@debian.org