Thursday 22 June 2017

Re: Hanging builds on s390x

Hi Dmitry,

I tried to recreate and think I can.
I hopped onto a s390x LPAR got the deb-src of your ppa and ran the following:

# prep LP like sbuild environment
sudo sbuild-launchpad-chroot create -n artful-LP-s390x -a s390x -s artful
cp /usr/share/doc/sbuild/examples/example.sbuildrc /home/ubuntu/.sbuildrc
sudo sbuild-update -udcar artful-LP-s390x

# build with ppa enabled for dependencies
DEB_BUILD_OPTIONS="parallel=4" sbuild -Adartful-LP-s390x --arch=s390x --extra-repository="deb [trusted=yes] http://ppa.launchpad.net/ci-train-ppa-service/2819/ubuntu artful main" qtquickcontrols-opensource-src_5.9.0-1.dsc

Then I left it alone but it already hangs at the following for about an hour now - so I think it is the same hang you see:

PASS   : qtquickcontrols::Tests_Calendar::test_hovered()
PASS   : qtquickcontrols::Tests_Calendar::test_keyNavigation()
SKIP   : qtquickcontrols::Tests_Calendar::test_minMaxJsDateRange() QTBUG-36846
   Loc: [/<<PKGBUILDDIR>>/tests/auto/controls/data/tst_calendar.qml(180)]
PASS   : qtquickcontrols::Tests_Calendar::test_minMaxUndefined()
QWARN  : qtquickcontrols::UnknownTestFunc() file:///usr/lib/s390x-linux-gnu/qt5/qml/QtTest/TestCase.qml:1761: TypeError: Cannot call method 'indexOf' of undefined


A quick check on the environment on hanging processes or anything like that showed the following process tree [1].
This tree does not change and hangs forever, so the question is what is the following polling for?
./tst_controls -import /build/qtquickcontrols-opensource-src-rUatts/qtquickcontrols-opensource-src-5.9.0/tests/auto/controls/../testplugin

The simple minded solution of killing that hanging process helped to unlock everything - so nothing else seems to infinitely block.
This even got me a working build - here the buildlog which pretty much matches your LP builds [2].
The fact that the build completes successful after killing it feels like it is not really waiting on something important but instead should have exited on its own.

You certainly know the actual tests and code better - maybe this already helps you to debug further.
If you need more please get in touch with me on #ubuntu-devel - Nick: cpaelzer



On Wed, Jun 21, 2017 at 7:03 PM, Dmitry Shachnev <mitya57@ubuntu.com> wrote:
Hi all,

Simon Quigley and I are currently working on Qt 5.9 transition in a PPA [1].

We noticed that some of the Qt packages hang when their tests are run on
s390x. This does not happen on other architectures, and this does not happen
on Debian s390x buildds (and I cannot reproduce it on zelenka.debian.org).

Examples of hanging builds:

- https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/2819/+build/12754612
- https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/2819/+build/12758700
- https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/2819/+build/12754642
- https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/2819/+build/12784776

The last one is still running, however the build log indicates that it hanged
*after* the tests have finished, so it should not be a bug in Qt code.

Has anybody else seen such issues? If no, maybe some buildd admin can
investigate what happens there?

[1]: https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/2819

--
Dmitry Shachnev

--
ubuntu-devel mailing list
ubuntu-devel@lists.ubuntu.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel




--
Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd