This is the mail archive of the
libc-alpha@sourceware.org
mailing list for the glibc project.
RISC-V test results
- From: "Maciej W. Rozycki" <macro at wdc dot com>
- To: libc-alpha at sourceware dot org
- Cc: Alistair Francis <alistair dot francis at wdc dot com>
- Date: Thu, 1 Aug 2019 00:01:35 +0100 (BST)
- Subject: RISC-V test results
- Ironport-sdr: QElyyKqqba36FC955XESvf+Wu/4dqTA3IkEcKbQzxNu3OZNBUuVw3J7kEyc9ubZqK/rUuLfbUZ AIVBQC/5sfXtpIm4YRUa55NOh/EO/qlJL541EpfpiU7mu7+a0g5UgCyb1AvSIxYgPPSyryk7d/ 4HfQERAsvYq6k48esNXRXlSzP7WJ6ACYSUpPMA/YWfiaOcHcHbQhckBQR7iYLuNNh6t6eJTs+C 1kgVDBsILJWJu40g0rLugU9K5nABN+9CChF3XKn2EkwlcWQAOAYxQCp2cYSR7C4upW2QNt+EBR pjs=
- Ironport-sdr: tVvLw5uTdhqgBs5djQoQLe6h7xcOEgR692bVuGeInF++BGn6tFsU7uXQHKy8TOC7RaA47FE6UL cuk/jHBjTtmmrkWQHTH/4dprgZBlhYz6nMElFTcV823EFeJxCgd+3Z4czphopozB1la2sgB6b5 /jpfgHo0k/vNxRWk6TBFnbFk+1PO1ONGE8PXfZZkcSVxCRnwhC0uF2HombpOoDD6EeLkQ7ALXu BDmo2WikWS7JmnKiT24AObh9Xlhse2nnuWjw1QcuK1nB9dpNd2lJ7Uj/lmJ6gxqdfnTXiTesjx ss3nCpfK7PskkUf36HH0WrNd
- Ironport-sdr: AjYokrxnYkxPiqkpr4VWiWmBCgYXoFVXF7dYg7WJPHKNcl48RbLmNI0vuNzFbE5E47VVabZQew X3SveBVSX0jlMBJ8aYscdlb47D5RpIEkgXvJv8ejcS/X/RUtkY7VlPoQN7TRlxsm6yvKXj+mpU 88bbsS6WaHgxU4MEBinxHPrCEsk8AG3I06gf0c1NRZqGHMBoWabCL0JkWqWm9+O62g0MYAgp3p liTu/8+9MvR7p2HSqUwo8pBe5cm/9OfmewOG02mr1zBpPboUV1iUvQkkYElGtii1i77tPohoNd yYk=
Hi,
I saw no RISC-V test results published for glibc 2.30, so I have spent
some time to see how we perform. These were obtained for lp64 and lp64d
multilibs with a cross-compilation environment using GCC version 10.0.0
20190618, GNU Binutils version 2.32.51.20190618, Linux version
5.2.0-rc1unleashed-00006-g5bc63aefde9a and a HiFive Unleashed board
(rv64imafdc CPU) accessing the glibc source and build tree from the build
system over NFS.
I had to bump up the timeout factor to avoid excessive timeouts and
experimented with that. Consequently the lp64 and lp64d multilib tests
were run with the factor of 10 and 20 respectively. Still a couple of
tests timed out:
FAIL: nptl/tst-stack4
FAIL: resolv/tst-resolv-res_ninit
(nptl/tst-stack4 crashed instead for lp64). When run standalone these
tests eventually succeed, requiring short of 8 hours and 25 minutes each,
which I believe is due to synchronous NFS inefficiency, and which implies
a timeout factor of at least ~300 to guarantee completion (timeout is 100
for nptl/tst-stack4). I will use that next time; these testsuite runs
took over 9 hours to complete each anyway, so doubling the time should not
be a big deal.
For some reason I haven't established yet lp64 results are significantly
worse than lp64d ones, which in turn are similar to these previously
obtained for 2.29. I have noticed that out of 140 lp64 FAILs 90 are due
to SIGABRT having been raised, including said nptl/tst-stack4. I'm still
investigating the cause, which is likely outside glibc as I can see there
have been results posted now and they are fine for lp64.
Also these aborts caused the nptl/tst-cancel7 and nptl/tst-cancelx7 test
cases to hang, requiring a manual intervention for testing to proceed, as
one of the child threads remained behind as the parent thread aborted and
prevented the remotely started command from completing. I think this has
to be addressed somehow and it prevents testing from running unattended.
Maybe another timeout has to be defined and enforced for the build system
in `cross-test-ssh.sh'.
For the record my actual results are as follows:
rv64imafdc/lp64:
UNSUPPORTED: assert/tst-assert-c++
UNSUPPORTED: assert/tst-assert-g++
FAIL: debug/tst-backtrace2
FAIL: debug/tst-backtrace3
FAIL: debug/tst-backtrace4
FAIL: debug/tst-backtrace5
FAIL: debug/tst-backtrace6
UNSUPPORTED: debug/tst-chk4
UNSUPPORTED: debug/tst-chk5
UNSUPPORTED: debug/tst-chk6
UNSUPPORTED: debug/tst-lfschk4
UNSUPPORTED: debug/tst-lfschk5
UNSUPPORTED: debug/tst-lfschk6
UNSUPPORTED: dlfcn/bug-atexit3
FAIL: elf/tst-rtld-preload
FAIL: elf/tst-tls12
FAIL: elf/tst-unwind-main
FAIL: iconv/tst-iconv-mt
FAIL: inet/tst-idna_name_classify
FAIL: io/ftwtest
FAIL: libio/tst-wfile-sync
FAIL: locale/tst-locale-locpath
FAIL: localedata/tst-langinfo-newlocale
FAIL: malloc/tst-malloc-stats-cancellation
FAIL: malloc/tst-malloc-usable-tunables
UNSUPPORTED: malloc/tst-mallocstate
UNSUPPORTED: math/test-fesetexcept-traps
UNSUPPORTED: math/test-fexcept-traps
UNSUPPORTED: math/test-matherr
UNSUPPORTED: math/test-matherr-2
UNSUPPORTED: math/test-nearbyint-except
UNSUPPORTED: math/test-nearbyint-except-2
FAIL: misc/tst-gettid-kill
UNSUPPORTED: misc/tst-pkey
UNSUPPORTED: nptl/test-cond-printers
UNSUPPORTED: nptl/test-condattr-printers
UNSUPPORTED: nptl/test-mutex-printers
UNSUPPORTED: nptl/test-mutexattr-printers
UNSUPPORTED: nptl/test-rwlock-printers
UNSUPPORTED: nptl/test-rwlockattr-printers
FAIL: nptl/tst-basic3
FAIL: nptl/tst-basic4
FAIL: nptl/tst-call-once
FAIL: nptl/tst-cancel-self
FAIL: nptl/tst-cancel-self-cancelstate
FAIL: nptl/tst-cancel-self-canceltype
FAIL: nptl/tst-cancel-self-testcancel
FAIL: nptl/tst-cancel1
FAIL: nptl/tst-cancel10
FAIL: nptl/tst-cancel11
FAIL: nptl/tst-cancel12
FAIL: nptl/tst-cancel13
FAIL: nptl/tst-cancel14
FAIL: nptl/tst-cancel15
FAIL: nptl/tst-cancel16
FAIL: nptl/tst-cancel17
FAIL: nptl/tst-cancel18
FAIL: nptl/tst-cancel2
FAIL: nptl/tst-cancel20
FAIL: nptl/tst-cancel21
FAIL: nptl/tst-cancel22
FAIL: nptl/tst-cancel23
UNSUPPORTED: nptl/tst-cancel24
UNSUPPORTED: nptl/tst-cancel24-static
FAIL: nptl/tst-cancel25
FAIL: nptl/tst-cancel3
FAIL: nptl/tst-cancel4
FAIL: nptl/tst-cancel4_1
FAIL: nptl/tst-cancel4_2
FAIL: nptl/tst-cancel5
FAIL: nptl/tst-cancel6
FAIL: nptl/tst-cancel7
FAIL: nptl/tst-cancel8
FAIL: nptl/tst-cancel9
FAIL: nptl/tst-cancelx10
FAIL: nptl/tst-cancelx11
FAIL: nptl/tst-cancelx12
FAIL: nptl/tst-cancelx13
FAIL: nptl/tst-cancelx14
FAIL: nptl/tst-cancelx15
FAIL: nptl/tst-cancelx16
FAIL: nptl/tst-cancelx17
FAIL: nptl/tst-cancelx18
FAIL: nptl/tst-cancelx2
FAIL: nptl/tst-cancelx20
FAIL: nptl/tst-cancelx21
FAIL: nptl/tst-cancelx3
FAIL: nptl/tst-cancelx4
FAIL: nptl/tst-cancelx5
FAIL: nptl/tst-cancelx6
FAIL: nptl/tst-cancelx7
FAIL: nptl/tst-cancelx8
FAIL: nptl/tst-cancelx9
FAIL: nptl/tst-cleanup0
FAIL: nptl/tst-cleanup0-cmp
FAIL: nptl/tst-cleanup1
FAIL: nptl/tst-cleanup3
FAIL: nptl/tst-cleanup4
FAIL: nptl/tst-cleanupx0
FAIL: nptl/tst-cleanupx1
FAIL: nptl/tst-cleanupx3
FAIL: nptl/tst-cleanupx4
FAIL: nptl/tst-cnd-basic
FAIL: nptl/tst-cnd-broadcast
FAIL: nptl/tst-cnd-timedwait
FAIL: nptl/tst-cond-except
FAIL: nptl/tst-cond22
FAIL: nptl/tst-cond25
FAIL: nptl/tst-cond7
FAIL: nptl/tst-cond8
FAIL: nptl/tst-exec5
FAIL: nptl/tst-execstack
FAIL: nptl/tst-exit2
FAIL: nptl/tst-exit3
FAIL: nptl/tst-fini1
FAIL: nptl/tst-join1
FAIL: nptl/tst-join5
FAIL: nptl/tst-join6
FAIL: nptl/tst-join8
FAIL: nptl/tst-join9
FAIL: nptl/tst-key3
FAIL: nptl/tst-minstack-cancel
FAIL: nptl/tst-minstack-exit
UNSUPPORTED: nptl/tst-minstack-throw
FAIL: nptl/tst-mtx-basic
FAIL: nptl/tst-mtx-timedlock
FAIL: nptl/tst-mtx-trylock
FAIL: nptl/tst-mutex8
FAIL: nptl/tst-mutexpi8
FAIL: nptl/tst-once3
FAIL: nptl/tst-once4
UNSUPPORTED: nptl/tst-once5
FAIL: nptl/tst-oncex3
FAIL: nptl/tst-oncex4
FAIL: nptl/tst-robust1
FAIL: nptl/tst-robust2
FAIL: nptl/tst-robust3
FAIL: nptl/tst-robust4
FAIL: nptl/tst-robust5
FAIL: nptl/tst-robust6
FAIL: nptl/tst-robust7
FAIL: nptl/tst-robustpi1
FAIL: nptl/tst-robustpi2
FAIL: nptl/tst-robustpi3
FAIL: nptl/tst-robustpi4
FAIL: nptl/tst-robustpi5
FAIL: nptl/tst-robustpi6
FAIL: nptl/tst-robustpi7
FAIL: nptl/tst-sem11
FAIL: nptl/tst-sem12
FAIL: nptl/tst-sem16
FAIL: nptl/tst-stack4
FAIL: nptl/tst-thrd-detach
FAIL: nptl/tst-thrd-sleep
UNSUPPORTED: nptl/tst-thread-exit-clobber
UNSUPPORTED: nptl/tst-thread_local1
FAIL: nptl/tst-tsd5
FAIL: nptl/tst-tss-basic
FAIL: nptl/tst-unwind-thread
FAIL: nss/tst-cancel-getpwuid_r
FAIL: posix/tst-getopt-cancel
UNSUPPORTED: posix/tst-glob_lstat_compat
UNSUPPORTED: posix/tst-spawn4-compat
FAIL: resolv/mtrace-tst-resolv-res_ninit
UNSUPPORTED: resolv/tst-p_secstodate
UNSUPPORTED: resolv/tst-resolv-ai_idn
UNSUPPORTED: resolv/tst-resolv-ai_idn-latin1
FAIL: resolv/tst-resolv-res_init
FAIL: resolv/tst-resolv-res_init-thread
FAIL: resolv/tst-resolv-res_ninit
FAIL: rt/tst-cpuclock2
FAIL: rt/tst-mqueue8
FAIL: rt/tst-mqueue8x
FAIL: rt/tst-shm-cancel
UNSUPPORTED: stdlib/tst-quick_exit
UNSUPPORTED: stdlib/tst-thread-quick_exit
Summary of test results:
140 FAIL
5721 PASS
36 UNSUPPORTED
18 XFAIL
rv64imafdc/lp64d:
UNSUPPORTED: assert/tst-assert-c++
UNSUPPORTED: assert/tst-assert-g++
UNSUPPORTED: debug/tst-chk4
UNSUPPORTED: debug/tst-chk5
UNSUPPORTED: debug/tst-chk6
UNSUPPORTED: debug/tst-lfschk4
UNSUPPORTED: debug/tst-lfschk5
UNSUPPORTED: debug/tst-lfschk6
UNSUPPORTED: dlfcn/bug-atexit3
FAIL: elf/tst-rtld-preload
FAIL: elf/tst-tls12
FAIL: io/ftwtest
FAIL: libio/tst-wfile-sync
FAIL: locale/tst-locale-locpath
FAIL: malloc/tst-malloc-usable-tunables
UNSUPPORTED: malloc/tst-mallocstate
UNSUPPORTED: math/test-fesetexcept-traps
UNSUPPORTED: math/test-fexcept-traps
UNSUPPORTED: math/test-matherr
UNSUPPORTED: math/test-matherr-2
UNSUPPORTED: math/test-nearbyint-except-2
UNSUPPORTED: misc/tst-pkey
UNSUPPORTED: nptl/test-cond-printers
UNSUPPORTED: nptl/test-condattr-printers
UNSUPPORTED: nptl/test-mutex-printers
UNSUPPORTED: nptl/test-mutexattr-printers
UNSUPPORTED: nptl/test-rwlock-printers
UNSUPPORTED: nptl/test-rwlockattr-printers
UNSUPPORTED: nptl/tst-cancel24
UNSUPPORTED: nptl/tst-cancel24-static
FAIL: nptl/tst-cancel7
FAIL: nptl/tst-cancelx7
UNSUPPORTED: nptl/tst-minstack-throw
UNSUPPORTED: nptl/tst-once5
FAIL: nptl/tst-stack4
UNSUPPORTED: nptl/tst-thread-exit-clobber
UNSUPPORTED: nptl/tst-thread_local1
UNSUPPORTED: posix/tst-glob_lstat_compat
UNSUPPORTED: posix/tst-spawn4-compat
FAIL: resolv/mtrace-tst-resolv-res_ninit
UNSUPPORTED: resolv/tst-p_secstodate
FAIL: resolv/tst-resolv-res_init
FAIL: resolv/tst-resolv-res_init-thread
FAIL: resolv/tst-resolv-res_ninit
UNSUPPORTED: stdlib/tst-quick_exit
FAIL: stdlib/tst-strfrom
FAIL: stdlib/tst-strfrom-locale
UNSUPPORTED: stdlib/tst-thread-quick_exit
Summary of test results:
15 FAIL
5849 PASS
33 UNSUPPORTED
18 XFAIL
Maciej