This is the mail archive of the binutils@sourceware.org mailing list for the binutils project.

Index Nav:	[Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav:	[Date Prev] [Date Next]	[Thread Prev] [Thread Next]
Other format:	[Raw text]

Re: testsuite regressions on trunk, compared to 2.28

From: "H.J. Lu" <hjl dot tools at gmail dot com>
To: Matthias Klose <doko at ubuntu dot com>
Cc: binutils <binutils at sourceware dot org>
Date: Wed, 21 Jun 2017 14:08:09 -0700
Subject: Re: testsuite regressions on trunk, compared to 2.28
Authentication-results: sourceware.org; auth=none
References: <70cfc0c2-5d8b-b7b4-c6ef-6d1905d6e65d@ubuntu.com> <CAMe9rOrXeFYF8YE-0eNDJkhjDCKkRSc96_0+YHy2zynSRHXBgQ@mail.gmail.com>

On Wed, Jun 21, 2017 at 10:48 AM, H.J. Lu <hjl.tools@gmail.com> wrote:
> On Wed, Jun 21, 2017 at 8:57 AM, Matthias Klose <doko@ubuntu.com> wrote:
>> Preparing for the next binutils release, I did a test rebuild on some
>> archictures, and comparing test results with those from binutils 2.28,
>> configured with
>>
>> --enable-shared --enable-plugins --enable-threads --with-system-zlib
>> --prefix=/usr --enable-deterministic-archives
>> --disable-compressed-debug-sections --enable-new-dtags
>>
>> binutils 2.28 was configured without --enable-new-dtags
>>
>> I see the following regressions:
>>
>> amd64:
>> Test results, compared with installed binutils:
>> W: [ld-x86-64/x86-64.exp] REGRESSION (PASS -> FAIL): Run pr19031
>> W: [ld-x86-64/no-plt.exp] REGRESSION (PASS -> FAIL): Run pr20253-2f
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a7 with
>> --dynamic-list-data -Bsymbolic and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a6 with
>> --dynamic-list-cpp-new -Bsymbolic-functions and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a5 with
>> -Bsymbolic-functions --dynamic-list-cpp-new and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a2 with
>> -Bsymbolic-functions and dlopen on libdl6a.so
>> W: [ld-srec/srec.exp] REGRESSION (PASS -> FAIL): S-records
>> W: [ld-srec/srec.exp] REGRESSION (PASS -> FAIL): S-records with constructors
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/rpath-1
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/now-3
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/now-4
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/rpath-2
>> W: [ld-scripts/crossref.exp] REGRESSION (PASS -> FAIL): NOCROSSREFS 3
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-5a
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-8
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-6
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-5b
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-4a
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-4b
>> 15 REGRESSIONS (0.47%).
>> 4 progressions (0.12%).
>> 3216 tests: 3129 pass (97.29%), 16 fail (0.50%), 57 xfail (1.77%) 1 untested
>> (0.03%).
>>
>> i386:
>> Test results, compared with installed binutils:
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/now-4
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/rpath-2
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/rpath-1
>> I: [ld-elf/elf.exp] progression (FAIL -> PASS): ld-elf/now-3
>> W: [ld-scripts/crossref.exp] REGRESSION (PASS -> FAIL): NOCROSSREFS_TO 3
>> W: [ld-scripts/crossref.exp] REGRESSION (PASS -> FAIL): NOCROSSREFS_TO 4
>> W: [ld-scripts/crossref.exp] REGRESSION (PASS -> FAIL): NOCROSSREFS 3
>> W: [ld-shared/shared.exp] REGRESSION (PASS -> FAIL): shared (non PIC, load offset)
>> W: [ld-shared/shared.exp] REGRESSION (PASS -> FAIL): shared (PIC main, non PIC so)
>> W: [ld-shared/shared.exp] REGRESSION (PASS -> FAIL): shared (non PIC)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (protected) (PIC
>> main, non PIC so)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (hidden_weak)
>> (non PIC, load offset)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (protected) (non
>> PIC, load offset)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (hidden_weak)
>> (non PIC)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (hidden_weak)
>> (PIC main)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (hidden_weak)
>> (PIC main, non PIC so)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (protected) (non
>> PIC)
>> W: [ld-elfvsb/elfvsb.exp] REGRESSION (PASS -> FAIL): visibility (hidden_weak)
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a6 with
>> --dynamic-list-cpp-new -Bsymbolic-functions and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a7 with
>> --dynamic-list-data -Bsymbolic and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a5 with
>> -Bsymbolic-functions --dynamic-list-cpp-new and dlopen on libdl6a.so
>> W: [ld-elf/shared.exp] REGRESSION (PASS -> FAIL): Run dl6a2 with
>> -Bsymbolic-functions and dlopen on libdl6a.so
>> W: [ld-i386/i386.exp] REGRESSION (PASS -> FAIL): Run got1
>> W: [ld-i386/i386.exp] REGRESSION (PASS -> FAIL): Build gotpc1
>> W: [ld-i386/i386.exp] REGRESSION (PASS -> FAIL): Undefined weak symbol (-fPIE )
>> W: [ld-i386/i386.exp] REGRESSION (PASS -> FAIL): Undefined weak symbol (-fPIE -pie)
>> W: [ld-i386/i386.exp] REGRESSION (PASS -> FAIL): Run pr19031
>> W: [ld-srec/srec.exp] REGRESSION (PASS -> FAIL): S-records
>> W: [ld-srec/srec.exp] REGRESSION (PASS -> FAIL): S-records with constructors
>> W: [ld-gc/gc.exp] REGRESSION (PASS -> FAIL): --gc-sections with KEEP
>> W: [ld-size/size.exp] REGRESSION (PASS -> FAIL): Run size-8
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): No PLT (dynamic 1i)
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): Run pr20253-1f
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): Run pr20244-3a
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): Run pr20253-2a
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): No PLT (dynamic 1h)
>> W: [ld-i386/no-plt.exp] REGRESSION (PASS -> FAIL): Run pr20253-2c
>> 33 REGRESSIONS (1.18%).
>> 4 progressions (0.14%).
>> 2804 tests: 2750 pass (98.07%), 33 fail (1.18%), 4 xfail (0.14%) 1 untested (0.04%).
>>
>
> I can't reproduce it on x86-64.
>

With PIE as default, I saw

FAIL: Run dl6a2 with -Bsymbolic-functions and dlopen on libdl6a.so
FAIL: Run dl6a5 with -Bsymbolic-functions --dynamic-list-cpp-new and
dlopen on libdl6a.so
FAIL: Run dl6a6 with --dynamic-list-cpp-new -Bsymbolic-functions and
dlopen on libdl6a.so
FAIL: Run dl6a7 with --dynamic-list-data -Bsymbolic and dlopen on libdl6a.so
FAIL: NOCROSSREFS 3
FAIL: Run size-4a
FAIL: Run size-4b
FAIL: Run size-5a
FAIL: Run size-5b
FAIL: Run size-6
FAIL: Run size-8
FAIL: S-records
FAIL: S-records with constructors
FAIL: No PLT (dynamic 1a)
FAIL: No PLT (dynamic 1c)
FAIL: Run pr20253-2f
FAIL: Build gotpcrel1
FAIL: Run pr19031



-- 
H.J.

Follow-Ups:
- Re: testsuite regressions on trunk, compared to 2.28
  - From: Matthias Klose

References:
- testsuite regressions on trunk, compared to 2.28
  - From: Matthias Klose
- Re: testsuite regressions on trunk, compared to 2.28
  - From: H.J. Lu

Index Nav:	[Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav:	[Date Prev] [Date Next]	[Thread Prev] [Thread Next]