x32 ABI support was added in Linux 3.4.0, so arch_minimum_kernel should be set to 3.4.0 at configure time for x32, not the present 2.6.16.
Fixed by https://sourceware.org/git/?p=glibc.git;a=commit;h=17c1d9f03e16d56db11b17eac828ad28f30a73e0