Errors when compiling julia on -current

Linux.tar.gz · 09-21-2015, 01:38 PM

Hi !

Julia v0.4.0-rc2-full.

Have this :
fatal error: gnu/stubs-hard.h: No such file or directory

and also :
configure: error: Need a version of gcc with -mavx

I successfully compiled this version on x86_64 -current.

Linux.tar.gz · 09-21-2015, 01:45 PM

Sounds like -mavx is related to x86 code, I added some ARM flags (used a simple "make" before), but I still have the fatal error: gnu/stubs-hard.h: No such file or directory .

knudfl · 09-21-2015, 02:37 PM

No `stubs-hard.h' in the 35.5MB Slackwarearm 14.0 package glibc-2.15-arm-8.tgz .
No `stubs-hard.h' in the 36.3MB Slackwarearm 14.1 glibc-2.17-arm-14.tgz .

The header stubs-hard.h is present in Debian-armhf, e.g. Debian Sid libc6-dev_2.19
https://packages.debian.org/search?s...s=stubs-hard.h

/usr/include/arm-linux-gnueabihf/gnu/stubs-hard.h :
https://packages.debian.org/sid/armh...6-dev/filelist
Package http://ftp.de.debian.org/debian/pool...9-20_armhf.deb
>>> libc6-dev_2.19-20_armhf.deb

Other examples with `stubs-hard.h' :
toolchain-armcortexa9-2012-2012.12.0-oselas.1.1.x86_64.rpm (CentOS 6)
toolchain-arm1136jfs-2012-2012.12.0-oselas.17.1.i686.rpm (CentOS 6)
cross-armv7hl-glibc-devel-2.21-1.6.noarch.rpm (openSUSE_Factory_ARM)
.... see http://rpm.pbone.net/

-

Linux.tar.gz · 09-21-2015, 02:39 PM

I'm building stuff with local libraries, it worked so far until libunwind using slackbuilds.org :

/bin/sh ../libtool --tag=CC --mode=link gcc -O2 -fexceptions -Wall -Wsign-compare -o Gperf-simple Gperf-simple.o ../src/libunwind-arm.la ../src/libunwind.la
libtool: link: gcc -O2 -fexceptions -Wall -Wsign-compare -o .libs/Gperf-simple Gperf-simple.o ../src/.libs/libunwind-arm.so ../src/.libs/libunwind.so -pthread
/usr/lib/gcc/arm-slackware-linux-gnueabi/4.9.3/../../../../arm-slackware-linux-gnueabi/bin/ld: copy reloc against protected `_Uarm_local_addr_space' is dangerous
../src/.libs/libunwind-arm.so: undefined reference to `AO_fetch_and_add'
../src/.libs/libunwind-arm.so: undefined reference to `AO_fetch_and_add1'
collect2: error: ld returned 1 exit status
make[1]: *** [Gperf-simple] Error 1
make[1]: Leaving directory `/tmp/SBo/libunwind-1.1/tests'
make: *** [all-recursive] Error 1

OpenBLAS also fails using slackbuilds.org :

fatal error: gnu/stubs-hard.h: No such file or directory

Here's my Make.user so far :

override USE_SYSTEM_BLAS=1
override USE_SYSTEM_LIBUNWIND=1
override USE_SYSTEM_LIBGIT2=1
override USE_SYSTEM_LLVM=1
override USE_SYSTEM_PCRE=1
override USE_SYSTEM_FFTW=1
override USE_SYSTEM_GMP=1
override USE_SYSTEM_MPFR=1

Linux.tar.gz · 09-21-2015, 03:01 PM

I tried to force -mfloat-abi=softfp in OpenBLAS, but -mfloat-abi=hard is probably hardcoded somewhere in the code :/ .

gcc -mfloat-abi=softfp -O2 -Wall -DF_INTERFACE_GFORT -fPIC -DSMP_SERVER -DNO_WARMUP -DMAX_CPU_NUMBER=2 -marm -mfpu=vfpv3 -mfloat-abi=hard -march=armv7-a -DASMNAME= -DASMFNAME=_ -DNAME=_ -DCNAME= -DCHAR_NAME="_" -DCHAR_CNAME="" -DNO_AFFINITY -I. -O2 -Wall -DF_INTERFACE_GFORT -fPIC -DSMP_SERVER -DNO_WARMUP -DMAX_CPU_NUMBER=2 -marm -mfpu=vfpv3 -mfloat-abi=hard -march=armv7-a -DASMNAME=saxpy -DASMFNAME=saxpy_ -DNAME=saxpy_ -DCNAME=saxpy -DCHAR_NAME="saxpy_" -DCHAR_CNAME="saxpy" -DNO_AFFINITY -I.. -I. -UDOUBLE -UCOMPLEX -c axpy.c -o saxpy.o

Linux.tar.gz · 09-21-2015, 03:14 PM

Here's a bit of OpenBLAS Makefile.arm :

ifeq ($(CORE), ARMV7)
CCOMMON_OPT += -marm -mfpu=vfpv3 -mfloat-abi=hard -march=armv7-a
FCOMMON_OPT += -marm -mfpu=vfpv3 -mfloat-abi=hard -march=armv7-a
endif

Why in the world things like that exists..?

I modified it, it's currently compiling.

Edit :
Compilation finished, 0.2.14 package installed, back to julia.

gus3 · 09-21-2015, 04:21 PM

Standard Slackware ARM and "-mfloat-abi=hard" are incompatible. GCC can compile for it, but the linker will signal an error and fail.

Linux.tar.gz · 09-21-2015, 05:26 PM

I'm almost there.
Unfortunately :

make[1]: pcre2-config: Command not found
PERL base/pcre_h.jl
gcc: error: /include/pcre2.h: No such file or directory
gcc: fatal error: no input files
compilation terminated.

I used Slackware's pcre, but it obviously lacks pcre2.h .

I've re-enabled julia's pcre2, so now I have :

CC src/flisp/flisp.o
In file included from jltypes.c:16:0:
julia_internal.h:164:23: fatal error: libunwind.h: No such file or directory
#include <libunwind.h>
^
compilation terminated.

My actual Make.user is now :

override USE_SYSTEM_LAPACK=1
override USE_SYSTEM_BLAS=1
override USE_SYSTEM_LIBUNWIND=1
override USE_SYSTEM_LIBGIT2=1
override USE_SYSTEM_LLVM=1
override USE_SYSTEM_FFTW=1
override USE_SYSTEM_GMP=1
override USE_SYSTEM_MPFR=1

I presume I now have to find a way to use julia's libunwind, or to generate libunwind.h from the previous SlackBuild...

Linux.tar.gz · 09-21-2015, 05:32 PM

Julia's libunwind :

Code:

libtool: link: gcc -U_FORTIFY_SOURCE -fPIC -fexceptions -Wall -Wsign-compare -o Gperf-trace Gperf-trace.o  ../src/.libs/libunwind-arm.a /root/julia/de
ps/libunwind-1.1/src/.libs/libunwind.a ../src/.libs/libunwind.a -lc -lgcc
../src/.libs/libunwind.a(flush_cache.o): In function `_Uarm_flush_cache':
flush_cache.c:(.text+0xa0): undefined reference to `AO_fetch_and_add1'
../src/.libs/libunwind.a(mempool.o): In function `_UIarm__sos_alloc':
mempool.c:(.text+0x30): undefined reference to `AO_fetch_and_add'
collect2: error: ld returned 1 exit status
make[3]: *** [Lperf-trace] Error 1
make[3]: *** Waiting for unfinished jobs....
../src/.libs/libunwind.a(flush_cache.o): In function `_Uarm_flush_cache':
flush_cache.c:(.text+0xa0): undefined reference to `AO_fetch_and_add1'
../src/.libs/libunwind.a(mempool.o): In function `_UIarm__sos_alloc':
mempool.c:(.text+0x30): undefined reference to `AO_fetch_and_add'
collect2: error: ld returned 1 exit status
make[3]: *** [Lperf-simple] Error 1
../src/.libs/libunwind-arm.a(flush_cache.o): In function `_Uarm_flush_cache':
flush_cache.c:(.text+0xa0): undefined reference to `AO_fetch_and_add1'
../src/.libs/libunwind-arm.a(mempool.o): In function `_UIarm__sos_alloc':
mempool.c:(.text+0x30): undefined reference to `AO_fetch_and_add'
collect2: error: ld returned 1 exit status
make[3]: *** [Gperf-simple] Error 1
../src/.libs/libunwind-arm.a(flush_cache.o): In function `_Uarm_flush_cache':
flush_cache.c:(.text+0xa0): undefined reference to `AO_fetch_and_add1'
../src/.libs/libunwind-arm.a(mempool.o): In function `_UIarm__sos_alloc':
mempool.c:(.text+0x30): undefined reference to `AO_fetch_and_add'
collect2: error: ld returned 1 exit status
make[3]: *** [Gperf-trace] Error 1
make[2]: *** [install-recursive] Error 1
make[1]: *** [/root/julia/usr/lib/libunwind.a] Error 2
make: *** [julia-deps] Error 2

knudfl · 09-21-2015, 05:54 PM

Re #8.

'pcre2' : Perl-Compatible Regular Expression library
pcre2-10.20.tar.gz, pcre2-10.20.tar.bz2 (1.4 MB)
http://sourceforge.net/projects/pcre/files/pcre2/10.20/
(( No Slackbuild, AFAIK.))

'libunwind' http://slackbuilds.org/repository/14...?search=unwind
libunwind.h is a generated header from "libunwind-1.1(.tar.gz)".

*** There is also a "libunwind-arm.h" in libunwind-1.1.tar.gz .

-

Linux.tar.gz · 09-22-2015, 02:22 AM

Julia's pcre2 compiled fine.

Libunwind 1.1 SlackBuild doen't compile :

/bin/sh ../libtool --tag=CC --mode=link gcc -O2 -fexceptions -Wall -Wsign-compare -o Gperf-simple Gperf-simple.o ../src/libunwind-arm.la ../src/libunwind.la
libtool: link: gcc -O2 -fexceptions -Wall -Wsign-compare -o .libs/Gperf-simple Gperf-simple.o ../src/.libs/libunwind-arm.so ../src/.libs/libunwind.so -pthread
/usr/lib/gcc/arm-slackware-linux-gnueabi/4.9.3/../../../../arm-slackware-linux-gnueabi/bin/ld: copy reloc against protected `_Uarm_local_addr_space' is dangerous
../src/.libs/libunwind-arm.so: undefined reference to `AO_fetch_and_add'
../src/.libs/libunwind-arm.so: undefined reference to `AO_fetch_and_add1'
collect2: error: ld returned 1 exit status
make[1]: *** [Gperf-simple] Error 1
make[1]: Leaving directory `/tmp/SBo/libunwind-1.1/tests'
make: *** [all-recursive] Error 1

Sounds like I have to try the git version or apply a patch...

knudfl · 09-22-2015, 02:44 AM

Re #11 : Some hints ...

Debian, libunwind : armhf, armel
https://packages.debian.org/stretch/libunwind8
The source https://packages.debian.org/source/stretch/libunwind
>>> libunwind_1.1.orig.tar.gz + "the seven patches" libunwind_1.1-4.debian.tar.xz

Debian is also using another source package for libunwind :
armhf, armel https://packages.debian.org/stretch/android-libunwind
The source https://packages.debian.org/source/s...rnal-libunwind

Overview https://packages.debian.org/search?s...ords=libunwind

-

Linux.tar.gz · 09-22-2015, 12:03 PM

Thanks for the links.

I took a look at the patches, at first glance, it seems that no one addresses the issue.

The git branch fails with the same error.

drmozes · 09-23-2015, 12:48 PM

I don't know if this helps, but debian also have their build logs public:

https://buildd.debian.org/status/log...&pkg=libunwind

knudfl · 09-23-2015, 03:05 PM

... The build log for armhf :

https://buildd.debian.org/status/log...&pkg=libunwind

And arm64 https://buildd.debian.org/status/log...&pkg=libunwind

-