I'm not an expert, but I know there's various ARM chips, and each needs its particular toolchain. This seems to be popular for building toolchains: crosstool-ng.
http://crosstool-ng.org/
It's probably available as a package, for whatever distro you're using.