http://gcc.gnu.org/bugzilla/show_bug.cgi?id=56116
--- Comment #2 from Andrew Pinski <pinskia at gcc dot gnu.org> 2013-01-26 17:01:34 UTC --- I have just recently built an aarch64 native compiler. Though not the same as an arm-linux-gnu compiler but it works. Can you provide your configure options for both set of compilers? Can you provide the error message you when compiling the native compiler? Are you building the target libraries when you build the native compiler; you don't need to do that as you already have them compiled.