BUILD: Building for Android AARCH64 on Linux #2154

manizzle · 2017-01-25T23:11:02Z

Cannot build for Android AARCH64.

Build for Android ARM32 works fine.

I initialize my toolchain like,

../ndk/android-ndk-r13b/build/tools/make-standalone-toolchain.sh --arch=arm --platform=android-21 --install-dir=android-ndk-21 --toolchain=arm-linux-androideabi-4.9

Replace linkers:

ln -sf arm-linux-androideabi-ld.bfd bin/arm-linux-androideabi-ld
ln -sf ld.bfd arm-linux-androideabi/bin/ld

cmake -DCMAKE_TOOLCHAIN_FILE=/root/dr/dynamorio/make/toolchain-android.cmake -DANDROID_TOOLCHAIN=/root/dr/android-ndk-21/ -DDR_COPY_TO_DEVICE=ON DYNAMORIO_CONFIGDIR=/sdcard/dynamo/ -DTARGET_ABI=arm-linux-androideabi /root/dr/dynamorio/

make -j

works fine.

Then if I try to do the same, but for aarch64 it fails:

../ndk/android-ndk-r13b/build/tools/make-standalone-toolchain.sh --arch=arm64 --platform=android-21 --install-dir=android-ndk-21-64 --toolchain=aarch64-linux-android-4.9

ln -sf aarch64-linux-android-ld.bfd bin/aarch64-linux-android-ld
ln -sf ld.bfd aarch64-linux-android/bin/ld

I tried this cmake line:

cmake -DCMAKE_TOOLCHAIN_FILE=/root/dr/dynamorio/make/toolchain-android.cmake -DANDROID_TOOLCHAIN=/root/dr/android-ndk-21-64/ -DDR_COPY_TO_DEVICE=ON DYNAMORIO_CONFIGDIR=/sdcard/dynamo/ -DTARGET_ABI=aarch64-linux-android /root/dr/dynamorio/

and it errors with

-- Performing Test no_pie_avail - Failed
CMake Error at /root/dr/build_android_64/cmake/DynamoRIOConfig.cmake:1069 (message):
  *** /root/dr/android-ndk-21-64/bin/aarch64-linux-android-ld.bfd failed: ***

  /root/dr/android-ndk-21-64/bin/aarch64-linux-android-ld.bfd: unrecognised
  emulation mode: elf_x86_64

  Supported emulations: aarch64linux aarch64elf aarch64elf32 aarch64elf32b
  aarch64elfb armelf armelfb aarch64linuxb aarch64linux32 aarch64linux32b
  armelfb_linux_eabi armelf_linux_eabi

Call Stack (most recent call first):
  clients/drcov/CMakeLists.txt:43 (configure_DynamoRIO_client)


-- Configuring incomplete, errors occurred!

So I tried with:

cmake -DCMAKE_TOOLCHAIN_FILE=/root/dr/dynamorio/make/toolchain-android.cmake -DANDROID_TOOLCHAIN=/root/dr/android-ndk-21-64/ -DDR_COPY_TO_DEVICE=ON DYNAMORIO_CONFIGDIR=/sdcard/dynamo/ -DTARGET_ABI=aarch64-linux-android -DCMAKE_SYSTEM_PROCESSOR=aarch64 /root/dr/dynamorio/

The cmake runs fine, but then when I build it with make -j, it errors with:

[  3%] Linking C executable ../bin64/drloader
In file included from /root/dr/dynamorio/core/lib/../globals.h:332:0,
                 from /root/dr/dynamorio/core/lib/dr_helper.c:40:
/root/dr/dynamorio/core/unix/os_exports.h:122:5: error: #error NYI
 #   error NYI
     ^
/root/dr/dynamorio/core/unix/os_exports.h:328:0: error: "_NSIG_BPW" redefined [-Werror]
 # define _NSIG_BPW 64
 ^
In file included from /root/dr/android-ndk-21-64/sysroot/usr/include/asm/signal.h:22:0,
                 from /root/dr/android-ndk-21-64/sysroot/usr/include/linux/signal.h:21,
                 from /root/dr/android-ndk-21-64/sysroot/usr/include/signal.h:43,
                 from /root/dr/dynamorio/core/lib/globals_shared.h:126,
                 from /root/dr/dynamorio/core/lib/../globals.h:90,
                 from /root/dr/dynamorio/core/lib/dr_helper.c:40:
/root/dr/android-ndk-21-64/sysroot/usr/include/asm-generic/signal.h:24:0: note: this is the location of the previous definition
 #define _NSIG_BPW __BITS_PER_LONG
 ^
In file included from /root/dr/dynamorio/core/lib/../globals.h:332:0,
                 from /root/dr/dynamorio/core/lib/dr_helper.c:40:
/root/dr/dynamorio/core/unix/os_exports.h:334:0: error: "_NSIG_WORDS" redefined [-Werror]
 # define _NSIG_WORDS (MAX_SIGNUM / _NSIG_BPW)
 ^
In file included from /root/dr/android-ndk-21-64/sysroot/usr/include/asm/signal.h:22:0,
                 from /root/dr/android-ndk-21-64/sysroot/usr/include/linux/signal.h:21,
                 from /root/dr/android-ndk-21-64/sysroot/usr/include/signal.h:43,
                 from /root/dr/dynamorio/core/lib/globals_shared.h:126,
                 from /root/dr/dynamorio/core/lib/../globals.h:90,
                 from /root/dr/dynamorio/core/lib/dr_helper.c:40:
/root/dr/android-ndk-21-64/sysroot/usr/include/asm-generic/signal.h:25:0: note: this is the location of the previous definition
 #define _NSIG_WORDS (_KERNEL__NSIG / _NSIG_BPW)
 ^
cc1: all warnings being treated as errors
core/CMakeFiles/drhelper.dir/build.make:104: recipe for target 'core/CMakeFiles/drhelper.dir/lib/dr_helper.c.o' failed
make[2]: *** [core/CMakeFiles/drhelper.dir/lib/dr_helper.c.o] Error 1
CMakeFiles/Makefile2:167: recipe for target 'core/CMakeFiles/drhelper.dir/all' failed
make[1]: *** [core/CMakeFiles/drhelper.dir/all] Error 2

egrimley · 2017-01-25T23:26:40Z

Cannot build for Android AARCH64.

I'm not surprised. You're probably the first person to try this. Since ARM Linux, AArch64 Linux and ARM Android are implemented, perhaps AArch64 Android won't need a lot of extra work, but I don't know much about what's needed for Android. Derek, do you have any thoughts on this? Can you foresee any particular obstacles?

derekbruening · 2017-01-26T00:52:44Z

DR has to emulate the system loader, and Android's loader has unique behavior and interdependencies with Bionic. Emulating it is not implemented for A64. Mostly it's about setting up the first thread's pthread data structure. Xref #1701 (comment), #1920, #1862.

derekbruening · 2017-01-26T01:04:08Z

You could disable the Bionic stuff and plain DR will work (just no clients except ones with no deps)

summershrimp · 2018-12-11T03:32:03Z

I'm successfully building DR for Android AArch64, but even libinscount.so could not work.

summershrimp · 2018-12-11T03:34:11Z

/data/dynamorio # LD_LIBRARY_PATH=/system/lib ./bin64/drrun -debug -loglevel 4 -c samples/bin64/libinscount.so -- ls             
WARNING: linker: Fixed LD_LIBRARY_PATH: /system/lib64
<log dir=/data/dynamorio/bin64/../logs/toybox.19361.00000000>
<Starting application /system/bin/toybox (19361)>
<Initial options = -no_dynamic_options -loglevel 4 -client_lib '/data/dynamorio/samples/bin64/libinscount.so;0;' -code_api -stack_size 56K -signal_stack_size 32K -max_elide_jmp 0 -max_elide_call 0 -early_inject -emulate_brk -no_inline_ignored_syscalls -native_exec_default_list '' -no_native_exec_managed_code -no_indcall2direct >
Trap

summershrimp · 2018-12-11T03:35:41Z

Could someone give a routine to fix DR working on Android-AArch64?

summershrimp · 2018-12-11T03:39:46Z

seems running without client work.

/data/dynamorio # LD_LIBRARY_PATH=/system/lib ./bin64/drrun -- ls                    
WARNING: linker: Fixed LD_LIBRARY_PATH: /system/lib64
<Starting application /system/bin/toybox (19479)>
<Initial options = -no_dynamic_options -code_api -stack_size 56K -signal_stack_size 32K -max_elide_jmp 0 -max_elide_call 0 -early_inject -emulate_brk -no_inline_ignored_syscalls -native_exec_default_list '' -no_native_exec_managed_code -no_indcall2direct >
<Paste into GDB to debug DynamoRIO clients:
set confirm off
add-symbol-file '/data/dynamorio/lib64/debug/libdynamorio.so' 0x00000075fdcf2f18
>
<get_memory_info mismatch! (can happen if os combines entries in /proc/pid/maps)
        os says: 0x00000075fe4df000-0x00000075fe4ea000 prot=0x00000003
        cache says: 0x00000075fe4e2000-0x00000075fe4e3000 prot=0x00000003
>
<CURIOSITY : out_data->alignment == alignment in file /home/xm1994/Projects/dynamorio/core/unix/module.c line 474
version 7.0.17871, custom build
-no_dynamic_options -code_api -stack_size 56K -signal_stack_size 32K -max_elide_jmp 0 -max_elide_call 0 -early_inject -emulate_brk -no_inline_ignored_syscalls -native_exec_default_list '' -no_native_exec_managed_code -no_indcall2direct
0x00000075e9cc96e0 0x00000075fe008aac
0x00000075e9cc9870 0x00000075fe014930
0x00000075e9cc9900 0x00000075fe007880
0x00000075e9cc99c0 0x00000075fde87a90
0x00000075e9cc9a50 0x00000075fde88200
0x00000075e9cc9aa0 0x00000075fdfe6ae8
0x00000075e9cc9b00 0x00000075fdfe6f7c
0x00000075e9cc9c20 0x00000075fdfe7c58
0x00000075e9cc9ca0 0x00000075fdd97260
0x00000075e9cc9e50 0x00000075fdd8d68c
0x00000075e9cc9e80 0x00000075fdd88e38
0x00000075e9cc9f40 0x00000075fe3b89e8
0x0000007ffa7baf20 0x00000075fe3b8584
0x0000007ffa7baf40 0x00000075fe3a4778
0x0000007ffa7baf70 0x00000075fe3a3e78>
<CURIOSITY : out_data->alignment == alignment in file /home/xm1994/Projects/dynamorio/core/unix/module.c line 474
version 7.0.17871, custom build
-no_dynamic_options -code_api -stack_size 56K -signal_stack_size 32K -max_elide_jmp 0 -max_elide_call 0 -early_inject -emulate_brk -no_inline_ignored_syscalls -native_exec_default_list '' -no_native_exec_managed_code -no_indcall2direct
0x00000075e9cc96e0 0x00000075fe008aac
0x00000075e9cc9870 0x00000075fe014930
0x00000075e9cc9900 0x00000075fe007880
0x00000075e9cc99c0 0x00000075fde87a90
0x00000075e9cc9a50 0x00000075fde88200
0x00000075e9cc9aa0 0x00000075fdfe6ae8
0x00000075e9cc9b00 0x00000075fdfe6f7c
0x00000075e9cc9c20 0x00000075fdfe7c58
0x00000075e9cc9ca0 0x00000075fdd97260
0x00000075e9cc9e50 0x00000075fdd8d68c
0x00000075e9cc9e80 0x00000075fdd88e38
0x00000075e9cc9f40 0x00000075fe3b89e8
0x0000007ffa7baf20 0x00000075fe3b8584
0x0000007ffa7baf40 0x00000075fe3a4778
0x0000007ffa7baf70 0x00000075fe3a3e78>
ACKNOWLEDGEMENTS License.txt README bin32 bin64 cmake ext include lib32 lib64 logs samples tools
<Stopping application /system/bin/toybox (19479)>

derekbruening · 2021-03-04T17:24:20Z

Help wanted. Probably reviving and finishing PR #3547 would be a good first step.

manizzle · 2021-03-04T19:30:18Z

sounds good will take a look on the weekend

NicoleMayer · 2022-07-07T04:37:24Z

Has this issue been resolved now?

izzeem · 2023-04-27T16:32:09Z

any update here?

derekbruening · 2023-05-02T03:21:15Z

New developers are needed to work on Android support. It sounds like there is interest: please consider contributing time.

derekbruening · 2024-03-12T14:23:50Z

Xref someone successfully building and running: https://groups.google.com/g/dynamorio-users/c/5lphjcB0Bwc/m/xzsJrOMlAAAJ

gaobsh · 2024-08-13T07:06:23Z

Hi derek, Is there a more better guidence for building for Android14/15 aarch64?

derekbruening · 2024-08-13T17:31:26Z

If you are interested in helping, #3547 is probably the best starting point: that pull request needs to be revived, finished, and merged.

derekbruening added Component-Build OpSys-AArch64 OpSys-Android labels Jan 26, 2017

fhahn mentioned this issue Jul 21, 2017

Android ld.bfd 2.25 adds PT_INTERP, breaking injection #1927

Open

egrimley mentioned this issue Dec 6, 2017

add AArch64 support: master issue #1569

Open

summershrimp mentioned this issue Apr 17, 2019

i#2154 Make build for Android aarch64 possible. #3547

Open

derekbruening added the help wanted label Apr 29, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BUILD: Building for Android AARCH64 on Linux #2154

BUILD: Building for Android AARCH64 on Linux #2154

manizzle commented Jan 25, 2017

egrimley commented Jan 25, 2017 via email

derekbruening commented Jan 26, 2017

derekbruening commented Jan 26, 2017

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

derekbruening commented Mar 4, 2021

manizzle commented Mar 4, 2021

NicoleMayer commented Jul 7, 2022

izzeem commented Apr 27, 2023

derekbruening commented May 2, 2023

derekbruening commented Mar 12, 2024

gaobsh commented Aug 13, 2024

derekbruening commented Aug 13, 2024

BUILD: Building for Android AARCH64 on Linux #2154

BUILD: Building for Android AARCH64 on Linux #2154

Comments

manizzle commented Jan 25, 2017

egrimley commented Jan 25, 2017 via email

derekbruening commented Jan 26, 2017

derekbruening commented Jan 26, 2017

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

summershrimp commented Dec 11, 2018

derekbruening commented Mar 4, 2021

manizzle commented Mar 4, 2021

NicoleMayer commented Jul 7, 2022

izzeem commented Apr 27, 2023

derekbruening commented May 2, 2023

derekbruening commented Mar 12, 2024

gaobsh commented Aug 13, 2024

derekbruening commented Aug 13, 2024