WIP: Api level 28, NDK 17c - Recipe Updates and Fixes #1381

rnixx · 2018-09-25T10:31:40Z

This PR contains changes necessary to build with API level 28 and python 2 and relates to #1219

It also contains changes from https://github.com/kivy/python-for-android/compare/set_app_platform_19, which should be generalized according to @tito and @inclement

The new patches contained in python2 recipe prevent the use of ctermid and setpwent, which are missing in bionic lib and caused System.err: dlopen failed: cannot locate symbol. Nevertheless, controlling this via HAVE_CTERMID and HAVE_GETPWENT in pyconfig.h would be the cleaner solution. I just have no idea how to control this via autoconf/autoheader in python build.

UPDATE Added another patch to disable large file support when compiling python 2. This is needed to prevent ftello64 error on Android < 7.

The following recipes have been added:

asn1crypto
attrs
pyasn1_modules
service_identity

UPDATE: asn1crypto, attrs, pyasn1_modules and service_identity have been removed again. Need to be defined in requirements of buildozer.spec if using buildozer. Gets installed via pip if missing. tested and working!

The following recipes have been updated:

cffi
cryptography
enum34
idna
ipaddress
openssl
pyasn1
pycparser
pyopenssl
twisted (added documentation about dependencies needed to use TLS)

The following recipes have been fixed:

cryptography
- openssl includes were missing in CFLAGS
- dependencies were changed, enum34 and ipaddress are optional, since only needed in python2 (untested in python3)

The following is missing:

Fix autodownload of newer NDK
Fix java source and target version when calling ant

How to test this PR

Following is defined in buildozer.spec:

android.api = 28
android.minapi = 21
android.sdk = 24
android.ndk = 17c

UPDATE changes in buildozer.spec since opening this PR

android.api changed from 27 to 28
android.minapi changed from 19 to 21
android.sdk changed from 23 to 24
android.ndk changed from 16b to 17c

You need to download NDK r17c manually, because the automatic download failes and define the NDK location in the spec file like so:

android.ndk_path = ~/.buildozer/android/android-ndk-r17c

UPDATE NDK download is fixed with kivy/buildozer#747

Modify ~/.buildozer/android/platform/android-sdk-23/tools/ant/build.xml and set java.source and java.target to 1.7 if necessary.

UPDATE Changing java.source and java.target in build.xml seems not necessary any more in SDK 24

Try to build your app. Good luck!

…lier devices) closes #866

…emplate for SDL2 if API >= 13

…ies. Add openssl includes to CFLAGS when compiling cryptography.

AndreMiras · 2018-10-20T14:44:30Z

You need to install buildozer from master branch since the fix is not yet released on PYPI. Sorry I'm on mobile phone. Edit: ``` pip install --user --upgrade https://github.com/kivy/buildozer/archive/master.zip ``` El sáb., 20 oct. 2018 16:28, Petar-Luketina <notifications@github.com> escribió:

…

@inclement <https://github.com/inclement> , hmm. I upgraded buildozer, and re-downloaded the p4a. That doesn't seem to fix the problem. How do I make sure that buildozer re-downloads the proper version of p4a? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1381 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABhjf3T5a4oVk2V811VONPXy1qyFWNfks5umzMDgaJpZM4W4UpH> .

Petar-Luketina · 2018-10-20T14:52:59Z

@AndreMiras , I appreciate you letting me know that, especially from a mobile phone! I downloaded buildozer master branch from the website using git clone but how do I switch to that version?

AndreMiras · 2018-10-20T15:00:52Z

Yep not easy from the phone 😛

pip install --user --upgrade https://github.com/kivy/buildozer/archive/master.zip

Petar-Luketina · 2018-10-20T15:30:04Z

Yes, @AndreMiras , that worked! Thank you so much @rnixx , @inclement , and @AndreMiras !!!

Blackth01 · 2018-10-21T22:47:45Z

@Blackth01 What device / android version are you encountering the error?

@rnixx on a Galayx J5 (SM-J500M) with android 6.0.1

brvier · 2018-10-24T09:17:52Z

Look like numpy doesnt run ...
ImportError: dlopen failed: cannot locate symbol "cpowf" referenced by "/data/data/.../files/app/lib/python2.7/site-packages/numpy/core/umath.so"...

brvier · 2018-11-06T09:46:05Z

This happen only on Samsung Galaxy J3 not on an Asus Zen Phone 3 Max

This reverts commit 23452ac.

rnixx · 2018-11-09T14:23:31Z

ftello64 error is gone on android < 7 since disabling large file support when building python2

rnixx · 2018-11-09T14:26:39Z

@brvier can you tell me the android versions of this devices?

numpy build probably somewhere has a switch to use cpowf if available. i guess it works on recent versions of android and fails on older ones and needs to be patched away

rnixx · 2018-11-09T14:28:18Z

@Blackth01 can you try again please with updated PR. disabling lfs seems to solve some problems

Blackth01 · 2018-11-16T01:32:23Z

@Blackth01 can you try again please with updated PR. disabling lfs seems to solve some problems

@rnixx, I tried to build it with the updated PR and it worked pretty well, the app was installed and now runs without any error, I only had some problems with cryptography, 'cause it was not finding module enum or something like that, but adding enum in the requirements worked fine. Thank you very much!

brvier · 2018-11-16T08:42:22Z

@brvier can you tell me the android versions of this devices?

numpy build probably somewhere has a switch to use cpowf if available. i guess it works on recent versions of android and fails on older ones and needs to be patched away

Sorry, answer by email havent been added.

So still have problem with numpy and latest patch, only on android <= 7.0.
Original error was: dlopen failed: cannot locate symbol "ftello64" referenced by "/data/data/net.chronolife.chronomonitoring/files/app/lib/python2.7/site-packages/numpy/core/multiarray.so"...
Probably numpy need to have large file support disabled too ...

rnixx · 2018-11-19T07:26:32Z

@brvier Actually the underlying problem of all the "cannot locate symbol" errors is that p4a does not (or did not - there's WIP about it) define the NDK API from min Android API level. It compiles against target Android API level, which causes missing functionality on older devices due to the wrong bionic lib.

Once the proper fix is merged into master, the whole problem should be gone, and the additional patches in this PR gets obsolete.

ghost · 2018-12-09T22:58:10Z

Just to chime in, wouldn't it be good to somehow manage to keep large file support enabled (on supported API levels of course)? For dealing with large files and such

rnixx · 2018-12-10T06:18:39Z

@Jonast see above,

Once the proper fix is merged into master, the whole problem should be gone, and the additional patches in this PR gets obsolete.

bunmalik · 2018-12-26T14:59:29Z

@AndreMiras @inclement @Blackth01 please I have a pending issue waiting for a reply. I need it fixed urgently! kivy/buildozer#772

KeyWeeUsr · 2018-12-26T15:23:11Z

@AndreMiras @inclement @Blackth01 please I have a pending issue waiting for a reply. I need it fixed urgently! kivy/buildozer#772

Everyone here is doing stuff in their free time, you won't get any further with demanding anything. Quite opposite. If this patch works for you, you can clone p4a locally, apply it to the local clone and in .spec file set the path for p4a to your local clone.

AndreMiras · 2018-12-27T14:04:49Z

@bunmalik I second what @KeyWeeUsr said. But it might be another way to speed things up. You can sponsor the project here https://opencollective.com/kivy or open a bug bounty directly for this issue. Sometime money can catalyse things... and sometimes not 😄
In any case also like @KeyWeeUsr said, you can clone that for locally and hook to it. Feel free to join the chat if you need assistance in doing so.

rnixx · 2019-02-17T08:06:56Z

PR is obsolete.

akshayaurora and others added 30 commits October 9, 2016 14:56

load ssl and crypto libs before loading python, for (4.1.2 or ear…

c1659b8

…lier devices) closes #866

dynamically load libcrypto ans libel if they exist

ce6417b

Merge branch '866' of https://github.com/kivy/python-for-android

7a5e657

customize kivy download URL

248ab32

Also load cffi lib

667e06f

Load cffi extensions

4aea97f

Another adoption of lib loading

1bf8d8f

add TODO note

bba8377

Merge branch 'master' of github.com:rnixx/python-for-android

ca9edac

Try cflag as described in #866 (comment)

3c17132

comment added cflag in python2 recipe, lets try a newer ndk first

a28d6d8

comment python3.5m for debugging purposes

87cd3ee

...

212bd9f

Add screenSize to android:configChanges AndroidManifest.xml t…

8b28857

…emplate for SDL2 if API >= 13

Merge branch 'master' of https://github.com/kivy/python-for-android

8272dae

resolve

a39e132

Merge branch 'master' of https://github.com/kivy/python-for-android

8ab51e7

merge p4a master

44c83b9

resolve conflicts

ac29df7

Merge branch 'master' of github.com:rnixx/python-for-android

ec9529f

try f017eb9

7b4b100

Add patches to disable ctermid and getpwall

4a7cd2d

Add asn1crypto recipe

381103d

Add attrs recipe

dbba5bb

Add pyasn1_modules recipe

eb90f78

Add service_identity recipe

47efdf9

Update cffi recipe version to 1.11.5

4b273ff

Update cryptography version to 2.3.1. Document cryptography dependenc…

0744f91

…ies. Add openssl includes to CFLAGS when compiling cryptography.

Update enum34 recipe version to 1.1.6

521922f

Update idna recipe version to 2.7

5e50de1

MichaelStott mentioned this pull request Oct 28, 2018

What is Command failed: pip install -q --user? MichaelStott/KivMob#18

Closed

rnixx added 4 commits November 7, 2018 10:55

adopt jnius recipe

23452ac

Revert "adopt jnius recipe"

87fd595

This reverts commit 23452ac.

merge kivy master

3822d8b

Add patch for disabling large file support when compiling python2

33671a0

rnixx changed the title ~~WIP: Api level 27, Recipe Updates and Fixes~~ WIP: Api level 28, NDK 17c - Recipe Updates and Fixes Nov 9, 2018

suizokukan mentioned this pull request Nov 9, 2018

APK build failed "ndk_platform doesn't exist" (Python3.6; android.api = 27) kivy/buildozer#742

Closed

rnixx mentioned this pull request Nov 20, 2018

fix ndk URLs kivy/buildozer#747

Merged

intellign mentioned this pull request Nov 23, 2018

Set the api level from 19 to 28 failed #1482

Closed

bunmalik mentioned this pull request Dec 25, 2018

No valid --ndk-api received, using the default of 0 = min(android-api=0, default ndk-api=21) kivy/buildozer#772

Closed

rnixx closed this Feb 17, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: Api level 28, NDK 17c - Recipe Updates and Fixes #1381

WIP: Api level 28, NDK 17c - Recipe Updates and Fixes #1381

rnixx commented Sep 25, 2018 •

edited

Loading

AndreMiras commented Oct 20, 2018 via email •

edited

Loading

Petar-Luketina commented Oct 20, 2018

AndreMiras commented Oct 20, 2018 •

edited

Loading

Petar-Luketina commented Oct 20, 2018

Blackth01 commented Oct 21, 2018

brvier commented Oct 24, 2018

brvier commented Nov 6, 2018

rnixx commented Nov 9, 2018

rnixx commented Nov 9, 2018 •

edited

Loading

rnixx commented Nov 9, 2018

Blackth01 commented Nov 16, 2018 •

edited

Loading

brvier commented Nov 16, 2018 •

edited

Loading

rnixx commented Nov 19, 2018

ghost commented Dec 9, 2018 •

edited by ghost

Loading

rnixx commented Dec 10, 2018

bunmalik commented Dec 26, 2018

KeyWeeUsr commented Dec 26, 2018

AndreMiras commented Dec 27, 2018

rnixx commented Feb 17, 2019

WIP: Api level 28, NDK 17c - Recipe Updates and Fixes #1381

WIP: Api level 28, NDK 17c - Recipe Updates and Fixes #1381

Conversation

rnixx commented Sep 25, 2018 • edited Loading

How to test this PR

AndreMiras commented Oct 20, 2018 via email • edited Loading

Petar-Luketina commented Oct 20, 2018

AndreMiras commented Oct 20, 2018 • edited Loading

Petar-Luketina commented Oct 20, 2018

Blackth01 commented Oct 21, 2018

brvier commented Oct 24, 2018

brvier commented Nov 6, 2018

rnixx commented Nov 9, 2018

rnixx commented Nov 9, 2018 • edited Loading

rnixx commented Nov 9, 2018

Blackth01 commented Nov 16, 2018 • edited Loading

brvier commented Nov 16, 2018 • edited Loading

rnixx commented Nov 19, 2018

ghost commented Dec 9, 2018 • edited by ghost Loading

rnixx commented Dec 10, 2018

bunmalik commented Dec 26, 2018

KeyWeeUsr commented Dec 26, 2018

AndreMiras commented Dec 27, 2018

rnixx commented Feb 17, 2019

rnixx commented Sep 25, 2018 •

edited

Loading

AndreMiras commented Oct 20, 2018 via email •

edited

Loading

AndreMiras commented Oct 20, 2018 •

edited

Loading

rnixx commented Nov 9, 2018 •

edited

Loading

Blackth01 commented Nov 16, 2018 •

edited

Loading

brvier commented Nov 16, 2018 •

edited

Loading

ghost commented Dec 9, 2018 •

edited by ghost

Loading