recipes: Introduce RustCompiledComponentsRecipe, add pydantic-core and update cryptography

[T-Dynamos]

Closes #2661 #2955
Surpasses #2957

CC: @AndreMiras @misl6 Is approach used here is fine?

[T-Dynamos]

@Julian-O Hi, can you please triggre CI?

[Julian-O]

Sorry, I don't have permissions for that. @misl6?

[AndreMiras]

Interesting approach, thanks for looking this up.
The CI actually tried running, but failed because of a syntax error:

[Invalid workflow file: .github/workflows/push.yml#L232](https://github.com/kivy/python-for-android/actions/runs/7658579349/workflow)
The workflow is not valid. .github/workflows/push.yml (Line: 232, Col: 13): Unexpected symbol: '|'. Located at position 23 within expression: (
  github.event_path | contains('pydantic-core')
  # github.event_path | contains('dir2') ||
  # github.event_path | contains('dir3')
)

See here https://github.com/kivy/python-for-android/actions/runs/7658579349
This would be our first Rust recipe I think. It's probably OK that we don't generalize anything yet, but we may want as we get more of them. I don't have much knowledge about Rust, so I don't know if the current method is future proof for dealing with different compiler versions plus dependencies, but I'm fine with it as it's a first, as long as the CI is happy about it.
misl6 should have the last word as I haven't been very active in p4a for a long time

[T-Dynamos]

Build works, please somebody cancel all the previous actions triggred except the latest one.

[misl6]

@T-Dynamos FYI, Unit tests are failing.

Regarding the approach, there's something that will be repetitive along all the upcoming recipes for rust-backed libraries?
If yes, how about moving these things into a RustCompiledComponentsRecipe ?

[T-Dynamos]

RustCompiledComponentsRecipe

It's good idea. As cryptography is also built on rust.

[misl6]

RustCompiledComponentsRecipe

It's good idea. As cryptography is also built on rust.

Do not take it as a "we should do it like that", feel free to improve the thinking.

Please also remind to add the new dependency into prerequisites.py, and in docs.

[T-Dynamos]

@misl6 Done!, After review I will document all.

[misl6]

@T-Dynamos can you please rebase on top of develop as CI pipeline for apple-silicon-m1 looks to fail on an issue that has already been fixed via #2842

[T-Dynamos]

@misl6 CI looks happy now.

[misl6]

Looks like we have a failure on 3 jobs with almost the same issue:

2024-03-17T08:12:12.1384103Z     sources = self.generate_sources(sources, (lib_name, build_info))
2024-03-17T08:12:12.1384888Z               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1386664Z   File "/home/user/.local/share/python-for-android/build/other_builds/numpy/arm64-v8a__ndk_target_21/numpy/numpy/distutils/command/build_src.py", line 378, in generate_sources
2024-03-17T08:12:12.1388177Z     source = func(extension, build_dir)
2024-03-17T08:12:12.1388716Z              ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1390355Z   File "/home/user/.local/share/python-for-android/build/other_builds/numpy/arm64-v8a__ndk_target_21/numpy/numpy/core/setup.py", line 702, in get_mathlib_info
2024-03-17T08:12:12.1391864Z     config_cmd.compiler = bk_c.cxx_compiler()
2024-03-17T08:12:12.1392413Z                           ^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1393495Z AttributeError: 'UnixCCompiler' object has no attribute 'cxx_compiler'

Can you make sure you have rebased on top of latest develop branch?

I'm wondering if the setuptools version bump may be the issue?

[T-Dynamos]

Looks like we have a failure on 3 jobs with almost the same issue:

2024-03-17T08:12:12.1384103Z     sources = self.generate_sources(sources, (lib_name, build_info))
2024-03-17T08:12:12.1384888Z               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1386664Z   File "/home/user/.local/share/python-for-android/build/other_builds/numpy/arm64-v8a__ndk_target_21/numpy/numpy/distutils/command/build_src.py", line 378, in generate_sources
2024-03-17T08:12:12.1388177Z     source = func(extension, build_dir)
2024-03-17T08:12:12.1388716Z              ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1390355Z   File "/home/user/.local/share/python-for-android/build/other_builds/numpy/arm64-v8a__ndk_target_21/numpy/numpy/core/setup.py", line 702, in get_mathlib_info
2024-03-17T08:12:12.1391864Z     config_cmd.compiler = bk_c.cxx_compiler()
2024-03-17T08:12:12.1392413Z                           ^^^^^^^^^^^^^^^^^
2024-03-17T08:12:12.1393495Z AttributeError: 'UnixCCompiler' object has no attribute 'cxx_compiler'

Can you make sure you have rebased on top of latest develop branch?

I'm wondering if the setuptools version bump may be the issue?

Yes setuptools version bump is the issue, I think this is the time to update numpy to latest version. I will do this ASAP.

[T-Dynamos]

@misl6 Done! 🔥 .

[T-Dynamos]

@misl6
Any update on this?

[misl6]

I've added a comment regarding a specific change.

No need to make changes, but I only need an explanation ATM.

Regarding the numpy fix: Hacky, but it works, and I'm fine with it.

Hopefully PEP738 will help us to clean python-for-android from these hacks and perform isolated builds as 1,2,3 ... (so let's keep an eye on the progress).

[T-Dynamos]

@misl6 Fixed.

[misl6]

Let's wait for the CI/CD pipeline to complete, but LGTM

[T-Dynamos]

Sorry had to do one last change, please cancel other actions.

[misl6]

Let's wait to the CI/CD pipeline to complete, but LGTM.