Problems to solve to be perfect #1

paulocoutinhox · 2018-05-24T05:03:41Z

Hi,

I finished my script to build the PDFium to iOS. All is here with manual patchs:
https://github.com/prsolucoes/mobile-pdfium

It generate files:

- libpdfium_arm.a
- libpdfium_arm64.a
- libpdfium_x64.a
- libpdfium_x86.a
- libpdfium.a (universal)

FIRST PROBLEM

The problem is that i join all ".a" files on each library and each library have +/- 200MB and the universal near 1GB of size.

I want understand what libraries i need merge with libtool, i have this:

- pdfium/out/debug-arm/obj/libfpdfdoc.a
- pdfium/out/debug-arm/obj/libfxge.a
- pdfium/out/debug-arm/obj/libpdfium.a
- pdfium/out/debug-arm/obj/libfdrm.a
- pdfium/out/debug-arm/obj/libformfiller.a
- pdfium/out/debug-arm/obj/third_party/libjpeg_turbo/libsimd.a
- pdfium/out/debug-arm/obj/third_party/libjpeg_turbo/libjpeg.a
- pdfium/out/debug-arm/obj/third_party/libfx_agg.a
- pdfium/out/debug-arm/obj/third_party/zlib/libzlib_x86_simd.a
- pdfium/out/debug-arm/obj/third_party/zlib/libchrome_zlib.a
- pdfium/out/debug-arm/obj/third_party/libbigint.a
- pdfium/out/debug-arm/obj/third_party/libfx_freetype.a
- pdfium/out/debug-arm/obj/third_party/libfx_libopenjpeg.a
- pdfium/out/debug-arm/obj/third_party/libfx_lcms2.a
- pdfium/out/debug-arm/obj/third_party/icu/libicuuc.a
- pdfium/out/debug-arm/obj/libpwl.a
- pdfium/out/debug-arm/obj/libfpdftext.a
- pdfium/out/debug-arm/obj/libfpdfapi.a
- pdfium/out/debug-arm/obj/libfxcrt.a
- pdfium/out/debug-arm/obj/libfxcodec.a
- pdfium/out/debug-arm/obj/libfxjs.a

Today im merging all for each library and each arch and the library is with a huge file size.

SECOND PROBLEM

The libraries are compile always with iOS 10 and xcode give me 402 warning about it:

ld: warning: object file (/Users/paulo/Downloads/UXReader-iOS/UXReader/UXReader/PDFium/libpdfium.a(cpdf_formcontrol.o)) was built for newer iOS version (10.0) than being linked (8.0)

My project need be for iOS 8.0, but the libraries are compile with iOS 10.

How to solve it?

THIRD PROBLEM

I merge and link with all libraries (.a), but when i use with a sample project i still have some functions not linked inside the library ".a":

FOURTY PROBLEM

How to build with bitcode support? How to enable and disable it?

FINISH

Can anyone help me with this problems?

Thanks.

The text was updated successfully, but these errors were encountered:

raghuwanshi · 2018-07-31T12:56:05Z

Thank you for saving my time by providing this script. I am still working on this project but let me share the solution to your first problem. You can use these args:

is_debug=false
symbol_level=0

Please see the symbol_level documentation for further details. Although my need to build PDFium on iOS is for a different purpose and due to that I have some other issues rather than what you have mentioned here, I will see if can find any solution for them.

paulocoutinhox · 2018-07-31T15:22:28Z

Ok. I will test it now. It is args for gen or for ninja call? Im trying for gen now.

paulocoutinhox · 2018-07-31T15:59:38Z

The flag "is_debug" i already use.

paulocoutinhox · 2018-07-31T16:00:42Z

My first problem is about merge all that libraries. The file size is too big.

This is to fix the issued mentioned in the following issue as the first problem: paulocoutinhox#1 With this change I am able to achieve a 38 Mb universal .a file rather than a gigabyte file.

raghuwanshi · 2018-08-02T07:30:43Z

I hope that suggested change has also reduced the files sizes for you.

hhartz · 2018-08-17T11:43:54Z

@raghuwanshi maybe make a pull request?

raghuwanshi · 2018-08-17T16:21:07Z

@hhartz I was able to fix the third problem too. Besides that I think I can automate those manual patching steps too. I am busy with something else right now. I will commit all I can do once I get some free time.

chml · 2018-08-28T09:42:11Z

THIRD PROBLEM

I merge and link with all libraries (.a), but when i use with a sample project i still have some functions not linked inside the library ".a":

Try change file third_party/BUILD.gn line 539 jumbo_source_set("pdfium_base") { to static_library("pdfium_base") {, to get the libpdfium_base.a.

raghuwanshi · 2018-08-29T13:15:28Z

@chml I tried that but that did not fix all errors. Then I found the real solution. I will commit that and make a pull request.

hhartz · 2018-08-29T13:21:31Z

I use the following patch file, which also removes the need for the whole chromium checkout (as it doesn't build the iossim test); http://ix.io/1lvz

This is to fix the issued mentioned in the following issue as the first and third problem: paulocoutinhox#1 With this change I am able to achieve a 38 Mb universal .a file rather than a gigabyte file. Linker errors; which were thrown during build of application using this library; are also fixed. Other two problems mentioned in the issue are not related to the project I am working on. I will not be able to work on them.

hhartz · 2018-08-29T13:56:05Z

@raghuwanshi did you manage to get arm to build with neon? I'm getting missing symbols

raghuwanshi · 2018-08-29T14:00:09Z

@hhartz I am using it for Xamarin.iOS. I was able to build my application for all four platforms i.e. ARM, ARM64, x86 and x64

hhartz · 2018-08-29T14:03:14Z

@raghuwanshi I'm getting linker issues for armv7, can you confirm your app builds when archiving, and that you have armv7 as one of the architectures?

  "_jsimd_ycc_extrgb_convert_neon", referenced from:
      _jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extrgbx_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extxbgr_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_ifast_neon", referenced from:
      _jsimd_idct_ifast in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_2x2_neon", referenced from:
      _jsimd_idct_2x2 in libpdfium.a(jsimd_arm.o)
  "_jsimd_h2v1_fancy_upsample_neon", referenced from:
      _jsimd_h2v1_fancy_upsample in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extbgrx_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extxrgb_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_islow_neon", referenced from:
      _jsimd_idct_islow in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_4x4_neon", referenced from:
      _jsimd_idct_4x4 in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extbgr_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_rgb565_convert_neon", referenced from:
      _jsimd_ycc_rgb565_convert in libpdfium.a(jsimd_arm.o)
ld: symbol(s) not found for architecture armv7```

paulocoutinhox · 2018-08-29T15:32:03Z

I merged the pull request, but im still getting errors:

Generated PDFium release:
https://www.dropbox.com/s/7fvj5n8ryv00xpb/pdfium-release.zip?dl=1

Sample project:
https://github.com/vfr/UXReader-iOS

** replace "libpdfium.a" from project to lib inside "pdfium-release.zip".

And have a lot of warnings about iOS version different from the used version for .a library.

chml · 2018-08-30T06:15:59Z

Add all these .a files, then it works

paulocoutinhox · 2018-08-30T17:27:45Z

But all .a files is inside the main .a file. They are merged.

paulocoutinhox · 2018-08-30T18:05:09Z

The problems in related to arm64. It is running fine on simulator. I think that zlib or something is not compiling to arm64.

paulocoutinhox · 2018-08-30T18:39:29Z

ARMv7:

Undefined symbols for architecture armv7:
  "_jsimd_ycc_extrgb_convert_neon", referenced from:
      _jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extbgr_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extbgrx_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extxrgb_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_Cr_z_inflateInit_", referenced from:
      (anonymous namespace)::FlateInit() in libpdfium.a(fx_codec_flate.o)
  "_jsimd_idct_islow_neon", referenced from:
      _jsimd_idct_islow in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_4x4_neon", referenced from:
      _jsimd_idct_4x4 in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_2x2_neon", referenced from:
      _jsimd_idct_2x2 in libpdfium.a(jsimd_arm.o)
  "_jsimd_h2v1_fancy_upsample_neon", referenced from:
      _jsimd_h2v1_fancy_upsample in libpdfium.a(jsimd_arm.o)
  "_jsimd_idct_ifast_neon", referenced from:
      _jsimd_idct_ifast in libpdfium.a(jsimd_arm.o)
  "_Cr_z_inflate", referenced from:
      (anonymous namespace)::FlateOutput(void*, unsigned char*, unsigned int) in libpdfium.a(fx_codec_flate.o)
  "_jsimd_ycc_rgb565_convert_neon", referenced from:
      _jsimd_ycc_rgb565_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extrgbx_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_jsimd_ycc_extxbgr_convert_neon", referenced from:
      l_switch.table.jsimd_ycc_rgb_convert in libpdfium.a(jsimd_arm.o)
  "_Cr_z_inflateEnd", referenced from:
      (anonymous namespace)::FlateEnd(void*) in libpdfium.a(fx_codec_flate.o)
ld: symbol(s) not found for architecture armv7
clang: error: linker command failed with exit code 1 (use -v to see invocation)

ARM64:

Undefined symbols for architecture arm64:
  "_Cr_z_inflate", referenced from:
      (anonymous namespace)::FlateOutput(void*, unsigned char*, unsigned int) in libpdfium.a(fx_codec_flate.o)
  "_Cr_z_inflateEnd", referenced from:
      (anonymous namespace)::FlateEnd(void*) in libpdfium.a(fx_codec_flate.o)
  "_Cr_z_inflateInit_", referenced from:
      (anonymous namespace)::FlateInit() in libpdfium.a(fx_codec_flate.o)
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

Changzw · 2018-09-13T11:49:10Z

libpdfium.a

Architectures in the fat file: ./libpdfium.a are: armv7 i386 x86_64 arm64
P.S. for simulator, you should add libz.tbd to your target.

platform：iOS 8.

pdfium commit hash: a38996be8

hhartz · 2018-09-13T12:06:21Z

I managed to get it building + running myself, by reverting the change that use libjpeg_turbo instead of libjpeg. @Changzw can you confirm it actually compiles if you archive a target which has armv7? in my experience it will fail due to having some specific SIMD symbols missing, even if file libpdfium.a tells you there is an armv7 segment

Changzw · 2018-09-14T03:20:16Z

I don't have armv7 devices and test armv7, but this lib can be archived.
if libpdfium.a don't include armv7, the compiler will report error

paulocoutinhox · 2018-09-14T14:47:11Z

@Changzw Put here what config you use to:

1 - Change the iOS version that library was built
2 - Include simd/z things that error happen.

Thanks.

hhartz · 2018-09-18T07:42:12Z

@prsolucoes In this branch you'll see instructions for how to build pdfium with working armv7. I took the liberty of copying your make.py (with attribution in the commit), and have a set of changes/reverts to make it work all outlined in the README.md. Basically it reverts the use of libjpeg_turbo to libjpeg. An improvement would be to only use that for arm and let it use libjpeg_turbo for other architectures, which I haven't gotten around to (yet). I played around with settings various compiler flags as mentioned in various threads, as well as adding gas-preprocessor.pl to PATH without any luck. Not a lasting solution, but it's the hammer that solves my issue at the moment :) The compiled binary can be fetched in iosprecompiled/ with git lfs fetch && git lfs update

Changzw · 2018-11-02T03:02:51Z

if you archive a target which has armv7?

I did it. use this link to download .a
#1 (comment)

hhartz · 2018-11-02T07:48:17Z

@Changzw As described in my earlier comments, I already have a working setup. Also, you should probably provide a build config instead, as people should have full control over the code they release to their customers.

paulocoutinhox · 2018-11-02T15:32:31Z

@hhartz Can you help me modify my script to build all with success? I want leave this repository as a reference to everyone that need it. After i will do the same for Android.

Changzw · 2018-11-08T11:31:44Z

it is a very huge project :( ! I not only change source code depended by pdfium, but also update UXReader code to support latest pdfium version and pdfium building config .

Sorry, I don't have enough time to do this.

peddamat · 2018-11-27T12:12:08Z

@Changzw I am unable to download the file from #1 (comment). Unfortunately, I do not read Chinese, and attempting to translate the page using Google Translate results in a 404. : ( Is there an alternative place that you can post it?

Changzw · 2018-11-30T03:02:56Z

@Changzw I am unable to download the file from #1 (comment). Unfortunately, I do not read Chinese, and attempting to translate the page using Google Translate results in a 404. : ( Is there an alternative place that you can post it?

try this.
All is bitcode version.

peddamat · 2018-12-01T07:45:07Z

@Changzw Thank you so much, I will report back with my results.

paulocoutinhox · 2019-11-17T05:50:31Z

Hi,

I solved all problems. It is working now. Check travis and new README file for instructions.

I something can be better, please report.

Thanks.

paulocoutinhox · 2019-11-18T06:16:45Z

Maybe someone could help here:
#4

paulocoutinhox · 2019-11-25T17:27:04Z

The main problem is here:

paulocoutinhox · 2019-11-26T01:54:14Z

Hi,

Problems solved. I have reimplemented read string methods from two files to solve memory bugs:

Now it is working very well on all devices.

Thanks.

raghuwanshi mentioned this issue Aug 29, 2018

Fix for Size and Symbols not found issues. #3

Merged

paulocoutinhox closed this as completed Nov 26, 2019

bthomale mentioned this issue Nov 8, 2022

iOS simulator arm64 build #67

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problems to solve to be perfect #1

Problems to solve to be perfect #1

paulocoutinhox commented May 24, 2018 •

edited

raghuwanshi commented Jul 31, 2018

paulocoutinhox commented Jul 31, 2018 •

edited

paulocoutinhox commented Jul 31, 2018

paulocoutinhox commented Jul 31, 2018

raghuwanshi commented Aug 2, 2018

hhartz commented Aug 17, 2018

raghuwanshi commented Aug 17, 2018

chml commented Aug 28, 2018

raghuwanshi commented Aug 29, 2018

hhartz commented Aug 29, 2018

hhartz commented Aug 29, 2018

raghuwanshi commented Aug 29, 2018

hhartz commented Aug 29, 2018

paulocoutinhox commented Aug 29, 2018 •

edited

chml commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

Changzw commented Sep 13, 2018 •

edited

hhartz commented Sep 13, 2018

Changzw commented Sep 14, 2018 •

edited

paulocoutinhox commented Sep 14, 2018

hhartz commented Sep 18, 2018 •

edited

Changzw commented Nov 2, 2018 •

edited

hhartz commented Nov 2, 2018

paulocoutinhox commented Nov 2, 2018

Changzw commented Nov 8, 2018

peddamat commented Nov 27, 2018 •

edited

Changzw commented Nov 30, 2018 •

edited

peddamat commented Dec 1, 2018

paulocoutinhox commented Nov 17, 2019

paulocoutinhox commented Nov 18, 2019

paulocoutinhox commented Nov 25, 2019

paulocoutinhox commented Nov 26, 2019

Problems to solve to be perfect #1

Problems to solve to be perfect #1

Comments

paulocoutinhox commented May 24, 2018 • edited

raghuwanshi commented Jul 31, 2018

paulocoutinhox commented Jul 31, 2018 • edited

paulocoutinhox commented Jul 31, 2018

paulocoutinhox commented Jul 31, 2018

raghuwanshi commented Aug 2, 2018

hhartz commented Aug 17, 2018

raghuwanshi commented Aug 17, 2018

chml commented Aug 28, 2018

raghuwanshi commented Aug 29, 2018

hhartz commented Aug 29, 2018

hhartz commented Aug 29, 2018

raghuwanshi commented Aug 29, 2018

hhartz commented Aug 29, 2018

paulocoutinhox commented Aug 29, 2018 • edited

chml commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

paulocoutinhox commented Aug 30, 2018

Changzw commented Sep 13, 2018 • edited

hhartz commented Sep 13, 2018

Changzw commented Sep 14, 2018 • edited

paulocoutinhox commented Sep 14, 2018

hhartz commented Sep 18, 2018 • edited

Changzw commented Nov 2, 2018 • edited

hhartz commented Nov 2, 2018

paulocoutinhox commented Nov 2, 2018

Changzw commented Nov 8, 2018

peddamat commented Nov 27, 2018 • edited

Changzw commented Nov 30, 2018 • edited

peddamat commented Dec 1, 2018

paulocoutinhox commented Nov 17, 2019

paulocoutinhox commented Nov 18, 2019

paulocoutinhox commented Nov 25, 2019

paulocoutinhox commented Nov 26, 2019

paulocoutinhox commented May 24, 2018 •

edited

paulocoutinhox commented Jul 31, 2018 •

edited

paulocoutinhox commented Aug 29, 2018 •

edited

Changzw commented Sep 13, 2018 •

edited

Changzw commented Sep 14, 2018 •

edited

hhartz commented Sep 18, 2018 •

edited

Changzw commented Nov 2, 2018 •

edited

peddamat commented Nov 27, 2018 •

edited

Changzw commented Nov 30, 2018 •

edited