[R] incompatibility with M2 and M3 processors in macOS

[rafapereirabr]

Describe the bug, including details regarding any error messages, version, and platform.

It seems there is some incompatibility between the current version of the {arrow} package in R and the M2 and M3 processors in macOS. Two colleagues who have laptops with those processors have found the following ERROR when trying to run the code below:

data("mtcars")
head(mtcars)

arrow::write_parquet(mtcars, 'mtcars.parquet')

df <- arrow::read_parquet('mtcars.parquet', as_data_frame = F)
head(df)

Error in parquet__WriterProperties_Builder_create() :
Cannot call parquet__WriterProperties_Builder_create(). See https://arrow.apache.org/docs/r/articles/install.html for help installing Arrow C++ libraries

observation 1. This error does not occur in macOS or pcs with Intel processors.
observation 2. I develop the {censobr} package, which imports {arrow}, and I also noticed that the package passes all CMD Checks in all operational systems, except in macOS. See the latest cmd chek here.

Component(s)

R

[amoeba]

Hi @rafapereirabr, thanks for the report.

The latest version of the arrow R package (15.0.1) has an issue just on macOS (at least Arm, not sure about Intel but maybe not) where it's missing most of its features, including Parquet. See #40667. arrow_info() can be run to show the set of features enabled in any version of the package and I expect on any of the systems where you can't run that snippet, you'll see "parquet FALSE" under the Capabilities section in the output.

I think your options right now are:

• Wait for 16.0.0, no clear timeline yet, sorry
• Install arrow from source where needed (e.g., add 'Remotes' to your DESCRIPTION file with apache/arrow/r@apache-arrow-15.0.2, or use install.packages("arrow", type = "source")
• Install arrow from https://apache.r-universe.dev/arrow. Those binaries all have the regular set of features enabled.

Would any of those options work for you here?

[pachecotaina]

I was one of the colleagues experimenting trouble with M3.

thank you so much @amoeba, the new version from r-universe installs fine for me!!

[emprestige]

I was having a similar issue and could not resolve it until coming across this thread and installing from r-universe! Thank you so much!!

[amoeba]

I'm going to leave this open for visibility until #40667 (and the underlying issue) is resolved. Thanks for confirming the workarounds all.

[rafapereirabr]

Great. Thanks for all the work on {arrow} and for the quick support here!

[jonkeane]

Issue resolved by pull request 41019
#41019