[R] "docker-compose run r" fails

[asfimport]

I get the following failure:

** testing if installed package can be loaded from temporary location
Error: package or namespace load failed for 'arrow' in dyn.load(file, DLLpath = DLLpath, ...):
 unable to load shared object '/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':
  /opt/conda/lib/libarrow.so.100: undefined symbol: LZ4F_resetDecompressionContext
Error: loading failed
Execution halted
ERROR: loading failed
* removing '/usr/local/lib/R/site-library/arrow'

Reporter: Antoine Pitrou / @pitrou
Assignee: Francois Saint-Jacques / @fsaintjacques

Related issues:

• [CI][Crossbow] Nightly R docker job fails (is duplicated by)

PRs and other links:

• GitHub Pull Request #5295

_{Note: This issue was originally created as ARROW-6171. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
This still happens here. @nealrichardson do you have any idea where this comes from?

[asfimport]

Neal Richardson / @nealrichardson:
Looks like a dependency version mismatch to me, but I've never used R with the docker-compose setup or with conda so I couldn't say further.

[asfimport]

Neal Richardson / @nealrichardson:
To be clear, a C++ dependency mismatch.

[asfimport]

Francois Saint-Jacques / @fsaintjacques:
export R_LD_LIBRARY_PATH=$LD_LIBRARY_PATH fixes the issue. According to [R documentation|[https://colinfay.me/r-installation-administration/add-on-packages.html]], it shouldn't be required. I've asked the R specialist, we'll see their answer.

[asfimport]

Neal Richardson / @nealrichardson:
This feature (such as it is) is documented in our README from when Wes ran into it: 26666df

Earlier discussion, including links to the official R documentation: #5036 (comment)

I'm guessing that that's when the problem began.

Aside: I noticed that the nightly test version of this job took 50 minutes (and that's just when it failed). That's really slow, much slower than even the Travis job. So I question the value of what we're doing in that nightly job.

[asfimport]

Francois Saint-Jacques / @fsaintjacques:
Yes. the 50 minutes is because it rebuilds the R docker image every time which is... painful.

[asfimport]

Neal Richardson / @nealrichardson:
Is that necessary?

[asfimport]

Wes McKinney / @wesm:
Issue resolved by pull request 5295
#5295