Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[R] Clarify README about S3 support on Windows #29089

Closed
asfimport opened this issue Jul 21, 2021 · 9 comments
Closed

[R] Clarify README about S3 support on Windows #29089

asfimport opened this issue Jul 21, 2021 · 9 comments

Comments

@asfimport
Copy link

From: #10764

Hello,

I am meeting troubles to install the R arrow package with the S3 support.
Shouldn't be yet any issues since I can read from the vignette:

In Windows and macOS binary packages, S3 support is included.

However after installing arrow from the CRAN (install.packages('arrow')) as recommended, I do not have the S3 support available :

arrow::arrow_with_s3()
[1] FALSE

Still didn't work after I un- and re-installed last release.
I have not be able to find any way to fix it. Any idea ?
Thank you!

Reporter: Nicola Crane / @thisisnic
Assignee: Neal Richardson / @nealrichardson

PRs and other links:

Note: This issue was originally created as ARROW-13422. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Nicola Crane / @thisisnic:
Please could you run this:
arrow_info()

It will give us a bit more information about your setup. Thanks!

@asfimport
Copy link
Author

JrmFRL:
Hello @thisisnic

please find hereafter: 

arrow::arrow_info()
Arrow package version: 4.0.1

Capabilities:

dataset TRUE
parquet TRUE
s3 FALSE
utf8proc TRUE
re2 FALSE
snappy TRUE
gzip TRUE
brotli FALSE
zstd TRUE
lz4 TRUE
lz4_frame TRUE
lzo FALSE
bz2 FALSE
jemalloc FALSE
mimalloc TRUE

Memory:

Allocator mimalloc
Current 0 bytes
Max 0 bytes

Runtime:

SIMD Level avx2
Detected SIMD Level avx2

@asfimport
Copy link
Author

JrmFRL:
Also, here are the logs of the install.packages()

 

install.packages("arrow")
Installing package into ‘C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6’
(as ‘lib’ is unspecified)

There is a binary version available but the source version is later:
binary source needs_compilation
arrow 4.0.0 4.0.1 TRUE

installing the source package ‘arrow’

trying URL 'https://cran.rstudio.com/src/contrib/arrow_4.0.1.tar.gz'
Content type 'application/x-gzip' length 426721 bytes (416 KB)
downloaded 416 KB

  • installing source package 'arrow' ...

    • package 'arrow' successfully unpacked and MD5 sums checked

    • using staged installation

      • Writing Makevars.win
    • libs

      • arch - i386
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c array.cpp -o array.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c array_to_vector.cpp -o array_to_vector.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c arraydata.cpp -o arraydata.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c arrowExports.cpp -o arrowExports.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c buffer.cpp -o buffer.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c chunkedarray.cpp -o chunkedarray.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c compression.cpp -o compression.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c compute.cpp -o compute.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c csv.cpp -o csv.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c dataset.cpp -o dataset.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c datatype.cpp -o datatype.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c expression.cpp -o expression.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c feather.cpp -o feather.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c field.cpp -o field.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c filesystem.cpp -o filesystem.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c imports.cpp -o imports.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c io.cpp -o io.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c json.cpp -o json.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c memorypool.cpp -o memorypool.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c message.cpp -o message.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c parquet.cpp -o parquet.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c py-to-r.cpp -o py-to-r.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c r_to_arrow.cpp -o r_to_arrow.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatch.cpp -o recordbatch.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatchreader.cpp -o recordbatchreader.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatchwriter.cpp -o recordbatchwriter.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c runtimeinfo.cpp -o runtimeinfo.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c scalar.cpp -o scalar.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c schema.cpp -o schema.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c symbols.cpp -o symbols.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c table.cpp -o table.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c threadpool.cpp -o threadpool.o
        C:/Rtools/mingw_32/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c type_infer.cpp -o type_infer.o
        C:/Rtools/mingw_32/bin/g++ -shared -s -static-libgcc -o arrow.dll tmp.def array.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o expression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet.o py-to-r.o r_to_arrow.o recordbatch.o recordbatchreader.o recordbatchwriter.o runtimeinfo.o scalar.o schema.o symbols.o table.o threadpool.o type_infer.o -L../windows/arrow-4.0.1/lib-4.9.3/i386 -L../windows/arrow-4.0.1/lib/i386 -lparquet -larrow_dataset -larrow -larrow_bundled_dependencies -lutf8proc -lthrift -lsnappy -lz -lzstd -llz4 -lbcrypt -lpsapi -lcrypto -lcrypt32 -lws2_32 -LC:/PROGRA1/R/R-361.2/bin/i386 -lR
        installing to C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/00LOCK-arrow/00new/arrow/libs/i386

      • arch - x64
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c array.cpp -o array.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c array_to_vector.cpp -o array_to_vector.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c arraydata.cpp -o arraydata.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c arrowExports.cpp -o arrowExports.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c buffer.cpp -o buffer.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c chunkedarray.cpp -o chunkedarray.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c compression.cpp -o compression.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c compute.cpp -o compute.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c csv.cpp -o csv.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c dataset.cpp -o dataset.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c datatype.cpp -o datatype.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c expression.cpp -o expression.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c feather.cpp -o feather.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c field.cpp -o field.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c filesystem.cpp -o filesystem.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c imports.cpp -o imports.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c io.cpp -o io.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c json.cpp -o json.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c memorypool.cpp -o memorypool.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c message.cpp -o message.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c parquet.cpp -o parquet.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c py-to-r.cpp -o py-to-r.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c r_to_arrow.cpp -o r_to_arrow.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatch.cpp -o recordbatch.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatchreader.cpp -o recordbatchreader.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c recordbatchwriter.cpp -o recordbatchwriter.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c runtimeinfo.cpp -o runtimeinfo.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c scalar.cpp -o scalar.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c schema.cpp -o schema.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c symbols.cpp -o symbols.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c table.cpp -o table.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c threadpool.cpp -o threadpool.o
        C:/Rtools/mingw_64/bin/g++ -std=gnu++11 -I"C:/PROGRA1/R/R-361.2/include" -DNDEBUG -I../windows/arrow-4.0.1/include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -I"C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/cpp11/include" -O2 -Wall -mtune=generic -c type_infer.cpp -o type_infer.o
        C:/Rtools/mingw_64/bin/g++ -shared -s -static-libgcc -o arrow.dll tmp.def array.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o expression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet.o py-to-r.o r_to_arrow.o recordbatch.o recordbatchreader.o recordbatchwriter.o runtimeinfo.o scalar.o schema.o symbols.o table.o threadpool.o type_infer.o -L../windows/arrow-4.0.1/lib-4.9.3/x64 -L../windows/arrow-4.0.1/lib/x64 -lparquet -larrow_dataset -larrow -larrow_bundled_dependencies -lutf8proc -lthrift -lsnappy -lz -lzstd -llz4 -lbcrypt -lpsapi -lcrypto -lcrypt32 -lws2_32 -LC:/PROGRA1/R/R-361.2/bin/x64 -lR
        installing to C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6/00LOCK-arrow/00new/arrow/libs/x64

    • R

    • inst

    • byte-compile and prepare package for lazy loading

    • help

      • installing help indices
        converting help for package 'arrow'
        finding HTML links ... done
        ArrayData html
        ChunkedArray html
        Codec html
        CsvReadOptions html
        CsvTableReader html
        DataType html
        Dataset html
        DictionaryType html
        Expression html
        FeatherReader html
        Field html
        FileFormat html
        FileInfo html
        FileSelector html
        FileSystem html
        FileWriteOptions html
        FixedWidthType html
        FragmentScanOptions html
        InputStream html
        MemoryPool html
        Message html
        MessageReader html
        OutputStream html
        ParquetArrowReaderProperties html
        ParquetFileReader html
        ParquetFileWriter html
        ParquetWriterProperties html
        Partitioning html
        RecordBatch html
        RecordBatchReader html
        RecordBatchWriter html
        Scalar html
        Scanner html
        Schema html
        Table html
        array html
        arrow-package html
        arrow_available html
        arrow_info html
        buffer html
        call_function html
        cast_options html
        codec_is_available html
        compression html
        copy_files html
        cpu_count html
        data-type html
        dataset_factory html
        default_memory_pool html
        dictionary html
        enums html
        flight_connect html
        flight_get html
        flight_put html
        hive_partition html
        install_arrow html
        install_pyarrow html
        list_compute_functions html
        list_flights html
        load_flight_server html
        make_readable_file html
        map_batches html
        match_arrow html
        mmap_create html
        mmap_open html
        open_dataset html
        read_delim_arrow html
        read_feather html
        read_ipc_stream html
        read_json_arrow html
        read_message html
        read_parquet html
        read_schema html
        reexports html
        s3_bucket html
        type html
        unify_schemas html
        value_counts html
        write_dataset html
        write_feather html
        write_ipc_stream html
        write_parquet html
        write_to_raw html
    • building package indices

    • installing vignettes

    • testing if installed package can be loaded from temporary location

      • arch - i386
      • arch - x64
    • testing if installed package can be loaded from final location

      • arch - i386
      • arch - x64
    • testing if installed package keeps a record of temporary installation path

  • DONE (arrow)

     

@asfimport
Copy link
Author

Nicola Crane / @thisisnic:
[~JrmFRL] Hmm, that's interesting; in your logs there's the message "There is a binary version available but the source version is later" and it's installing the source version. On Windows, the binaries have all the dependencies bundled with the binary version, which is why S3 should "just work", but for some reason your installation has gone with the source version as it's not detected the binary version of 4.0.1 in the repo it's downloading it from, and so S3 isn't enabled.

I've got a few things to try. Firstly, let's check there's not something strange with the studio CRAN mirror you're downloading from; please could you see if it still does the same thing if you run:

install.packages("arrow", repos = "https://cloud.r-project.org")

Alternatively, you could try forcing it to install the binary even if it's an older one:

install.packages("arrow", type = "win.binary")

I would like to help enable you to be able to download the latest version though, and have a couple of ideas to look into, so if you try the above solutions, would you mind sharing the install output? Thanks!

@asfimport
Copy link
Author

Jonathan Keane / @jonkeane:
Another question that might help us: it looks like you might be running R version 3.6 (based on the line I've copied below). Is that accurate?

C:/Users/john.doe/OneDrive - company/Documents/R/win-library/3.6

@asfimport
Copy link
Author

Neal Richardson / @nealrichardson:
That's the issue: S3 support on Windows is only available for R >= 4.0 https://github.com/apache/arrow/blob/master/ci/scripts/PKGBUILD#L81

We should update our readme to be clear about that.

@asfimport
Copy link
Author

JrmFRL:
@nealrichardson

hu oh, that is why then. 

Thank you for the answer! You can close the issue.

@thisisnic  : indeed I'm running R 3.6.x on this machine. 

@asfimport
Copy link
Author

Neal Richardson / @nealrichardson:
The installation vignette has been updated to reflect this. I think all that's left is to update the README.md.

@asfimport
Copy link
Author

Neal Richardson / @nealrichardson:
Issue resolved by pull request 11411
#11411

@asfimport asfimport added this to the 6.0.0 milestone Jan 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants