-
Notifications
You must be signed in to change notification settings - Fork 183
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Installation Error #30
Comments
Hmmmm, looks like the tokenizers package (a dependency of tidytext) is not installing correctly for you. |
Thanks for the feedback. I already opened an issue on the package page and upgraded Centos and GCC. But the compilation is still failing for that package. cat /etc/centos-release gcc --version I am wondering if other folks are having the same issue. |
I haven't heard of anybody else running into this issue at this point, I'm afraid. |
Same error for me. Im not sure if it is because of the gcc version 4.8. But probably it is. |
Tried it with gcc 4.4.7. Still not working |
Have you tried getting some help over at the tokenizers package? |
yep I have already asked the question there. All versions (R,gcc,binutils etc) are up to date. Still searching what is causing the error. |
Hello, I'm getting the same issue, has anyone come up with a solution? |
I am having same issue with below errors. I am using Linux 6.8 with gcc-c++ 4.4 shingle_ngrams.cpp:28: error: expected initializer before ‘:’ token shingle_ngrams.cpp:44: error: ‘len’ was not declared in this scope |
Yep, those are errors from the tokenizers package. I see that you have asked over there on an issue in that repo, which is the right way to go. You might also show them the exact errors you are getting, like you did here. |
Just a note - I think that this is caused by the dependency tokenizers has on C++11. It may be possible to switch the code to C++98, which would widen the number of compilers it can be used on. I've extended an offer to Lincoln to do that, since it's too makework for him to really be enthusiastic about but would help clear a couple of open issues and expand the usability of tokenizers and its dependent packages. |
@statspro1 this should now be fixed; if you run:
before installing tidytext, you'll have a version which works swimmingly on CentOS with older GCC versions. It'll be in the next CRAN release, too, but in the meantime grabbing that developer version is the solution, and this bug is officially fixed! |
@Ironholds Thank you SO MUCH for your work in getting this installation issue hammered out. ⭐⭐⭐ |
Noo problem! Although now it looks like I'm clearing |
This issue has been automatically locked. If you believe you have found a related problem, please file a new issue (with a reprex: https://reprex.tidyverse.org) and link to this issue. |
2016-11-15 12:43:46 (1.23 MB/s) - “/tmp/RtmpbgvQJi/tokenizers_0.1.4.tar.gz” saved [50453/50453]
Installing tokenizers
'/usr/lib64/R/bin/R' --no-site-file --no-environ --no-save --no-restore
--quiet CMD INSTALL '/tmp/RtmpbgvQJi/devtoolsb60b281702c/tokenizers'
--library='/home/R/x86_64-redhat-linux-gnu-library/3.2'
--install-tests
** package ‘tokenizers’ successfully unpacked and MD5 sums checked
** libs
g++ -m64 -std=c++0x -I/usr/include/R -I/usr/local/include -I"/home/R/x86_64-redhat-linux-gnu-library/3.2/Rcpp/include" -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -c RcppExports.cpp -o RcppExports.o
g++ -m64 -std=c++0x -I/usr/include/R -I/usr/local/include -I"/home/R/x86_64-redhat-linux-gnu-library/3.2/Rcpp/include" -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -c shingle_ngrams.cpp -o shingle_ngrams.o
shingle_ngrams.cpp: In function ‘Rcpp::CharacterVector generate_ngrams_internal(Rcpp::CharacterVector, uint32_t, uint32_t, std::tr1::unordered_set<std::basic_string<char, std::char_traits, std::allocator >, std::tr1::hash<std::basic_string<char, std::char_traits, std::allocator > >, std::equal_to<std::basic_string<char, std::char_traits, std::allocator > >, std::allocator<std::basic_string<char, std::char_traits, std::allocator > > >&, std::vector<std::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::basic_string<char, std::char_traits, std::allocator > > >&, std::string)’:
shingle_ngrams.cpp:28: error: expected initializer before ‘:’ token
shingle_ngrams.cpp:35: error: expected primary-expression before ‘ngram_out_len’
shingle_ngrams.cpp:35: error: expected ‘)’ before ‘ngram_out_len’
shingle_ngrams.cpp:35: error: ‘ngram_out_len’ was not declared in this scope
shingle_ngrams.cpp:36: error: ‘ngram_out_len’ was not declared in this scope
shingle_ngrams.cpp:44: error: ‘len’ was not declared in this scope
shingle_ngrams.cpp: In function ‘Rcpp::ListOf<Rcpp::Vector<16, Rcpp::PreserveStorage> > generate_ngrams_batch(Rcpp::ListOf<const Rcpp::Vector<16, Rcpp::PreserveStorage> >, uint32_t, uint32_t, Rcpp::CharacterVector, Rcpp::String)’:
shingle_ngrams.cpp:80: error: expected initializer before ‘:’ token
shingle_ngrams.cpp:83: error: expected primary-expression before ‘for’
shingle_ngrams.cpp:83: error: expected ‘;’ before ‘for’
shingle_ngrams.cpp:83: error: expected primary-expression before ���for’
shingle_ngrams.cpp:83: error: expected ‘)’ before ‘for’
make: *** [shingle_ngrams.o] Error 1
ERROR: compilation failed for package ‘tokenizers’
Error: Command failed (1)
locale:
[1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
[3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8
[5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
[7] LC_PAPER=en_US.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] devtools_1.12.0
loaded via a namespace (and not attached):
[1] httr_1.2.1 R6_2.2.0 tools_3.2.3 withr_1.0.2 curl_2.2
[6] memoise_1.0.0 knitr_1.11 git2r_0.15.0 digest_0.6.10
Thanks!
The text was updated successfully, but these errors were encountered: