error: command 'gcc' failed with exit status 1 - fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found #289

johndpope · 2018-09-25T16:15:21Z

ython setup.py build develop
running build
running build_py
running build_ext
building 'fairseq.libbleu' extension
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/jpope/miniconda3/envs/tf/include -arch x86_64 -I/Users/jpope/miniconda3/envs/tf/include -arch x86_64 -I/Users/jpope/miniconda3/envs/tf/include/python3.7m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.7/fairseq/clib/libbleu/libbleu.o -std=c++11
fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found
#include
^~~~~
1 error generated.
error: command 'gcc' failed with exit status 1

I'm on majove / 10.14
I have xcode 10.1 beta installed with command line tools.

xcodebuild -version && xcrun --find clang --version
Xcode 9.4.1
Build version 9F2000
Apple LLVM version 9.1.0 (clang-902.0.39.2)
Target: x86_64-apple-darwin18.0.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

The text was updated successfully, but these errors were encountered:

johndpope · 2018-09-25T16:22:22Z

related - facebook/infer#37

facebook/infer#69

johndpope · 2018-09-25T16:25:32Z

actually - above error was on 9.4.1

I tried switching to 10.1 and same error.

xcodebuild -version && xcrun --find clang --version
Xcode 10.1
Build version 10O23u
Apple LLVM version 10.0.0 (clang-1000.11.45.5)
Target: x86_64-apple-darwin18.0.0
Thread model: posix
InstalledDir: /Applications/Xcode-beta.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
(tf) ➜ fairseq git:(master) ✗ /Users/jpope/Documents/tensorflowWorkspace/fairseq
(tf) ➜ fairseq git:(master) ✗ python setup.py build develop
running build
running build_py
running build_ext
building 'fairseq.libbleu' extension
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/jpope/miniconda3/envs/tf/include -arch x86_64 -I/Users/jpope/miniconda3/envs/tf/include -arch x86_64 -I/Users/jpope/miniconda3/envs/tf/include/python3.7m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.7/fairseq/clib/libbleu/libbleu.o -std=c++11
warning: include path for stdlibc++ headers not found; pass '-std=libc++' on the command line to use the libc++ standard library instead [-Wstdlibcxx-not-found]
fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found
#include
^~~~~
1 warning and 1 error generated.
error: command 'gcc' failed with exit status 1

johndpope · 2018-09-25T16:30:20Z

setup.py

bleu = Extension(
    'fairseq.libbleu',
    sources=[
        'fairseq/clib/libbleu/libbleu.cpp',
        'fairseq/clib/libbleu/module.cpp',
    ],
    extra_compile_args=['-std=libc++'],
)

this didn't work.

Xcode 10 beta 4 - stdlibc++ headers not found;
https://forums.developer.apple.com/thread/106114

johndpope · 2018-09-25T16:35:38Z

(tf) ➜ fairseq git:(master) ✗ gcc --version
Configured with: --prefix=/Applications/Xcode-beta.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode-beta.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include/c++/4.2.1
Apple LLVM version 10.0.0 (clang-1000.11.45.5)
Target: x86_64-apple-darwin18.0.0
Thread model: posix
InstalledDir: /Applications/Xcode-beta.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
(tf) ➜ fairseq git:(master) ✗ whereis gcc
/usr/bin/gcc
(tf) ➜ fairseq git:(master) ✗ whereis make
/usr/bin/make

johndpope · 2018-09-25T16:40:43Z

so the folder c++ doesn't exist for MacOSX10.14

/Applications/Xcode-beta.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include/???

I dragged the c++ folder from
/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.13.sdk

to
/Applications/Xcode-beta.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk

which solved the missing map error - but now I got missing array error.

johndpope · 2018-09-25T16:49:12Z

c++ --version
c++ (GCC) 4.8.5
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE

johndpope · 2018-09-25T16:51:17Z

fixed it using DGTEST_USE_OWN_TR1_TUPLE=1
extra_compile_args=['-stdlib=libc++','-DGTEST_USE_OWN_TR1_TUPLE=1'],
https://gist.github.com/johndpope/7d221fcccb4d478e3450792584566eef

tlikhomanenko · 2018-11-07T17:38:38Z

For Linux system solution for me was using export CFLAGS='-std=c++11' before calling python setup.py build develop.

likeucode · 2018-11-10T06:29:06Z

For mac os Mojave for me was using export CFLAGS='-stdlib=libc++' before calling python setup.py install

krazyeom · 2018-12-19T07:57:16Z

For mac os Mojave for me was using export CFLAGS='-stdlib=libc++' before calling python setup.py install

thanks a lot. It works for me.

gcunhase · 2019-02-07T07:03:07Z

@tlikhomanenko I'm using Ubuntu but I'm still getting the same error even after exporting CFLAGS... any suggestion?

This is the error I get:

building 'fairseq.libbleu' extension
[...]
fairseq/clib/libbleu/module.cpp:9.20: fatal error: Python.h: No such file or directory
compilation terminated.
error: command 'x68_64-linux-gnu-gcc' failed with exit status 1

eguoguo321 · 2019-03-11T03:06:02Z

For mac os Mojave for me was using export CFLAGS='-stdlib=libc++' before calling python setup.py install

THX a lot,you really help me ,it cost me a lot lot lot lot time to solve.feeling my brain is been eating by Zombi

Summary: Fairseq wouldn't install on macOS. A workaround was found here: #289 This is now automatic in setup.py, maybe be there's a cleaner way to do it. I checked that it compiles fine on Linux and macOS. Pull Request resolved: #862 Differential Revision: D16142105 Pulled By: myleott fbshipit-source-id: 998ac7781d7a1ac047f4f9239c1fe16eab4be0dd

SimahoJr · 2019-07-23T11:36:47Z

For mac os Mojave for me was using export CFLAGS='-stdlib=libc++' before calling python setup.py install

Thank you @likeucode , it works also for me

marikgoldstein · 2019-08-06T11:55:09Z

For mac os Mojave for me was using export CFLAGS='-stdlib=libc++' before calling python setup.py install

Also worked for me! Thank you !

cloudy-sfu · 2023-06-14T11:07:50Z

@tlikhomanenko I'm using Ubuntu but I'm still getting the same error even after exporting CFLAGS... any suggestion?

This is the error I get:
building 'fairseq.libbleu' extension
[...]
fairseq/clib/libbleu/module.cpp:9.20: fatal error: Python.h: No such file or directory
compilation terminated.
error: command 'x68_64-linux-gnu-gcc' failed with exit status 1

Same problem. Any update?

ashleykleynhans · 2023-08-23T21:50:40Z

@tlikhomanenko I'm using Ubuntu but I'm still getting the same error even after exporting CFLAGS... any suggestion?
This is the error I get:
building 'fairseq.libbleu' extension
[...]
fairseq/clib/libbleu/module.cpp:9.20: fatal error: Python.h: No such file or directory
compilation terminated.
error: command 'x68_64-linux-gnu-gcc' failed with exit status 1
Same problem. Any update?

apt install python3-dev

…ebookresearch#289)

…ebookresearch#336) See also facebookresearch#289

johndpope closed this as completed Sep 25, 2018

louismartin mentioned this issue Jul 5, 2019

Add specific compile flags for macOS #862

Closed

GregoireMialon mentioned this issue Aug 27, 2020

ENH compilation on OSX inria-thoth/cyanure#10

Closed

yfyeung pushed a commit to yfyeung/fairseq that referenced this issue Dec 6, 2023

Support specifying iteration number of checkpoints for decoding. (fac…

87cf923

…ebookresearch#289)

yfyeung pushed a commit to yfyeung/fairseq that referenced this issue Dec 6, 2023

Support specifying iteration number of checkpoints for decoding. (fac…

caab6cf

…ebookresearch#336) See also facebookresearch#289

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

error: command 'gcc' failed with exit status 1 - fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found #289

error: command 'gcc' failed with exit status 1 - fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found #289

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018

tlikhomanenko commented Nov 7, 2018

likeucode commented Nov 10, 2018

krazyeom commented Dec 19, 2018

gcunhase commented Feb 7, 2019 •

edited

Loading

eguoguo321 commented Mar 11, 2019

SimahoJr commented Jul 23, 2019

marikgoldstein commented Aug 6, 2019

cloudy-sfu commented Jun 14, 2023

ashleykleynhans commented Aug 23, 2023

error: command 'gcc' failed with exit status 1 - fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found #289

error: command 'gcc' failed with exit status 1 - fairseq/clib/libbleu/libbleu.cpp:9:10: fatal error: 'map' file not found #289

Comments

johndpope commented Sep 25, 2018 • edited Loading

johndpope commented Sep 25, 2018 • edited Loading

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018 • edited Loading

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018

johndpope commented Sep 25, 2018 • edited Loading

johndpope commented Sep 25, 2018

tlikhomanenko commented Nov 7, 2018

likeucode commented Nov 10, 2018

krazyeom commented Dec 19, 2018

gcunhase commented Feb 7, 2019 • edited Loading

eguoguo321 commented Mar 11, 2019

SimahoJr commented Jul 23, 2019

marikgoldstein commented Aug 6, 2019

cloudy-sfu commented Jun 14, 2023

ashleykleynhans commented Aug 23, 2023

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018 •

edited

Loading

johndpope commented Sep 25, 2018 •

edited

Loading

gcunhase commented Feb 7, 2019 •

edited

Loading