Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

install error #905

Closed
mtfelix opened this issue Jul 24, 2019 · 9 comments
Closed

install error #905

mtfelix opened this issue Jul 24, 2019 · 9 comments

Comments

@mtfelix
Copy link

mtfelix commented Jul 24, 2019

After installing pytorch, I installed fairseq following the introduction, but got the errors below:

pip install fairseq
Collecting fairseq
Using cached https://files.pythonhosted.org/packages/1c/13/41fb03306f9e50581210d2fb24f2f056f700f9ffdddb0f7734c7bda5d715/fairseq-0.7.2.tar.gz
Requirement already satisfied: cffi in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.9.1)
Requirement already satisfied: numpy in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.16.4)
Requirement already satisfied: sacrebleu in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.3.7)
Requirement already satisfied: torch in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.1.0)
Requirement already satisfied: tqdm in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (4.32.1)
Requirement already satisfied: pycparser in /Users/superman/anaconda/lib/python3.6/site-packages (from cffi->fairseq) (2.17)
Requirement already satisfied: typing in /Users/superman/anaconda/lib/python3.6/site-packages (from sacrebleu->fairseq) (3.7.4)
Requirement already satisfied: portalocker in /Users/superman/anaconda/lib/python3.6/site-packages (from sacrebleu->fairseq) (1.5.0)
Building wheels for collected packages: fairseq
Building wheel for fairseq (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; file='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-wheel-0iolc_t8 --python-tag cp36
cwd: /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/
Complete output (166 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.macosx-10.7-x86_64-3.6
creating build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/legacy_distributed_data_parallel.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/options.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/meters.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/registry.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/bleu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_generator.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/pdb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/hub_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_scorer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/checkpoint_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/distributed_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/file_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/search.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/progress_bar.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/trainer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/binarizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
creating build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/preprocess.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/generate.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/setup.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/interactive.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/train.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/eval_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/score.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/fairseq_task.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/multilingual_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/language_modeling.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/audio_pretraining.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/semisupervised_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/cross_lingual_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/nag.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/lamb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/bmuf.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adafactor.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/sgd.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fairseq_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fp16_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adagrad.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adam.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adadelta.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_self_att.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/multilingual_transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/distributed_fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/wav2vec.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lstm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/composite_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_incremental_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/beamable_mm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/downsampled_multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/mean_pool_gating_network.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/learned_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/grad_multiply.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/character_token_embedder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_softmax.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/conv_tbc.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/unfold.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/gelu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/linearized_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder_layer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/highway.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/dynamic_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_input.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/lightweight_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/scalar_bias.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/logsumexp_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/sinusoidal_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/layer_norm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/concat_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/backtranslation_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/block_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/multi_corpus_sampled_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/noising.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/monolingual_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/data_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/round_robin_zip_datasets.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/iterators.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/language_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/indexed_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/fairseq_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/lm_context_window_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/token_block_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_lang_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/masked_lm_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/fairseq_criterion.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/adaptive_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/label_smoothed_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/composite_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/binary_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fixed_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/polynomial_decay_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/inverse_square_root_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/cosine_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/triangular_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/raw_audio_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/sentencepiece_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/nltk_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/gpt2_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/subword_nmt_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/space_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/moses_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
running build_ext
building 'fairseq.libbleu' extension
creating build/temp.macosx-10.7-x86_64-3.6
creating build/temp.macosx-10.7-x86_64-3.6/fairseq
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1

ERROR: Failed building wheel for fairseq
Running setup.py clean for fairseq
Failed to build fairseq
Installing collected packages: fairseq
Running setup.py install for fairseq ... error
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; file='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-record-w8a267u9/install-record.txt --single-version-externally-managed --compile
cwd: /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/
Complete output (166 lines):
running install
running build
running build_py
creating build
creating build/lib.macosx-10.7-x86_64-3.6
creating build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/legacy_distributed_data_parallel.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/options.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/meters.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/registry.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/bleu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_generator.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/pdb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/hub_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_scorer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/checkpoint_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/distributed_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/file_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/search.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/progress_bar.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/trainer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/binarizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
creating build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/preprocess.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/generate.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/setup.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/interactive.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/train.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/eval_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/score.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/fairseq_task.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/multilingual_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/language_modeling.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/audio_pretraining.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/semisupervised_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/cross_lingual_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/nag.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/lamb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/bmuf.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adafactor.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/sgd.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fairseq_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fp16_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adagrad.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adam.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adadelta.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_self_att.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/multilingual_transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/distributed_fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/wav2vec.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lstm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/composite_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_incremental_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/beamable_mm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/downsampled_multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/mean_pool_gating_network.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/learned_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/grad_multiply.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/character_token_embedder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_softmax.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/conv_tbc.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/unfold.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/gelu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/linearized_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder_layer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/highway.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/dynamic_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_input.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/lightweight_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/scalar_bias.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/logsumexp_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/sinusoidal_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/layer_norm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/concat_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/backtranslation_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/block_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/multi_corpus_sampled_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/noising.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/monolingual_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/data_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/round_robin_zip_datasets.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/iterators.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/language_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/indexed_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/fairseq_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/lm_context_window_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/token_block_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_lang_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/masked_lm_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/fairseq_criterion.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/adaptive_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/label_smoothed_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/composite_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/binary_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fixed_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/polynomial_decay_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/inverse_square_root_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/cosine_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/triangular_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/raw_audio_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/sentencepiece_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/nltk_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/gpt2_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/subword_nmt_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/init.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/space_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/moses_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
running build_ext
building 'fairseq.libbleu' extension
creating build/temp.macosx-10.7-x86_64-3.6
creating build/temp.macosx-10.7-x86_64-3.6/fairseq
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; file='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-record-w8a267u9/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
@mtfelix
Copy link
Author

mtfelix commented Jul 24, 2019

then I tried another way： Installing from source. And got the error below:

Installing collected packages: fairseq
Running setup.py develop for fairseq
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"'; file='"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' develop --no-deps
cwd: /Users/superman/Documents/work/pytorch-prj/fairseq/
Complete output (18 lines):
running develop
running egg_info
writing fairseq.egg-info/PKG-INFO
writing dependency_links to fairseq.egg-info/dependency_links.txt
writing entry points to fairseq.egg-info/entry_points.txt
writing requirements to fairseq.egg-info/requires.txt
writing top-level names to fairseq.egg-info/top_level.txt
reading manifest file 'fairseq.egg-info/SOURCES.txt'
writing manifest file 'fairseq.egg-info/SOURCES.txt'
running build_ext
building 'fairseq.libbleu' extension
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/superman/anaconda/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"'; file='"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

@jeremyasapp
Copy link

Same here :(

@XiaoqingNLP
Copy link

@jeremyasapp @mtfelix the errors has been placed in your log, You need google to install library

ld: library not found for -lstdc++

@simonefrancia
Copy link
Contributor

apt-get update && apt-get install build-essential ?

@znculee
Copy link

znculee commented Nov 25, 2019

At commit 5349052aae4ec1350822c894fbb6be350dff61a0, excuting pip install -e . cause the following error.

Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Installing collected packages: fairseq
  Running setup.py develop for fairseq
    ERROR: Command errored out with exit status 1:
     command: /home/username/miniconda3/envs/pt13/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/username/workspace/fairseq/setup.py'"'"'; __file__='"'"'/home/username/workspace/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
         cwd: /home/username/workspace/fairseq/
    Complete output (26 lines):
    which: no nvcc in (/home/username/bin:/home/username/miniconda3/envs/pt13/bin:/home/username/.linuxbrew/bin:/usr/local/torque-6.1.3/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin)
    running develop
    running egg_info
    writing fairseq.egg-info/PKG-INFO
    writing dependency_links to fairseq.egg-info/dependency_links.txt
    writing entry points to fairseq.egg-info/entry_points.txt
    writing requirements to fairseq.egg-info/requires.txt
    writing top-level names to fairseq.egg-info/top_level.txt
    reading manifest file 'fairseq.egg-info/SOURCES.txt'
    writing manifest file 'fairseq.egg-info/SOURCES.txt'
    running build_ext
    skipping 'fairseq/data/data_utils_fast.cpp' Cython extension (up-to-date)
    skipping 'fairseq/data/token_block_utils_fast.cpp' Cython extension (up-to-date)
    building 'fairseq.libbleu' extension
    gcc -pthread -B /home/username/miniconda3/envs/pt13/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/username/miniconda3/envs/pt13/include/python3.7m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o -std=c++11 -O3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=libbleu -D_GLIBCXX_USE_CXX11_ABI=0
    cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
    gcc -pthread -B /home/username/miniconda3/envs/pt13/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/username/miniconda3/envs/pt13/include/python3.7m -c fairseq/clib/libbleu/module.cpp -o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/module.o -std=c++11 -O3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=libbleu -D_GLIBCXX_USE_CXX11_ABI=0
    cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
    g++ -pthread -shared -B /home/username/miniconda3/envs/pt13/compiler_compat -L/home/username/miniconda3/envs/pt13/lib -Wl,-rpath=/home/username/miniconda3/envs/pt13/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/module.o -o build/lib.linux-x86_64-3.7/fairseq/libbleu.cpython-37m-x86_64-linux-gnu.so
    /home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
    /home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
    /home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
    /home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
    build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: file not recognized: file format not recognized
    collect2: error: ld returned 1 exit status
    error: command 'g++' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: /home/username/miniconda3/envs/pt13/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/username/workspace/fairseq/setup.py'"'"'; __file__='"'"'/home/username/workspace/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

@znculee
Copy link

znculee commented Nov 25, 2019 •
edited
Loading

Solved by using /usr/bin/g++ instead of /home/username/.linuxbrew/bin/g++.

username@hostname:~
$ /usr/bin/g++ --version
g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

username@hostname:~
$ .linuxbrew/bin/g++ --version
g++ (Homebrew gcc 5.5.0_4) 5.5.0
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

[username@hostname]:~/workspace/fairseq
$ pip install -e .
Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Installing collected packages: fairseq
  Running setup.py develop for fairseq
Successfully installed fairseq

@lematt1991
Copy link
Contributor

Sounds like this is resolved.

@jwc19890114
Copy link

Solved by using /usr/bin/g++ instead of /home/username/.linuxbrew/bin/g++.

username@hostname:~
$ /usr/bin/g++ --version
g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

username@hostname:~
$ .linuxbrew/bin/g++ --version
g++ (Homebrew gcc 5.5.0_4) 5.5.0
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

[username@hostname]:~/workspace/fairseq
$ pip install -e .
Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Installing collected packages: fairseq
  Running setup.py develop for fairseq
Successfully installed fairseq

if i install in win10, how to fix this problem?

@preeth04
Copy link

preeth04 commented Feb 3, 2022

Solved by using /usr/bin/g++ instead of /home/username/.linuxbrew/bin/g++.

username@hostname:~
$ /usr/bin/g++ --version
g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

username@hostname:~
$ .linuxbrew/bin/g++ --version
g++ (Homebrew gcc 5.5.0_4) 5.5.0
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

[username@hostname]:~/workspace/fairseq
$ pip install -e .
Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Installing collected packages: fairseq
  Running setup.py develop for fairseq
Successfully installed fairseq

if i install in win10, how to fix this problem?

any fix for windows 10 found yet?

yfyeung pushed a commit to yfyeung/fairseq that referenced this issue Dec 6, 2023
@yaozengwei
add ctc-greedy-search with timestamps (facebookresearch#905)
25ee50e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@mtfelix @jwc19890114 @simonefrancia @XiaoqingNLP @lematt1991 @znculee @jeremyasapp @preeth04