noisechannel code issue #2738
Labels
Comments
|
What commands did you run? What's the full error message + stack trace? |
|
I just use the Example usage script with beam_size = 10. This is error message. |
facebook-github-bot
pushed a commit
that referenced
this issue
Jan 11, 2022
Summary: This is the equivalent to PR fairinternal/fairseq-py#2697 but on top of main instead of gshard (cherry-picked and merged the squash): * reorganize preprocess.py code a bit * use Binarizers objects in the multiprocess code * clean up the make_binary * multiprocess logic * learn to count * format and doc string * add basic test for vocab binarizer * generalize to one line * move multiprocess in binarizer Testing: ``` python -m fairseq_cli.preprocess --only-source --trainpref ~/fixathon/small_vocab_test/train.in --destdir ~/fixathon/small_vocab_test/data-bin.cherry --workers 20 python -m fairseq_cli.preprocess --only-source --trainpref ~/fixathon/small_vocab_test/train.in --destdir ~/fixathon/small_vocab_test/data-bin.main --workers 20 ``` ``` md5sum ~/fixathon/small_vocab_test/data-bin.cherry/train.bin == md5sum ~/fixathon/small_vocab_test/data-bin.main/train.bin ``` ``` diff ~/fixathon/small_vocab_test/data-bin.main/dict.txt ~/fixathon/small_vocab_test/data-bin.cherry/dict.tx ``` Pull Request resolved: fairinternal/fairseq-py#2738 Reviewed By: sshleifer, dianaml0 Differential Revision: D32830875 Pulled By: Mortimerp9 fbshipit-source-id: e7463d5cdd96a877691bf39666daa319ebb3dcb8
|
How was this issue fixed exactly? I still get the same error |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
🐛 Bug
For reproducing noisechannel code, I just executed the Example usage Script. But I saw some errors.
'FileNotFoundError: [Errno 2] No such file or directory:
'/home/compu/GAN/fairseq/examples/noisychannel/rerank_data/wmt17/nbest_10_subset_test_fw_name_model_ex_shard_0_of_1/rescore_data_new_bpe.en' '
In my guess, the Latest code is not uploaded. So, I hope to see the latest code.
Environment
pip, source): pip install --editable ./Additional context
The text was updated successfully, but these errors were encountered: