Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

wikitext-2 is not available anymore #2247

Open
huangjia2019 opened this issue Mar 26, 2024 · 0 comments
Open

wikitext-2 is not available anymore #2247

huangjia2019 opened this issue Mar 26, 2024 · 0 comments

Comments

@huangjia2019
Copy link

huangjia2019 commented Mar 26, 2024

馃悰 Bug

Describe the bug

requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip
This exception is thrown by iter of HTTPReaderIterDataPipe(skip_on_error=False, source_datapipe=OnDiskCacheHolderIterDataPipe, timeout=None)

To Reproduce Steps to reproduce the behavior:

from torchtext.datasets import WikiText2
from torchtext.data.utils import get_tokenizer
from torchtext.vocab import build_vocab_from_iterator
from torch.utils.data import DataLoader, Dataset

tokenizer = get_tokenizer("basic_english")

train_iter = WikiText2(split='train')
valid_iter = WikiText2(split='valid')

def yield_tokens(data_iter):
for item in data_iter:
yield tokenizer(item)

vocab = build_vocab_from_iterator(yield_tokens(train_iter),
specials=["", "", ""])
vocab.set_default_index(vocab[""])

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Environment

Please copy and paste the output from our
environment collection script (or
fill out the checklist below manually).

You can get the script and run it with:

wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip

  • PyTorch Version (e.g., 1.0):
  • OS (e.g., Linux):
  • How you installed PyTorch (conda, pip, source):
  • Build command you used (if compiling from source):
  • Python version:
  • CUDA/cuDNN version:
  • GPU models and configuration:
  • Any other relevant information:

Additional context Add any other context about the problem here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant