Zero-sized dimensions while batchifying

[aayux]

Traceback (most recent call last):
  File "finetune.py", line 69, in <module>
    main()
  File "finetune.py", line 21, in main
    loader = ff.Loader(train, val, lang='en', bs=64, bptt=60)
  File "/home/guest/user/fitfast/trainer.py", line 70, in __init__
    self.val = LanguageModelIterator(val_ids, bs, bptt)
  File "/home/guest/user/fitfast/text.py", line 19, in __init__
    self.data = self.batchify(data)
  File "/home/guest/user/fitfast/text.py", line 45, in batchify
    return T(data)
  File "/home/guest/user/fitfast/utils/core.py", line 28, in T
    a = torch.LongTensor(a.astype(np.int64))
RuntimeError: the given numpy array has zero-sized dimensions. Zero-sized dimensions are not supported in PyTorch

[aayux]

This occurs on small datasets where batch size is larger than the data length. A related issue is when the large batch size causes __len__() for LanguageModelIterator objects to return -1 (why?).

TO DO: Catch and handle these conditions.