Bad behaviour on TweetDataset

[Galeos93]

I think TweetDataset will not work directly if I feed it to DataLoader. This is so because of the different lenghts of the sentences. This fact makes their aggrupation on a batch impossible. I have to find out how to fix it.

For example, here, they use collate_fn=collate_batch to "flatten" the sentences into a giant unidimensional vector. I will see if there are alternatives to this.