Regarding lack of drop_last in Deepspeed Trainloader

[rsn870]

Hi ,

After encountering problems during training with my custom dataset using Deepspeed Initialize , I have narrowed the problem to the fact that since the number of images in my dataset is not divisible by the batch size , Deepspeed is throwing an error. This is easily resolvable in torch Dataloader by setting drop_last = True , the Deepspeed.pt.Dataloader source code however does not use this argument at all .

Could this be added to the source please ?

If not , please suggest an alternative means for training

[tjruwase]

Hi, thanks for reporting this issue. We will work on this as soon as possible. However, if you can prepare a PR, that would be great as well.

[rsn870]

Sure , thanks for your prompt response . I will try preparing a PR asap