Error handling

[AzHicham]

Hello,

It could be really nice to add error handling while fetching.
eg. For Dataset that reads data from IO file/http .....
Currently we can only unwrap/expect.
One solution could be to allow fetch to return a Result. And then collat if all Result are Ok
Iterator then return a Result<Batch, Self::E>

[AzHicham]

@Tudyx WDYT of this ?

[Tudyx]

I'm kind of mitigated of this, I'm afraid it will deteriorate the API. For files we can panic, it will be more or less equivalent about how python handle this case.
For network, it makes more sense to define another trait, an async one, and then we can put a Result on this one.

But I'm not close to this, if this is a really wanted feature I might change my mind.

[AzHicham]

Ok I un understand your POV.
Right now I'm using ai-dataloader to load data through network (a server allow me to retrieve images).
Using async cool be a great addition indeed !

[AzHicham]

Another detail is that in python we can throw exceptions when we get_samples, and catch it in the main program.
However this cannot be done in rust without using Result (ie only using unwrap)