Handling large resultset

[koenedaele]

Currently the find and get_all operations all return a list. It would be niceto be able to return something like a list-like class that can do lazy loading of results. Something like an iterable class that can load data in chunks through a callback or by subclassing it and supports most or all operations a list does?

Would probably be very useful in skosprovider_sqlalchemy and skosprovider_getty (provided it's possible to chunk results in the Getty services)? Not much point in using this with a MemoryProvider based backend.