You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A search engine indexer module uses a queryset iterator to iterate over all the records to index. This sends a sql query to the database to fetch all data, but also to iterate over it and not to actually fetch all of this. Cachalot intercepts the request and seems to ignore the fact that it is going to iterate, instead fetching all the data from the table. This caused on out of memory error on the server.
What should've happened instead?
Cachalot should understand that the query was sent by an iterator and just let it query the database the way it did OR have support for this iteration process and get the right data from the cache somehow.
Steps to reproduce
OS -> Ubuntu
Django version -> 4.2.9
Database -> Postgres
django-cachalot -> 2.6.2
The text was updated successfully, but these errors were encountered:
lucasmoeskops
changed the title
Bug when using queryset iterator
Out of memory error when using queryset iterator
May 7, 2024
What happened?
A search engine indexer module uses a queryset iterator to iterate over all the records to index. This sends a sql query to the database to fetch all data, but also to iterate over it and not to actually fetch all of this. Cachalot intercepts the request and seems to ignore the fact that it is going to iterate, instead fetching all the data from the table. This caused on out of memory error on the server.
What should've happened instead?
Cachalot should understand that the query was sent by an iterator and just let it query the database the way it did OR have support for this iteration process and get the right data from the cache somehow.
Steps to reproduce
OS -> Ubuntu
Django version -> 4.2.9
Database -> Postgres
django-cachalot -> 2.6.2
The text was updated successfully, but these errors were encountered: