You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was playing with the .append of a store and I saw that it was very slow compared to a load_pandas when there are a lot of tuples.
Here the tuples list's length is 100 000.
Context
The use case would be a quants in a front office retrieving tuples from its internal message service and who would try to load group of tuples directly in the store.
Other information (if relevant)
I put it as a feature request because you could use pandas in the back end of .append method or change the documentation to tell users to use load_pandas. It is not really a bug but a performance issue. I think it is better to make .append efficient (else what would be its use case?) but I let you decide what solutions is the best as you have the overview of the product.
The text was updated successfully, but these errors were encountered:
Description
Hello,
I was playing with the .append of a store and I saw that it was very slow compared to a load_pandas when there are a lot of tuples.
Here the tuples list's length is 100 000.
Context
The use case would be a quants in a front office retrieving tuples from its internal message service and who would try to load group of tuples directly in the store.
Other information (if relevant)
I put it as a feature request because you could use pandas in the back end of .append method or change the documentation to tell users to use load_pandas. It is not really a bug but a performance issue. I think it is better to make .append efficient (else what would be its use case?) but I let you decide what solutions is the best as you have the overview of the product.
The text was updated successfully, but these errors were encountered: