Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
perf(postprocessing): improve pivot postprocessing operation
Executing a pivot for with `drop_missing_columns=False` and lots of resulting columns can increase the postprocessing time by seconds or even minutes for large datasets. The main culprit is `df.drop(...)` operation in the for loop. We can refactor this slightly, without any change to the results, and push down the postprocessing time to seconds instead of minutes for large datasets (millions of columns). Fixes #23464
- Loading branch information