Commits on Mar 23, 2023

1. perf(postprocessing): improve pivot postprocessing operation …

   Executing a pivot for with `drop_missing_columns=False` and lots of resulting columns can increase the postprocessing time by seconds or even minutes for large datasets.
   The main culprit is `df.drop(...)` operation in the for loop. We can refactor this slightly, without any change to the results, and push down the postprocessing time
   to seconds instead of minutes for large datasets (millions of columns).
   
   Fixes apache#23464

   

   Usiel committed Mar 23, 2023
   Configuration menu

   • View commit details
   • Copy full SHA for 20bc99a
   • Browse repository at this point

   Copy the full SHA

   20bc99a View commit details

   Browse the repository at this point in the history