When importing data into DART from files instead of streaming, decommutation can become many minutes out of order when spread across processes. This isn't inherently wrong, but can cause reduction to think that data is ready to be reduced when it is not all available yet. This change will modify:
Make reduction have a 2 minute holdoff to ensure all data is available
Change decom to a work queue design to ensure that packets do not get multiple minutes out of processing order
Improve decommutation speed using transactions
Don't try to switch to bad configs multiple times
The text was updated successfully, but these errors were encountered:
When importing data into DART from files instead of streaming, decommutation can become many minutes out of order when spread across processes. This isn't inherently wrong, but can cause reduction to think that data is ready to be reduced when it is not all available yet. This change will modify:
The text was updated successfully, but these errors were encountered: