You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Qbeast Format supports reading files not indexed with the Otree / not containing Qbeast Metadata. We call it the "Staging Area".
To reduce the overhead of writing small files, we use an operation called Compaction on this area. But changes on #284 would reduce the implementation of compaction to a single call to the optimize method. On the other hand, the optimization of the Staging Area should NOT be the same than the optimization for Indexed Files.
The solution proposed is:
Delete compact() as an actionable command both in IndexedTable and QbeastTable.
Remove CompactTableCommand.
Remove or fix tests accordingly.
Rename compact() method in the DataWriter interface and implementation. Might be confusing to still use that naming internally.
When optimize() is applied to the Staging Area -> index the data.
When optimize() is applied to other areas / revisions -> maintain the current implementation.
The text was updated successfully, but these errors were encountered:
Qbeast Format supports reading files not indexed with the Otree / not containing Qbeast Metadata. We call it the "Staging Area".
To reduce the overhead of writing small files, we use an operation called Compaction on this area. But changes on #284 would reduce the implementation of
compaction
to a single call to theoptimize
method. On the other hand, the optimization of the Staging Area should NOT be the same than the optimization for Indexed Files.The solution proposed is:
compact()
as an actionable command both inIndexedTable
andQbeastTable
.CompactTableCommand
.compact()
method in theDataWriter
interface and implementation. Might be confusing to still use that naming internally.optimize()
is applied to the Staging Area -> index the data.optimize()
is applied to other areas / revisions -> maintain the current implementation.The text was updated successfully, but these errors were encountered: