storage: select compaction strategy using statistics

[skyzh]

If we find distinct value statistics is very small compared with row counts, we can use RLE encoding when building RowSets.

risinglight/src/storage/secondary/compactor.rs

Lines 93 to 96 in 65372ee

	let mut builder = RowsetBuilder::new(
	table.columns.clone(),
	ColumnBuilderOptions::from_storage_options(&table.storage_options),
	);

[jess-x]

newbie here, can I give this a try?

[noneback]

Any progress? I am also very interested in it.

[skyzh]

Hmm, maybe you can take over this as it has been nearly a month that we haven't heard back from @jess-x 🤣

[jess-x]

hi, feel free to take over. didn't have the bandwidth this past month 🥲