Tracking: Sqlsmith extras

[kwannoel]

This issue tracks enhancements to sqlsmith.

High priority:

• Sqlsmith: Differential testing #10427
• Sqlsmith: updates and deletes #9824
• Sqlsmith: Increase number of inserts #9861
• Sqlsmith: Interleave writes, instead of doing all DML at the start.
• Sqlsmith: Decouple weights from generators #3936
• sqlsmith: run less queries, but make the tested queries more complex #10360
• Add executor consistency testing mode as described in Discussion: Handling inconsistent streams #14031
• Add source parsing test as described in https://github.com/risingwavelabs/risingwave-test/issues/475#issuecomment-1855090250

Low priority:

• Improving ease of contribution to sqlsmith #9720
• SqlSmith: Pretty print failed SQL statement with error to log files #4415
• sqlsmith: sql reducer #7504
• Sqlsmith test: panic recovery on various types of panics. Should print complete query to reproduce.
• Refine recursion so that probability of recursion drop with increasing depth of recursion See: feat(sqlsmith): enable sub-query generation #4216 (comment)
• Revisit gen_from_relation's use of can_recurse. Other branches might recurse in the future. See: https://github.com/singularity-data/risingwave/pull/4216/files#r934137424
• Sqlsmith: Test invalid arguments for expr, func, cast #4468
• Sqlsmith trace: Tracing generation path of queries - useful to debug query generator itself.
• Sqlsmith: Parallelize query execution.
• Sqlsmith coverage (SQL Smith: Measure Coverage #7825)
• SQL Smith Awareness of Stream User Errors #7827
• Sqlsmith: Test pgwire binary format.
• Sqlsmith: Test various execution modes. Currently only distributed is tested.
• Sqlsmith: Test more mv-on-mv. Currently ddl phase creates only 10 mvs.
• Sqlsmith: Add risedev command.
• Sqlsmith: Fuzz snapshots with different RW configurations.

[kwannoel]

Sqlsmith feature gen is long running task. Track here instead: #7934