v0.3.4: Better Table View, optimized string storage

[ianarawjo]

This update brings two major quality-of-life changes:

• Strings throughout the application are now frequently interned in a global StringLookup table, to improve performance and reduce duplicate memory usage. This noticeably improves performance when the number of LLM responses start to exceed 1000, and also results in smaller memory footprint for exported .cforge files.
• Table View in Response Inspectors now uses Mantine React Table. This brings:
  • Sort columns by value
  • Selectively show/hide columns
  • Filter within columns
  • Sticky header when scrolling down the table
  • Pagination to improve performance when rendering large tables

In addition, Response Inspectors now try to lazy-load and show a LoadingSpinner when first calculating the selected inspector view.

This change is a first-step towards moving the StorageCache into the Python back-end when the memory footprint exceeds a MB threshold. This will enable a lighter and streamlined front-end when running large-scale experiments.

Warning

This change touched many source code files in ChainForge and altered the way cforge files are imported and exported. Although changes should be backwards-compatible and bug-free, this cannot be guaranteed. If performance breaks, revert to the previous version.

---

This discussion was created from the release v0.3.4: Better Table View, optimized string storage.