Prompttools offers a set of free, open-source tools for testing and experimenting with models, prompts, and configurations. The core idea is to enable developers to evaluate prompts using familiar interfaces like code and notebooks. You can use it to experiment with different configurations of LanceDB, and test how LanceDB integrates with the LLM of your choice.
In this example, we'll compare, visualize and evaluate multiple embedding functions (including openai) across various metrics inlcuding latency and custom evaluation metric.