Integration with W and B Weave

[JacobGoldenArt]

I've been playing around with Weave. It's a great framework for tracking, experimenting with, evaluating, deploying, and improving LLM-based applications. Since it's compatible with OpenAI you can use it in HeyStack but it would be great to have it as an official integration.

Here's some of it's features:

• Tracing & Monitoring: Track LLM calls and application logic to debug and analyze production systems.
• Systematic Iteration: Refine and iterate on prompts, datasets, and models.
• Experimentation: Experiment with different models and prompts in the LLM Playground.
• Evaluation: Use custom or pre-built scorers alongside our comparison tools to systematically assess and enhance application performance.
• Guardrails: Protect your application with pre- and post-safeguards for content moderation, prompt safety, and more.

Here's the docs: https://weave-docs.wandb.ai/

Thanks!

[julian-risch]

Hello @JacobGoldenArt Thank you for your suggestion! We just merged this PR deepset-ai/haystack-core-integrations#1412 bringing support for weave to Haystack as a core integration. We are about to merge a documentation page for this integration in the next days. You can find the open PR for that here: https://github.com/deepset-ai/haystack-integrations/pull/302/files including a code example.