v0.2.2 - PyPI Documentation & Package Links

What's Changed in v0.2.2

• Documentation & PyPI Links: Fixed documentation URLs to point to master branch on GitHub and added direct links for Quick Start, Metrics Catalog, and API Reference.
• README Links: Converted relative markdown links in README to absolute URLs for full PyPI compatibility.
• SPDX License: Modernized license metadata in pyproject.toml.

Installation

pip install --upgrade forjinn-eval==0.2.2

PyPI: https://pypi.org/project/forjinn-eval/0.2.2/

v0.2.1 - OpenAI-compatible Judge & Modernized Metadata

What's Changed in v0.2.1

• OpenAIJudge: Added support for OpenAI-compatible LLMs (OpenRouter, Groq, Together, Ollama, vLLM) as judges.
• Runnable Example: Added examples/openai_judge.py.
• License Metadata: Switched to SPDX identifier.

Installation

pip install forjinn-eval==0.2.1

PyPI: https://pypi.org/project/forjinn-eval/0.2.1/

v0.2.0 - Expanded Metric Catalog & Evaluation Harness

What's Changed in v0.2.0

• 30+ Metric Catalog: Deterministic (latency, token usage, tool use, JSON schema, safety) and LLM-judged metrics (faithfulness, hallucination, answer relevancy, G-Eval).
• Multi-turn Agent Testing: Support for multi-turn conversations and per-turn assertions.
• CLI & Pytest Plugin: forjinn-eval command-line interface and pytest runner integration.

Installation

pip install forjinn-eval==0.2.0

PyPI: https://pypi.org/project/forjinn-eval/0.2.0/