v0.0.42
You can find this package release on PyPI: https://pypi.org/project/judgeval/0.0.42/
What's Changed
- Staging and auto package release by @justinsheu in #275
- Trace Usage Edits by @alanzhang25 in #266
- update litellm pyproject and fix e2etest by @Mandolaro in #276
- Agent Names added by @adivate2021 in #270
- Fix assert test e2e test by @justinsheu in #277
- add evaluation link by @Mandolaro in #279
- Image file updates and social media badges by @shunuen0 in #274
- Testing updates by @justinsheu in #269
- add new has_evaluation column by @Mandolaro in #281
- change e2e timeout to use variable by @justinsheu in #282
- add code coverage for staging e2es by @justinsheu in #285
- Add ToolDependency Scorer and Parameter Checking by @adivate2021 in #253
- modified deep tracing to chain with existing tracefuncs by @justinsheu in #286
- Refactor agent names by @adivate2021 in #287
- Handle un-serializable types in Traces and filter 'self' arguments. by @JCamyre in #278
- Example Created At by @alanzhang25 in #284
- fix logging for assert test trace by @Mandolaro in #290
- E2E additions based on assigned judgeval files by @justinsheu in #283
- Ahh/new error format (#273) by @abhishekg999 in #288
- Make default project name uuid by @rishi763 in #293
- Raise warning for missing Org ID or API Key by @Mandolaro in #294
- Agent state by @andrewli2403 in #295
- Update Docs link by @JCamyre in #297
- Ahh/http error recording by @abhishekg999 in #289
- Update README.md by @JCamyre in #298
- prevent merging blocked pr by @justinsheu in #300
- Example Check and User Prompt by @alanzhang25 in #301
- Trace Datasets by @alanzhang25 in #291
- Update blocked-pr.yaml by @justinsheu in #302
- removed src/demo by @justinsheu in #299
- v1 audit by @justinsheu in #306
- Langgraph integration traces can now track non-langgraph functions by @justinsheu in #307
- Migrate to uv by @JCamyre in #308
- Langgraph aux function tracking fix by @justinsheu in #310
- Trace saving migration by @Mandolaro in #309
- Tracer audit by @adivate2021 in #311
- hotfix by @Mandolaro in #312
- Alert refactor by @Mandolaro in #305
- Improve span performance by @Mandolaro in #314
- small change to reflect backend route change by @KryptoCrash in #316
- Parse metadata out of langgraph integration (JUD-1087) by @Mandolaro in #317
- Update README by @SecroLoL in #318
- Andrew/obs all tools by @andrewli2403 in #319
- Combine CI files + add branch check as conditional (JUD-1153) by @justinsheu in #320
- PagerDuty Integration (JUD-1121) by @Mandolaro in #315
- fixed s3 for bucket creation in us-east-1 by @justinsheu in #321
- account for client.beta.chat.completions.parse by @justinsheu in #322
- Staging -> Main by @justinsheu in #323
New Contributors
- @shunuen0 made their first contribution in #274
- @rishi763 made their first contribution in #293
- @KryptoCrash made their first contribution in #316
Full Changelog: v0.0.41...v0.0.42