v2.1.0

What's Changed

• add image rule guide by @pekopoke in #237
• fix:Layout Prompt by @chaserRen in #239
• add new prompt by @dt-yy in #241
• Fix/ade/dev by @decrystal in #243
• feat: add 5 RAG eval metrics by @e06084 in #244
• feat: support sql datasouce multi-column eval by @shijinpjlab in #259
• feat: sql by @shijinpjlab in #260
• feat: 以星河场景为例的介绍文档、example、rule by @shijinpjlab in #262
• refactor: multi-turn dialog by @seancoding-day in #264
• feat: update readme by @shijinpjlab in #265
• docs: update architecture pic by @e06084 in #266
• feat: label QUALITY_GOOD by @shijinpjlab in #267
• fix: rag metric by @e06084 in #269
• fix: fix rag example by @e06084 in #270
• feat: add rag mock and eval by @e06084 in #271
• Dev lld: update 5 metrics and dataset for rags by @pekopoke in #273
• fix: rags of 5 metrics by @pekopoke in #276
• fix : embedding model change by @pekopoke in #277
• docs: update wechat by @e06084 in #279
• feat: gradio by @shijinpjlab in #280
• feat: fix by @shijinpjlab in #281
• feat: merge main by @shijinpjlab in #282
• feat: update modelres by @shijinpjlab in #278
• fix: fix rag example by @e06084 in #283
• feat: ci check import by @shijinpjlab in #285
• feat: add score summary by @e06084 in #286
• Feature/ats keyword matcher and resume optimizer by @Kylie-dot-s in #284
• feat: summary support multi-column by @e06084 in #287
• fix: fix ut by @e06084 in #288
• feat: update auto-gen-metric by @e06084 in #289
• feat: update rag_eval_baseline by @e06084 in #290
• feat: update e2e RAG eval by @e06084 in #292
• feat: add PII detetction by @e06084 in #293
• feat: add LLMTextQualityV5 by @e06084 in #294
• fix : update answer_relevancy metric by @pekopoke in #291
• docs: update metrics docs by @e06084 in #295
• docs: update wechat doc by @e06084 in #297
• docs: update README by @e06084 in #298
• docs: update README by @e06084 in #299
• docs: update README by @e06084 in #300
• build: set numpy>=1.26.4 by @e06084 in #301
• feat: update gradio to v2.0 by @shijinpjlab in #302
• feat: update embedding model init by @e06084 in #303
• feat: support excel by @shijinpjlab in #305
• feat: fix bug gradio detail repeat by @shijinpjlab in #306
• feat: unshare link by @shijinpjlab in #307
• feat: update gradio image in readme, add limit of label in gradio by @shijinpjlab in #308
• fix: fix embedding config load by @e06084 in #309
• Fix/docs and examples cleanup by @Kylie-dot-s in #296
• feat: support csv by @shijinpjlab in #310
• feat: add Instruction Quality Evaluation by @e06084 in #313
• feat: add examples in metrics by @e06084 in #314
• feat: init agent&tool architecture by @seancoding-day in #311
• docs: update wechat by @e06084 in #315
• feat: fix spark by @shijinpjlab in #316
• feat:front page V2.0 by @tenwanft in #318
• feat: support parquet file by @shijinpjlab in #320
• Fix/docs only by @Kylie-dot-s in #321
• feat: use_browser by @shijinpjlab in #323
• Feat/update all examples and tests by @Kylie-dot-s in #322
• feat: agent&tool docs/tests/examples by @seancoding-day in #319
• docs: update wechat doc by @shijinpjlab in #324
• feat: add required fileds by @shijinpjlab in #327
• feat: optimize label when data is empty in rag metrics by @e06084 in #330
• fix: update rag example by @e06084 in #331
• feat: add VLMRenderJudge metric by @e06084 in #332
• feat: x by @e06084 in #334
• feat: support sciencemetabench by @shijinpjlab in #333
• feat: split langchain way and custom way; add description and docs for these two ways by @seancoding-day in #336
• feat: update front page jpg by @shijinpjlab in #339
• Fix MCP stdio communication issues by @Kylie-dot-s in #326
• Feature/llm scout by @Kylie-dot-s in #343
• docs: README add SAAS apply by @e06084 in #345
• feat(agent): agent for article fact checking by @seancoding-day in #348
• package: optimize requirements by @e06084 in #352
• feat: Add cursor rule by @e06084 in #353
• feat: 2.1.0 by @shijinpjlab in #354
• feat: cursor fix by @shijinpjlab in #356

New Contributors

• @decrystal made their first contribution in #243
• @tenwanft made their first contribution in #318

Full Changelog: v1.11.1...v2.1.0