Skip to content

Update simple example eval dataset#200

Merged
yczhang-nv merged 18 commits intoNVIDIA:developfrom
yczhang-nv:yuchen-fix-simple-eval
May 2, 2025
Merged

Update simple example eval dataset#200
yczhang-nv merged 18 commits intoNVIDIA:developfrom
yczhang-nv:yuchen-fix-simple-eval

Conversation

@yczhang-nv
Copy link
Contributor

@yczhang-nv yczhang-nv commented May 2, 2025

Description

  • Updated the eval dataset for simple example, as the url we used for context retrieval has changed.
  • Updated the nim_rag_eval_llm config which should work better

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
    • Any contribution which contains commits that are not Signed-Off will not be accepted.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
…ython3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
…ython3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
@yczhang-nv yczhang-nv added bug Something isn't working non-breaking Non-breaking change labels May 2, 2025
@yczhang-nv yczhang-nv self-assigned this May 2, 2025
Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
@yczhang-nv yczhang-nv merged commit ac3cfe3 into NVIDIA:develop May 2, 2025
10 checks passed
@yczhang-nv yczhang-nv deleted the yuchen-fix-simple-eval branch May 6, 2025 21:47
yczhang-nv added a commit to yczhang-nv/NeMo-Agent-Toolkit that referenced this pull request May 8, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Yuchen Zhang <134643420+yczhang-nv@users.noreply.github.com>
yczhang-nv added a commit to yczhang-nv/NeMo-Agent-Toolkit that referenced this pull request May 9, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Eric Evans <194135482+ericevans-nv@users.noreply.github.com>
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Signed-off-by: Eric Evans <194135482+ericevans-nv@users.noreply.github.com>
AnuradhaKaruppiah pushed a commit to AnuradhaKaruppiah/oss-agentiq that referenced this pull request Aug 4, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
scheckerNV pushed a commit to scheckerNV/aiq-factory-reset that referenced this pull request Aug 22, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix doc

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update uv.lock

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* resolve comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* fix comments

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* updated simple example eval dataset

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

* update the nim_rag_eval_llm config

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>

---------

Signed-off-by: Yuchen Zhang <yuchenz@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants