Skip to content

simple-calculator: Additional input validation#259

Merged
rapids-bot[bot] merged 6 commits intoNVIDIA:developfrom
AnuradhaKaruppiah:simple-calc
May 14, 2025
Merged

simple-calculator: Additional input validation#259
rapids-bot[bot] merged 6 commits intoNVIDIA:developfrom
AnuradhaKaruppiah:simple-calc

Conversation

@AnuradhaKaruppiah
Copy link
Contributor

@AnuradhaKaruppiah AnuradhaKaruppiah commented May 14, 2025

This PR includes two changes:

  1. Reduce the evaluation dataset to a consistently working one
  2. Add input validation for the simple_calculator tools
    In some cases the tools are receiving more than 2xnumbers which is causing the workflow to spin.
    Example:
[AGENT]
Calling tools: calculator_multiply
Tool's input: {"text": "60 * 39"}
Tool's response:
The product of 60 * 39 is 2340
------------------------------
2025-05-13 09:39:52,286 - aiq.agent.react_agent.agent - INFO - ------------------------------
[AGENT]
Agent input: What is 9 times 7, and is it greater than the current number of seconds since midnight? Agent's thoughts:
Thought: Now that I have the product of 60 and 39, I can continue with the calculation to get the total number of seconds since midnight. I will add 2340 to 32400, then add 32.

Action: calculator_subtract
Action Input: {'text': '32400 + 2340 + 32'}
------------------------------
2025-05-13 09:39:52,291 - aiq.agent.react_agent.agent - INFO - ------------------------------
[AGENT]
Calling tools: calculator_subtract
Tool's input: {"text": "32400 + 2340 + 32"}
Tool's response:
The result of 32400 - 2340 is 30060
------------------------------
2025-05-13 09:39:56,498 - aiq.agent.react_agent.agent - INFO - ------------------------------
[AGENT]
Agent input: What is 9 times 7, and is it greater than the current number of seconds since midnight? Agent's thoughts:
Thought: It seems there was an error in the previous calculation. The correct calculation should be 32400 + 2340 + 32. I will redo the calculation.

This PR validates the number of "numbers" received

Description

Closes

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
    • Any contribution which contains commits that are not Signed-Off will not be accepted.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

…eived

In some cases the tools are receiving more than 2xnumbers which causing
the workflow to spin.
Example:
[AGENT]
Calling tools: calculator_multiply
Tool's input: {"text": "60 * 39"}
Tool's response:
The product of 60 * 39 is 2340
------------------------------
2025-05-13 09:39:52,286 - aiq.agent.react_agent.agent - INFO -
------------------------------
[AGENT]
Agent input: What is 9 times 7, and is it greater than the current number of seconds since midnight?
Agent's thoughts:
Thought: Now that I have the product of 60 and 39, I can continue with the calculation to get the total number of seconds since midnight. I will add 2340 to 32400, then add 32.

Action: calculator_subtract
Action Input: {'text': '32400 + 2340 + 32'}
------------------------------
2025-05-13 09:39:52,291 - aiq.agent.react_agent.agent - INFO -
------------------------------
[AGENT]
Calling tools: calculator_subtract
Tool's input: {"text": "32400 + 2340 + 32"}
Tool's response:
The result of 32400 - 2340 is 30060
------------------------------
2025-05-13 09:39:56,498 - aiq.agent.react_agent.agent - INFO -
------------------------------
[AGENT]
Agent input: What is 9 times 7, and is it greater than the current number of seconds since midnight?
Agent's thoughts:
Thought: It seems there was an error in the previous calculation. The correct calculation should be 32400 + 2340 + 32. I will redo the calculation.

Signed-off-by: Anuradha Karuppiah <anuradhak@nvidia.com>
@AnuradhaKaruppiah AnuradhaKaruppiah self-assigned this May 14, 2025
@AnuradhaKaruppiah AnuradhaKaruppiah added bug Something isn't working non-breaking Non-breaking change labels May 14, 2025
Signed-off-by: Anuradha Karuppiah <anuradhak@nvidia.com>
@AnuradhaKaruppiah AnuradhaKaruppiah requested a review from Copilot May 14, 2025 00:45
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds input validation to the simple calculator tools to ensure they only operate on exactly two numbers, avoiding issues with extraneous inputs.

  • Added validation for inequality, multiplication, division, and subtraction tools.
  • Returns specific error messages when the number of provided numeric inputs is not exactly two.

AnuradhaKaruppiah and others added 4 commits May 13, 2025 18:45
Signed-off-by: Anuradha Karuppiah <anuradhak@nvidia.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Anuradha Karuppiah <anuradha.karuppiah@gmail.com>
Signed-off-by: Anuradha Karuppiah <anuradhak@nvidia.com>
@AnuradhaKaruppiah
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit ef3a1f2 into NVIDIA:develop May 14, 2025
10 checks passed
@AnuradhaKaruppiah AnuradhaKaruppiah deleted the simple-calc branch May 20, 2025 18:54
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
Closes

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/AIQToolkit/blob/develop/docs/source/advanced/contributing.md).
- We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
  - Any contribution which contains commits that are not Signed-Off will not be accepted.
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)

Approvers:
  - Dhruv Nandakumar (https://github.com/dnandakumar-nv)

URL: NVIDIA#259
Signed-off-by: Eric Evans <194135482+ericevans-nv@users.noreply.github.com>
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
Closes

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/AIQToolkit/blob/develop/docs/source/advanced/contributing.md).
- We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
  - Any contribution which contains commits that are not Signed-Off will not be accepted.
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)

Approvers:
  - Dhruv Nandakumar (https://github.com/dnandakumar-nv)

URL: NVIDIA#259
Signed-off-by: Eric Evans <194135482+ericevans-nv@users.noreply.github.com>
AnuradhaKaruppiah added a commit to AnuradhaKaruppiah/oss-agentiq that referenced this pull request Aug 4, 2025
Closes

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/AIQToolkit/blob/develop/docs/source/advanced/contributing.md).
- We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
  - Any contribution which contains commits that are not Signed-Off will not be accepted.
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)

Approvers:
  - Dhruv Nandakumar (https://github.com/dnandakumar-nv)

URL: NVIDIA#259
scheckerNV pushed a commit to scheckerNV/aiq-factory-reset that referenced this pull request Aug 22, 2025
Closes

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/AIQToolkit/blob/develop/docs/source/advanced/contributing.md).
- We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
  - Any contribution which contains commits that are not Signed-Off will not be accepted.
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)

Approvers:
  - Dhruv Nandakumar (https://github.com/dnandakumar-nv)

URL: NVIDIA#259
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants