Skip to content

feat: Parallel Function calling and concurrent tool execution#520

Merged
Henry-811 merged 7 commits intodev/v0.1.14from
Parallel_tool_calling
Nov 19, 2025
Merged

feat: Parallel Function calling and concurrent tool execution#520
Henry-811 merged 7 commits intodev/v0.1.14from
Parallel_tool_calling

Conversation

@praneeth999
Copy link
Copy Markdown
Collaborator

@praneeth999 praneeth999 commented Nov 16, 2025

Add the parallel_tool_calls parameter to the backends and enable concurrent tool execution.

Closes MAS-80

PR Title Format

Your PR title must follow the format: <type>: <brief description>

Valid types:

  • fix: - Bug fixes
  • feat: - New features
  • breaking: - Breaking changes
  • docs: - Documentation updates
  • refactor: - Code refactoring
  • test: - Test additions/modifications
  • chore: - Maintenance tasks
  • perf: - Performance improvements
  • style: - Code style changes
  • ci: - CI/CD configuration changes

Examples:

  • fix: resolve memory leak in data processing
  • feat: add export to CSV functionality
  • breaking: change API response format
  • docs: update installation guide

Description

Brief description of the changes in this PR

Type of change

  • Bug fix (fix:) - Non-breaking change which fixes an issue
  • New feature (feat:) - Non-breaking change which adds functionality
  • Breaking change (breaking:) - Fix or feature that would cause existing functionality to not work as expected
  • Documentation (docs:) - Documentation updates
  • Code refactoring (refactor:) - Code changes that neither fix a bug nor add a feature
  • Tests (test:) - Adding missing tests or correcting existing tests
  • Chore (chore:) - Maintenance tasks, dependency updates, etc.
  • Performance improvement (perf:) - Code changes that improve performance
  • Code style (style:) - Changes that do not affect the meaning of the code (formatting, missing semi-colons, etc.)
  • CI/CD (ci:) - Changes to CI/CD configuration files and scripts

Checklist

  • I have run pre-commit on my changed files and all checks pass
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes

Pre-commit status

# Paste the output of running pre-commit on your changed files:
# uv run pre-commit install
# git diff --name-only HEAD~1 | xargs uv run pre-commit run --files # for last commit
# git diff --name-only origin/<base branch>...HEAD | xargs uv run pre-commit run --files # for all commits in PR
# git add <your file> # if any fixes were applied
# git commit -m "chore: apply pre-commit fixes"
# git push origin <branch-name>

How to Test

Add test method for this PR.

Test CLI Command

Write down the test bash command. If there is pre-requests, please emphasize.

 uv run python -m massgen.cli --config massgen/configs/tools/custom_tools/gpt5_nano_custom_tool_with_mcp_parallel.yaml "whats the sum of 123 and 456? and whats the weather of Tokyo and london?"

Expected Results

Description/screenshots of expected results.

Additional context

Add any other context about the PR here.

@praneeth999 praneeth999 marked this pull request as draft November 16, 2025 04:44
Add the parallel_tool_calls parameter to the Responses API (default: true) and enable concurrent tool execution.
Add a new config file enabling concurrent tool 
execution and parallel tool calls
@praneeth999 praneeth999 force-pushed the Parallel_tool_calling branch from c919e50 to b8fe8ea Compare November 18, 2025 02:55
add concurrent tool execution support
Unified handling of custom and MCP tool calls with improved
NLIP routing. Enabled the concurrent tool execution and sequential loops
Introduce a new documentation page explaining model-level tool calling
and local parallel execution knobs
@praneeth999 praneeth999 marked this pull request as ready for review November 18, 2025 04:38
@ncrispino
Copy link
Copy Markdown
Collaborator

Can you check this works with #530? See https://ai.google.dev/gemini-api/docs/thought-signatures, they have a section on parallel tool calling.

@praneeth999
Copy link
Copy Markdown
Collaborator Author

Will look into it.

@Henry-811 Henry-811 changed the base branch from main to dev/v0.1.14 November 19, 2025 15:42
@Henry-811 Henry-811 merged commit 25f672e into dev/v0.1.14 Nov 19, 2025
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants