Call Tools in Parallel

[arey]

This development consists of checking the value of activating the parallelToolCalls option of the OpenAiStreamingChatModel class. It could be useful when the user is asking the following question:

Add a dog for Betty Davis. His name is Moopsie. His birthday is on 2 October 2024.

Before calling the tool addPetToOwner, the LLM has to call 2 others tools: getAllOwners and populatePetTypes

[arey]

With langchain4j.open-ai.streaming-chat-model.parallel-tool-calls=true, OpenAI asks the pet clinic to call both the getAllOwners and populatePetTypes functions.
These functions are called sequentially from a single thread.
Both results are sent to the LLM in a single response:

{
    "role" : "assistant",
    "tool_calls" : [ {
      "id" : "call_pPRz31R7GPsNSaXaXCnN3IwW",
      "type" : "function",
      "function" : {
        "name" : "getAllOwners",
        "arguments" : "{}"
      }
    }, {
      "id" : "call_oZZlBrv5GDS47tq7TSGWr8R4",
      "type" : "function",
      "function" : {
        "name" : "populatePetTypes",
        "arguments" : "{}"
      }
    } ]
  }, {
    "role" : "tool",
    "tool_call_id" : "call_pPRz31R7GPsNSaXaXCnN3IwW",
    "content" : "{\n  \"owners\": [\n    {\n      \"address\": \"110 W. Liberty St.\",\n      \"city\": \"Madison\",\n      \"telephone\": \"6085551023\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-09-07\",\n          \"type\": {\n            \"name\": \"cat\",\n            \"id\": 1\n          },\n          \"visits\": [],\n          \"name\": \"Leo\",\n          \"id\": 1\n        }\n      ],\n      \"firstName\": \"George\",\n      \"lastName\": \"Franklin\",\n      \"id\": 1\n    },\n    {\n      \"address\": \"638 Cardinal Ave.\",\n      \"city\": \"Sun Prairie\",\n      \"telephone\": \"6085551749\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2012-08-06\",\n          \"type\": {\n            \"name\": \"hamster\",\n            \"id\": 6\n          },\n          \"visits\": [],\n          \"name\": \"Basil\",\n          \"id\": 2\n        }\n      ],\n      \"firstName\": \"Betty\",\n      \"lastName\": \"Davis\",\n      \"id\": 2\n    },\n    {\n      \"address\": \"2693 Commerce St.\",\n      \"city\": \"McFarland\",\n      \"telephone\": \"6085558763\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-03-07\",\n          \"type\": {\n            \"name\": \"dog\",\n            \"id\": 2\n          },\n          \"visits\": [],\n          \"name\": \"Jewel\",\n          \"id\": 4\n        },\n        {\n          \"birthDate\": \"2011-04-17\",\n          \"type\": {\n            \"name\": \"dog\",\n            \"id\": 2\n          },\n          \"visits\": [],\n          \"name\": \"Rosy\",\n          \"id\": 3\n        }\n      ],\n      \"firstName\": \"Eduardo\",\n      \"lastName\": \"Rodriquez\",\n      \"id\": 3\n    },\n    {\n      \"address\": \"563 Friendly St.\",\n      \"city\": \"Windsor\",\n      \"telephone\": \"6085553198\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-11-30\",\n          \"type\": {\n            \"name\": \"lizard\",\n            \"id\": 3\n          },\n          \"visits\": [],\n          \"name\": \"Iggy\",\n          \"id\": 5\n        }\n      ],\n      \"firstName\": \"Harold\",\n      \"lastName\": \"Davis\",\n      \"id\": 4\n    },\n    {\n      \"address\": \"2387 S. Fair Way\",\n      \"city\": \"Madison\",\n      \"telephone\": \"6085552765\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-01-20\",\n          \"type\": {\n            \"name\": \"snake\",\n            \"id\": 4\n          },\n          \"visits\": [],\n          \"name\": \"George\",\n          \"id\": 6\n        }\n      ],\n      \"firstName\": \"Peter\",\n      \"lastName\": \"McTavish\",\n      \"id\": 5\n    },\n    {\n      \"address\": \"105 N. Lake St.\",\n      \"city\": \"Monona\",\n      \"telephone\": \"6085552654\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2012-09-04\",\n          \"type\": {\n            \"name\": \"cat\",\n            \"id\": 1\n          },\n          \"visits\": [\n            {\n              \"date\": \"2013-01-02\",\n              \"description\": \"rabies shot\",\n              \"id\": 2\n            },\n            {\n              \"date\": \"2013-01-03\",\n              \"description\": \"neutered\",\n              \"id\": 3\n            }\n          ],\n          \"name\": \"Max\",\n          \"id\": 8\n        },\n        {\n          \"birthDate\": \"2012-09-04\",\n          \"type\": {\n            \"name\": \"cat\",\n            \"id\": 1\n          },\n          \"visits\": [\n            {\n              \"date\": \"2013-01-01\",\n              \"description\": \"rabies shot\",\n              \"id\": 1\n            },\n            {\n              \"date\": \"2013-01-04\",\n              \"description\": \"spayed\",\n              \"id\": 4\n            }\n          ],\n          \"name\": \"Samantha\",\n          \"id\": 7\n        }\n      ],\n      \"firstName\": \"Jean\",\n      \"lastName\": \"Coleman\",\n      \"id\": 6\n    },\n    {\n      \"address\": \"1450 Oak Blvd.\",\n      \"city\": \"Monona\",\n      \"telephone\": \"6085555387\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2011-08-06\",\n          \"type\": {\n            \"name\": \"bird\",\n            \"id\": 5\n          },\n          \"visits\": [],\n          \"name\": \"Lucky\",\n          \"id\": 9\n        }\n      ],\n      \"firstName\": \"Jeff\",\n      \"lastName\": \"Black\",\n      \"id\": 7\n    },\n    {\n      \"address\": \"345 Maple St.\",\n      \"city\": \"Madison\",\n      \"telephone\": \"6085557683\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2007-02-24\",\n          \"type\": {\n            \"name\": \"dog\",\n            \"id\": 2\n          },\n          \"visits\": [],\n          \"name\": \"Mulligan\",\n          \"id\": 10\n        }\n      ],\n      \"firstName\": \"Maria\",\n      \"lastName\": \"Escobito\",\n      \"id\": 8\n    },\n    {\n      \"address\": \"2749 Blackhawk Trail\",\n      \"city\": \"Madison\",\n      \"telephone\": \"6085559435\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-03-09\",\n          \"type\": {\n            \"name\": \"bird\",\n            \"id\": 5\n          },\n          \"visits\": [],\n          \"name\": \"Freddy\",\n          \"id\": 11\n        }\n      ],\n      \"firstName\": \"David\",\n      \"lastName\": \"Schroeder\",\n      \"id\": 9\n    },\n    {\n      \"address\": \"2335 Independence La.\",\n      \"city\": \"Waunakee\",\n      \"telephone\": \"6085555487\",\n      \"pets\": [\n        {\n          \"birthDate\": \"2010-06-24\",\n          \"type\": {\n            \"name\": \"dog\",\n            \"id\": 2\n          },\n          \"visits\": [],\n          \"name\": \"Lucky\",\n          \"id\": 12\n        },\n        {\n          \"birthDate\": \"2012-06-08\",\n          \"type\": {\n            \"name\": \"cat\",\n            \"id\": 1\n          },\n          \"visits\": [],\n          \"name\": \"Sly\",\n          \"id\": 13\n        }\n      ],\n      \"firstName\": \"Carlos\",\n      \"lastName\": \"Estaban\",\n      \"id\": 10\n    }\n  ]\n}"
  }, {
    "role" : "tool",
    "tool_call_id" : "call_oZZlBrv5GDS47tq7TSGWr8R4",
    "content" : "[\n  {\n    \"name\": \"bird\",\n    \"id\": 5\n  },\n  {\n    \"name\": \"cat\",\n    \"id\": 1\n  },\n  {\n    \"name\": \"dog\",\n    \"id\": 2\n  },\n  {\n    \"name\": \"hamster\",\n    \"id\": 6\n  },\n  {\n    \"name\": \"lizard\",\n    \"id\": 3\n  },\n  {\n    \"name\": \"snake\",\n    \"id\": 4\n  }\n]"
  } ],