Llama 3.1 Tool-Calling Support #555
Description
System Info
N/A
Who can help?
Information
- The official example scripts
- My own modified scripts
Tasks
- An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - My own task or dataset (give details below)
Reproduction
N/A
Expected behavior
Llama 3.1 introduced tools, which allows their models to run code internally to generate results. Is this feature going to be added? I've tried it on my current Triton Server but get the tool-calling behavior as an output, e.g.,
brave_search.call(query="current weather in Menlo Park, California")assistant
The current weather in Menlo Park, California is not available to me. You can check a current weather website such as weather.com for the current weather in Menlo Park, California.
actual behavior
N/A
additional notes
N/A