About the directory rllm/tools

[shuoyinn]

Hello, your work is fantastic and I really like it!

When I studied your code, I found the directory rllm/tools defining some function calling api (like calculator, python interpreter and web search). However, I cannot figure out the relationship between rllm/tools and your LLM training and evaluating code. Did you use rllm/tools for training or evaluation? If yes, how?

I would appreciate it if you could answer my questions :)

[michaelzhiluo]

We do have an internal branch on this, I can push it if you want to train it. It does work but can't replicate/or get truly improved performance beyond training without tools.

[LeonLixyz]

Hey Michael, could you push the brank with tool use? Thanks so much!