Skip to content

max_tokens and temperature not used in payload #18

@dandansamax

Description

@dandansamax

Hi, and congratulations on having the paper accepted to NeurIPS 2025 — great work and exciting results!

I'm trying to reproduce your work. While reading the code, I noticed that call_openai_model_with_tools() takes max_tokens and temperature as arguments, but they are not forwarded into the payload.

max_tokens: int = 4096,
As a result, the model uses defaults. Did the experiments in the paper rely on default decoding parameters?

Another question about the released caption files. I downloaded the LVBench and it works great, but for VideoMME caption, I noticed that the matrix field is not provided so I could not load them into nanovectorDB.

Thanks for open-sourcing the code! I apperaciate it if you can help with my problems.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions