Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

type mismatch when attempting to update max tokens per request #98

Open
terberlo opened this issue May 4, 2024 · 3 comments
Open

type mismatch when attempting to update max tokens per request #98

terberlo opened this issue May 4, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@terberlo
Copy link

terberlo commented May 4, 2024

Which version of integration_openai are you using?

2.0.0 (as indicated in info.xml)

Which version of Nextcloud are you using?

Nextcloud 8 (29.0.0)

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Firefox 125.0.3 & Chrome 124.0.6367.93

Describe the Bug

In the NextCloud settings under the "Connected accounts" group, attempts to modify the field "Max new tokens per request" result in an error message. The error is: "Failed to save OpenAI admin options: Invalid type for key: max_tokens. Expected integer, got string".

This error displays no matter what value I try to put, even when it's strictly numeric.
The issue is encountered in both FireFox and Chrome browsers, on desktop (x64) and Android platforms.

See attached video of how to reproduce this error:
https://github.com/nextcloud/integration_openai/assets/150498890/c27ece94-31d3-4e0b-a732-44e8746eb812

Expected Behavior

Updating the field should result in a confirmation that the numeric value has been accepted.

To Reproduce

Log into NextCloud. Browse to the Admin Settings. Select the "Connected accounts" panel. Type in a numeric value for the field "Max new tokens per request". The error will display.

@terberlo terberlo added the bug Something isn't working label May 4, 2024
@K-J-VV
Copy link

K-J-VV commented May 5, 2024

Came here to report same finding. I have my LLM being detected in the connected accounts section, but the Assistant fails to generate anything. I'm wondering if its because of this default token limit?

@pmarini-nc
Copy link

Same error for me on request_timeout.

Updating the parameter works fine from the command line:

# occ config:app:set integration_openai request_timeout --value 2500
Config value 'request_timeout' for app 'integration_openai' is now set to '2500', stored as mixed in fast cache

But I don't know what the stored in mixed in fast cache means.

@PaoloFoti
Copy link

Version of integration_openai 2.0.1
Nextcloud version Nextcloud 28.0.4
Browser version: Firefox 126.0 for Linux Mint

Same error for me displaying: "Failed to save OpenAI admin options: Invalid type for key: max_tokens. Expected integer, got string" when filling the "Max new tokens per request" box. Prefectly reproducible as shown in terberlo's video. It seems there is no way to make the box accept any kind of input.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants