Skip to content

Conversation

@femto
Copy link
Contributor

@femto femto commented Nov 3, 2024

Hello, while trying bon, deepseek reports error since deepseek can't support n > 1,
so I added

    except:
        for _ in range(n):
            response = client.chat.completions.create(
                model=model,
                messages=messages,
                max_tokens=4096,
                n=1,
                temperature=1
            )
            completions.extend([choice.message.content for choice in response.choices])
            bon_completion_tokens += response.usage.completion_tokens

@codelion
Copy link
Member

codelion commented Nov 3, 2024

This is good, can you also update it for moa, mcts and pvg approaches? It should then fix #67 .

@codelion
Copy link
Member

Another request for something like this with some discussion is here #99

@CLAassistant
Copy link

CLAassistant commented Dec 14, 2024

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants