Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: DeepSeek API returns truncated long response #3413

Open
ambitiousCC opened this issue Mar 7, 2025 · 0 comments
Open

[BUG]: DeepSeek API returns truncated long response #3413

ambitiousCC opened this issue Mar 7, 2025 · 0 comments
Labels
possible bug Bug was reported but is not confirmed or is unable to be replicated.

Comments

@ambitiousCC
Copy link

ambitiousCC commented Mar 7, 2025

How are you running AnythingLLM?

Docker (local)

What happened?

I found that when using the official API, the think content stops halfway and then waits for a long time before continuing to reply to the question. As shown in the figure, The content of the reasoning section is obviously truncated.

Image

The results of running the inference model locally are shown in the figure (only compatible with OpenAI's API)

Image

By the way, "\(" and "\)" are also mathematical symbol markers in LaTeX, and this model clearly uses this marking method, not "$". From the current return results, it seems that the "\( & \)" markers are not supported. When can compatibility be added?

Are there known steps to reproduce?

Using the official DeepSeek API, ask the same question as me:

Let $x,y$ and $z$ be positive real numbers that satisfy the following system of equations: \n\[\log_2\left({x \over yz}\right) = {1 \over 2}\]\n\[\log_2\left({y \over xz}\right) = {1 \over 3}\]\n\[\log_2\left({z \over xy}\right) = {1 \over 4}\]\nThen the value of $\left|\log_2(x^4y^3z^2)\right|$ is $\tfrac{m}{n}$ where $m$ and $n$ are relatively prime positive integers. Find $m+n$.
@ambitiousCC ambitiousCC added the possible bug Bug was reported but is not confirmed or is unable to be replicated. label Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
possible bug Bug was reported but is not confirmed or is unable to be replicated.
Projects
None yet
Development

No branches or pull requests

1 participant