You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Go to Settings -> Advanced and turn on the "Show tokens per second" toggle
Click Save
Type any prompt and see the generation
Before b6399 (61bdfd5) the web interface (http://localhost:8080) immediately showed a label Speed: xx t/s with the current speed, which was constantly updated during the generation and streaming (and when the mouse pointer was over it, it also showed details like pp tokens, generated tokens, times, speed, etc.).
Since b6399, the Speed label is shown only when the token generation is fully complete and is not visible during the streaming. This is especially annoying when the generation is slow or there is a big thinking part.
NOTE: Tested with both Firefox and Chrome, as well as on Windows and macOS, so the bug is not OS, or browser specific.