Skip to content

b12188

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 07 Nov 11:58
0956684

server: visit parent slots before child slots (#30779)

  • server: visit parent slots before child slots
    A parent slot wakes its waiting child slots once it finishes the shared
    prompt prefix, while slots are visited in id order. When a child task
    lands on a lower slot id than its parent, the child is visited before
    the parent wakes it and waits an extra batch to process its suffix.
    Non-child slots are now visited before active child slots, so every
    child woken by its parent joins the same batch.

  • server: check systemone test events through test tags

The systemone tests matched free-form debug messages, including the
formatted f_keep value of the prompt cache. The server now emits
TEST_TAG_WAIT_PARENT_SLOT when a child slot waits for its parent,
TEST_TAG_PROMPT_CACHE_RESTORE on every prompt cache restore and
TEST_TAG_PROMPT_CACHE_FULL_RESTORE when the whole cached prompt is
a prefix of the new one, compared on token counts.


Co-authored-by: Pascal admin@serveurperso.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: