Skip to content

v13

Choose a tag to compare

@github-actions github-actions released this 08 Feb 06:28
  • The app allows benchmarking the model used in a chat. Go to Settings > Benchmark Model in any
    chat and click 'Start Benchmarking'. The benchmark results are pp (tokens/sec for prompt
    processing) and tg (tokens/sec for token generation).