Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

main: add options for temperature control #2088

Merged
merged 1 commit into from
May 13, 2024

Conversation

ziegenberg
Copy link
Contributor

@ziegenberg ziegenberg commented Apr 22, 2024

Add two options:

-tp,       --temperature N     [0.00   ] The sampling temperature, between 0 and 1
-tpi,      --temperature-inc N [0.20   ] The increment of temperature, between 0 and 1

@ziegenberg ziegenberg force-pushed the add-temperature branch 2 times, most recently from c41ad26 to 7092144 Compare April 26, 2024 13:05
@ziegenberg
Copy link
Contributor Author

I rebased and pushed.

Add two options:

```
-tp,       --temperature N     [0.00   ] The sampling temperature, between 0 and 1
-tpi,      --temperature-inc N [0.20   ] The increment of temperature, between 0 and 1
```

The sampling temperature, between 0 and 1. Higher values like 0.8 will
make the output more random, while lower values like 0.2 will make it
more focused and deterministic. If set to 0, the model will use log
probability to automatically increase the temperature until certain
thresholds are hit.

Signed-off-by: Daniel Ziegenberg <daniel@ziegenberg.at>
@ggerganov ggerganov merged commit f141b2b into ggerganov:master May 13, 2024
@ziegenberg ziegenberg deleted the add-temperature branch May 13, 2024 13:48
bygreencn added a commit to bygreencn/whisper.cpp that referenced this pull request May 14, 2024
* ggerganov/master: (291 commits)
  whisper : fix model path encoding in windows (ggerganov#2086)
  server : return utf-8 (ggerganov#2138)
  node : add audio_ctx and audio buffer params (ggerganov#2123)
  cmake : fix HIP/ROCm build (ggerganov#2102)
  node : add additional params (ggerganov#2000)
  js : remove un-needed request header from fetchRemote (ggerganov#2119)
  cmake : fix metal embed sources path (ggerganov#2110)
  main : dont print timings with --no-prints (ggerganov#2108)
  main : add options for temperature control (ggerganov#2088)
  whisper : switch back to F32 mask (#0)
  whisper.android : update example, add field to print timestamp (ggerganov#2072)
  cmake : fix json INTERFACE library (ggerganov#2069)
  main : fix double quote escaping in csv output (ggerganov#2090)
  metal : tune soft_max number of threads (#0)
  whisper : remove old flash attn code (#0)
  ggml : try fix ppc64 (#0)
  ggml : remove oboslete alibi code (skipme) (#0)
  talk-llama : sync llama.cpp
  sync : ggml
  ggml : optimize for ppc64le using VSX intrinsics (ggml/784)
  ...
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
Add two options:

```
-tp,       --temperature N     [0.00   ] The sampling temperature, between 0 and 1
-tpi,      --temperature-inc N [0.20   ] The increment of temperature, between 0 and 1
```

The sampling temperature, between 0 and 1. Higher values like 0.8 will
make the output more random, while lower values like 0.2 will make it
more focused and deterministic. If set to 0, the model will use log
probability to automatically increase the temperature until certain
thresholds are hit.

Signed-off-by: Daniel Ziegenberg <daniel@ziegenberg.at>
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
Add two options:

```
-tp,       --temperature N     [0.00   ] The sampling temperature, between 0 and 1
-tpi,      --temperature-inc N [0.20   ] The increment of temperature, between 0 and 1
```

The sampling temperature, between 0 and 1. Higher values like 0.8 will
make the output more random, while lower values like 0.2 will make it
more focused and deterministic. If set to 0, the model will use log
probability to automatically increase the temperature until certain
thresholds are hit.

Signed-off-by: Daniel Ziegenberg <daniel@ziegenberg.at>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants