Frink v0.49.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.49.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.49.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.49.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• docs(readme): pin the version strings, correct the binary size by @antonellof in #365
• docs: MODELS.md is a list of models by @antonellof in #366
• docs: move finished plans out of the live set, pin the index by @antonellof in #367
• feat(serving): cache-aware admission, bounded so it cannot starve by @antonellof in #368
• docs: new README logo by @antonellof in #369
• feat(models): llama-embed runs, via one alias rather than a dozen rows by @antonellof in #370
• docs: refreshed README logo by @antonellof in #371
• docs: correct README logo by @antonellof in #372
• fix(serving): report prefix reuse from the batched path by @antonellof in #373
• fix(bench): date every ledger row, and stop the prose contradicting it by @antonellof in #374
• feat(serve-bench): measure prefix reuse, and stop the default run getting it by accident by @antonellof in #375
• chore(release): 0.49.0 - prefix reuse, measured and reported by @antonellof in #376

Full Changelog: v0.48.0...v0.49.0

Frink v0.48.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.48.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.48.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.48.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): /v1/score and /score by @antonellof in #358
• docs: audit against the shipped surface, and pin the counts by @antonellof in #359
• fix(cli): accept --sampler-seq, and check documented flags exist by @antonellof in #360
• docs: FEATURES.md lists what the decoder can express, not a closure log by @antonellof in #361
• docs: ROADMAP is what is next, not a month of what closed by @antonellof in #362
• docs: cache_salt and sleep where an operator looks for them by @antonellof in #363
• chore(release): 0.48.0 - /v1/score, and a documentation audit by @antonellof in #364

Full Changelog: v0.47.0...v0.48.0

Frink v0.47.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.47.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.47.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.47.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): logit_bias by @antonellof in #356
• chore(release): 0.47.0 - logit_bias by @antonellof in #357

Full Changelog: v0.46.0...v0.47.0

Frink v0.46.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.46.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.46.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.46.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): skip_special_tokens and return_tokens_as_token_ids by @antonellof in #354
• chore(release): 0.46.0 - skip_special_tokens and return_tokens_as_token_ids by @antonellof in #355

Full Changelog: v0.45.0...v0.46.0

Frink v0.45.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.45.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.45.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.45.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): echo and truncate_prompt_tokens by @antonellof in #352
• chore(release): 0.45.0 - echo and truncate_prompt_tokens by @antonellof in #353

Full Changelog: v0.44.0...v0.45.0

Frink v0.44.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.44.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.44.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.44.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): allowed_token_ids and bad_words by @antonellof in #350
• chore(release): 0.44.0 - allowed_token_ids and bad_words by @antonellof in #351

Full Changelog: v0.43.0...v0.44.0

Frink v0.43.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.43.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.43.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.43.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): prompt_logprobs on the paged KV store by @antonellof in #348
• chore(release): 0.43.0 - prompt_logprobs on the paged store by @antonellof in #349

Full Changelog: v0.42.0...v0.43.0

Frink v0.42.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.42.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.42.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.42.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): cache_salt on the paged KV store by @antonellof in #346
• chore(release): 0.42.0 - cache_salt on the paged store by @antonellof in #347

Full Changelog: v0.41.0...v0.42.0

Frink v0.41.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.41.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.41.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.41.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(server): streamed n, interleaved by choice index by @antonellof in #344
• chore(release): 0.41.0 - streamed n, interleaved by @antonellof in #345

Full Changelog: v0.40.0...v0.41.0

Frink v0.40.0

Install

curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Or pin a version:

FRINK_VERSION=v0.40.0 \
  curl -fsSL https://raw.githubusercontent.com/antonellof/frink/main/scripts/install.sh | bash

Prebuilt archives

Asset	Notes
frink-v0.40.0-darwin-arm64.tar.gz	macOS Apple Silicon, Metal
frink-v0.40.0-linux-x86_64.tar.gz	Linux x86_64, CPU

CUDA and other hosts: build from source (--features cuda).

What's Changed

• feat(kv): copy-on-write forks on the paged store by @antonellof in #342
• chore(release): 0.40.0 - copy-on-write forks on the paged store by @antonellof in #343

Full Changelog: v0.39.0...v0.40.0