Repository navigation
Releases
Releases · mrubens/fmev
fmev v0.1.5
- New opt-in
FMEV_RUNNER_UP=1: Choice questions with 3+ options get a second question to find the model's runner-up, which gets a larger share of the remaining probability instead of an even split. On jevbench's public items the runner-up was the right answer on 21 of 45 misses (47%, against 34% by chance). The chosen option and its probability are unchanged. It costs 1.5–2× latency, so it's off by default. - Score questions now give the remaining probability mostly to the levels next to the chosen one, so expected scores are no longer pulled toward the middle of the scale.
- The chosen option is always kept strictly above the others, so it never ties.
- Install:
brew install mrubens/tap/fmev
SHA-256 (fmev-0.1.5-macos-arm64.zip): 73eee4df9379d97d66e659e1f05bba463893f5254c3235cffb566ca0d68356f2
fmev v0.1.4
- fmev now always answers with one greedy generation plus the model's stated confidence. The sampling-based
adaptivemode is gone, along withFMEV_MODE,FMEV_SAMPLES,FMEV_EARLY_STOP,FMEV_TEMPERATURE,FMEV_SMOOTHINGand theX-FM-Samplesheader. The only settings left areFMEV_HOST,FMEV_PORT,FMEV_API_KEYandFMEV_CONCURRENCY. - Answers are unchanged: jevbench results on the public items are identical to v0.1.3's default.
- Install:
brew install mrubens/tap/fmev
SHA-256 (fmev-0.1.4-macos-arm64.zip): 62d031c5e852c280fa1dfb923f5e1f1f057125c46cda23f0a06c27d9a61c74d6
fmev v0.1.3
fmev --helpprints usage and settings,fmev --versionprints the version, and unknown arguments exit with an error. Previouslyfmev --helpstarted the server.- JSON responses write numbers in short form, rounded to 6 decimal places (
0.94instead of0.93999999999999995). - The away-message emoji example is now a curl request in the README.
- Install:
brew install mrubens/tap/fmev
SHA-256 (fmev-0.1.3-macos-arm64.zip): 52ee7ff9d1c3d929018bdd2fbbd99abf3522e87cbc7d59a3ff68c87288f27eb2
fmev v0.1.2
- Removes options that lost on jevbench:
votemode, the alternative confidence prompts (FMEV_VERBAL_STYLE) and the content-tagging adapter (FMEV_USE_CASE).FMEV_MODEis nowverbal(default) oradaptive, and an unknown value exits with an error. - In verbal mode, Apple guardrail refusals return HTTP 422, as they already did in adaptive mode.
- Adds an away-message emoji example (
examples/away_emoji.py). - Install:
brew install mrubens/tap/fmev
SHA-256 (fmev-0.1.2-macos-arm64.zip): 73ccaba56f0fc1e62383797a598e9a362865a0ef16810ea3157ac1ef523bd9d2
fmev v0.1.1
First release: a TypeSafe System One (Jev) compatible server on Apple's built-in on-device Foundation Model.
- Defaults:
verbalmode with theanchoredconfidence prompt (one greedy generation per question, about 0.6 s median on an M4 Max). - Requires an Apple Silicon Mac on macOS 27+ with Apple Intelligence turned on.
- The binary is signed with a Developer ID and notarized by Apple.
SHA-256 (fmev-0.1.1-macos-arm64.zip): d90a5314d3ed9dbeadb84dd2ce32ea7db6fc4bd8334aacd96681326c223d41d4
See the README for configuration and jevbench results.