Skip to content

solidsf-inc/ssf

Repository files navigation

ssf

The public solidSF CLI installs the solidSF IDE and manages local rvLLM projects, models, chat, LoRA, and QLoRA. It is not a proxy.

Target CLI IDE installer Tuning rvLLM serving
macOS arm64 yes yes MLX Metal experimental
Linux x86_64 yes no PEFT on NVIDIA H100 / sm_90
Linux arm64 yes no PEFT on supported NVIDIA no release kernel bundle

rvLLM source is pinned to commit afcad6c0145b4455ce91aca52d5a5de4eb4e1572. The H100 kernel bundle is bound to its immutable v0.3.0 release URL, exact size, SHA-256, manifest, policy, licenses, PTX entries, and shared-library ABI.

Install

curl -fsSL https://cli.solidsf.com/install.sh | sh

Start a project

ssf ide install
ssf ide authorize
ssf rvllm install
ssf rvllm init ./my-project
cd ./my-project

Projects and chat

ssf rvllm model add local-gemma ./models/local-gemma
ssf rvllm model select local-gemma
ssf rvllm up
ssf rvllm chat

If you stay in the parent directory, put the global project option before the subcommand, for example ssf --project ./my-project rvllm status.

ssf rvllm chat launches rvLLM's native local comparison client and currently requires the default project port 8080; its second editable pane starts at 8081. Custom project ports remain supported for the server and IDE workflows, but native chat fails closed instead of opening against the wrong port. Direct chat stays in the foreground until its window closes so the private runtime artifact can be removed. IDE chat requires an independently deployed HTTPS rvLLM URL:

ssf rvllm link-ide --url https://models.example.com/v1
ssf rvllm chat --ide

The CLI stores only that nonsecret URL in its own configuration. The IDE owns authorization and account state.

CUDA and tuning

ssf rvllm kernels status
ssf rvllm kernels install --arch sm_90   # H100
ssf rvllm kernels install --arch sm_100  # B200 remains fail-closed
ssf rvllm tune init --base local-gemma --data ./data --method lora --adapter support
ssf rvllm tune run
ssf rvllm adapter merge --adapter support

PEFT adapter merges preserve the exact receipt-bound tokenizer, processor, generation, and chat-template assets. rvLLM does not hot-load adapters.

See TUNING.md and AGENT_GUIDE.md.

cargo fmt --all -- --check
cargo test --locked --all-targets
cargo clippy --locked --all-targets -- -D warnings

MIT licensed.

About

ssf — the public solidSF CLI for the solidSF IDE and rvLLM

Topics

Resources

License

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Packages

 
 
 

Contributors

Languages