Existing Similar Projects Tracker

[MichaelFomenko]

I found some similar Projects for streaming from SSD the Weights.

https://github.com/antirez/ds4
https://github.com/kibbyd/llm_upper
https://github.com/kibbyd/llm_upper_ollama

Different Technologies:
https://github.com/ai-dynamo/modelexpress
https://docs.pytorch.org/TensorRT/tutorials/_rendered_examples/dynamo/weight_streaming_example.html
https://gitlab.com/IsolatedOctopi/greenboost

Maybe this Projects can be used for Inspiration or for finding Solution for Problems or just copy the code from them.

[MichaelFomenko]

https://github.com/gavamedia/deltafin

[MichaelFomenko]

https://github.com/Mega4alik/ollm

[MichaelFomenko]

https://github.com/sqliteai/waste

[MichaelFomenko]

https://github.com/zeroextub-collab/wisp

[Pummelchen]

https://github.com/drumih/turbo-fieldfare
https://github.com/jundot/omlx
https://github.com/Pummelchen/XAIOS

[MichaelFomenko]

https://github.com/FareedKhan-dev/kimi-k3-in-c