MNN-LLM v1.0.0
New Features:
- Individual Sampler (greedy, temperature, top K, top P, min P )
- StateCacheManager (Paged Attention, Fused CPU Attention op)
qwen1.5-4B-chat model in MNN format with fused attention operator is appended in the Release binary.