7 Pull requests merged by 2 people

• DSV3/R1 fixes

  #1173 merged Mar 8, 2025

• Bump ring from 0.17.11 to 0.17.13

  #1179 merged Mar 8, 2025

• Refactor NCCL device mappers

  #1172 merged Mar 5, 2025

• Remove gpu<>cpu sync for faster long-context

  #1170 merged Mar 3, 2025

• No extra split/cat pair in rope

  #1169 merged Mar 3, 2025

• Implement Phi-4 Multimodal!

  #1163 merged Mar 2, 2025

• Working PrefixCacherV2!

  #1168 merged Mar 2, 2025

1 Pull request opened by 1 person

• Refactor multiproc TP impl

  #1180 opened Mar 9, 2025

2 Issues closed by 2 people

• Unsupported cuda toolkit version: `12.8`

  #1099 closed Mar 6, 2025

• CausalLM model class `M2M100ForConditionalGeneration`

  #1157 closed Mar 3, 2025

5 Issues opened by 5 people

• Guidance on how to create my own gguf / uqff format file similar to llava.

  #1181 opened Mar 9, 2025

• cargo build --release --features metal -> error: could not compile `mistralrs-core` (lib) due to 3 previous errors

  #1177 opened Mar 6, 2025

• `phi4mm.py` script is failing on MacOS M2 (Python 3.13.2)

  #1176 opened Mar 6, 2025

• no response when send too big request

  #1174 opened Mar 5, 2025

• Panics when deploying a Flux model through docker image v0.4.0

  #1171 opened Mar 3, 2025

3 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Memory leak and channel closure issues when reusing/dropping Model

  #865 commented on Mar 5, 2025 • 0 new comments

• Model Wishlist

  #156 commented on Mar 8, 2025 • 0 new comments

• MiniCPM-O 2.6 audio support

  #1089 commented on Mar 4, 2025 • 0 new comments