-
Notifications
You must be signed in to change notification settings - Fork 257
Labels
Description
Here is the development roadmap for 2025 Q4.
Focus
- Improve the execute performance since
mindtorchuse python written Dispatch mechanism caused a huge host-bound overhead. [Feature] MindNLP 0.6 performance optimize #2225 will focus this problem and try to supportmindspore.jitdirectly without code modification. We will discuss the detail in the sub-issue. - Integrate good features of MindSpore, in previous version of MindNLP, we have already try to introduce MindData, Compile to speedup the training and inference of LLMs, but in mindnlp 0.5 we choose the compatibility solution to solve the infinite increacing of LLMs, thus those speedup features do not available with 0.5 version. [Feature] MindSpore features integrate #2226 shows the features we will integrate。