[Bug] When I run the mlc-llm app (RedPjama chat 3B model) on my Redmi K60 (with a First Generation Snapdragon 8 processor), the program gets stuck during token generation. What could be the reason for this?

[BBuf]

Whether it's the compiled APK or the directly downloaded APK, both have this issue. I tested it on both the Redmi K60 and Redmi K10.

[GameOverFlowChart]

The prebuild apk only works with the 2 models which are listed in the app. In the discord there is an unofficial apk version which only works with llama2 based models. Both work for me. Your phone has a better processor than mine. How much ram do you have? I have 12gb and my phone really struggles with the 7b models (app can crash, if the input is too long even the phone can crash). If you have the right combination of apk and model, I would guess that you don't have enough ram?

[tqchen]

There is a new apk in the docs, feel free to try it out. It does come with high RAM demand, so latest snapdragon devices would work

[BBuf]

There is a new apk in the docs, feel free to try it out. It does come with high RAM demand, so latest snapdragon devices would work

I successfully ran the rwkv-world-3b model on my Xiaomi phone now! I want to know which pr fix the stuck bug?