Model Do Not Respond [Bug]

[bunnywaffle]

🐛 Bug

I downloaded the model RedPajamas 3B, but when I try to chat with it, it does not respond.

Expected behavior

The model should respond to my chat requests.

Environment

• Platform (Android):
• Operating system (e.g. Ubuntu/Windows/MacOS/...):
• Device (Samsung Galaxy M32)
• How you installed MLC-LLM (APK):
• Any other relevant information:

Additional context

[sherelynyap]

I have the same problem using Samsung Galaxy S21+

[cyx-6]

Sorry for replying late! Please try new apk. It will show error message for information.

[sherelynyap]

Error message: InternalError: Check failed: (chat_ != nullptr) is false: Chat is not initialized via reload Stack trace: File "/Users/houbohan/mlc-llm/cpp/llm_chat.cc", line 1301

Got this error message

[junrushao]

@sherelynyap I just tried again but couldn't reproduce this issue with my device. The particular lines you point to is:

mlc-llm/cpp/llm_chat.cc

Lines 1329 to 1330 in f0b1225

	ICHECK(chat_ != nullptr) << "Chat is not initialized via reload";
	return chat_.get();

, which means the chat_ field is not initialized yet, but we do already initialize it in the Android app in those lines:

mlc-llm/android/MLCChat/app/src/main/java/ai/mlc/mlcchat/AppViewModel.kt

Lines 477 to 483 in f0b1225

	fun startChat() {
	chatState.requestReloadChat(
	modelConfig.localId,
	modelConfig.modelLib,
	modelDirFile.absolutePath
	)
	}