Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] MLCEngine instance must be a singleton? #2581

Closed
wqwz111 opened this issue Jun 14, 2024 · 2 comments
Closed

[Question] MLCEngine instance must be a singleton? #2581

wqwz111 opened this issue Jun 14, 2024 · 2 comments
Labels
question Question about the usage

Comments

@wqwz111
Copy link

wqwz111 commented Jun 14, 2024

❓ General Questions

When I create two instance of MLCEngine, each of them always generate: Role "user" is not supported.

@wqwz111 wqwz111 added the question Question about the usage label Jun 14, 2024
@tqchen
Copy link
Contributor

tqchen commented Jun 16, 2024

@wqwz111 would be great if you can send in a python snippet that reproduces the error, we would be happy to look into it. Although in general we recommend running a single MLCEngine, if there is a need to support multiple models, likely extending the engine to do so would be more efficient

@wqwz111
Copy link
Author

wqwz111 commented Jun 17, 2024

Thanks! I will try extending the engine to solve my problem.

@wqwz111 wqwz111 closed this as completed Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Question about the usage
Projects
None yet
Development

No branches or pull requests

2 participants