Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the exo reasoning results are messy #188

Open
fangxuezheng opened this issue Aug 28, 2024 · 6 comments
Open

the exo reasoning results are messy #188

fangxuezheng opened this issue Aug 28, 2024 · 6 comments

Comments

@fangxuezheng
Copy link

device info: 5 Android devices+1 windows WSL
There is no error message in the log, but the output result is confusing,Can you help analyze what caused this?
thank you
image
image

@fangxuezheng
Copy link
Author

The list of Llama3 8B model files is as follows:
image

@AlexCheema
Copy link
Contributor

Thanks for reporting this. Cool you have 5 Linux boxes set up.

Can you run on one of the nodes with DEBUG=6 and paste the logs here? This is definitely a bug.

@fangxuezheng
Copy link
Author

image image

@AlexCheema
Copy link
Contributor

Does this work when you run on 2 of the CLANG boxes only?

I can't reproduce on my end, wondering if it's some edge case when running with more nodes with the tinygrad backend. Never tested tinygrad backend with more than 2 devices.

@HysenX-LI
Copy link

Hello, I've been trying to run this project on the Linux platform as well, but it seems that I've encountered some compatibility issues with tinygrad, which has prevented successful execution. May I inquire which version of Linux you are using?

@JKYtydt
Copy link

JKYtydt commented Sep 5, 2024

@fangxuezheng 您好,请问您使用的是本地模型么,如果是的话您能分享一下是怎么设置的么

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants