Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing fails with EOF on test folder #86

Closed
danjenson opened this issue Mar 6, 2023 · 5 comments
Closed

Testing fails with EOF on test folder #86

danjenson opened this issue Mar 6, 2023 · 5 comments

Comments

@danjenson
Copy link

I have run the following command: python evaluate.py ours+hammer ours+hammer-TEST --path runs/astactic/checkpoints/model_003.pth --filter zfc and it ran for ~14 hours before failing with the following:
image
Can you please advise what this is and how it may be remedied? We are trying to reproduce your results.

@danjenson
Copy link
Author

A cursory inspection suggests sertop --implicit --omit_loc --print0 is not matching the expectatio on line 82. I ran this command from CLI and got the following:
image

@yangky11
Copy link
Collaborator

yangky11 commented Mar 8, 2023

Looks like serapi is producing an unexpected error. I'll try to run the code and get back to you. What is "line 82"?

@yangky11
Copy link
Collaborator

yangky11 commented Mar 11, 2023

Hi,

I cannot run python evaluate.py ours+hammer ours+hammer-TEST --path runs/astactic/checkpoints/model_003.pth --filter zfc due to the change in --filter's behavior that you tried to introduce in #83. Could you please provide an example that will trigger the error in the original codebase instead of your own modified repo? Thanks.

@yangky11
Copy link
Collaborator

Also, I have just added a Docker image with everything pre-installed: https://github.com/princeton-vl/CoqGym#2-using-coqgym-in-docker. Hopefully it can make it easier to set up

@yangky11
Copy link
Collaborator

Closing due to inactivity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants