Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

33 New Proofs Found by Machines #13

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

yangky11
Copy link

Hi,

We evaluated our machine learning prover on miniF2F and found 26 new proofs.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 28, 2023
Copy link

@spolu spolu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏

@yangky11 yangky11 changed the title 26 New Proofs Found by Machines 33 New Proofs Found by Machines Jun 7, 2023
@yangky11
Copy link
Author

yangky11 commented Jun 8, 2023

Hi,

I have re-run a new version of the model, which discovered 7 additional proofs: 5740c4a

@faabian
Copy link
Contributor

faabian commented Sep 8, 2023

Thank you for sharing the proofs! I'm not sure whether we should continue to add proofs to minif2f though because it will lead to training data contamination with Github being a classical source of pretraining data. I will leave it open for now :)

@yangky11
Copy link
Author

yangky11 commented Sep 8, 2023

I totally understand. Feel free to close this PR as you see appropriate.

@faabian
Copy link
Contributor

faabian commented Sep 10, 2023

Let's leave it open for visibility :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants