I use the default config, but the reault is too bad

[silence401]

Thanks for your excellent work!
I use the xmen data you provoided, but the result is worse than the paper said.
The test_result as follow:

And the result of superman:

[Kai-46]

Hi @silence401 , this is a significantly refactored version (for improved readability) of the private codebase I used for experiments; I haven't got time to carefully checked reproducibility yet.

This said, I did clone this public codebase, follow the steps on the readme, and re-run the experiment without hassles last night. Below are the test-set results I got for the xmen:

I'm not sure what happened on your side based on this limited information; can you try spending some time debugging this issue first?