Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Answering questions #23

Closed
SergeyPetrakov opened this issue Nov 9, 2022 · 3 comments
Closed

Answering questions #23

SergeyPetrakov opened this issue Nov 9, 2022 · 3 comments

Comments

@SergeyPetrakov
Copy link

IMAGE 2022-11-09 11:45:50

I followed your advice to push into the model
input="predict answer: what can cause a tsunami"
and then
out = topkSample(input, model, tokenizer, num_samples=5)
But as you can see ther esults are extremely low, but in your notebooks this approach showed good results, can you help me please with this issue

@apoorvumang
Copy link
Owner

Hi @SergeyPetrakov , thanks for your interest!

Are you using the model from here? https://huggingface.co/spaces/apoorvumang/kgt5 . The publicly available models are only trained on the KG completion task and have not been finetuned for QA. Hence they will be good only for KGC. For the results in the paper, we further finetuned the models on QA datasets. To reproduce the results, you will have to finetune the models yourself

@SergeyPetrakov
Copy link
Author

Hi @apoorvumang, thank you for fast answer!
I have used apoorvumang/kgt5-base-wikikg90mv2 model. May I ask you to share checkpoints of models that you finetuned on QA datasets?

@apoorvumang
Copy link
Owner

Unfortunately we don't have pretrained checkpoints available right now (but we might be adding them soon). Request you to create a new issue for this for tracking

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants