Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Just a comment (poor results) ... #5

Open
victoriastuart opened this issue Dec 20, 2018 · 8 comments
Open

Just a comment (poor results) ... #5

victoriastuart opened this issue Dec 20, 2018 · 8 comments

Comments

@victoriastuart
Copy link

victoriastuart commented Dec 20, 2018

... very interesting paper (http://aclweb.org/anthology/D18-1206 , with included examples), but I tried the online demo, http://cohort.inf.ed.ac.uk/xsum.html , with rather appalling results.

The textual sources for my tests were the abstract for one of my published papers, and the Google infobox for Nova Scotia.

Does the code for the online demo faithfully replicate the code in the paper?

selection_999 1097

selection_999 1098

@shashiongithub
Copy link
Collaborator

Thanks for sharing your results. We have also different texts to play with our demo. Note that the demo uses a model which is trained on the XSum (BBC) dataset to generate an extreme summary (single sentence). The underlying model is not faithful to other datasets.

@victoriastuart
Copy link
Author

Ahh, thank you for the quick reply (appreciated). Would we be able to train on our own datasets, or (even better) use a pretrained language model (e.g.: fastText; ELMo; BERT) ... that would likely include relevant semantic information/embeddings?

@shashiongithub
Copy link
Collaborator

Of course you can train these models on your own datasets. All the codes are available. It would be interesting to plug pretrained language model (e.g.: fastText; ELMo; BERT) with these architectures.

@victoriastuart
Copy link
Author

Excellent; thank you! :-)

@chenbaicheng
Copy link

@victoriastuart do you know how to train model use myself data ? and how to combine fasttext or bert to make the result better ? thank you

@chenbaicheng
Copy link

@shashiongithub how to make this project support Chinese language ? thank

@shashiongithub
Copy link
Collaborator

I have not explored these options in my models. I do encourage you to do so.

@chenbaicheng
Copy link

@shashiongithub thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants