You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I notice that the QAGSCNN/QAGSXsum ROUGE result in Table5 (Factual Test) is different from other paper (eg. the paper which release this QAGS dataset).
Whether it is because this paper calculates the ROUGE between document and summary while other papers calculate the ROUGE between reference and summary? ( In your experiment setting, you set "ref_sum" same as "src")
I am confused whether baselines for comparison are the same
The text was updated successfully, but these errors were encountered:
We calculate the ROUGE between document and summary, while other papers calculate the ROUGE between reference and summary. We do this because factuality describes the relationship between the original text and the generated text.
We calculate the ROUGE between document and summary, while other papers calculate the ROUGE between reference and summary. We do this because factuality describes the relationship between the original text and the generated text.
Hi, I notice that the QAGSCNN/QAGSXsum ROUGE result in Table5 (Factual Test) is different from other paper (eg. the paper which release this QAGS dataset).
Whether it is because this paper calculates the ROUGE between document and summary while other papers calculate the ROUGE between reference and summary? ( In your experiment setting, you set "ref_sum" same as "src")
I am confused whether baselines for comparison are the same
The text was updated successfully, but these errors were encountered: