confusion about LDC datasets #14
Comments
|
Among those files, 83 files don't matter. They were not used in LDC2012T04 to SRL according to CoNLL-2009-ST/LDC2012T04/docs/English-README.TXT:
But what about the other 500 files? |
|
This is what I've heard referred to as the "financial subset" of WSJ. There was a bunch of files which were judged to be extremely repetitive formulaic financial text (largely a list of stocks going up and down) and those putting together OntoNotes decided to remove them from the release. So as far as I've been told, it was intentional that it was omitted from OntoNotes, even though some of them already had SRL annotations. Updating these wasn't really in scope when we did the unification, so I don't think any unified form exists (it requires updating the old SRL data to match OntoNotes tokenization, and some manual judgments for the small set of frames that changed since PB1) |
|
Most importantly, these files were not included in the treebank revision that was aimed at improving synchronization with PropBank. So at this point the original TB/PB annotation on those files is pretty archaic. I was personally very unhappy with that decision because those files also had WSD and I believe coref as well, so it seemed wasteful but it wasn’t up to me.
Martha
On Sep 2, 2021, at 7:46 AM, timjogorman ***@***.***> wrote:
This is what I've heard referred to as the "financial subset" of WSJ. There was a bunch of files which were judged to be extremely repetitive formulaic financial text (largely a list of stocks going up and down) and those putting together OntoNotes decided to remove them from the release. So as far as I've been told, it was intentional that it was omitted from OntoNotes, even though some of them already had SRL annotations.
Updating these wasn't really in scope when we did the unification, so I don't think any unified form exists (it requires updating the old SRL data to match OntoNotes tokenization, and some manual judgments for the small set of frames that changed since PB1)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#14 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABB327U56RRJS2USHITHPPLT755DFANCNFSM5CRBO7LQ>.
Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
copied from UniversalDependencies/UD_English-EWT#204
I would like to clarify the relation between https://catalog.ldc.upenn.edu/LDC2013T19 (OntoNotes 5.0) with https://catalog.ldc.upenn.edu/LDC2012T04 (2009 CoNLL Shared Task). The doc of LDC2012T04 says that the texts came from https://catalog.ldc.upenn.edu/LDC95T7. I didn't know that LDC95T7 is part of LDC2013T19 (OntoNotes). I just found
ontonotes-release 5.0/data/files/data/english/annotations/nw/wsj/with the same subdirectories of WSJ thatLDC95T7/combined/wsj/!So LDC95T7 is part of LDC2013T19! My bad! I didn't know that. I also didn't know about https://catalog.ldc.upenn.edu/LDC2015T13, it is a revised version of https://catalog.ldc.upenn.edu/LDC95T7 but sadly, there is no reference to this new version in the https://catalog.ldc.upenn.edu/LDC95T7 page.
Since I am projecting the SRL into UD annotations obtained from LDC95T7, and I have already done that for EWT and Ontonotes, I may already have the data I was trying to obtain from LDC2012T04. I suspect that probably the SRL annotations from LDC2012T04 should also differ from the OntoNotes annotations here, being the last probably the most recent one. Am I right? Maybe @MarthaSPalmer can also have something to add here and can confirm my understanding!
But in OntoNotes, we have 1728 files inside
data/files/data/english/annotations/nw/wsj/subdirectories and in LDC95T7 we have 2312 files. There are 584 missing files in OntoNotes, does anyone knows anything about it? There are the missing ones in OntoNotes:The text was updated successfully, but these errors were encountered: