Skip to content

Commit

Permalink
fixing other typos, cleaning old connl files from the evaluation dire…
Browse files Browse the repository at this point in the history 
…ctory
  • Loading branch information
@lfoppiano
lfoppiano committed Jul 13, 2017
1 parent 77efb75 commit 0ce838b
Show file tree
Hide file tree
Showing 4 changed files with 7 additions and 2,820 deletions.
6 changes: 3 additions & 3 deletions grobid-ner/resources/dataset/ner/corpus/xml/final/Wikipedia_brexit.2.en.training.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@
<sentence xml:id="P8E1">All of the major political parties and mainstream press supported continuing membership of the <ENAMEX type="INSTITUTION">EEC</ENAMEX>.</sentence>
<sentence xml:id="P8E2">However, there were significant splits within the ruling <ENAMEX type="ORGANISATION">Labour party,</ENAMEX> the membership of which had voted <ENAMEX type="MEASURE">2:1</ENAMEX> in favour of withdrawal at a <ENAMEX type="PERIOD">one-day</ENAMEX> party conference on <ENAMEX type="PERIOD">26 April 1975</ENAMEX>.</sentence>
<sentence xml:id="P8E3">Since the cabinet was split between strongly pro-<ENAMEX type="NATIONAL">European</ENAMEX> and strongly anti-<ENAMEX type="NATIONAL">European</ENAMEX> ministers, <ENAMEX type="PERSON">Harold Wilson</ENAMEX> suspended the constitutional convention of <ENAMEX type="INSTITUTION">Cabinet collective responsibility</ENAMEX> and allowed <ENAMEX type="TITLE">ministers</ENAMEX> to publicly campaign on either side.</sentence>
<sentence xml:id="P8E4"><ENAMEX type="MEAURE">Seven of the twenty-three</ENAMEX> members of the cabinet opposed <ENAMEX type="INSTITUTION">EEC</ENAMEX> membership.</sentence>
<sentence xml:id="P8E4"><ENAMEX type="MEASURE">Seven of the twenty-three</ENAMEX> members of the cabinet opposed <ENAMEX type="INSTITUTION">EEC</ENAMEX> membership.</sentence>
</p>
<p xml:lang="en" xml:id="P9">
<sentence xml:id="P9E0">On <ENAMEX type="PERIOD">5 June 1975</ENAMEX>, the electorate were asked to vote yes or no on the question: &quot;Do you think the <ENAMEX type="LOCATION">UK</ENAMEX> should stay in the <ENAMEX type="INSTITUTION">European Community (Common Market)</ENAMEX>?&quot;</sentence>
Expand Down Expand Up @@ -73,7 +73,7 @@
<sentence xml:id="P21E2">This was the <ENAMEX type="MEASURE">first</ENAMEX> time since the <ENAMEX type="EVENT">1910 general election</ENAMEX> that any party other than the <ENAMEX type="ORGANISATION">Labour or Conservative parties</ENAMEX> had taken the largest share of the vote in a nationwide election.</sentence>
</p>
<p xml:lang="en" xml:id="P22">
<sentence xml:id="P22E0">In <ENAMEX type="PERIOD">2014</ENAMEX>, <ENAMEX type="ORGANISATION">UKIP</ENAMEX> won <ENAMEX type="MEAURE">two</ENAMEX> by-elections, triggered when the sitting <ENAMEX type="TITLE">Conservative MPs</ENAMEX> defected to <ENAMEX type="ORGANISATION">UKIP</ENAMEX> and then resigned.</sentence>
<sentence xml:id="P22E0">In <ENAMEX type="PERIOD">2014</ENAMEX>, <ENAMEX type="ORGANISATION">UKIP</ENAMEX> won <ENAMEX type="MEASURE">two</ENAMEX> by-elections, triggered when the sitting <ENAMEX type="TITLE">Conservative MPs</ENAMEX> defected to <ENAMEX type="ORGANISATION">UKIP</ENAMEX> and then resigned.</sentence>
<sentence xml:id="P22E1">These were their <ENAMEX type="MEASURE">first</ENAMEX> elected <ENAMEX type="TITLE">MPs</ENAMEX>.</sentence>
<sentence xml:id="P22E2">At the <ENAMEX type="EVENT">2015 general election</ENAMEX> <ENAMEX type="ORGANISATION">UKIP</ENAMEX> took <ENAMEX type="MEASURE">12.6%</ENAMEX> of the total vote and held <ENAMEX type="MEASURE">one of the two</ENAMEX> seats won in <ENAMEX type="PERIOD">2014</ENAMEX>.</sentence>
</p>
Expand Down Expand Up @@ -138,7 +138,7 @@
<sentence xml:id="P38E0">Main article: Results of the <ENAMEX type="EVENT">United Kingdom European Union membership referendum, 2016</ENAMEX></sentence>
</p>
<p xml:lang="en" xml:id="P39">
<sentence xml:id="P39E0">The result was announced on the <ENAMEX type="PERIOD">morning of 24 June</ENAMEX>: <ENAMEX type="MEASUE">52%</ENAMEX> voted in favour of leaving the <ENAMEX type="INSTITUTION">European Union</ENAMEX> and <ENAMEX type="MEASURE">48%</ENAMEX> voted in favour of remaining a <ENAMEX type="TITLE">member</ENAMEX> of the <ENAMEX type="INSTITUTION">European Union</ENAMEX>.</sentence>
<sentence xml:id="P39E0">The result was announced on the <ENAMEX type="PERIOD">morning of 24 June</ENAMEX>: <ENAMEX type="MEASURE">52%</ENAMEX> voted in favour of leaving the <ENAMEX type="INSTITUTION">European Union</ENAMEX> and <ENAMEX type="MEASURE">48%</ENAMEX> voted in favour of remaining a <ENAMEX type="TITLE">member</ENAMEX> of the <ENAMEX type="INSTITUTION">European Union</ENAMEX>.</sentence>
</p>
<p xml:lang="en" xml:id="P40">
<sentence xml:id="P40E0"><ENAMEX type="EVENT">United Kingdom European Union membership referendum, 2016</ENAMEX></sentence>
Expand Down
8 changes: 4 additions & 4 deletions grobid-ner/resources/dataset/ner/corpus/xml/final/wikipedia.ner26.en.training.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@
<sentence xml:id="P0E99">Main article:</sentence>
<sentence xml:id="P0E100"><ENAMEX type="LOCATION" subtype="military_action/N1">Western Front</ENAMEX> ( <ENAMEX type="EVENT" subtype="military_action/N1">World War I</ENAMEX> )</sentence>
<sentence xml:id="P0E101">At the outbreak of <ENAMEX type="EVENT" subtype="military_action/N1">World War I</ENAMEX>, the <ENAMEX type="INSTITUTION" subtype="O">German army</ENAMEX> ( consisting in the West of <ENAMEX type="MEASURE">seven</ENAMEX> field armies ) carried out a modified version of the <ENAMEX type="UNKNOWN" subtype="O">Schlieffen Plan</ENAMEX>.</sentence>
<sentence xml:id="P0E102">This marched <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> armies through neutral <ENAMEX type="LOCATION" subtype="country/N1">Belgium</ENAMEX> and into <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX>, before turning southwards to encircle the <ENAMEX type="INSITUTION" subtype="O">French army</ENAMEX> on the <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> border.</sentence>
<sentence xml:id="P0E102">This marched <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> armies through neutral <ENAMEX type="LOCATION" subtype="country/N1">Belgium</ENAMEX> and into <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX>, before turning southwards to encircle the <ENAMEX type="INSTITUTION" subtype="O">French army</ENAMEX> on the <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> border.</sentence>
<sentence xml:id="P0E103">Since <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX> had declared that it would " keep full freedom of acting in case of a war between <ENAMEX type="LOCATION" subtype="country/N1">Germany and Russia</ENAMEX> ", <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> had to expect the possibility of an attack by <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX> on one front and by <ENAMEX type="LOCATION" subtype="country/N1">Russia</ENAMEX> on the other.</sentence>
<sentence xml:id="P0E104">To meet such a scenario, the <ENAMEX type="UNKNOWN" subtype="O">Schlieffen Plan</ENAMEX> stated that <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> must try to defeat <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX> quickly ( as had happened in the <ENAMEX type="EVENT" subtype="military_action/N1">Franco - Prussian War of 1870 - 71</ENAMEX> ).</sentence>
<sentence xml:id="P0E105">It further suggested that to repeat a fast victory in the west, <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> should not attack through the difficult terrain of <ENAMEX type="LOCATION" subtype="historical_country/N1">Alsace - Lorraine</ENAMEX> ( which had a direct border west of the <ENAMEX type="LOCATION" subtype="delimited_body_of_water/N1">river Rhine</ENAMEX> ), instead, the idea was to try to quickly cut <ENAMEX type="LOCATION" subtype="municipality/N1">Paris</ENAMEX> off from the <ENAMEX type="LOCATION" subtype="delimited_body_of_water/N1">English Channel</ENAMEX> and <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">British</ENAMEX> assistance, and take <ENAMEX type="LOCATION" subtype="municipality/N1">Paris</ENAMEX>, thus winning the war.</sentence>
Expand Down Expand Up @@ -199,7 +199,7 @@
<sentence xml:id="P0E193">At the start of the war, the <ENAMEX type="LOCATION" subtype="historical_country/N1">German Empire</ENAMEX> had cruisers scattered across the globe, some of which were subsequently used to attack <ENAMEX type="INSTITUTION" subtype="O">Allied</ENAMEX> merchant shipping.</sentence>
<sentence xml:id="P0E194">The <ENAMEX type="INSTITUTION" subtype="O">British Royal Navy</ENAMEX> systematically hunted them down, though not without some embarrassment from its inability to protect <ENAMEX type="INSTITUTION" subtype="O">Allied</ENAMEX> shipping.</sentence>
<sentence xml:id="P0E195">For example, the <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> detached light cruiser <ENAMEX type="ARTIFACT" subtype="vessel/N2">SMS Emden</ENAMEX>, part of the <ENAMEX type="LOCATION" subtype="supernational_region/N1">East - Asia</ENAMEX> squadron stationed at <ENAMEX type="LOCATION" subtype="municipality/N1">Qingdao</ENAMEX>, seized or destroyed <ENAMEX type="MEASURE" subtype="rational_number/N1">15</ENAMEX> merchantmen, as well as sinking a <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Russian</ENAMEX> cruiser and a <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">French</ENAMEX> destroyer.</sentence>
<sentence xml:id="P0E196">However, most of the <ENAMEX type="NATIONAL" subtype="O">German East - Asia</ENAMEX> squadron - - consisting of the armoured cruisers <ENAMEX type="ARTIFACT" subtype="vessel/N2">Scharnhorst and Gneisenau</ENAMEX>, light cruisers <ENAMEX type="ARTIFACT" subtype="vessel/N2">Nurnberg and Leipzig</ENAMEX> and <ENAMEX type="MEASURE">two</ENAMEX> transport ships - - did not have orders to raid shipping and was instead underway to <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> when it met <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">British</ENAMEX><ENAMEX type="0" subtype="0">ships.</ENAMEX></sentence>
<sentence xml:id="P0E196">However, most of the <ENAMEX type="NATIONAL" subtype="O">German East - Asia</ENAMEX> squadron - - consisting of the armoured cruisers <ENAMEX type="ARTIFACT" subtype="vessel/N2">Scharnhorst and Gneisenau</ENAMEX>, light cruisers <ENAMEX type="ARTIFACT" subtype="vessel/N2">Nurnberg and Leipzig</ENAMEX> and <ENAMEX type="MEASURE">two</ENAMEX> transport ships - - did not have orders to raid shipping and was instead underway to <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> when it met <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">British</ENAMEX> ships.</sentence>
<sentence xml:id="P0E197">The <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> flotilla and <ENAMEX type="ARTIFACT" subtype="vessel/N2">Dresden</ENAMEX> sank <ENAMEX type="MEASURE" subtype="O">two</ENAMEX> armoured cruisers at the <ENAMEX type="EVENT" subtype="military_action/N1">Battle of Coronel</ENAMEX>, but was almost destroyed at the <ENAMEX type="EVENT" subtype="military_action/N1">Battle of the Falkland Islands in December 1914</ENAMEX>, with only <ENAMEX type="ARTIFACT" subtype="vessel/N2">Dresden</ENAMEX> and a few auxiliaries escaping, but at the <ENAMEX type="EVENT" subtype="military_action/N1">Battle of Mas a Tierra</ENAMEX> these too were destroyed or interned.</sentence>
<sentence xml:id="P0E198">Soon after the outbreak of hostilities, <ENAMEX type="LOCATION" subtype="country/N1">Britain</ENAMEX> began a <ENAMEX type="EVENT" subtype="military_action/N1">naval blockade of Germany</ENAMEX>.</sentence>
<sentence xml:id="P0E199">The strategy proved effective, cutting off vital military and civilian supplies, although this blockade violated accepted international law codified by several international agreements of the <ENAMEX type="PERIOD" subtype="O">past two centuries</ENAMEX>.</sentence>
Expand Down Expand Up @@ -322,7 +322,7 @@
<sentence xml:id="P0E316"><ENAMEX type="PERSON" subtype="O">Generalissimo Chiang Kai - shek</ENAMEX> deployed his best army to defend <ENAMEX type="LOCATION" subtype="municipality/N1">Shanghai</ENAMEX>, but, <ENAMEX type="PERIOD">after three months</ENAMEX> of fighting, <ENAMEX type="LOCATION" subtype="municipality/N1">Shanghai</ENAMEX> fell.</sentence>
<sentence xml:id="P0E317">The <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> continued to push the <ENAMEX type="INSTITUTION" subtype="jurisdictional_cultural_adjective/J1">Chinese forces</ENAMEX> back, capturing the capital <ENAMEX type="LOCATION" subtype="municipality/N1">Nanking</ENAMEX> in <ENAMEX type="PERIOD" subtype="date/N7">December 1937</ENAMEX> and committed the <ENAMEX type="EVENT" subtype="military_action/N1">Nanking Massacre</ENAMEX>.</sentence>
<sentence xml:id="P0E318">In <ENAMEX type="PERIOD" subtype="date/N7">June 1938</ENAMEX>, <ENAMEX type="INSTITUTION" subtype="jurisdictional_cultural_adjective/J1">Chinese forces</ENAMEX> stalled the <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> advance by flooding the <ENAMEX type="LOCATION" subtype="delimited_body_of_water/N1">Yellow River</ENAMEX>; this manoeuvre bought time for the <ENAMEX type="PERSON_TYPE" subtype="member_of_an_ethnic_group/N1">Chinese</ENAMEX> to prepare their defences at <ENAMEX type="LOCATION" subtype="municipality/N1">Wuhan</ENAMEX>, but the city was taken by <ENAMEX type="PERIOD" subtype="O">October</ENAMEX>.</sentence>
<sentence xml:id="P0E319"><ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> military victories did not bring about the collapse of <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Chinese</ENAMEX> resistance that <ENAMEX type="LOCATION" subtype="country/N1">Japan</ENAMEX> had hoped to achieve; instead the <ENAMEX type="INSITUTION" subtype="O">Chinese government</ENAMEX> relocated inland to <ENAMEX type="LOCATION" subtype="municipality/N1">Chongqing</ENAMEX> and continued the war.</sentence>
<sentence xml:id="P0E319"><ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> military victories did not bring about the collapse of <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Chinese</ENAMEX> resistance that <ENAMEX type="LOCATION" subtype="country/N1">Japan</ENAMEX> had hoped to achieve; instead the <ENAMEX type="INSTITUTION" subtype="O">Chinese government</ENAMEX> relocated inland to <ENAMEX type="LOCATION" subtype="municipality/N1">Chongqing</ENAMEX> and continued the war.</sentence>
<sentence xml:id="P0E320"><ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Japanese invasion of the Soviet Union and Mongolia ( 1938 )</ENAMEX></sentence>
<sentence xml:id="P0E321">On <ENAMEX type="PERIOD" subtype="date/N7">29 July 1938</ENAMEX>, the <ENAMEX type="PERSON_TYPE" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> invaded the <ENAMEX type="LOCATION" subtype="country/N1">USSR</ENAMEX> and were checked at the <ENAMEX type="EVENT" subtype="military_action/N1">Battle of Lake Khasan</ENAMEX>.</sentence>
<sentence xml:id="P0E322">Although the battle was a <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">Soviet</ENAMEX> victory, the <ENAMEX type="PERSON_TYPE" subtype="jurisdictional_cultural_adjective/J1">Japanese</ENAMEX> dismissed it as an inconclusive draw, and on <ENAMEX type="PERIOD" subtype="date/N7">11 May 1939</ENAMEX> decided to move the <ENAMEX type="LOCATION" subtype="O">Japanese-Mongolian border</ENAMEX> up to the <ENAMEX type="LOCATION" subtype="delimited_body_of_water/N1">Khalkhin Gol River</ENAMEX> by force.</sentence>
Expand Down Expand Up @@ -383,7 +383,7 @@
<sentence xml:id="P0E377"><ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX> launched an offensive against <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX> and, for reasons of military strategy, also invaded the neutral nations of <ENAMEX type="LOCATION" subtype="country/N1">Belgium, the Netherlands, and Luxembourg</ENAMEX> on <ENAMEX type="PERIOD" subtype="date/N7">10 May 1940</ENAMEX>.</sentence>
<sentence xml:id="P0E378">That same day <ENAMEX type="LOCATION" subtype="country/N1">Britain</ENAMEX> invaded <ENAMEX type="LOCATION" subtype="country/N1">Iceland</ENAMEX> to preempt a possible <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German</ENAMEX> invasion of the island.</sentence>
<sentence xml:id="P0E379">The <ENAMEX type="LOCATION" subtype="country/N1">Netherlands and Belgium</ENAMEX> were overrun using <ENAMEX type="LOCATION">blitzkrieg</ENAMEX> tactics in a <ENAMEX type="PERIOD">few days and weeks</ENAMEX>, respectively.</sentence>
<sentence xml:id="P0E380">The <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">French</ENAMEX> - fortified <ENAMEX type="LOCTION" subtype="military_facility/N1">Maginot Line</ENAMEX> and the <ENAMEX type="INSTITUTION" subtype="organization_adjective/J1">Allied forces in Belgium</ENAMEX> were circumvented by a flanking movement through the thickly wooded <ENAMEX type="LOCATION" subtype="other_non-political_region/N1">Ardennes</ENAMEX> region, mistakenly perceived by <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">French</ENAMEX> planners as an impenetrable natural barrier against armoured vehicles.</sentence>
<sentence xml:id="P0E380">The <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">French</ENAMEX> - fortified <ENAMEX type="LOCATION" subtype="military_facility/N1">Maginot Line</ENAMEX> and the <ENAMEX type="INSTITUTION" subtype="organization_adjective/J1">Allied forces in Belgium</ENAMEX> were circumvented by a flanking movement through the thickly wooded <ENAMEX type="LOCATION" subtype="other_non-political_region/N1">Ardennes</ENAMEX> region, mistakenly perceived by <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">French</ENAMEX> planners as an impenetrable natural barrier against armoured vehicles.</sentence>
<sentence xml:id="P0E381">As a result, the bulk of the <ENAMEX type="INSTITUTION" subtype="O">Allied armies</ENAMEX> found themselves trapped in an encirclement and were annihilated.</sentence>
<sentence xml:id="P0E382"><ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">British</ENAMEX> troops were forced to evacuate the continent at <ENAMEX type="LOCATION" subtype="municipality/N1">Dunkirk</ENAMEX>, abandoning their heavy equipment by early <ENAMEX type="PERIOD" subtype="date/N7">June</ENAMEX>.</sentence>
<sentence xml:id="P0E383">On <ENAMEX type="PERIOD" subtype="date/N7">10 June</ENAMEX>, <ENAMEX type="LOCATION" subtype="country/N1">Italy</ENAMEX> invaded <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX>, declaring war on both <ENAMEX type="LOCATION" subtype="country/N1">France and Britain</ENAMEX>; <ENAMEX type="LOCATION" subtype="municipality/N1">Paris</ENAMEX> fell on <ENAMEX type="PERIOD" subtype="date/N7">14 June</ENAMEX> and <ENAMEX type="PERIOD">eight days later</ENAMEX> <ENAMEX type="LOCATION" subtype="country/N1">France</ENAMEX> surrendered and was soon divided into <ENAMEX type="NATIONAL" subtype="jurisdictional_cultural_adjective/J1">German and Italian</ENAMEX> occupation zones, and an unoccupied rump state under the <ENAMEX type="EVENT" subtype="O">Vichy Regime</ENAMEX>, which, though officially neutral, was generally aligned with <ENAMEX type="LOCATION" subtype="country/N1">Germany</ENAMEX>.</sentence>
Expand Down

0 comments on commit 0ce838b

Please sign in to comment.