Merge branch 'master' of https://github.com/kermitt2/grobid-ner

grobid-ner/resources/dataset/ner/corpus/xml/final/EHRI_institutions_be-006093.en.training.xml

@@ -11,11 +11,11 @@
 				<sentence xml:id="P0E4">The institution includes the “<ENAMEX type="INSTITUTION">Archives Générales du Royaume</ENAMEX>” in <ENAMEX type="LOCATION">Brussels</ENAMEX> and <ENAMEX type="MEASURE">18</ENAMEX> <ENAMEX type="INSTITUTION">State Archives</ENAMEX> that are distributed throughout the country.</sentence>
 				<sentence xml:id="P0E5">The <ENAMEX type="INSTITUTION">State Archives</ENAMEX> ensure the proper preservation of archival documents produced and managed by the state authorities.</sentence>
 				<sentence xml:id="P0E6">For this purpose, the <ENAMEX type="INSTITUTION">State Archives</ENAMEX> issue directives and recommendations, conduct inspections, organises training for civil servants and act as an advisory body for the construction and preparation of premises for the conservation of archives and for the organisation of archive management within a public authority.</sentence>
-				<sentence xml:id="P0E7">The <ENAMEX type="INSTITUTION">State Archives</ENAMEX> obtain and preserve (following sorting) archive documents that are at least <ENAMEX type="MEASURE">30</ENAMEX> years old from courts, tribunals, public authorities, notaries and from the private sector and private individuals (companies, politicians, associations and societies, influential families, etc. that have played an important role in society).</sentence>
+				<sentence xml:id="P0E7">The <ENAMEX type="INSTITUTION">State Archives</ENAMEX> obtain and preserve (following sorting) archive documents that are at least <ENAMEX type="PERIOD">30 years</ENAMEX> old from courts, tribunals, public authorities, notaries and from the private sector and private individuals (companies, politicians, associations and societies, influential families, etc. that have played an important role in society).</sentence>
 				<sentence xml:id="P0E8">They ensure that public archives are transferred according to strict archival standards.</sentence>
 			</p>
 			<p xml:lang="en" xml:id="P1">
-				<sentence xml:id="P1E0">The <ENAMEX type="INSTITUTION">National Archives of Belgium</ENAMEX> 2 – <ENAMEX type="PERSON">Joseph Cuvelier</ENAMEX> repository preserves the archives of the external services of the <ENAMEX type="INSTITUTION">Federal Public Service Justice</ENAMEX> (penal institutions), the courts and tribunals under the responsiblity of the <ENAMEX type="LOCATION">Brussels-Capital Region</ENAMEX> (justices of peace, police tribunals, <ENAMEX type="LEGAL">Court of Cassation</ENAMEX>, etc.), the <ENAMEX type="INSTITUTION">Federal Public Service Economy</ENAMEX> (patents), the <ENAMEX type="INSTITUTION">Ministry for Reconstruction</ENAMEX> (files on war damages) and business archives.</sentence>
+				<sentence xml:id="P1E0">The <ENAMEX type="INSTITUTION">National Archives of Belgium</ENAMEX> 2 – <ENAMEX type="PERSON">Joseph Cuvelier</ENAMEX> repository preserves the archives of the external services of the <ENAMEX type="INSTITUTION">Federal Public Service Justice</ENAMEX> (penal institutions), the courts and tribunals under the responsiblity of the <ENAMEX type="LOCATION">Brussels-Capital Region</ENAMEX> (justices of peace, <ENAMEX type="INSTITUTION">police tribunals, Court of Cassation</ENAMEX>, etc.), the <ENAMEX type="INSTITUTION">Federal Public Service Economy</ENAMEX> (patents), the <ENAMEX type="INSTITUTION">Ministry for Reconstruction</ENAMEX> (files on war damages) and business archives.</sentence>
 			</p>
 			<p xml:lang="en" xml:id="P2">
 				<sentence xml:id="P2E0">There are several online search engines: keyword, archives, creator, persons, themes (<ENAMEX type="WEBSITE">http://search.arch.be/</ENAMEX>).</sentence>

grobid-ner/resources/dataset/ner/corpus/xml/final/EHRI_unit_il-002798-o_32-61.en.training.xml

@@ -3,7 +3,7 @@
 	<subcorpus>
 		<document name="EHRI_unit_il-002798-o_32-61.en">
 			<p xml:lang="en" xml:id="P0">
-				<sentence xml:id="P0E0">Documentation of the murder of the <ENAMEX type="PERSON_TYPE">Jews of Crimea</ENAMEX>, <ENAMEX type="PERIOD">1941-1942</ENAMEX> Excerpts of documents of the <ENAMEX type="INSTITUTION">Soviet Extraordinary State Commission</ENAMEX> (<ENAMEX type="INSTITUTION">ChGK</ENAMEX>) in the <ENAMEX type="NATIONAL">Crimean</ENAMEX> occupied territory, including information regarding the murder of <ENAMEX type="PERSON_TYPE">Jews</ENAMEX> in <ENAMEX type="LOCATION">Yevpatoria, Zuya, Kheyrus and Biyuk-Onlar</ENAMEX>, names of those who perished, <ENAMEX type="PERIOD">January-March 1942</ENAMEX>; notice from the <ENAMEX type="TITLE">mayor of Simferopol</ENAMEX> regarding housing for <ENAMEX type="PERSON_TYPE">Jews</ENAMEX>, <ENAMEX type="PERIOD">15 March 1942</ENAMEX>; Ausweis (identity card) of <ENAMEX type="PERSON">Foma Paskitovski</ENAMEX>, from <ENAMEX type="LOCATION">Kerch</ENAMEX>; copy of a photograph of a cell in the <ENAMEX type="LOCATION">Kerch</ENAMEX> jail, <ENAMEX type="PERIOD">December 1941</ENAMEX>.</sentence>
+				<sentence xml:id="P0E0">Documentation of the murder of the <ENAMEX type="PERSON_TYPE">Jews of Crimea</ENAMEX>, <ENAMEX type="PERIOD">1941-1942</ENAMEX> Excerpts of documents of the <ENAMEX type="INSTITUTION">Soviet Extraordinary State Commission</ENAMEX> (<ENAMEX type="INSTITUTION">ChGK</ENAMEX>) in the <ENAMEX type="NATIONAL">Crimean</ENAMEX> occupied territory, including information regarding the murder of <ENAMEX type="PERSON_TYPE">Jews</ENAMEX> in <ENAMEX type="LOCATION">Yevpatoria, Zuya, Kheyrus and Biyuk-Onlar</ENAMEX>, names of those who perished, <ENAMEX type="PERIOD">January-March 1942</ENAMEX>; notice from the <ENAMEX type="TITLE">mayor of Simferopol</ENAMEX> regarding housing for <ENAMEX type="PERSON_TYPE">Jews</ENAMEX>, <ENAMEX type="PERIOD">15 March 1942</ENAMEX>; Ausweis (identity card) of <ENAMEX type="PERSON">Foma Paskitovski</ENAMEX>, from <ENAMEX type="LOCATION">Kerch</ENAMEX>; copy of a photograph of a cell in the <ENAMEX type="INTALLATION">Kerch jail</ENAMEX>, <ENAMEX type="PERIOD">December 1941</ENAMEX>.</sentence>
 			</p>
 		</document>
 	</subcorpus>

grobid-ner/resources/dataset/ner/corpus/xml/final/EHRI_unit_il-002798-p_37.1.en.training.xml

@@ -7,7 +7,7 @@
 				<sentence xml:id="P0E1">He lived in <ENAMEX type="LOCATION">Sofia</ENAMEX> (except for <ENAMEX type="PERIOD">two years</ENAMEX> during <ENAMEX type="EVENT">World War II</ENAMEX>) <ENAMEX type="PERIOD">from 1916-1949</ENAMEX>.</sentence>
 				<sentence xml:id="P0E2">He was one of the outstanding activists in the <ENAMEX type="ORGANISATION">Zionist movement in Bulgaria</ENAMEX>: he served as a <ENAMEX type="TITLE">member of the Central Committee of the Zionist Union in Bulgaria</ENAMEX>, <ENAMEX type="PERIOD">1919-1923</ENAMEX>; he held <ENAMEX type="MEASURE">five</ENAMEX> terms of office as the <ENAMEX type="TITLE">representative to the World Zionist Congress</ENAMEX>; he served as the <ENAMEX type="TITLE">chairman of the Zionist Organization in Sofia</ENAMEX>; he was one of the <ENAMEX type="TITLE">founders of the Revisionist movement in Bulgaria and its chairman</ENAMEX> <ENAMEX type="PERIOD">from 1925-1935</ENAMEX>.</sentence>
 				<sentence xml:id="P0E3"><ENAMEX type="PERSON">Arditti</ENAMEX> was a <ENAMEX type="TITLE">member</ENAMEX> of the illegal Committee for the <ENAMEX type="EVENT">Rescue of Bulgarian Jewry during World War II</ENAMEX>, maintaining his <ENAMEX type="CONCEPTUAL">Zionist</ENAMEX> activities and encouragement of <ENAMEX type="CONCEPTUAL">aliya</ENAMEX> to <ENAMEX type="LOCATION">Eretz Israel</ENAMEX> <ENAMEX type="PERIOD">after 1944</ENAMEX>.</sentence>
-				<sentence xml:id="P0E4"><ENAMEX type="PERSON">Arditti</ENAMEX> continued to serve as <ENAMEX type="TITLE">representative of the Revisionists in the Union of Bulgarian Jews</ENAMEX> during the years <ENAMEX type="PERIOD">1947-1949</ENAMEX>.</sentence>
+				<sentence xml:id="P0E4"><ENAMEX type="PERSON">Arditti</ENAMEX> continued to serve as <ENAMEX type="TITLE">representative of the Revisionists in the Union of Bulgarian Jews</ENAMEX> during the <ENAMEX type="PERIOD">years 1947-1949</ENAMEX>.</sentence>
 				<sentence xml:id="P0E5">He made <ENAMEX type="CONCEPTUAL">aliya</ENAMEX> to <ENAMEX type="LOCATION">Israel</ENAMEX> and joined the leadership of the <ENAMEX type="ORGANISATION">Herut party and the Organization of Sephardi Jews in Israel</ENAMEX> in <ENAMEX type="PERIOD">1949</ENAMEX>.</sentence>
 				<sentence xml:id="P0E6">He also served as the <ENAMEX type="TITLE">chairman of the Central Committee of the World Sephardi Federation and a member of the Knesset</ENAMEX>.</sentence>
 			</p>
@@ -22,11 +22,11 @@
 				<sentence xml:id="P4E2">2.<ENAMEX type="PERSON">Benjamin Arditti</ENAMEX>&apos;s correspondence with various institutions and public figures;</sentence>
 				<sentence xml:id="P4E3">3.Manuscripts and various publications (articles, essays and more, not including books) by <ENAMEX type="PERSON">Benjamin Arditti</ENAMEX>;</sentence>
 				<sentence xml:id="P4E4">4.Documentation regarding <ENAMEX type="PERSON">Benjamin Arditti</ENAMEX>&apos;s activities as a <ENAMEX type="TITLE">Knesset member</ENAMEX> and an activist in <ENAMEX type="PERSON_TYPE">Sephardi Jewish</ENAMEX> organizations;</sentence>
-				<sentence xml:id="P4E5">5.Documentation regarding the history of the <ENAMEX type="PERSON_TYPE">Jews in Bulgaria</ENAMEX> until <ENAMEX type="EVENT">World War II</ENAMEX>, <ENAMEX type="CONCEPT">Zionism</ENAMEX> and the <ENAMEX type="ORGANISATION">Zionist movement in Bulgaria</ENAMEX> and throughout the world;</sentence>
+				<sentence xml:id="P4E5">5.Documentation regarding the history of the <ENAMEX type="PERSON_TYPE">Jews</ENAMEX> in <ENAMEX type="LOCATION">Bulgaria</ENAMEX> until <ENAMEX type="EVENT">World War II</ENAMEX>, <ENAMEX type="CONCEPT">Zionism</ENAMEX> and the <ENAMEX type="ORGANISATION">Zionist movement in Bulgaria</ENAMEX> and throughout the world;</sentence>
 				<sentence xml:id="P4E6">6.Documentation regarding the <ENAMEX type="PERSON_TYPE">Jews of Bulgaria</ENAMEX> during <ENAMEX type="EVENT">World War II</ENAMEX>.</sentence>
 				<sentence xml:id="P4E7">The material consists of the following documentation: - Internal policies of <ENAMEX type="LOCATION">Bulgaria</ENAMEX> during the war and <ENAMEX type="LEGAL">anti-Jewish legislation</ENAMEX>;- Implementation of the <ENAMEX type="LEGAL">anti-Semitic policy</ENAMEX> and <ENAMEX type="INSTITUTION">Commissariat for Jewish Affairs</ENAMEX> activities; - Condition of the various <ENAMEX type="PERSON_TYPE">Jewish</ENAMEX> communities in <ENAMEX type="LOCATION">Bulgaria</ENAMEX> during the war;- Unsuccessful <ENAMEX type="CONCEPTUAL">aliya</ENAMEX> attempts to <ENAMEX type="LOCATION">Eretz Israel</ENAMEX> and the fate of the <ENAMEX type="MEASURE">two</ENAMEX> illegal immigrant ships,&quot;<ENAMEX type="CREATION">Salvador</ENAMEX>&quot;and&quot;<ENAMEX type="CREATION">Struma</ENAMEX>&quot;; - The <ENAMEX type="EVENT">Holocaust of the Jews of Turkey and Macedonia</ENAMEX>:- Forced labor camps in <ENAMEX type="LOCATION">Bulgaria</ENAMEX>; - <ENAMEX type="EVENT">Rescue of the Jews of Bulgaria</ENAMEX>;</sentence>
 				<sentence xml:id="P4E8">7.Documentation regarding <ENAMEX type="CONCEPTUAL">aliya</ENAMEX> from <ENAMEX type="LOCATION">Bulgaria</ENAMEX> to <ENAMEX type="LOCATION">Eretz Israel</ENAMEX>, <ENAMEX type="PERIOD">from the late 19th century until the&quot;Great Aliya&quot;, 1948-1949</ENAMEX>.</sentence>
-				<sentence xml:id="P4E9">There is also original documentation in the records group as a whole (mainly personal documentation belonging to <ENAMEX type="PERSON">Arditti</ENAMEX>, but also many documents regarding the history of the <ENAMEX type="PERSON_TYPE">Jews of Bulgaria</ENAMEX> <ENAMEX type="PERIOD">before the 1940s</ENAMEX>, the <ENAMEX type="ORGANISATION">Zionist movement</ENAMEX> in <ENAMEX type="LOCATION">Bulgaria</ENAMEX> and the fate of the <ENAMEX type="PERSON_TYPE">Jews of Bulgaria, Turkey and Macedonia</ENAMEX> during the <ENAMEX type="EVENT">Holocaust</ENAMEX>), photographs and copies of various documents, newspaper clippings and journals on a range of subjects.</sentence>
+				<sentence xml:id="P4E9">There is also original documentation in the records group as a whole (mainly personal documentation belonging to <ENAMEX type="PERSON">Arditti</ENAMEX>, but also many documents regarding the history of the <ENAMEX type="PERSON_TYPE">Jews of Bulgaria</ENAMEX> <ENAMEX type="PERIOD">before the 1940s</ENAMEX>, the <ENAMEX type="ORGANISATION">Zionist movement in Bulgaria</ENAMEX> and the fate of the <ENAMEX type="PERSON_TYPE">Jews of Bulgaria, Turkey and Macedonia</ENAMEX> during the <ENAMEX type="EVENT">Holocaust</ENAMEX>), photographs and copies of various documents, newspaper clippings and journals on a range of subjects.</sentence>
 			</p>
 			<p xml:lang="en" xml:id="P6">
 				<sentence xml:id="P6E0">Description of the files are available on <ENAMEX type="ARTIFACT">IDEA ALM</ENAMEX> system at <ENAMEX type="INSTITUTION">Yad Vashem Archives</ENAMEX> reading room and on the <ENAMEX type="INSTITUTION">Yad Vashem</ENAMEX> website</sentence>