add new gt metadata yml files #143

tboenig · 2024-03-20T13:51:33Z

No description provided.

tboenig · 2024-04-27T15:37:08Z

Hello, can you please commit the PR. Thank you.

bertsky

IMO it would be better if the titles get prefixed by OCR-D so they will line-up in the catalog and be immediately recognizable.

If possible at all, it would probably be better from HTR United's side if all the gt_structure entries (except gt_structure_text) were composed into one dataset here.

bertsky · 2024-05-15T15:07:53Z

catalog/ocr-d/gt_structure_1_1_METADATA_htr_united.yml

@@ -0,0 +1,50 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_1_1


Suggested change

title: gt_structure_1_1

title: OCR-D gt_structure_1_1

bertsky · 2024-05-15T15:12:08Z

catalog/ocr-d/gt_structure_1_1_METADATA_htr_united.yml

+  metric: regions
+citation-file-link: https://github.com/OCR-D/gt_structure_1_1/blob/main/CITATION.cff
+transcription-guidelines: >-
+  OCR-D-GT-Guideline, Part: Structure Ground Truth  https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html


this was a carriage return instead of a newline.

Suggested change

OCR-D-GT-Guideline, Part: Structure Ground Truth https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

OCR-D-GT-Guideline, Part: Structure Ground Truth

https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

bertsky · 2024-05-15T15:12:21Z

catalog/ocr-d/gt_structure_1_2_METADATA_htr_united.yml

@@ -0,0 +1,51 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_1_2


Suggested change

title: gt_structure_1_2

title: OCR-D gt_structure_1_2

bertsky · 2024-05-15T15:13:02Z

catalog/ocr-d/gt_structure_1_3_METADATA_htr_united.yml

@@ -0,0 +1,50 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_1_3


Suggested change

title: gt_structure_1_3

title: OCR-D gt_structure_1_3

bertsky · 2024-05-15T15:13:39Z

catalog/ocr-d/gt_structure_1_3_METADATA_htr_united.yml

+  metric: regions
+citation-file-link: https://github.com/OCR-D/gt_structure_1_3/blob/main/CITATION.cff
+transcription-guidelines: >-
+  OCR-D-GT-Guideline, Part: Structure Ground Truth  https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html


same here.

Suggested change

OCR-D-GT-Guideline, Part: Structure Ground Truth https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

OCR-D-GT-Guideline, Part: Structure Ground Truth

https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

bertsky · 2024-05-15T15:18:45Z

catalog/ocr-d/gt_structure_5_1_METADATA_htr_united.yml

+  metric: regions
+citation-file-link: https://github.com/OCR-D/gt_structure_5_1/blob/main/CITATION.cff
+transcription-guidelines: >-
+  OCR-D-GT-Guideline, Part: Structure Ground Truth  https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html


Suggested change

OCR-D-GT-Guideline, Part: Structure Ground Truth https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

OCR-D-GT-Guideline, Part: Structure Ground Truth

https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

bertsky · 2024-05-15T15:18:53Z

catalog/ocr-d/gt_structure_5_2_METADATA_htr_united.yml

@@ -0,0 +1,50 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_5_2


Suggested change

title: gt_structure_5_2

title: OCR-D gt_structure_5_2

bertsky · 2024-05-15T15:19:01Z

catalog/ocr-d/gt_structure_5_2_METADATA_htr_united.yml

+  metric: regions
+citation-file-link: https://github.com/OCR-D/gt_structure_5_2/blob/main/CITATION.cff
+transcription-guidelines: >-
+  OCR-D-GT-Guideline, Part: Structure Ground Truth  https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html


Suggested change

OCR-D-GT-Guideline, Part: Structure Ground Truth https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

OCR-D-GT-Guideline, Part: Structure Ground Truth

https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

bertsky · 2024-05-15T15:19:10Z

catalog/ocr-d/gt_structure_5_3_METADATA_htr_united.yml

@@ -0,0 +1,51 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_5_3


Suggested change

title: gt_structure_5_3

title: OCR-D gt_structure_5_3

bertsky · 2024-05-15T15:19:38Z

catalog/ocr-d/gt_structure_text_METADATA_htr_united.yml

@@ -0,0 +1,54 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_text


Suggested change

title: gt_structure_text

title: OCR-D gt_structure_text

catalog/ocr-d/gt_structure_2_4_METADATA_htr_united.yml

PonteIneptique · 2024-05-21T12:30:14Z

Dear @tboenig and @bertsky,
I am very happy that the collaboration is going forward, but I must say I am a bit lost about the extent of the dataset, what seems like duplication of corpora (??). Could you provide a little more insight ?

Also: be careful with Goth script code, it's for Gothic Language (and not Runes as I said: https://en.wikipedia.org/wiki/Gothic_alphabet ). I think you mean Latf

bertsky

typo?

bertsky · 2024-05-21T13:22:36Z

catalog/ocr-d/gt_structure_5_3_METADATA_htr_united.yml

@@ -0,0 +1,51 @@
+schema: https://htr-united.github.io/schema/2023-06-27/schema.json
+title: gt_structure_5_3
+url: https://github.com/OCR-D/tboenig/gt_structure_5_3


Suggested change

url: https://github.com/OCR-D/tboenig/gt_structure_5_3

url: https://github.com/OCR-D/gt_structure_5_3

bertsky · 2024-05-21T13:27:14Z

@PonteIneptique

but I must say I am a bit lost about the extent of the dataset, what seems like duplication of corpora (??)

What do you mean duplication? The various entries are subcorpora of https://github.com/OCR-D/gt_structure_all, which is basically a subcorpus of deutschestextarchiv.de split into smaller chunks.

I proposed aggregating them into a single dataset here. But since the metadata.yml files are generated via CI on our side (for each repo independently), that might be difficult to achieve...

tboenig · 2024-05-21T17:49:55Z

Hallo @PonteIneptique

Thank you for the rigorous check of the data records. I have changed Goth to Latf.

to @bertsky

https://github.com/OCR-D/gt_structure_all is a metarepo that links all datasets.

Maybe it should be considered for a future version of HTR-United, how such metarepos are represented in the catalog.

I suggest that first of all the datasets are published in the catalog. In a second or subsequent step, you can always make improvements.

Of course, the metadata/data must be correct. Thank you again for the check.

All the Bests
tboenig

PonteIneptique · 2024-05-22T08:03:48Z

Dear both,
Given that nothing differentiates each repository except its name (same authors, same language, same scripts, etc.), and given that their name are non-semantic, I would probably refuse such a "massive" push (19 files) for usability reasons. The meta-repo however is completely welcome.

bertsky · 2024-05-22T14:39:48Z

@PonteIneptique – understood, @tboenig is already working on a solution.

PonteIneptique · 2024-05-22T14:54:47Z

Thank you for your understanding :)

tboenig added 7 commits March 20, 2024 14:49

add new gt metadata yml files

6268507

add new metadata.yml catalog files and corrections

2ae670e

indent corrections

09f95c7

indets

d58fdc3

update Metadata

eac0f9c

corr count

081d886

corr indent

d67de42

bertsky suggested changes May 15, 2024

View reviewed changes

PonteIneptique reviewed May 21, 2024

View reviewed changes

catalog/ocr-d/gt_structure_2_4_METADATA_htr_united.yml Outdated Show resolved Hide resolved

bertsky suggested changes May 21, 2024

View reviewed changes

tboenig added 2 commits May 21, 2024 18:58

corr goth -> latf

2b5e58e

corr metadata indent and returns

685ed55

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add new gt metadata yml files #143

add new gt metadata yml files #143

tboenig commented Mar 20, 2024

tboenig commented Apr 27, 2024

bertsky left a comment

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

bertsky May 15, 2024

PonteIneptique commented May 21, 2024

bertsky left a comment

bertsky May 21, 2024

bertsky commented May 21, 2024

tboenig commented May 21, 2024

PonteIneptique commented May 22, 2024

bertsky commented May 22, 2024

PonteIneptique commented May 22, 2024

		@@ -0,0 +1,50 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_1_1

	OCR-D-GT-Guideline, Part: Structure Ground Truth https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html
	OCR-D-GT-Guideline, Part: Structure Ground Truth
	https://ocr-d.de/en/gt-guidelines/trans/structur_gt.html

		@@ -0,0 +1,51 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_1_2

		@@ -0,0 +1,50 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_1_3

		@@ -0,0 +1,50 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_5_2

		@@ -0,0 +1,51 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_5_3

		@@ -0,0 +1,54 @@
		schema: https://htr-united.github.io/schema/2023-06-27/schema.json
		title: gt_structure_text

	url: https://github.com/OCR-D/tboenig/gt_structure_5_3
	url: https://github.com/OCR-D/gt_structure_5_3

add new gt metadata yml files #143

Are you sure you want to change the base?

add new gt metadata yml files #143

Conversation

tboenig commented Mar 20, 2024

tboenig commented Apr 27, 2024

bertsky left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

PonteIneptique commented May 21, 2024

bertsky left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

bertsky commented May 21, 2024

tboenig commented May 21, 2024

PonteIneptique commented May 22, 2024

bertsky commented May 22, 2024

PonteIneptique commented May 22, 2024