Training data , Data Format

[saramoeini20]

Hello,
I have two questions,

1. I saw dev-text folder and it had more than one .txt file. I know about source/target file ( it has incorect/correct pair , right?) but what about other files that has same sentences with different order/grammar?

2. From what I have found, for training phase we need source/target file (incorrect/correct sentence) but what about M2 format? Is it for just enhancing the model or other things?

[mrqorib]

Hi @saramoeini20,

1. The dev-txt folder contains corrections of the source.txt by the base GEC systems.
2. Actually only the M2 files are used for training/testing. The files in *-text are used to generate the M2 files if they don't exist in the *-m2 folder.

I hope this answers your questions.

[saramoeini20]

So for training only M2 format is needed for GEC or in your case it is that way?

[saramoeini20]

And also you used base models output only or used their models too?

[mrqorib]

Yes, only the M2 format is needed.

ESC only requires the outputs, you don't need the models' weights.

[saramoeini20]

Thank you.