Duplicated rows in GMEX_std_clean

[eshdb]

When checking for duplicated rows in the XX_std_clean files, I found 24 duplicated rows in GMEX_std_clean. It seems to be 1-2 hauls per year where the same species occurs twice in the same haul with the exact same num, wgt, cpue and cpua.

Could this be mistake that happens during data processing or are the duplicates really double values, and can I sum their abundances within hauls?

Example where this is the case is accepted_name Cynoscion in haul_id 004177485813088.

[AquaAuma]

@zoekitchel @mpinsky @afredston do you know?

[jepa]

We had a similar issue back in the day with surveys in the "original data" that might shine a light on this. See here

[zoekitchel]

@afredston will decide whether or not we will tackle this issue, or if we just integrate new workflow recommended by M. Karp August 2025

[mpinsky]

@eshdb , I believe this will be fixed in the next release. We dramatically re-did how this region is processed, and I no longer find duplicates. You can also check out the gmex2025 branch if you want data earlier!