Missing appearances

[mortgad]

Hi David,

When I look at the Kaggle dataset it seems like the appearances.csv file is lacking values, since the date range goes from 2012-07-03 to 2023-06-11. I use them to calculate team values.

When I run my script now, I lack values since the end of the 2022/23 season, and I suspect it is due to the lack of appearances.

[dcaribou]

Hey @mortgad, can you provide some examples of such values that you found missing?

[mortgad]

Hi David,

If I go to your Kaggle dataset and view the appearances.csv file I can see the data range is 2012-07-03 - 2023-06-11.
Assuming I read that correctly, it means that the dataset currently does not hold appearances later than the 11th of June 2023.

[mortgad]

[dcaribou]

Thank you for the additional details @mortgad.
I've found the missing data leaked in this commit 833bf36 from some days ago.
My guess is that this is due to a change in transfermarkt, but I'll need to investigate more.

In the meantime, I'll be restoring the missing data and blocking the updates until I find the root cause.

[dcaribou]

Update on this: the issue was indeed caused by a change in transfermarkt. It should be fixed by now. This is the related fix in the scraper.

I'll try to add some tests, so errors like this are caught before they propagate to kaggle and other frontends in the future. Watch #195.

[mortgad]

Awesome, thank you! :)