Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filtering recipes by scraper error reason #775

Closed
RavanJAltaie opened this issue May 8, 2023 · 1 comment
Closed

Filtering recipes by scraper error reason #775

RavanJAltaie opened this issue May 8, 2023 · 1 comment
Assignees
Labels

Comments

@RavanJAltaie
Copy link

As per issue openzim/zim-requests#621 . I see that we could filter the files with long descriptions in order to fix them.
Can we filter failed recipes in Zimfarm with naming issues so we could fix them all?

@rgaudin rgaudin transferred this issue from openzim/cms May 8, 2023
@rgaudin
Copy link
Member

rgaudin commented May 8, 2023

No, we can't. Reason for failure is not an information we get. At best, it's a somewhat clear message in the logs.
This is not something we plan to work in the foreseeable future.

That said:

  • we want to prevent creating recipes with incorrect description. Quite easy.
  • this won't prevent some scrapers to create ZIM with incorrect metadata. I am thinking of YT recipes with dynamic metadata for instance.

This should eventually be handled in the CMS ; I believe zimcheck now support those since 3.2.0 (now used by zimfarm). Eventually, we may may improve the zimcheck dashboard on the CMS to list corresponding Books.

@rgaudin rgaudin closed this as completed May 8, 2023
@rgaudin rgaudin self-assigned this May 8, 2023
@rgaudin rgaudin changed the title Filtering File Name issue Filtering recipes by scraper error reason May 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants