Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDRHnew 内容更新在同一链接 #10210

Closed
1 task done
terrytw opened this issue Jul 13, 2022 · 2 comments
Closed
1 task done

CDRHnew 内容更新在同一链接 #10210

terrytw opened this issue Jul 13, 2022 · 2 comments
Labels
Bug Ping: Pinged Route: v2 v2 route related RSS bug Something isn't working

Comments

@terrytw
Copy link
Contributor

terrytw commented Jul 13, 2022

路由地址

/fda/cdrh

完整路由地址

/fda/cdrh

相关文档

https://docs.rsshub.app/government.html#mei-guo-shi-pin-yao-pin-jian-du-guan-li-ju

预期是什么?

获取相应源的信息更新

实际发生了什么?

该网站有一种做法,就是重复使用同一个链接不停的更新
如该链接:https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/in-vitro-diagnostics-euas-antigen-diagnostic-tests-sars-cov-2
因为内容在不断更新,每次更新都会发一次不同的标题,但是链接全是同一个
RSSHUB这边大概是扫到链接相同的,就不更新出来了

建议针对这个网站,不仅比对链接,也比对一下标题
链接相同,标题不同,就重新抓取一次该链接,并作为一个新条目放出。
(另外如果短时间内,如12小时内出现多次同链接不同标题,是否可以合并标题,以避免重复抓取?)

部署

RSSHub 演示 (https://rsshub.app)

部署相关信息

No response

额外信息

N/A

这不是重复的 issue

  • 我已经搜索了现有 issue,以确保该错误尚未被报告。
@terrytw terrytw added the RSS bug Something isn't working label Jul 13, 2022
@github-actions
Copy link
Contributor

Searching for maintainers:

To maintainers: if you are not willing to be disturbed, list your username in scripts/workflow/test-issue/call-maintainer.js. In this way, your username will be wrapped in an inline code block when tagged so you will not be notified.

如果有任何路由无法匹配,issue 将会被自动关闭。如果 issue 和路由无关,请使用 NOROUTE 关键词,或者留下评论。我们会重新审核。
If there is any route not found, the issue will be closed automatically. Please use NOROUTE for a route-irrelevant issue or leave a comment if it is a mistake.

@terrytw
Copy link
Contributor Author

terrytw commented Jul 23, 2022

搞错了,其实是reader的问题,同样的链接reader会无视

@terrytw terrytw closed this as completed Jul 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Ping: Pinged Route: v2 v2 route related RSS bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant