Skip to content
This repository has been archived by the owner on Nov 28, 2023. It is now read-only.

收集RSC中出现的域名 #15

Closed
FeeiCN opened this issue Apr 25, 2018 · 0 comments
Closed

收集RSC中出现的域名 #15

FeeiCN opened this issue Apr 25, 2018 · 0 comments
Labels
enhancement New feature or request

Comments

@FeeiCN
Copy link
Owner

FeeiCN commented Apr 25, 2018

每个厂商都有自己专属特征域名,比如蘑菇街的(molidai.mogujie.com)。

对最终子域名结果集的响应内容进行爬取,分析其中包含的子域名,加入结果集作为最终结果。

@FeeiCN FeeiCN added the enhancement New feature or request label Apr 25, 2018
FeeiCN added a commit that referenced this issue Jun 11, 2018
- faster(uvloop)
- collect response html's domains #15
- collect redirect history's domains #9
- add debug mode
- add retry when request timeout
- improves request user-agent
@FeeiCN FeeiCN closed this as completed Jun 11, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant