Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[+] add quake api for subfinder #424

Merged
merged 10 commits into from
Aug 31, 2022
Merged

Conversation

zer0yu
Copy link
Contributor

@zer0yu zer0yu commented May 27, 2021

Quake is a awesome cyberspace mapping engine, and you can use it to discover more subdomains.
Like:

❯ ./subfinder -d skyscanner.net -sources quake

               __    _____           __         
   _______  __/ /_  / __(_)___  ____/ /__  _____
  / ___/ / / / __ \/ /_/ / __ \/ __  / _ \/ ___/
 (__  ) /_/ / /_/ / __/ / / / / /_/ /  __/ /    
/____/\__,_/_.___/_/ /_/_/ /_/\__,_/\___/_/ v2.4.8

                projectdiscovery.io

Use with caution. You are responsible for your actions
Developers assume no liability and are not responsible for any misuse or damage.
By using subfinder, you also agree to the terms of the APIs used.

[INF] Enumerating subdomains for skyscanner.net
analytics.skyscanner.net
ww2.business.skyscanner.net
carhirehelp.skyscanner.net
business.skyscanner.net
api.skyscanner.net
slipstream.skyscanner.net
ablink.sender.skyscanner.net
translate.skyscanner.net
hotelshelp.skyscanner.net
support.business.skyscanner.net
help.skyscanner.net
gateway.skyscanner.net
talent.skyscanner.net
cn.skyscanner.net
www.partners.skyscanner.net
forum.skyscanner.net
clicks.skyscanner.net
se.skyscanner.net
news.skyscanner.net
futuretech.skyscanner.net
partners.skyscanner.net
m.skyscanner.net
travelpro.skyscanner.net
yj.partners.api.skyscanner.net
azuremfa.skyscanner.net
widgets.skyscanner.net
www.skyscanner.net
redirect.skyscanner.net
partners.api.skyscanner.net
www.futuretech.skyscanner.net
[INF] Found 30 subdomains for skyscanner.net in 7 seconds 358 milliseconds

In config.yaml, you only need to add the following fields

resolvers:
    - 1.1.1.1
    - 1.0.0.1
    - 8.8.8.8
    - 8.8.4.4
    - 9.9.9.9
    - 9.9.9.10
    - 77.88.8.8
    - 77.88.8.1
    - 208.67.222.222
    - 208.67.220.220
sources:
    - quake
all-sources:
    - quake
quake: []
subfinder-version: 2.4.8

@ehsandeep ehsandeep changed the base branch from master to dev May 27, 2021 08:59
@ehsandeep ehsandeep requested a review from Ice3man543 May 28, 2021 22:18
@ehsandeep
Copy link
Member

@zer0yu thank you for adding the new source, I was looking to signup for keys from here - https://quake.360.cn/quake/login#/ correct me if I'm wrong, as per the form it's limited to signup with a local number?

@ehsandeep ehsandeep added the Status: Review Needed The issue has a PR attached to it which needs to be reviewed label May 28, 2021
@zer0yu
Copy link
Contributor Author

zer0yu commented May 29, 2021

@zer0yu thank you for adding the new source, I was looking to signup for keys from here - https://quake.360.cn/quake/login#/ correct me if I'm wrong, as per the form it's limited to signup with a local number?

Yes, this is the correct url

@ehsandeep ehsandeep added status:in-review 🔨 and removed Status: Review Needed The issue has a PR attached to it which needs to be reviewed labels Jun 23, 2021
@shadow1ng
Copy link

run error by using
./subfinder -d fofa.so -sources quake

Could not run source quake: quake.quakeResults.Data: []struct { Service struct { HTTP struct { Host string "json:\"host\""; StatusCode int "json:\"status_code\"" } "json:\"http\"" } }: Service: HTTP: StatusCode: readUint64: unexpected character: �, error found in #10 byte of ...|us_code":"\u6682\u65|..., bigger context ...|eaders":"\u6682\u65e0\u6743\u9650","status_code":"\u6682\u65e0\u6743\u9650","title":"\u9996\u9875","

image
image

@shadow1ng
Copy link

shadow1ng commented Jun 28, 2021

run error by using
./subfinder -d fofa.so -sources quake

Could not run source quake: quake.quakeResults.Data: []struct { Service struct { HTTP struct { Host string "json:\"host\""; StatusCode int "json:\"status_code\"" } "json:\"http\"" } }: Service: HTTP: StatusCode: readUint64: unexpected character: �, error found in #10 byte of ...|us_code":"\u6682\u65|..., bigger context ...|eaders":"\u6682\u65e0\u6743\u9650","status_code":"\u6682\u65e0\u6743\u9650","title":"\u9996\u9875","

image
image

解决办法
StatusCode int json:"status_code" 修改成 StatusCode string json:"status_code" 或注释掉StatusCode int json:"status_code"

@zer0yu
Copy link
Contributor Author

zer0yu commented Jun 28, 2021

Thanks for the feedback, although I failed to replicate the bug on my MacOS Big Sur, I commented out the StatusCode field to ensure compatibility on most systems.

@ehsandeep
Copy link
Member

@zer0yu not sure if it's too much to ask, is it possible for you to join https://discord.gg/projectdiscovery and ping "pdteam" or Twitter DM https://twitter.com/pdiscoveryio?

This is related to obtaining a key to confirm this PR.

@zer0yu
Copy link
Contributor Author

zer0yu commented Jul 4, 2021

Thank you for the reminder @ehsandeep .

Copy link
Member

@Mzack9999 Mzack9999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd remove unused commented code - LGTM otherwise

v2/pkg/subscraping/sources/quake/quake.go Outdated Show resolved Hide resolved
@forgedhallpass
Copy link
Contributor

Validated:

image

image

@ehsandeep ehsandeep removed the request for review from Ice3man543 August 31, 2022 15:19
@ehsandeep ehsandeep merged commit a40133f into projectdiscovery:dev Aug 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants