Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: adding subdomain center as source #118

Merged
merged 5 commits into from
Oct 18, 2023
Merged

feature: adding subdomain center as source #118

merged 5 commits into from
Oct 18, 2023

Conversation

iamshreeram
Copy link
Contributor

This source returns the empty list for almost all the domains. The original sourcecode has rate limiting (upto 2 request) as well.

// SubdomainCenter retrieves from the url below some known subdomains.
func SubdomainCenter(domain string, plain bool) []string {
if !plain {
fmt.Println("Pulling data from ThreatCrowd")
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not threatcrowd

defer resp.Body.Close()

dec := json.NewDecoder(resp.Body)
err = dec.Decode(&wrapper)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here trying this code I get the err json: cannot unmarshal array into Go value of type struct { Records []string "json:\"subdomains\"" }

@edoardottt edoardottt linked an issue Oct 17, 2023 that may be closed by this pull request
@iamshreeram
Copy link
Contributor Author

@edoardottt , Please look into 5217aa6

// SubdomainCenter retrieves from the url below some known subdomains.
func SubdomainCenter(domain string, plain bool) []string {
if !plain {
fmt.Println("Pulling data from Subdomain")
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be Pulling data from Subdomain Center

@edoardottt
Copy link
Owner

@iamshreeram

  1. I've opened an issue to understand if the service is still working or not Subdomain Center not working ARPSyndicate/puncia#1
  2. You should also add the code to use this service in the main enumeration part, but commented because we don't know if it's working or not (search for word sonar in this file https://github.com/edoardottt/scilla/blob/main/pkg/runner/runner.go and you will get it)
  3. Linting problems to be solved (see https://github.com/edoardottt/scilla/actions/runs/6554557853/job/17809795344?pr=118)

@iamshreeram
Copy link
Contributor Author

  1. Sure. Thanks!
  2. I have added the code to main enumeration, both in ReportSubcommandHandler and SubdomainSubcommandHandler
  3. I have fixed the linting problem.

Please review - #df98dcc

@edoardottt edoardottt changed the base branch from main to devel October 18, 2023 12:12
@edoardottt edoardottt self-requested a review October 18, 2023 12:13
Copy link
Owner

@edoardottt edoardottt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@edoardottt edoardottt merged commit 4f242d5 into edoardottt:devel Oct 18, 2023
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add SubdomainCenter as subdomain source
2 participants