automerge url parameters from input and templates

[tarunKoyalwar]

Proposed changes

• Currently when input has parameters they don't merge with template path and url parameters as discussed in
  Auto-Merge Parameters and Paths #1392
• Now parameters are added instead of replacing any existing parameters.
  Ex: https://scanme.sh/?user=pd | nuclei -t some-template.yaml
  final url if some-template.yaml adds user=admin would be
  https://scanme.sh/?user=pd&user=admin
• This also applies for Raw requests .

Can be Validated Using

echo "https://scanme.sh/admin/?user=pd" | go run . -t automerge-params.yaml -silent

Checklist

• Pull request is created against the dev branch
• All checks passed (lint, unit/integration/regression tests etc.) with my changes
• I have added tests that prove my fix is effective or that my feature works
• I have added necessary documentation (if appropriate)

[tarunKoyalwar]

Example Template to validate

id: automerge-parmas

info:
  name: Automerge templates
  author: pdtm
  severity: low
  description: Information Disclosure of Garbage Collection
  tags: exposure,devops,python

requests:
  - method: GET
    path:
      - "{{BaseURL}}/metrics"
      - "{{BaseURL}}?user=admin&key=val"
      - "{{BaseURL}}/?user=admin"
      - "{{BaseURL}}/django/?user=admin"
    matchers:
      - type: status
        status:
          - 200

  - raw:
      - |
        GET /?user=admin HTTP/1.1
        Host: {{Hostname}}
        Origin: {{BaseURL}}
      - |
        GET /admin?user=scanme HTTP/1.1
        Host: {{Hostname}}
        Origin: {{BaseURL}}
      - |
        GET https://{{Hostname}}/admin HTTP/1.1
        Host: {{Hostname}}
      - |
        GET ?user=scanme HTTP/1.1
        Host: {{Hostname}}

    matchers:
      - type: status
        status:
          - 200

[tarunKoyalwar]

Automerge Params

• Parameters will now be automerged (base request/raw request) regardless if param is given in input or template .
• Parameters are added instead of being replaced with precedence given to input (As shown below).

echo "https://scanme.sh/path?user=pd" | go run . -t ~/test/automerge-params.yaml  -silent
[automerge-parmas] [http] [low] https://scanme.sh/path/metrics?user=pd
[automerge-parmas] [http] [low] https://scanme.sh/path?key=val&user=pd&user=admin
[automerge-parmas] [http] [low] https://scanme.sh/path/?user=pd&user=admin
[automerge-parmas] [http] [low] https://scanme.sh/path/django/?user=pd&user=admin
[automerge-parmas] [http] [low] https://scanme.sh/path/?user=pd&user=admin
[automerge-parmas] [http] [low] https://scanme.sh/path/admin?user=pd&user=scanme
[automerge-parmas] [http] [low] https://scanme.sh/path/admin?user=pd
[automerge-parmas] [http] [low] https://scanme.sh/path?user=pd&user=scanme

[Mzack9999]

suggesting small code refactor + extra new lines