use CL instead of TE + unit test

[tarunKoyalwar]

Proposed Changes

• closes All 'method: POST' templates using 'Transfer-Encoding: chunked' header #4032
• added unit test for this edgecase to avoid regression
• "Content-Length" is used instead of "Transfer-Encoding" under certain conditions
  • If "Transfer-Encoding: chunked" header is explicitiy not set
  • Method is not GET/HEAD
  • request Body exists

[tarunKoyalwar]

POC

$ ./nuclei -u http://localhost:8000 -id CVE-2022-35405 -debug

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v2.9.15-dev

		projectdiscovery.io


[INF] Current nuclei version: v2.9.15-dev (development)
[INF] Current nuclei-templates version: v9.6.3 (latest)
[INF] New templates added in latest release: 54
[INF] Templates loaded for current scan: 1
[INF] Targets loaded for current scan: 1
[INF] [CVE-2022-35405] Dumped HTTP request for http://localhost:8000/xmlrpc

POST /xmlrpc HTTP/1.1
Host: localhost:8000
User-Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2919.83 Safari/537.36
Connection: close
Content-Length: 153
Accept: */*
Accept-Language: en
Accept-Encoding: gzip

<?xml version="1.0"?><methodCall><methodName>2VRMFcfz6SXPuYWXg3PNNDW95kp</methodName><params><param><value>big0us</value></param></params></methodCall>
[DBG] [CVE-2022-35405] Dumped HTTP response http://localhost:8000/xmlrpc

HTTP/1.1 404 Not Found
Connection: close
Content-Length: 19
Content-Type: text/plain; charset=utf-8
Date: Fri, 15 Sep 2023 16:12:17 GMT
X-Content-Type-Options: nosniff

404 page not found
[INF] No results found. Better luck next time!

$  simplehttpserver -verbose

   _____ _                 __     __  __________________                                
  / ___/(_)___ ___  ____  / /__  / / / /_  __/_  __/ __ \________  ______   _____  _____
  \__ \/ / __ -__ \/ __ \/ / _ \/ /_/ / / /   / / / /_/ / ___/ _ \/ ___/ | / / _ \/ ___/
 ___/ / / / / / / / /_/ / /  __/ __  / / /   / / / ____(__  )  __/ /   | |/ /  __/ /    
/____/_/_/ /_/ /_/ .___/_/\___/_/ /_/ /_/   /_/ /_/   /____/\___/_/    |___/\___/_/     
                /_/                                                       - v0.0.6

		projectdiscovery.io

Serving /Users/tarun/Codebase2/nuclei/v2 on http://0.0.0.0:8000/

[2023-09-15 21:42:17]
Remote Address: 127.0.0.1:63084
POST /xmlrpc HTTP/1.1
Host: localhost:8000
Connection: close
Accept: */*
Accept-Encoding: gzip
Accept-Language: en
Connection: close
Content-Length: 153
User-Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2919.83 Safari/537.36

<?xml version="1.0"?><methodCall><methodName>2VRMFcfz6SXPuYWXg3PNNDW95kp</methodName><params><param><value>big0us</value></param></params></methodCall>

HTTP/1.1 404 Not Found
Content-Type: text/plain; charset=utf-8
X-Content-Type-Options: nosniff

[ehsandeep]

echo http://localhost | ./nuclei -id CVE-2020-16846

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v2.9.15-dev

		projectdiscovery.io

[INF] Current nuclei version: v2.9.15-dev (development)
[INF] Current nuclei-templates version: v9.6.3 (latest)
[INF] New templates added in latest release: 54
[INF] Templates loaded for current scan: 1
[INF] Targets loaded for current scan: 1
[CVE-2020-16846] [http] [critical] http://localhost/run

[dogancanbakir]

LGTM -It would be beneficial for us to document this implicit decision to provide clarity to the users.