Wordlist with special chars may cause errors on crates.io version of the tool

[sp1nn4k3r]

5/18 thread 'main' panicked at 'called Result::unwrap() on an Err value: http::Error(InvalidHeaderName)

Is possible to override this error? Or maybe a flag to clean the wordlist before bf starting?

Thank you

[Sh1Yo]

Hi, thanks for the issue. Can you provide the word that causes this error and the version(main or from crates.io) of the tool?

[sp1nn4k3r]

Latest version of the tool main version installed with "cargo install x8" cargo version = cargo 1.70.0 (ec8a8a0ca 2023-04-25). The word I am not sure but it gives that error also with Wordlists provided by you in the readme. Started to think is a cargo release problem.

Thanks

[sp1nn4k3r]

Error keep going with --header flag and without it.

[sp1nn4k3r]

Gzip main version go well on parameters but stop on --headers flag without error.

[Sh1Yo]

Thanks, I'll check it in my free time and return to this issue. For now, you can manually remove the words with special characters from the wordlist. I think they're the main reason of the error.

[sp1nn4k3r]

Perfect. Thank you again

[Sh1Yo]

Gzip main version go well on parameters but stop on --headers flag without error.

It's fine. Sometimes a server may refuse to send an answer or send it after a delay in case some special or invalid headers are sent. You can try to decrease the value of --timeout if it bothers you.

[mAminP]

Hi

I also encounter this error when I use the following wordlist. I tried to remove some characters from the wordlist, but I didn't get any result

wordlsit:
https://wordlists-cdn.assetnote.io/data/automated/httparchive_parameters_top_1m_2023_05_28.txt

Error:
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: http::Error(InvalidUri(InvalidUriChar))', /root/.cargo/registry/src/github.com-1ecc6299db9ec823/x8-4.3.0/src/network/request.rs:325:58 note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

commad:

x8 -u <domain.tld> -w <wordlist> -c 1 -m 20

[mAminP]

Hi again

I used this command to fix the problem.
The problem is solved now, but I think this method makes me miss some words

cat <WORDLIST> | jq -Rr @uri | tee <NEW_WORDLIST>

[dualfade]

^^ confirmed worked for me as well.

[sp1nn4k3r]

Wow thank you :) Il lun 12 giu 2023, 07:48 Mohammad Amin Pasban ***@***.***> ha scritto:

…

Hi again I used this command to fix the problem. The problem is solved now, but I think this method makes me miss some words cat <WORDLIST> | jq -Rr @uri | tee <NEW_WORDLIST>.txt — Reply to this email directly, view it on GitHub <#41 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALSF72N7G4JQ655IODPJ6ZTXK2UTTANCNFSM6AAAAAAY2CCZUU> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[mAminP]

Hi again

I used this command to fix the problem. The problem is solved now, but I think this method makes me miss some words

cat <WORDLIST> | jq -Rr @uri | tee <NEW_WORDLIST>

Hiiii Again :)

I recently found out that x8 itself has a flag to solve this problem

flag:--encode

final command: x8 -u <domain.tld> -w <wordlist> -c 1 -m 20 --encode

[sp1nn4k3r]

Thank you Il gio 22 giu 2023, 15:28 Mohammad Amin Pasban ***@***.***> ha scritto:

…

Hi again I used this command to fix the problem. The problem is solved now, but I think this method makes me miss some words cat <WORDLIST> | jq -Rr @uri | tee <NEW_WORDLIST> Hiiii Again :) I recently found out that x8 itself has a flag to solve this problem flag:--encode final command: x8 -u <domain.tld> -w <wordlist> -c 1 -m 20 --encode — Reply to this email directly, view it on GitHub <#41 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALSF72IOHJJM25GGIDQAYQLXMRB65ANCNFSM6AAAAAAY2CCZUU> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[Sh1Yo]

Hi @sp1nn4k3r and @mAminP. Please, don't try to use the --encode flag to solve the issue. It encodes the whole query and therefore the server won't recognize the parameters. I'll try to fix the issue this week and return with an update

[sp1nn4k3r]

Ok thank you again. Btw good job for this awesome tool ✅💪. Il mar 27 giu 2023, 20:47 Alexander Mironov ***@***.***> ha scritto:

…

Hi @sp1nn4k3r <https://github.com/sp1nn4k3r> and @mAminP <https://github.com/mAminP>. Please, don't try to use the --encode flag to solve the issue. It encodes the whole query and therefore the server won't recognize the parameters. I'll try to fix the issue this week and return with an update — Reply to this email directly, view it on GitHub <#41 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALSF72M37DOR2BCNGJE6V7DXNMTDHANCNFSM6AAAAAAY2CCZUU> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[Sh1Yo]

The new version of the tool from crates.io (that gets installed with cargo install) now urlencodes parameters' keys and ignores invalid headers that solves the issue.