Custom dirlist not working

[victorshx]

This tool is really great, nonetheless, with the built-in downloader. I couldn't get it to work with an S3 compatible endpoint hence I looked into the code to find how you generate the dirlist.

Here is what I got: aws --no-sign-request s3 ls s3://capitol-hill-riots --endpoint-url=https://s3.us-east-1.wasabisys.com --recursive > list.txt

Here is the preview:

However, I get a warning message box when trying to load it.

[victorshx]

PS: Here is the attached file should you need it for debugging.

list.txt

[SharonBrizinov]

Hi,

I looked at your data and I think that your shell is not configured to work with utf-8 because when I generated the dirlist everything was fine. Can you try to generate the dirlist from a different machine?

Please look at the comparison I made between your dirlist and mine. I've also attached the new dirlist I created.

list2.txt

[victorshx]

Unfortunately, I do not have a Linux machine. I've also enabled the beta UTF-8 support.

However, it's still showing the same error with a slightly different message.

But I tried loading your dirlist and it works fine on my machine! Can I confirm that you are on a Linux machine?

[SharonBrizinov]

can you upload the new dirlist?

[victorshx]

can you upload the new dirlist?

Here list.txt

[SharonBrizinov]

I've pushed a fix to support different encoding schemes
so now even the first dirlist should work for you.

Can you try again? (if you want to wait for the binary it will be ready in a few min)

[victorshx]

The latest commit works for the first dirlist, and the latest dirlist 👍