Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does not work with JavaScript generated (S3) #76

Closed
Chin0p opened this issue Feb 22, 2021 · 4 comments
Closed

Does not work with JavaScript generated (S3) #76

Chin0p opened this issue Feb 22, 2021 · 4 comments

Comments

@Chin0p
Copy link

Chin0p commented Feb 22, 2021

I tried to run this website but it's not working. It returned this error:

Finshed indexing
|**Url:** [http://dl.ncsbe.gov.s3.amazonaws.com/i...](http://dl.ncsbe.gov.s3.amazonaws.com/index.html?prefix=)|||
|:-|-:|-:|
|**Extension (Top 5)**|**Files**|**Size**|
|**Dirs:** 1 **Ext:** 0|**Total:** 0|**Total:**  B|
|**Date (UTC):** 2021-02-22 08:38:06|**Time:** 00:00:04||

^(Created by [KoalaBear84's OpenDirectory Indexer](https://github.com/KoalaBear84/OpenDirectoryDownloader/))

No URLs to save
Http status codes
200: 1
Total files: 0, Total estimated size:  B
Total directories: 1
Total HTTP requests: 1, Total HTTP traffic: 520 B
|**Url:** [http://dl.ncsbe.gov.s3.amazonaws.com/i...](http://dl.ncsbe.gov.s3.amazonaws.com/index.html?prefix=)|||
|:-|-:|-:|
|**Extension (Top 5)**|**Files**|**Size**|
|**Dirs:** 1 **Ext:** 0|**Total:** 0|**Total:**  B|
|**Date (UTC):** 2021-02-22 08:38:06|**Time:** 00:00:04||

^(Created by [KoalaBear84's OpenDirectory Indexer](https://github.com/KoalaBear84/OpenDirectoryDownloader/))

Finished indexing!
Press ESC to exit! Or C to copy to clipboard and quit!
  • OS: [Windows 10]
  • Version: [ v1.9.3.8]
@KoalaBear84
Copy link
Owner

I've encountered this one before. Generated through JavaScript. Will try to support it, not sure when I have time to look at it.

@Chin0p
Copy link
Author

Chin0p commented Feb 22, 2021

Does this tool have selenium support?

@KoalaBear84
Copy link
Owner

No, it only retrieves the HTML and parses it. And for some formats it emulates the 'AJAX' / javascript calls.

@KoalaBear84 KoalaBear84 changed the title Does not work with this website Does not work with JavaScript generated (S3) Apr 6, 2021
@KoalaBear84
Copy link
Owner

Better late then never? Implemented it. Thanks to @Chaphasilor for giving a little push to fix his issue and got wandering 😂

Supports at least the following urls:
http://dl.ncsbe.gov.s3.amazonaws.com/
http://dl.ncsbe.gov.s3.amazonaws.com/index.html
http://dl.ncsbe.gov.s3.amazonaws.com/index.html?prefix=
http://dl.ncsbe.gov.s3.amazonaws.com/index.html?prefix=Voter_Registration/

It's released:
https://github.com/KoalaBear84/OpenDirectoryDownloader/releases/tag/v2.3.1.4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants