Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sites with many files not working properly #6

Closed
HelloZeroNet opened this issue Jan 13, 2015 · 7 comments
Closed

Sites with many files not working properly #6

HelloZeroNet opened this issue Jan 13, 2015 · 7 comments
Labels

Comments

@HelloZeroNet
Copy link
Owner

No description provided.

@HelloZeroNet
Copy link
Owner Author

Needs more testing + Put priority on browser requested files (and maybe start download with smaller files) Problematic site: 1Jr5bnqSnnp94CfC7xrqPh4yYYDRkpzozD

@HelloZeroNet
Copy link
Owner Author

file queue priority based on browser request added: efb1dc3
It should be much better now!
Tomorrow i will do some more testing...

@doublec
Copy link

doublec commented Jan 14, 2015

Here's another one for testing: 13TSUryi4GhHVQYKoRvRNgok9q8KsMLncq

It's weblog but is fairly large. The index page downloads but the CSS is often not downloaded in time so the initial display is unstyled. A refresh shows it styled due to it having downloaded by then.

@HelloZeroNet
Copy link
Owner Author

Your site worked here nicely:

[2015-01-14 18:35:35,969] DEBUG    Site:13TSUr..Lncq Start downloading...
[2015-01-14 18:35:35,987] DEBUG    Site:13TSUr..Lncq Need content.json first
[2015-01-14 18:35:37,736] DEBUG    WorkerManager:13TSUr..Lncq x.x.x.x:15441: Hash correct: content.json
[2015-01-14 18:35:38,838] DEBUG    Site:13TSUr..Lncq Downloading 1229 files...
[2015-01-14 18:35:39,364] INFO     Site:13TSUr..Lncq Bad file solved: index.html
[2015-01-14 18:35:39,563] INFO     Site:13TSUr..Lncq Bad file solved: 2008/03/13/index.html
[2015-01-14 18:35:39,766] INFO     Site:13TSUr..Lncq Bad file solved: css/syntax.css
[2015-01-14 18:35:39,954] INFO     Site:13TSUr..Lncq Bad file solved: css/screen.css
[2015-01-14 18:35:40,138] INFO     Site:13TSUr..Lncq Bad file solved: css/print.css
[2015-01-14 18:35:40,323] INFO     Site:13TSUr..Lncq Bad file solved: css/bluishcoder.css
[2015-01-14 18:35:41,387] INFO     Site:13TSUr..Lncq Bad file solved: self/self_comment.webm
[2015-01-14 18:35:41,960] INFO     Site:13TSUr..Lncq Bad file solved: self/self_font.webm
[2015-01-14 18:35:42,145] INFO     Site:13TSUr..Lncq Bad file solved: nixos/standalone-ndk/default.nix
[2015-01-14 18:35:42,338] INFO     Site:13TSUr..Lncq Bad file solved: 2006/06/04/narrative-javascript.html
...

Please make sure you have the latest version. Yesterday night I added a modification that put priority to files that requested by the browser. But maybe putting priority to *.js and *.css files by default could not hurt anyone.

@doublec
Copy link

doublec commented Jan 14, 2015

Ah, I didn't have that commit, thanks. Looks like that's fixed it.

@HelloZeroNet
Copy link
Owner Author

Fine :)
At there is still some problem with large sites: the site has 1 minute to finish all file downloads or the task will be killed.

Working on it, I think it will be fixed today.

@HelloZeroNet
Copy link
Owner Author

Here it comes: bcd0c00
(I think we can close this issue)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants