Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Help with generation of large blog #710

Closed
rahul286 opened this issue Jul 4, 2014 · 15 comments
Closed

Help with generation of large blog #710

rahul286 opened this issue Jul 4, 2014 · 15 comments
Labels
bug

Comments

@rahul286
Copy link

@rahul286 rahul286 commented Jul 4, 2014

I got:

[info] Files loaded in 78.488s
FATAL ERROR: JS Allocation failed - process out of memory
[1]    19999 abort      hexo generate

For 4000+ posts.

I am moving a wordpress site (atleast trying to move) which has 4000+ posts.

Earlier importer failed but I managed to get exitwp working for me which converted it into jekyll successfully. Then I am trying to generate using jekyll data.

Any ideas or workaround?

@Xuanwo
Copy link
Contributor

@Xuanwo Xuanwo commented Jul 12, 2014

@tommy351 tommy351 added the bug label Jul 19, 2014
@tommy351
Copy link
Member

@tommy351 tommy351 commented Jul 19, 2014

I didn't expect this problem before. I'll try to investigate it.

@rahul286
Copy link
Author

@rahul286 rahul286 commented Jul 27, 2014

@tommy351 I think its about EJS/template issue. Memory is leaking.

@kahwee
Copy link

@kahwee kahwee commented Jul 28, 2014

I got the "FATAL ERROR: JS Allocation failed - process out of memory" issue too. And I tried to generate again and I find the generation goes slower and slower generally:

[update] Generated: tags/mario/page/2/index.html (481ms)
[update] Generated: tags/nintendo/index.html (985ms)
[update] Generated: tags/nintendo/page/2/index.html (1469ms)
[update] Generated: tags/2d/index.html (7ms)
[update] Generated: tags/disney/index.html (490ms)
[update] Generated: tags/winnie-the-pooh/index.html (6ms)
[create] Generated: tags/accent/index.html (517ms)
[create] Generated: tags/boston/index.html (479ms)
[create] Generated: tags/funny/index.html (3374ms)
[create] Generated: tags/funny/page/2/index.html (5783ms)
[create] Generated: tags/funny/page/3/index.html (11969ms)
FATAL ERROR: JS Allocation failed - process out of memory
[1]    25463 abort      hexo generate

@tommy351 Do you need some additional info? I can provide. Thanks!

@tommy351
Copy link
Member

@tommy351 tommy351 commented Jul 28, 2014

@kahwee You can send it to my email.

@kahwee
Copy link

@kahwee kahwee commented Jul 28, 2014

Dropped you an email @tommy351 , thanks!

@antoniocosta
Copy link

@antoniocosta antoniocosta commented Sep 1, 2014

Same here. 5000+ files.

FATAL ERROR: JS Allocation failed - process out of memory
Abort trap: 6

@antoniocosta
Copy link

@antoniocosta antoniocosta commented Sep 1, 2014

FYI, this seems to be a problem with the default landscape theme.
No mem error with athena: https://github.com/steven5538/hexo-theme-athena

@jr0cket
Copy link

@jr0cket jr0cket commented Sep 1, 2014

Does using fragment caching help the situation ?

http://hexo.io/news/2014/06/14/hexo-2-7-released/

@antoniocosta
Copy link

@antoniocosta antoniocosta commented Sep 1, 2014

I guess not since "Landscape is updated and supports Fragment Caching now" and I am running hexo 2.8.2.

@rahul286
Copy link
Author

@rahul286 rahul286 commented Sep 2, 2014

Problem could be with nodejs or core logic. For 5000 posts+pages, other nodejs static site generators (SSG) also crashed. Of course, I think most SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using it, you may try https://github.com/spf13/hugo (it built my big site in 5 seconds).

@antoniocosta
Copy link

@antoniocosta antoniocosta commented Sep 2, 2014

Yeah hexo (or docpad for that matter) don't seem suited for my needs.
I was trying to avoid Jekyll/ruby, but after trying it I'm afraid I'm
hooked. Didn't flinch.
On Sep 2, 2014 7:49 PM, "Rahul Bansal" notifications@github.com wrote:

Problem could be with nodejs or core logic. For 5000 posts+pages, other
nodejs static site generators (SSG) also crashed. Of course, I think most
SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using
it, you may try https://github.com/spf13/hugo (it built my big site in 5
seconds).


Reply to this email directly or view it on GitHub
#710 (comment).

@rahul286
Copy link
Author

@rahul286 rahul286 commented Sep 2, 2014

@antoniocosta hugo is based on golang. No dependencies. Just download one single directly executable file and start using it!

@jr0cket
Copy link

@jr0cket jr0cket commented Sep 2, 2014

Please close this issue if you are moving on to another project and not looking to help out.

Thank you.

@rahul286
Copy link
Author

@rahul286 rahul286 commented Sep 2, 2014

@jr0cket I left issue open for others who are looking for solution.

And about....

not looking to help out.

If I could help with a fix, I would have sent pull-request rather than opening issue and moving to different project.

Anyway, I will close this.

@rahul286 rahul286 closed this Sep 2, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
6 participants
You can’t perform that action at this time.