Help with generation of large blog

[rahul286]

I got:

[info] Files loaded in 78.488s
FATAL ERROR: JS Allocation failed - process out of memory
[1]    19999 abort      hexo generate

For 4000+ posts.

I am moving a wordpress site (atleast trying to move) which has 4000+ posts.

Earlier importer failed but I managed to get exitwp working for me which converted it into jekyll successfully. Then I am trying to generate using jekyll data.

Any ideas or workaround?

[Xuanwo]

@tommy351 看起来是内存泄漏问题
stackoverflow上有人问过类似的问题。
http://stackoverflow.com/questions/13616770/node-js-fatal-error-js-allocation-failed-process-out-of-memory-possible

[tommy351]

I didn't expect this problem before. I'll try to investigate it.

[rahul286]

@tommy351 I think its about EJS/template issue. Memory is leaking.

[kahwee]

I got the "FATAL ERROR: JS Allocation failed - process out of memory" issue too. And I tried to generate again and I find the generation goes slower and slower generally:

[update] Generated: tags/mario/page/2/index.html (481ms)
[update] Generated: tags/nintendo/index.html (985ms)
[update] Generated: tags/nintendo/page/2/index.html (1469ms)
[update] Generated: tags/2d/index.html (7ms)
[update] Generated: tags/disney/index.html (490ms)
[update] Generated: tags/winnie-the-pooh/index.html (6ms)
[create] Generated: tags/accent/index.html (517ms)
[create] Generated: tags/boston/index.html (479ms)
[create] Generated: tags/funny/index.html (3374ms)
[create] Generated: tags/funny/page/2/index.html (5783ms)
[create] Generated: tags/funny/page/3/index.html (11969ms)
FATAL ERROR: JS Allocation failed - process out of memory
[1]    25463 abort      hexo generate

@tommy351 Do you need some additional info? I can provide. Thanks!

[tommy351]

@kahwee You can send it to my email.

[kahwee]

Dropped you an email @tommy351 , thanks!

[antoniocosta]

Same here. 5000+ files.

FATAL ERROR: JS Allocation failed - process out of memory
Abort trap: 6

[antoniocosta]

FYI, this seems to be a problem with the default landscape theme.
No mem error with athena: https://github.com/steven5538/hexo-theme-athena

[practicalli-john]

Does using fragment caching help the situation ?

http://hexo.io/news/2014/06/14/hexo-2-7-released/

[antoniocosta]

I guess not since "Landscape is updated and supports Fragment Caching now" and I am running hexo 2.8.2.

[rahul286]

Problem could be with nodejs or core logic. For 5000 posts+pages, other nodejs static site generators (SSG) also crashed. Of course, I think most SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using it, you may try https://github.com/spf13/hugo (it built my big site in 5 seconds).

[antoniocosta]

Yeah hexo (or docpad for that matter) don't seem suited for my needs.
I was trying to avoid Jekyll/ruby, but after trying it I'm afraid I'm
hooked. Didn't flinch.
On Sep 2, 2014 7:49 PM, "Rahul Bansal" notifications@github.com wrote:

Problem could be with nodejs or core logic. For 5000 posts+pages, other
nodejs static site generators (SSG) also crashed. Of course, I think most
SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using
it, you may try https://github.com/spf13/hugo (it built my big site in 5
seconds).

—
Reply to this email directly or view it on GitHub
#710 (comment).

[rahul286]

@antoniocosta hugo is based on golang. No dependencies. Just download one single directly executable file and start using it!

[practicalli-john]

Please close this issue if you are moving on to another project and not looking to help out.

Thank you.

[rahul286]

@jr0cket I left issue open for others who are looking for solution.

And about....

not looking to help out.

If I could help with a fix, I would have sent pull-request rather than opening issue and moving to different project.

Anyway, I will close this.