/hexo

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Help with generation of large blog #710

Closed
rahul286 opened this Issue Jul 4, 2014 · 15 comments

Comments

Assignees
No one assigned
Labels
bug
Milestone
No milestone
6 participants
@rahul286 @Xuanwo @tommy351 @kahwee @antoniocosta @jr0cket
@rahul286

rahul286 commented Jul 4, 2014

I got:

[info] Files loaded in 78.488s
FATAL ERROR: JS Allocation failed - process out of memory
[1]    19999 abort      hexo generate

For 4000+ posts.

I am moving a wordpress site (atleast trying to move) which has 4000+ posts.

Earlier importer failed but I managed to get exitwp working for me which converted it into jekyll successfully. Then I am trying to generate using jekyll data.

Any ideas or workaround?
@Xuanwo

This comment has been minimized.

Show comment
Hide comment
@Xuanwo

Xuanwo Jul 12, 2014

Contributor

@tommy351 看起来是内存泄漏问题
stackoverflow上有人问过类似的问题。
http://stackoverflow.com/questions/13616770/node-js-fatal-error-js-allocation-failed-process-out-of-memory-possible
Contributor

Xuanwo commented Jul 12, 2014

@tommy351 看起来是内存泄漏问题
stackoverflow上有人问过类似的问题。
http://stackoverflow.com/questions/13616770/node-js-fatal-error-js-allocation-failed-process-out-of-memory-possible

@tommy351 tommy351 added the bug label Jul 19, 2014

@tommy351

This comment has been minimized.

Show comment
Hide comment
@tommy351

tommy351 Jul 19, 2014

Member

I didn't expect this problem before. I'll try to investigate it.
Member

tommy351 commented Jul 19, 2014

I didn't expect this problem before. I'll try to investigate it.
@rahul286

This comment has been minimized.

Show comment
Hide comment
@rahul286

rahul286 Jul 27, 2014

@tommy351 I think its about EJS/template issue. Memory is leaking.

rahul286 commented Jul 27, 2014

@tommy351 I think its about EJS/template issue. Memory is leaking.
@kahwee

This comment has been minimized.

Show comment
Hide comment
@kahwee

kahwee Jul 28, 2014

I got the "FATAL ERROR: JS Allocation failed - process out of memory" issue too. And I tried to generate again and I find the generation goes slower and slower generally:

[update] Generated: tags/mario/page/2/index.html (481ms)
[update] Generated: tags/nintendo/index.html (985ms)
[update] Generated: tags/nintendo/page/2/index.html (1469ms)
[update] Generated: tags/2d/index.html (7ms)
[update] Generated: tags/disney/index.html (490ms)
[update] Generated: tags/winnie-the-pooh/index.html (6ms)
[create] Generated: tags/accent/index.html (517ms)
[create] Generated: tags/boston/index.html (479ms)
[create] Generated: tags/funny/index.html (3374ms)
[create] Generated: tags/funny/page/2/index.html (5783ms)
[create] Generated: tags/funny/page/3/index.html (11969ms)
FATAL ERROR: JS Allocation failed - process out of memory
[1]    25463 abort      hexo generate

@tommy351 Do you need some additional info? I can provide. Thanks!

kahwee commented Jul 28, 2014

I got the "FATAL ERROR: JS Allocation failed - process out of memory" issue too. And I tried to generate again and I find the generation goes slower and slower generally:

[update] Generated: tags/mario/page/2/index.html (481ms)
[update] Generated: tags/nintendo/index.html (985ms)
[update] Generated: tags/nintendo/page/2/index.html (1469ms)
[update] Generated: tags/2d/index.html (7ms)
[update] Generated: tags/disney/index.html (490ms)
[update] Generated: tags/winnie-the-pooh/index.html (6ms)
[create] Generated: tags/accent/index.html (517ms)
[create] Generated: tags/boston/index.html (479ms)
[create] Generated: tags/funny/index.html (3374ms)
[create] Generated: tags/funny/page/2/index.html (5783ms)
[create] Generated: tags/funny/page/3/index.html (11969ms)
FATAL ERROR: JS Allocation failed - process out of memory
[1]    25463 abort      hexo generate

@tommy351 Do you need some additional info? I can provide. Thanks!
@tommy351

This comment has been minimized.

Show comment
Hide comment
@tommy351

tommy351 Jul 28, 2014

Member

@kahwee You can send it to my email.
Member

tommy351 commented Jul 28, 2014

@kahwee You can send it to my email.
@kahwee

This comment has been minimized.

Show comment
Hide comment
@kahwee

kahwee Jul 28, 2014

Dropped you an email @tommy351 , thanks!

kahwee commented Jul 28, 2014

Dropped you an email @tommy351 , thanks!
@antoniocosta

This comment has been minimized.

Show comment
Hide comment
@antoniocosta

antoniocosta Sep 1, 2014

Same here. 5000+ files.

FATAL ERROR: JS Allocation failed - process out of memory
Abort trap: 6

antoniocosta commented Sep 1, 2014

Same here. 5000+ files.

FATAL ERROR: JS Allocation failed - process out of memory
Abort trap: 6
@antoniocosta

This comment has been minimized.

Show comment
Hide comment
@antoniocosta

antoniocosta Sep 1, 2014

FYI, this seems to be a problem with the default landscape theme.
No mem error with athena: https://github.com/steven5538/hexo-theme-athena

antoniocosta commented Sep 1, 2014

FYI, this seems to be a problem with the default landscape theme.
No mem error with athena: https://github.com/steven5538/hexo-theme-athena
@jr0cket

This comment has been minimized.

Show comment
Hide comment
@jr0cket

jr0cket Sep 1, 2014

Does using fragment caching help the situation ?

http://hexo.io/news/2014/06/14/hexo-2-7-released/

jr0cket commented Sep 1, 2014

Does using fragment caching help the situation ?

http://hexo.io/news/2014/06/14/hexo-2-7-released/
@antoniocosta

This comment has been minimized.

Show comment
Hide comment
@antoniocosta

antoniocosta Sep 1, 2014

I guess not since "Landscape is updated and supports Fragment Caching now" and I am running hexo 2.8.2.

antoniocosta commented Sep 1, 2014

I guess not since "Landscape is updated and supports Fragment Caching now" and I am running hexo 2.8.2.
@rahul286

This comment has been minimized.

Show comment
Hide comment
@rahul286

rahul286 Sep 2, 2014

Problem could be with nodejs or core logic. For 5000 posts+pages, other nodejs static site generators (SSG) also crashed. Of course, I think most SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using it, you may try https://github.com/spf13/hugo (it built my big site in 5 seconds).

rahul286 commented Sep 2, 2014

Problem could be with nodejs or core logic. For 5000 posts+pages, other nodejs static site generators (SSG) also crashed. Of course, I think most SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using it, you may try https://github.com/spf13/hugo (it built my big site in 5 seconds).
@antoniocosta

This comment has been minimized.

Show comment
Hide comment
@antoniocosta

antoniocosta Sep 2, 2014

Yeah hexo (or docpad for that matter) don't seem suited for my needs.
I was trying to avoid Jekyll/ruby, but after trying it I'm afraid I'm
hooked. Didn't flinch.
On Sep 2, 2014 7:49 PM, "Rahul Bansal" notifications@github.com wrote:

Problem could be with nodejs or core logic. For 5000 posts+pages, other
nodejs static site generators (SSG) also crashed. Of course, I think most
SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using
it, you may try https://github.com/spf13/hugo (it built my big site in 5
seconds).

—
Reply to this email directly or view it on GitHub
#710 (comment).

antoniocosta commented Sep 2, 2014

Yeah hexo (or docpad for that matter) don't seem suited for my needs.
I was trying to avoid Jekyll/ruby, but after trying it I'm afraid I'm
hooked. Didn't flinch.
On Sep 2, 2014 7:49 PM, "Rahul Bansal" notifications@github.com wrote:

Problem could be with nodejs or core logic. For 5000 posts+pages, other
nodejs static site generators (SSG) also crashed. Of course, I think most
SSG are not designed for these many posts.

Hexo is nice project but if size of your site is preventing you from using
it, you may try https://github.com/spf13/hugo (it built my big site in 5
seconds).

—
Reply to this email directly or view it on GitHub
#710 (comment).
@rahul286

This comment has been minimized.

Show comment
Hide comment
@rahul286

rahul286 Sep 2, 2014

@antoniocosta hugo is based on golang. No dependencies. Just download one single directly executable file and start using it!

rahul286 commented Sep 2, 2014

@antoniocosta hugo is based on golang. No dependencies. Just download one single directly executable file and start using it!
@jr0cket

This comment has been minimized.

Show comment
Hide comment
@jr0cket

jr0cket Sep 2, 2014

Please close this issue if you are moving on to another project and not looking to help out.

Thank you.

jr0cket commented Sep 2, 2014

Please close this issue if you are moving on to another project and not looking to help out.

Thank you.
@rahul286

This comment has been minimized.

Show comment
Hide comment
@rahul286

rahul286 Sep 2, 2014

@jr0cket I left issue open for others who are looking for solution.

And about....

not looking to help out.

If I could help with a fix, I would have sent pull-request rather than opening issue and moving to different project.

Anyway, I will close this.

rahul286 commented Sep 2, 2014

@jr0cket I left issue open for others who are looking for solution.

And about....

not looking to help out.

If I could help with a fix, I would have sent pull-request rather than opening issue and moving to different project.

Anyway, I will close this.

@rahul286 rahul286 closed this Sep 2, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment