Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

docpad fails to generate files for large size websites #446

Closed
segalr3 opened this Issue · 9 comments

5 participants

@segalr3

docpad version = 6.21.10
node version = v0.8.18
npm version = 1.2.7
Ubuntu 12.04

What i did:

I have a website with many languages, which i am migrating to docpad.
First i tried to generate for 2 languages, all was generated fine.
Then i copied the rest of the languages folders to the documents directory and tried to generate again.

what happend:

I actually hit the nodejs memory limit:

"FATAL ERROR: CALL_AND_RETRY_2 Allocation failed - process out of memory"

no files were created in the out directory.

Please advise


Want to back this issue? Place a bounty on it! We accept bounties via Bountysource.

@segalr3

I used a few partials in my layouts, after removing the partials, docpad managed to generate all the files.
So the issue is having partials and lots of documents...

@balupton
Owner

Ref #276

@cmawhorter

Researching static site generators and noticed this issue. Out of curiosity @segalr3, would you happen to remember how many was a lot? Hundreds, thousands or millions?

I'm not seeing any limitations or guidelines related to this mentioned in the docs.

@segalr3
@mikeumus
Owner

Hey Gang, @dorajistyle just posted this as example of handling many files with DocPad:
https://github.com/dorajistyle/blogger-docpad
(in this pull-req: docpad/documentation#147)

Check it out, hope it helps. :smiley::+1:

@cmawhorter
@dorajistyle

I sent pull request to jekyll-import but not merged yet.

You can download importer 'blogger_docpad.rb' below:

https://github.com/dorajistyle/jekyll-import/blob/master/lib/jekyll-import/importers/blogger_docpad.rb

@cmawhorter

This is good info, but I'll be needing thousands of pages. Maybe add a limitations section in the docs with this info? This is a pretty big one IMO.

@balupton
Owner

The raw plugin solves this if most of your files are static files. However, if they are documents, it gets more interesting.

Moving the discussion here: https://discuss.bevry.me/t/docpad-is-slow-for-large-websites/47

@balupton balupton closed this
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.