Projects with over 100 files or so throw an EMFILE error #1

Open
RickyRomero opened this Issue Jun 8, 2012 · 6 comments

Comments

Projects
None yet
2 participants
@RickyRomero

Solution is to rejigger handlers.js to use fs.readFileSync().

@RickyRomero

This comment has been minimized.

Show comment Hide comment
@RickyRomero

RickyRomero Jun 8, 2012

Actually, looks like my project is even bigger than readFileSync can handle. :-\

Actually, looks like my project is even bigger than readFileSync can handle. :-\

@robashton

This comment has been minimized.

Show comment Hide comment
@robashton

robashton Jun 8, 2012

Owner

Okay - well this will need looking at - the file handles should be closed (I'm surprised you're getting this actually, I'm working on fairly large projects myself)

Owner

robashton commented Jun 8, 2012

Okay - well this will need looking at - the file handles should be closed (I'm surprised you're getting this actually, I'm working on fairly large projects myself)

@robashton

This comment has been minimized.

Show comment Hide comment
@robashton

robashton Jun 8, 2012

Owner

(And by need looking at, I'll look at it now :-))

Owner

robashton commented Jun 8, 2012

(And by need looking at, I'll look at it now :-))

@robashton

This comment has been minimized.

Show comment Hide comment
@robashton

robashton Jun 8, 2012

Owner

I don't think this is an issue with large projects, I've done a test with over 1000 files and it works well.

There IS a bug here clearly - just don't know where! Very annoying

Owner

robashton commented Jun 8, 2012

I don't think this is an issue with large projects, I've done a test with over 1000 files and it works well.

There IS a bug here clearly - just don't know where! Very annoying

@RickyRomero

This comment has been minimized.

Show comment Hide comment
@RickyRomero

RickyRomero Jun 8, 2012

If it makes a difference, I'm on a superfast SSD. Might have something to do with it.

It looks like since everything is running asynchronously, it's opening hundreds of files at once and getting hung up.

If it makes a difference, I'm on a superfast SSD. Might have something to do with it.

It looks like since everything is running asynchronously, it's opening hundreds of files at once and getting hung up.

@robashton

This comment has been minimized.

Show comment Hide comment
@robashton

robashton Jun 8, 2012

Owner

That could cause it (crikey), although all of my machines are on SSD I'm currently on the MBA rather than my crazy beast - surprised in that case that the synchronous calls don't work as a fix.

I guess I can put a limit in to throttle the number of concurrent actions, shouldn't be too hard to code up.

Owner

robashton commented Jun 8, 2012

That could cause it (crikey), although all of my machines are on SSD I'm currently on the MBA rather than my crazy beast - surprised in that case that the synchronous calls don't work as a fix.

I guess I can put a limit in to throttle the number of concurrent actions, shouldn't be too hard to code up.

@ghost ghost assigned robashton Jun 8, 2012

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment