-
Notifications
You must be signed in to change notification settings - Fork 356
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
High CPU usage #35
Comments
It's not. How many files are you watching and could you post your |
Versions: As for the amount of files, since I am using bootstrap there are more 40 less files being watched. There really isn't much of a need for me to watch those though so perhaps that is one of the issues? Looks like it happens just when watching. module.exports = function(grunt) {
grunt.initConfig({
// The lint task will run the build configuration and the application
// JavaScript through JSHint and report any errors. You can change the
// options for this task, by reading this:
// https://github.com/cowboy/grunt/blob/master/docs/task_lint.md
lint: {
files: [
"public/**/*.js"
]
},
// The jst task compiles all application templates into JavaScript
// functions with the underscore.js template function from 1.2.4. You can
// change the namespace and the template options, by reading this:
// https://github.com/tbranyen/build-tasks/tree/master/jst
//
// The concat task depends on this file to exist, so if you decide to
// remove this, ensure concat is updated accordingly.
jst: {
"public/js/templates.js": [
"views/templates/**/*.html"
]
},
// The concatenate task is used here to merge the almond require/define
// shim and the templates into the application code. It's named
// dist/debug/require.js, because we want to only load one script file in
// index.html.
concat: {
"public/js/debug.js": [
"public/js/vendor/*.js",
"public/js/vendor/bootstrap/*.js",
"public/js/templates.js",
"public/js/app/*.js",
"public/js/app/models/*.js",
"public/js/app/views/*.js",
"public/js/app/collections/*.js",
"public/js/app/views/nests/*.js"
]
},
// This task uses the MinCSS Node.js project to take all your CSS files in
// order and concatenate them into a single CSS file named index.css. It
// also minifies all the CSS as well. This is named index.css, because we
// only want to load one stylesheet in index.html.
mincss: {
"public/dist/release.css": [
"public/stylesheets/*.css"
]
},
// Takes the built require.js file and minifies it for filesize benefits.
min: {
"public/dist/release.js": [
"public/js/debug.js"
]
},
// less to CSS
less: {
compile: {
files: {
"public/stylesheets/style.css": "public/stylesheets/style.less",
"public/stylesheets/nest.css": "public/stylesheets/nest.less",
"public/stylesheets/style.css": "public/stylesheets/style.less",
"public/stylesheets/vendor/bootstrap/bootstrap.css": "public/stylesheets/vendor/bootstrap/less/bootstrap.less",
"public/stylesheets/vendor/fontawesome/font-awesome.css": "public/stylesheets/vendor/fontawesome/less/font-awesome.less"
}
}
},
watch: {
scripts: {
files: '**/*.less',
tasks: ['less']
},
templates: {
files: 'views/templates/**/*.html',
tasks: ['jst']
}
}
});
// The default task will remove all contents inside the dist/ folder, lint
// all your code, precompile all the underscore templates into
// dist/debug/templates.js, compile all the application code into
// dist/debug/require.js, and then concatenate the require/define shim
// almond.js and dist/debug/templates.js into the require.js file.
grunt.registerTask("default", "concat min less mincss jst");
grunt.loadNpmTasks('grunt-contrib');
}; |
Thanks for the info. If you get a chance, could you try the latest grunt and grunt-contrib-watch? Let me know if it still runs up the CPU. We've made a lot of changes since v0.1.4 in the watch. I'll try your setup shortly to see if I can duplicate. Thanks! |
I updated to the lastest grunt and grunt-contrib versions and now the process never gets above 1% cpu, so I would say you guys did some awesome work on that update! When running watch now and updating a less file, I get this error:
Any ideas on what I need to change to get it to work? (I already update the registerTask default alias to use an array instead of string" |
Awesome, glad to hear! To get less working, you'll need to install the Grunt v0.4 version with: Another thing to try if staying on Grunt v0.3 for the time being. Try uninstalling grunt-contrib-watch and using the previously built-in watch task in Grunt v0.3. grunt-contrib-watch is intended as a replacement for the watch task in Grunt v0.4. We just had Grunt v0.3 support on the v0.1.x branch to get some early testers. :) |
I tried upgrading to grunt .4 and upgrading the grunt plugins but I ran into some issues I don't have time to figure out. I removed the bootstrap less files from being watched and that dropped the cpu to under 5%. |
Hopefully the other issues you got figured out :) Otherwise please reopen if one of those is with the watch task, thanks! |
I'm having the same issue on my Windows 8, cpu level near 70%, watching just a few files. |
Have issue with high load too. Versions: System: Ubuntu 12.04 LTS Gruntfile: ...
watch: {
sass: {
files: ['app/stylesheets/{,**/}*.scss'],
tasks: ['sass:dev']
},
html: {
files: ['app/index.html'],
tasks: ['html:dev']
}
},
html: {
dev: {
options: {
src: 'app/index.html',
dest: 'temp/index.html',
vars: config('development')
}
}
},
sass: {
dev: {
options: {
style: 'expanded'
},
files: {
'temp/stylesheets/application.css': 'app/stylesheets/application.scss'
}
}
},
... |
Try running with |
Task is watching 45 scss files and version of node is v0.10.4. |
I'm curious if the problem is within this lib or just watching in general (as that greatly differs on environments). Are you game to try some examples for me? Could you first make sure any previous node processes are not running with var fs = require('fs');
[
// Please add a bunch more files
'app/stylesheets/application.scss',
].forEach(function(file) {
fs.watch(file, function(event, filename) {
console.log(file + ' was ' + event);
});
}); |
Not fully understand, how to run this example. Can you explain, please =) |
Oh that example will watch files using the core node.js api because I want to see if the problem is from this watch task or with any file watching. Throw that example into a file named |
Thank you for explain) I can't find other process of node on machine and have this error on start:
|
Thanks for giving it go. That error means one of the files you've tried doesn't exist. Could you try on only files that exists? |
Hmm bummer. I'll reopen although I'm not sure how to fix as I can't reproduce and I am out of ideas. I really appreciate you trying those examples for me @Jesterovskiy! If someone has this issue and discovers a fix please let us know! Thanks. |
Just chiming in to say that we're experiencing the same issue watching around 100 files. We ran the same test above and didn't see any serious CPU usage, so no idea what's causing it. |
Some test with https://github.com/shama/gaze shows same situation: 5 process and quiescent load 20-23% of cpu. I will dig deeper =) |
I found the problem! =) In Gaze by default interval sets https://github.com/shama/gaze/blob/master/lib/gaze.js#L36 but in fs lib we see different default value https://github.com/joyent/node/blob/master/lib/fs.js#L1128 I changed this value in my test file and the result - no more high cpu load =) var fs = require('fs'),
opts = { persistent: true, interval: 5007 };
[
// Please add a bunch more files
'app/stylesheets/application.scss',
'app/stylesheets/app/_authentication.scss',
'app/stylesheets/app/_dynamic-content.scss',
'app/stylesheets/app/_main.scss',
'app/stylesheets/app/_news-feed.scss',
'app/stylesheets/app/crime-reporting/_incident-show.scss',
'app/stylesheets/app/crime-reporting/_incidents.scss',
'app/stylesheets/app/crime-reporting/_print-content.scss',
'app/stylesheets/app/crime-reporting/_subjects.scss',
'app/stylesheets/app/crime-reporting/_video-edit.scss',
'app/stylesheets/app/features/_comments.scss',
'app/stylesheets/app/features/_entities.scss',
'app/stylesheets/app/features/_groups.scss',
'app/stylesheets/app/features/_messages.scss',
'app/stylesheets/app/features/_premises.scss',
'app/stylesheets/app/features/_statistics.scss',
'app/stylesheets/app/features/_users.scss',
'app/stylesheets/app/headers/_action-bar.scss',
'app/stylesheets/app/headers/_header.scss',
'app/stylesheets/app/plugins/_custom-redactor.scss',
'app/stylesheets/app/plugins/_on-off-switch.scss',
'app/stylesheets/app/sidebars/_left.scss',
'app/stylesheets/app/sidebars/_right.scss',
'app/stylesheets/app/ui/_flashes.scss',
'app/stylesheets/app/ui/_forms.scss',
'app/stylesheets/app/ui/_tables.scss',
'app/stylesheets/lib/_lt-ie7.scss',
'app/stylesheets/lib/_lt-ie8.scss',
'app/stylesheets/lib/_lt-ie9.scss',
'app/stylesheets/lib/_mixins.scss',
'app/stylesheets/lib/bootstrap/_custom-icons.scss',
'app/stylesheets/lib/bootstrap/_ie7buttonfix.scss',
'app/stylesheets/lib/bootstrap/_ie8buttonfix.scss',
'app/stylesheets/lib/bootstrap/_mixins-custom.scss',
'app/stylesheets/lib/bootstrap/_modal.scss',
'app/stylesheets/lib/bootstrap/_overrides.scss',
'app/stylesheets/lib/bootstrap/_popover.scss'
].forEach(function(file) {
fs.watchFile(file, opts, function(event, filename) {
console.log(file + ' was ' + event);
});
}); |
@Jesterovskiy Awesome find! Thanks for looking into this! That makes a lot of sense. I'll have to increase the default interval for polling in gaze. In the meantime that setting is available through the options: |
I see that this has been closed but I still see grunt using about 9% (of a 2.4 i5) on a watch of a few dozen files on OS X. Doesn't seem like a lot but if I leave the watch running all day it keeps power management from kicking in and costs me battery life. I'll play around with that polling interval option, I just wanted to mention it here so that you know the defaults aren't ideal. |
FWIW, the next version of gaze uses native OS events for everything and will dramatically reduce the CPU usage. In the meantime, just make sure it's not matching unintended files |
Hi, I know its a very old issue but i face this problem again on My windows 8.1 PC. Its regarding the Sails.js mvc. I have tried all the above suggestions but these were not working for me. I have to commented out the codes under Create watcher per target line from the file tasks/watch.js of this module. I just stop the watchers to pushing items on it under a infinite type loop. I just did it so don't know what happened further. Hope it will help others temporarily. Thanks |
Also seeing a CPU usage on a Windows 7 machine. And high memory usage (> 100MB). |
Had the same problem. |
i have the same issue! |
I am also experiencing this issue. It starts out running at around 10-20%, then after about five minutes it shoots up to 99% CPU and stays there until I stop the watch task. I was unaware this was happening on my desktop but when I run it on my laptop it gets very warm and the fan spins constantly, which is what alerted me to the issue. Edit: Just noticed the comment about watching the node_modules folder, that was my problem as well. Once I specified the watch directories to exclude that it fixed the issue. |
@pwdonald exactly same for me. but i have node_modules excluded already... |
Have the same problem on Yosemite on mac mini, 50% CPU for couple hundreds of scripts. I use the same configuration on fedora and grunt uses less than 1% |
I've found out that updating gaze to 0.6.4 solves my issue. PR about it: #412 |
@tikosar spot on! I was watching node_modules! tku |
I've had the issue of watching node_modules/ as well. I've added
like:
Should you maybe disable watching node_modules/ by default since I don't see why anyone would do that anyways and they could always enable it manually? |
I'm seeing the same disparity in CPU usage between Linux (lower/more manageable) and Mac (high). I'm using 0.6.1. |
obviously ymmv, but just thought I mention another potential biggie that caused slowdown on my Mac which was solved by ignoring the bower_components folder, e.g. before : ~3100 files using ~%60 CPU usage versions: grunt-contrib-watch v0.6.1 I would have thought watching 3100 files would not be such a problem giving the Mac's FSEvent API is supposed to be fast and light weight. But, I've just noticed that the grunt-contrib-watch package.json doesn't explicitly mention the node module https://www.npmjs.com/package/fsevents as a dependancy and uses gaze which at first glance also doest use node's fsevent. (this was just a cursory check, but given the behaviour it would seem it doesn't) I guess a potential fix (for very large projects) is to use fsevent on Mac (either directly in grunt-watch or by patching node's gaze) |
My special dumb case: Took me 3h (of looking in
Guess what? Recursion! CPU went in 100% instantly, no info in terminal, verbose mode showed watch task running continuously. That was stupid but made me laugh in the end. I don't think my solution will help someone but I posted it just to cover all scenarios... |
Someone had composer'd a /vendor/ dir in my theme. Ignoring that with '!/vendor/' did the trick for me. Thanks! |
When running grunt watch, the process sits around 70% cpu usage on my mac (10.8.2). Is this a known issue?
The text was updated successfully, but these errors were encountered: