get rid of node-gyp dependency

[akhoury]

that's been bothering me for a while

[andreapernici]

Here now I get

-bash-3.2# npm install nodebb-plugin-import
npm WARN package.json nodebb-plugin-soundpack-default@0.1.1 No README data
npm WARN package.json nodebb-plugin-dbsearch@0.0.13 No repository field.

npm WARN package.json reds@0.2.4 No repository field.

contextify@0.1.9 install /home/domains/xxxx/htdocs/nodebb/node_modules/nodebb-plugin-import/node_modules/jsdom/node_modules/contextify
node-gyp rebuild

gyp ERR! configure error
gyp ERR! stack Error: "pre" versions of node cannot be installed, use the --nodedir flag instead
gyp ERR! stack at install (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/install.js:66:16)
gyp ERR! stack at Object.self.commands.(anonymous function) as install
gyp ERR! stack at getNodeDir (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:152:20)
gyp ERR! stack at /usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:95:9
gyp ERR! stack at ChildProcess.exithandler (child_process.js:723:7)
gyp ERR! stack at ChildProcess.emit (events.js:110:17)
gyp ERR! stack at maybeClose (child_process.js:1000:16)
gyp ERR! stack at Socket. (child_process.js:1168:11)
gyp ERR! stack at Socket.emit (events.js:107:17)
gyp ERR! stack at Pipe.close (net.js:461:12)
gyp ERR! System Linux 2.6.32-6-pve
gyp ERR! command "node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/domains/xxxx/htdocs/nodebb/node_modules/nodebb-plugin-import/node_modules/jsdom/node_modules/contextify
gyp ERR! node -v v0.13.0-pre
gyp ERR! node-gyp -v v1.0.1
gyp ERR! not ok
npm ERR! contextify@0.1.9 install: node-gyp rebuild
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the contextify@0.1.9 install script.
npm ERR! This is most likely a problem with the contextify package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! node-gyp rebuild
npm ERR! You can get their info via:
npm ERR! npm owner ls contextify
npm ERR! There is likely additional logging output above.

npm ERR! System Linux 2.6.32-6-pve
npm ERR! command "/usr/local/bin/node" "/usr/local/bin/npm" "install" "nodebb-plugin-import"
npm ERR! cwd /home/domains/xxxx/htdocs/nodebb
npm ERR! node -v v0.13.0-pre
npm ERR! npm -v 1.4.28
npm ERR! code ELIFECYCLE
npm ERR! not ok code 0

[akhoury]

you should get the same error if you try:

npm install jsdom

[andreapernici]

Yes. Exactly.

-bash-3.2# npm install jsdom
npm WARN package.json nodebb-plugin-soundpack-default@0.1.1 No README data
npm WARN package.json nodebb-plugin-dbsearch@0.0.13 No repository field.
npm WARN package.json reds@0.2.4 No repository field.

contextify@0.1.9 install /home/domains/xxxx/htdocs/nodebb/node_modules/jsdom/node_modules/contextify
node-gyp rebuild

gyp ERR! configure error
gyp ERR! stack Error: "pre" versions of node cannot be installed, use the --nodedir flag instead
gyp ERR! stack at install (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/install.js:66:16)
gyp ERR! stack at Object.self.commands.(anonymous function) as install
gyp ERR! stack at getNodeDir (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:152:20)
gyp ERR! stack at /usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:95:9
gyp ERR! stack at ChildProcess.exithandler (child_process.js:723:7)
gyp ERR! stack at ChildProcess.emit (events.js:110:17)
gyp ERR! stack at maybeClose (child_process.js:1000:16)
gyp ERR! stack at Process.ChildProcess._handle.onexit (child_process.js:1072:5)
gyp ERR! System Linux 2.6.32-6-pve
gyp ERR! command "node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/domains/xxxx/htdocs/nodebb/node_modules/jsdom/node_modules/contextify
gyp ERR! node -v v0.13.0-pre
gyp ERR! node-gyp -v v1.0.1
gyp ERR! not ok
npm ERR! contextify@0.1.9 install: node-gyp rebuild
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the contextify@0.1.9 install script.
npm ERR! This is most likely a problem with the contextify package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! node-gyp rebuild
npm ERR! You can get their info via:
npm ERR! npm owner ls contextify
npm ERR! There is likely additional logging output above.

npm ERR! System Linux 2.6.32-6-pve
npm ERR! command "/usr/local/bin/node" "/usr/local/bin/npm" "install" "jsdom"
npm ERR! cwd /home/domains/xxxx/htdocs/nodebb
npm ERR! node -v v0.13.0-pre
npm ERR! npm -v 1.4.28
npm ERR! code ELIFECYCLE
npm ERR! not ok code 0

[akhoury]

@andreapernici that's fixed in master, however, the "resume after crash" feature is till fragile. I wouldnt use it, you can just delete everything at each try

[andreapernici]

Now I installed it.

Clicked "Delete everything, then re-import to NodeBB", but honestly I don't understand why an importer should delete the MySql db content :D

I'm waiting for the import to finish...I have a big DB: more than 10GB

I get:
State: idle, by event: importer.complete | Phase: importerComplete Progress: 100.00%

But nothing is imported.
I put this in the exporter nodebb-plugin-import-vbulletin without installing it it's correct?
The nodebb-plugin-import include everything? Or not?

[andreapernici]

I see a red notice not finding the exporter.

Started after installing the vbulletin importer but
Skipping user._uid: 394 because _email is falsy. Value:
Skipping user._uid: 394 because _email is falsy. Value:
Skipping user._uid: 2 because _email is falsy. Value:
Skipping user._uid: 2 because _email is falsy. Value:

and then stopped

State: idle, by event: | Phase: Progress: 0%

[akhoury]

Oh no no I'm not deleting the mysql db. It just flushes the NodeBB db
including the default categories that NodeBB installs.
And If this is not your first try out, it would delete the data from NodeBB
db from previous try outs
On Oct 1, 2014 11:48 AM, "Andrea" notifications@github.com wrote:

Now I installed it.

Clicked "Delete everything, then re-import to NodeBB", but onestly I don't
understand why an importer should delete the MySql db content.

I'm waiting for the import to finish...I have a big DB: more than 10GB

—
Reply to this email directly or view it on GitHub
#58 (comment)
.

[akhoury]

You need to select the right exporter type or type it in.
So what is your source forum type?
SMF ? Ubb ? Phpbb ? VBulletin ? Etc.. You need to tell the importer that
On Oct 1, 2014 11:55 AM, "Andrea" notifications@github.com wrote:

I see a red notice not finding the exporter.

—
Reply to this email directly or view it on GitHub
#58 (comment)
.

[akhoury]

Wait for the next release. Master is not stable
On Oct 1, 2014 12:41 PM, "Aziz Khoury" bentael@gmail.com wrote:

You need to select the right exporter type or type it in.
So what is your source forum type?
SMF ? Ubb ? Phpbb ? VBulletin ? Etc.. You need to tell the importer that
On Oct 1, 2014 11:55 AM, "Andrea" notifications@github.com wrote:

I see a red notice not finding the exporter.

—
Reply to this email directly or view it on GitHub
#58 (comment)
.

[andreapernici]

Yes I used the vbulletin importer.

It starts, but after some seconds stop. Thanks for all your feedback and let me know when a stable version will be out. I'd really like to test how nodebb scale on a very large forum with high traffic.

[akhoury]

track it here, #60
will def attempt to fix before I release, I will let you know once that happens

how hard would it be for you to give me an altered version of your DB, maybe obfuscate any private data.
I'd like to test large real DBs as well?

[andreapernici]

If you want I can create a shell access on my test server so we can experiment there without obfuscating anything. Obviously the test server is not with a lot of power but it should be fine.