Windows support

(Was "Windows build fails", ed:RV)

Actual NPM error log:
https://gist.github.com/3730932

I just found something about compiling leveldb in Windows:
https://groups.google.com/d/msg/leveldb/VuECZMnsob4/tROLqJq_JcEJ

And here are the aditional packages that are needed:
http://www.boost.org/users/download

And some more information from official source:
http://code.google.com/p/leveldb/source/browse/WINDOWS?name=windows

[rvagg]

Spent some time in Windows today trying to get my head around the issues involved here. Not as straightforward as I hoped unfortunately.

• While using Boost is a possibility, it's huge and I certainly wouldn't want to bundle it just to get a Windows compile. It'd be nice if only the useful bits could be extracted but I haven't looked at it.
• My GYP files for LevelDB and Snappy started from the ones that Chromium uses and Chromium compiles in Windows of course. They do it by abstracting out the non-portable bits in most libraries they include. It may be possible to pull out the important bits and reuse those. See here, the important bits are in Chromium's "base", references are in *env_chromium.cc" and "leveldatabase.gyp"
• There is a leveldbwin project that did a win32 port, looks a little old but may be useful.
• I'm not sure exactly what this is, or if that guy has any relation to the LevelDB project but it looks like a fork that includes Windows build components, including some stuff snaffled from the above project. Looks more up to date but unfortunately also looks like the Windows stuff is munged in with the LevelDB stuff so I'm not sure how hard it would be to pull it out.

And that's all I have for now. Would be happy for others to pitch in here because this isn't a very high priority for me.

someone is writting a pouch db layer to use your levelup code.
This means a 100% nodejs based databae using couchdb semantics.

its over here: https://github.com/chesles/pouchdb

[rvagg]

OK peeps, the real solution to this is to simply use libuv since we have direct access to it anyway! I've already completed the basics of a leveldb port to libuv but unfortunately it requires Node 0.9 because of a required feature only introduced to libuv a month ago. So, maybe by the time 0.8 comes to an end we'll have proper Windows support in LevelUP.

[chesles]

Hey that's great news!

Awesome! Could you create an unstable branch with Node.js 0.9? This way we could start testings in our scripts :)

[rvagg]

I'll keep you informed here when I have something interesting, I have a branch on the go but it's only a start.

[rvagg]

A quick update on this. I have a libuv port.h working across platforms, but unfortunately there's a lot more work for an env.cc required for Windows/libuv than I suspected. There's even a few things we can't do with libuv and will have to be done manually for different platforms.
In summary, I ran out of steam, but there is a libuv branch on the go.

it looks like Ben closed the LubUV issue requesting a different API to file seeking.

So whats the way forward for getting a windows port now ?
I assume it means adapting the code to us the API as it stands ?

[rvagg]

yeah, it'll just mean an #ifdef WIN32 blah blah to switch between Posix and Windows in the env.cc file. A lot of the rest may be able to be done by libuv as is.

i see.

Of course i would want to eliminate the need for the conditionals too.

If you can get a build going in travis woudl be awesome.
I will be a happy tester.

I am also looking for libraries to allow levelup to be distributed like
couch db is.
If you know of any that would be great.

i see no reason why we cant get something like riak working

On 10 February 2013 12:19, Rod Vagg notifications@github.com wrote:

yeah, it'll just mean an #ifdef WIN32 blah blah to switch between Posix
and Windows in the env.cc file. A lot of the rest may be able to be
done by libuv as is.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/5#issuecomment-13347476..

Contact details:
+49 1573 693 8595 (germany)
+46 73 364 67 96 (sweden)
skype: gedw99

[juliangruber]

For distribution you can check out level-scuttlebutt by dominictarr.

Re riak: we mustn't forget that leveldb is just an unopinionated storage engine. There are versions or riak that use leveldb though.

thanks

I know what you mean. I agree its great to keep levelup as an
agnostic storage engine.

I was not suggesting we implement distributed storage in levleup. But more
looking for github projects that implement it on top of levelup.

I see that scuttle butt has map reduce to allow many storage instances to
be used.

But i am more thinking of data replication, key ring based storage, leveldb
server to handle connection pooling etc

it would be really great to add a list of these to the main level db web
page maybe ?

On 10 February 2013 12:36, Julian Gruber notifications@github.com wrote:

For distribution you can check out level-scuttlebutt by dominictarr.

Re riak: we mustn't forget that leveldb is just an unopinionated storage
engine. There are versions or riak that use leveldb though.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/5#issuecomment-13347647..

Contact details:
+49 1573 693 8595 (germany)
+46 73 364 67 96 (sweden)
skype: gedw99

Ok i correct myself. you have the Modules page in the wiki :)

On 10 February 2013 13:04, Ged Wed gedw99@gmail.com wrote:

thanks

I know what you mean. I agree its great to keep levelup as an
agnostic storage engine.

I was not suggesting we implement distributed storage in levleup. But more
looking for github projects that implement it on top of levelup.

I see that scuttle butt has map reduce to allow many storage instances to
be used.

But i am more thinking of data replication, key ring based storage,
leveldb server to handle connection pooling etc

it would be really great to add a list of these to the main level db web
page maybe ?

On 10 February 2013 12:36, Julian Gruber notifications@github.com wrote:

For distribution you can check out level-scuttlebutt by dominictarr.

Re riak: we mustn't forget that leveldb is just an unopinionated storage
engine. There are versions or riak that use leveldb though.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/5#issuecomment-13347647..

Contact details:
+49 1573 693 8595 (germany)
+46 73 364 67 96 (sweden)
skype: gedw99

Contact details:
+49 1573 693 8595 (germany)
+46 73 364 67 96 (sweden)
skype: gedw99