Allow test suite usage without installing the package

[aslakhellesoy]

I'm using Auobahn's test suite to test Webbit's WebSocket implementation. In order to easily update the test suite when it changes we're thinking about including it as a git submodule.

It would be nice if we could run it without having to install the package, simply by setting PYTHONPATH. This is currently not possible since lib/python/autobahn/fuzzing.py uses pkg_info to get the autobahn_version.

Would you be willing to add a fallback solution for this? For example falling back to "UNKNOWN" or something if the package is not installed?

Cheers,
Aslak

[aslakhellesoy]

FWIW I have updated Webbit's README with Autobahn test suite install instructions: https://github.com/aslakhellesoy/webbit/blob/master/README.md

I'm also running into a problem with closed connections - any pointers about what it could be would be greatly appreciated: https://github.com/joewalnes/webbit/issues/38

[oberstet]

Just rectified that on HEAD. Please have a look if that works for you.

The git submodule approach to include Autobahn for convenient testing of Webbit is nice. Thanks also for mentioning. Just one caveat (dont know if that applies): we use tags to mark release versions .. the master HEAD might be broken at any time .. its dev bleeding edge. Are you planning to submodule an Autobahn tagged version?

Closing stuff: dont know which Autobahn version you are using .. the HEAD has significant new code regarding close handling and close reporting in the fuzzing stuff, more options to control, i.e.
https://github.com/oberstet/Autobahn/blob/master/testsuite/websockets/fuzzing_client.py#L30
etc etc - whats missing to release 0.4.3 are the actual test cases for section 7 (close) .. hope to get that done in the next 2 weeks. Docs are also lagging. Sorry ..

Anyway: it would be nice if you could test using HEAD (against the normal rules of only using releases) .. and see what happens. If the issue is still there, ping me back, I'll try to help.

[aslakhellesoy]

@oberstet - thanks for your quick response. I'll probably be using HEAD in dev and the latest Autobahn release for Webbit releases. We'll see what works. And thanks for the heads up on fuzzer.failByDrop = False - and the fix.

I'll close this issue since it's solved. I'll probably get back with more questions/suggestions as I progress.

Thanks for your work on Autobahn btw - it's a gold mine. I expect the Node.js crowd will check in soon too ;-)