pybuilder 0.11.x fails under WIndows

[sdomme]

(afp-cli) PS C:\IdeaProjects\afp-cli> pyb_ -C
PyBuilder version 0.11.1
Build started at 2015-09-10 11:21:54
------------------------------------------------------------
[INFO]  Building afp-cli version 1.0.4
[INFO]  Executing build in C:\IdeaProjects\afp-cli
[INFO]  Going to execute tasks: clean, analyze, publish
[INFO]  Removing target directory C:\IdeaProjects\afp-cli\target
[INFO]  Running unit tests
------------------------------------------------------------
BUILD FAILED - Can't pickle <function instrumented_target at 0x02E6E1B0>: it's not found as pybuilder.utils.instrumented_target
------------------------------------------------------------
Build finished at 2015-09-10 11:21:55
Build took 0 seconds (702 ms)
(afp-cli) PS C:\IdeaProjects\afp-cli> Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "c:\python27\Lib\multiprocessing\forking.py", line 380, in main
    prepare(preparation_data)
  File "c:\python27\Lib\multiprocessing\forking.py", line 488, in prepare
    assert main_name not in sys.modules, main_name
AssertionError: __main__

Tested on Python 2.6, 2.7, 3.4

Last working Version 0.10.63

pyb_ install_dependencies works fine

[mriehl]

Yes install_dependencies doesn't fork, but run_unit_tests now does. Seems like a windows-specific issue with pickling because what the code does is totally valid.

[mriehl]

Can you downgrade to 0.10.63? I'm looking into fixing this.

[mriehl]

The issue might be that instrumented_target is not in the top level of the module, but pickle wants to resolve the function's full name on windows somehow.

I think currying the q queue into the instrumented_target closure and then pulling the closure out as a top-level function would solve this, but I don't have a windows machine to test on right now. Will test a fix later today and let you know how it goes.

[mriehl]

Also @sdomme if you want you could try out the branch fix/issue_184. If you can confirm it works now that would be faster.

[arcivanov]

well, that escalated quickly 😉

[mriehl]

We managed to solve some of the issues (the branch I pushed helps) but windows has massive issues with multiprocessing combined with pickle. Will continue imvestigating on my own windows machine.

[arcivanov]

👍