Weld benchmarks - Python 3.

[kchasialis]

Hello!

I tried building Weld for Python 3 but had no success. I managed, however, to get pyweld and pygrizzly installed using python2 pip. Python 2 is deprecated and I would like to build pygrizzly and pyweld for Python 3.

Did you manage to build pyweld and pygrizzly for Python 3?

Thanks in advance!

[LeonhardFS]

We tried a couple things and believe got pyweld working for Python3. To achieve this, I forked off Weld and manually fixed some files for Python3 support (https://github.com/LeonhardFS/weld/tree/py3fixes). Yet, for the benchmarks we had to use python2 for grizzly. The time needed to fix it would have been a great deal too much.

Also, Weld is not in any way a project maintained by us. We did our best though to make it run, which turned out to be quite time consuming and challenging as it is highly experimental.

If you need a docker container with Weld/Grizzly working, you can reuse the one we used for the experiments: https://github.com/tuplex/tuplex/tree/master/scripts/docker/benchmark

Our Weld numbers (and all others) can be reproduced using the driver script tuplex.py in https://github.com/tuplex/tuplex/tree/master/benchmarks/sigmod21-reproducibility

[kchasialis]

Thanks for your fast response! I believe I have everything I need now.

…

On 19 Apr 2022, at 17:43, Leonhard Spiegelberg ***@***.***> wrote:  We tried a couple things and believe got pyweld working for Python3. To achieve this, I forked off Weld and manually fixed some files for Python3 support (https://github.com/LeonhardFS/weld/tree/py3fixes). Yet, for the benchmarks we had to use python2 for grizzly. The time needed to fix it would have been a great deal too much. Also, Weld is not in any way a project maintained by us. We did our best though to make it run, which turned out to be quite time consuming and challenging as it is highly experimental. If you need a docker container with Weld/Grizzly working, you can reuse the one we used for the experiments: https://github.com/tuplex/tuplex/tree/master/scripts/docker/benchmark Our Weld numbers (and all others) can be reproduced using the driver script tuplex.py in https://github.com/tuplex/tuplex/tree/master/benchmarks/sigmod21-reproducibility — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.