tfx support for python 3

[orechick]

Hi
is there an estimation when tfx will be based on python 3 (and not as today - python 2)?

[MattMorgis]

Hi @orechick - We've been compiling/installing from source, and it works on Python 3. There is a commit that enables it in setup.py. I think it's going to be supported and offered in the next version, 0.13.0

You'll need protoc installed where you do this, and then I believe the command is pip install -e .[tfx] from the root directory after a git checkout of this repo.

[ruoyu90]

Thanks @MattMorgis for the detailed introduction!
Hi @orechick - tfx package is now Python3 compatible, however we decide to postpone releasing Python3 version on PyPi since there are some bugs to be fixed in our dependency libraries. The good news is we're very close and hope to release 0.13 (including a Python3 version) soon. In the meantime, you can try it out by installing from source. Please let us know for any problem!

[orechick]

when does 0.13 will be released?

[zhitaoli]

We are waiting for Apache beam 0.12.0 release since there is some python3 bug fixes in that version. Once that is release we will release 0.13.0 asap.

…

On Mon, Apr 15, 2019 at 11:11 PM orechick ***@***.***> wrote: when does 0.13 will be released? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#35 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADHgZv3-0sRfo0EPcxXZuWzEZFQCQDcQks5vhWmWgaJpZM4cgx16> .

-- Cheers, Zhitao Li

[krazyhaas]

minor correction: we are awaiting Apache beam 2.12.0 to be released.

[ruoyu90]

TFX 0.13.0rc0 is alive now. Feel free to try it out and let us know for anything :)

[thak123]

Apache beam 2.12.0 is out
https://github.com/apache/beam/releases

[Mageswaran1989]

Error

  Traceback (most recent call last):
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/runpy.py", line 193, in _run_module_as_main
      "__main__", mod_spec)
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/runpy.py", line 85, in _run_code
      exec(code, run_globals)
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/site-packages/pip/__main__.py", line 16, in <module>
      from pip._internal import main as _main  # isort:skip # noqa
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/site-packages/pip/_internal/__init__.py", line 4, in <module>
      import locale
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/locale.py", line 16, in <module>
      import re
    File "/home/mageswarand/.conda/envs/default/lib/python3.7/re.py", line 143, in <module>
      class RegexFlag(enum.IntFlag):
  AttributeError: module 'enum' has no attribute 'IntFlag'

While following the workshop setup on Python 3.7.1 env, Airflow installation is having problem and solution is pip uninstall enum34 . Reference

[ruoyu90]

@thak123 Yep! We pushed 0.13.0rc0 last week which includes Python 3 support (3.5). Feel free to try it out :)

@Mageswaran1989 Currently we only have fully support for Python 3.5 with 0.13.0rc0. Btw, are you having problems on Mac?

[Mageswaran1989]

@ruoyu90 I use Ubuntu 18 and this particular issue comes while installing Airflow package, which I had faced in the past also.

[ruoyu90]

@Mageswaran1989 Maybe try a different Python version? Python 3.5 works for me well on Linux. If problem still persists, maybe forward this to Airflow community for better assistant?

[Mageswaran1989]

@ruoyu90 it is just that we are using python 3.7.1 version, and we are currently understanding the example :)

We are working on Image data set and was wondering is there any examples/materials that could help us to start with? 80

[ruoyu90]

FYI TFX 0.13 release is alive now with Python 3.5 support.