You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to use smart_open from within an Apache Spark application by sending it to Spark wtihin a zip containing my application's third party dependencies. It works for all the other modules I'm importing, but the _get_version function in __init__.py tries and fails to open the VERSION file.
Traceback (most recent call last):
File "user_code.py", line 5, in <module>
import smart_open
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
File "/mnt/yarn/usercache/hadoop/appcache/application_1567622467027_0006/container_1567622467027_0006_01_000001/3rdparty.zip/smart_open/__init__.py", line 39, in <module>
File "/mnt/yarn/usercache/hadoop/appcache/application_1567622467027_0006/container_1567622467027_0006_01_000001/3rdparty.zip/smart_open/__init__.py", line 35, in _get_version
File "/mnt/yarn/usercache/hadoop/appcache/application_1567622467027_0006/container_1567622467027_0006_01_000001/3rdparty.zip/smart_open/smart_open_lib.py", line 307, in open
File "/mnt/yarn/usercache/hadoop/appcache/application_1567622467027_0006/container_1567622467027_0006_01_000001/3rdparty.zip/smart_open/smart_open_lib.py", line 512, in _shortcut_open
NotADirectoryError: [Errno 20] Not a directory: '/mnt/yarn/usercache/hadoop/appcache/application_1567622467027_0006/container_1567622467027_0006_01_000001/3rdparty.zip/smart_open/VERSION'
storing the version in a .py file and importing it should solve this issue.
The text was updated successfully, but these errors were encountered:
I'm trying to use smart_open from within an Apache Spark application by sending it to Spark wtihin a zip containing my application's third party dependencies. It works for all the other modules I'm importing, but the
_get_version
function in__init__.py
tries and fails to open theVERSION
file.storing the version in a .py file and importing it should solve this issue.
The text was updated successfully, but these errors were encountered: