Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No module named 'pyarrow._orc' #10

Open
Jasonsey opened this issue Jul 14, 2022 · 1 comment
Open

No module named 'pyarrow._orc' #10

Jasonsey opened this issue Jul 14, 2022 · 1 comment

Comments

@Jasonsey
Copy link
Owner

code:

from fern.data import check_path, FernDataFrame

log:

Traceback (most recent call last):
  File "C:/workspace/code/game-analysis/src/main.py", line 11, in <module>
    from api.data.preprocess import main as preprocess
  File "C:\workspace\code\game-analysis\src\api\data\preprocess.py", line 6, in <module>
    from utils.data import Preprocessor
  File "C:\workspace\code\game-analysis\src\utils\data\__init__.py", line 4, in <module>
    from .data_pipeline import *
  File "C:\workspace\code\game-analysis\src\utils\data\data_pipeline.py", line 12, in <module>
    from utils.common import HDFSPath
  File "C:\workspace\code\game-analysis\src\utils\common\__init__.py", line 4, in <module>
    from .common import *
  File "C:\workspace\code\game-analysis\src\utils\common\common.py", line 11, in <module>
    from fern.data import check_path, FernDataFrame
  File "C:\ProgramData\Miniconda3\envs\game-analysis\lib\site-packages\fern\data\__init__.py", line 8, in <module>
    from .data_utils import *
  File "C:\ProgramData\Miniconda3\envs\game-analysis\lib\site-packages\fern\data\data_utils.py", line 15, in <module>
    import pyarrow.orc as orc
  File "C:\ProgramData\Miniconda3\envs\game-analysis\lib\site-packages\pyarrow\orc.py", line 23, in <module>
    import pyarrow._orc as _orc
ModuleNotFoundError: No module named 'pyarrow._orc'

@Jasonsey
Copy link
Owner Author

Jasonsey commented Jul 14, 2022

because orc reader does not support in windows. So the pyarrow is only available in linux. See more details https://stackoverflow.com/a/58967391.

I will try not to import pyarrow.orc if not necessary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant