Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fate1.10.0 上传数据集报错 #875

Open
ChrisBamaofan opened this issue Apr 12, 2023 · 6 comments
Open

fate1.10.0 上传数据集报错 #875

ChrisBamaofan opened this issue Apr 12, 2023 · 6 comments

Comments

@ChrisBamaofan
Copy link

环境：使用kubefate ，照 fate-on-k8s安装fate 1.10.0 具体是 fate +spark+pulsar，且在一套k8s中安装了9999端和10000端
问题：在9999上传breast_hetero_guest时，报错，如图
image
服务都启动正常，且namenode有该路径

image

帮忙看下是哪里配置的问题
@ChrisBamaofan
Copy link
Author

@owlet42 通过接口绑定到hdfs的方式也失败了，fateflow报错如下
image

@ChrisBamaofan
Copy link
Author

ChrisBamaofan commented Apr 12, 2023 •
edited
Loading

在网上看到了通过pyarrow连 hadoop 3.x 的相同报错

@ChrisBamaofan ChrisBamaofan mentioned this issue Apr 12, 2023
Open
@owlet42
Copy link
Collaborator

owlet42 commented Apr 18, 2023

k8s集群网络插件是否正常，检查下hdfs的pod的IP都对不对

@FFinchR
Copy link

FFinchR commented May 6, 2023

@ChrisBamaofan 请问你解决了吗？我遇到了同样的问题
image

@ChrisBamaofan
Copy link
Author

@ChrisBamaofan 请问你解决了吗？我遇到了同样的问题 image

没解决，后来用了localspark+localfs的方式部署

@FFinchR
Copy link

FFinchR commented May 6, 2023 •
edited
Loading

没解决，后来用了localspark+localfs的方式部署

好的，感谢回复。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ChrisBamaofan @owlet42 @FFinchR