Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【Bug】The built-in Louvain algorithm can only run on graphs where the OID are integers #3545

Closed
yyg192 opened this issue Feb 8, 2024 · 11 comments

Comments

@yyg192
Copy link

yyg192 commented Feb 8, 2024

platform

ubuntu 20.04
jdk 11.0.21
python 3.8.13
gcc 9.4.0
graphscope==0.26.0
standalone mode

Here's the code that can run correctly

"""
以下是可以运行的代码,只需要将上面不可运行的代码中的节点oid设置为 整型 即可
"""
"""
以下是可以运行的代码,只需要将上面不可运行的代码中的节点vid设置为 整型 即可
"""
import numpy as np
import pandas as pd
import os
import graphscope as gs
gs.set_option(show_log=False)

leader_id = [0, 0, 0, 1, 1, 3, 3, 6, 6, 6, 7, 7, 8]
member_id = [2, 3, 4, 5, 6, 6, 8, 0, 2, 8, 8, 9, 9]
group_size = [4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2]
edges_df = pd.DataFrame({"leader_id":leader_id, "member_id":member_id, "group_size":group_size})

student_id = [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]
vertices_df = pd.DataFrame({"student_id":student_id})
sess = gs.session(cluster_type='hosts')
gs_graph = sess.g(oid_type='int64_t', directed=False, generate_eid=False)
gs_graph = gs_graph.add_vertices(vertices_df, label="id", properties=[]).add_edges(edges_df, label="leader-member", src_label="id", dst_label="id", properties=["group_size"])
louvain_contxt = gs.louvain(gs_graph)
result_df = louvain_contxt.to_dataframe(
selector={"id": "v.id", "result": "r"}
)
print(result_df)

The following code is unable to run (as the OID are of string type):

"""
下面是无法运行的代码,无法运行的原因是因为顶点oid为string
"""
import numpy as np
import pandas as pd
import os
import graphscope as gs
gs.set_option(show_log=False)

leader_id = ["0","0","0","1","1","3","3","6","6","6","7","7","8"]
member_id = ["2","3","4","5","6","6","8","0","2","8","8","9","9"]
group_size = [4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2]
edges_df = pd.DataFrame({"leader_id":leader_id, "member_id":member_id, "group_size":group_size})
student_id = ["0", "1", "2", "3", "4", "5", "6", "7", "8", "9"]
vertices_df = pd.DataFrame({"student_id":student_id})
sess = gs.session(cluster_type='hosts')
gs_graph = sess.g(oid_type='string', directed=False, generate_eid=False)
gs_graph = gs_graph.add_vertices(vertices_df, label="id", properties=[]).add_edges(edges_df, label="leader-member", src_label="id", dst_label="id", properties=["group_size"])
louvain_contxt = gs.louvain(gs_graph)
result_df = louvain_contxt.to_dataframe(
selector={"id": "v.id", "result": "r"}
)
print(result_df)

bug information

Failed to run command: cmake . -DNETWORKX=ON -DENABLE_JAVA_SDK=OFF -DCMAKE_PREFIX_PATH='/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime;/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/openmpi' -DPROJECT_FRAME=ON, error message is: CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findlz4Alt.cmake:29 (find_package):
By not providing "Findlz4.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "lz4", but
CMake did not find one.

Could not find a package configuration file provided by "lz4" with any of
the following names:

lz4Config.cmake
lz4-config.cmake

Add the installation prefix of "lz4" to CMAKE_PREFIX_PATH or set "lz4_DIR"
to a directory containing one of the above files. If "lz4" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:29 (find_package):
By not providing "Findzstd.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "zstd", but
CMake did not find one.

Could not find a package configuration file provided by "zstd" with any of
the following names:

zstdConfig.cmake
zstd-config.cmake

Add the installation prefix of "zstd" to CMAKE_PREFIX_PATH or set
"zstd_DIR" to a directory containing one of the above files. If "zstd"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findre2Alt.cmake:29 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.

Could not find a package configuration file provided by "re2" with any of
the following names:

re2Config.cmake
re2-config.cmake

Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:153 (add_library):
add_library cannot create imported target "Brotli::brotlicommon" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:157 (add_library):
add_library cannot create imported target "Brotli::brotlienc" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:161 (add_library):
add_library cannot create imported target "Brotli::brotlidec" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

2024-02-18 10:55:32,281 [ERROR][rpc:188]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during RunStep, The traceback is: Traceback (most recent call last):
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/utils.py", line 417, in _compile_on_local
logger.debug(run_command(command, cwd=workdir))
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/utils.py", line 330, in run_command
raise RuntimeError(f"Failed to run command: {args}, err: {err}")
RuntimeError: Failed to run command: cmake . -DNETWORKX=ON -DENABLE_JAVA_SDK=OFF -DCMAKE_PREFIX_PATH='/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime;/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/openmpi' -DPROJECT_FRAME=ON, err: CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findlz4Alt.cmake:29 (find_package):
By not providing "Findlz4.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "lz4", but
CMake did not find one.

Could not find a package configuration file provided by "lz4" with any of
the following names:

lz4Config.cmake
lz4-config.cmake

Add the installation prefix of "lz4" to CMAKE_PREFIX_PATH or set "lz4_DIR"
to a directory containing one of the above files. If "lz4" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:29 (find_package):
By not providing "Findzstd.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "zstd", but
CMake did not find one.

Could not find a package configuration file provided by "zstd" with any of
the following names:

zstdConfig.cmake
zstd-config.cmake

Add the installation prefix of "zstd" to CMAKE_PREFIX_PATH or set
"zstd_DIR" to a directory containing one of the above files. If "zstd"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findre2Alt.cmake:29 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.

Could not find a package configuration file provided by "re2" with any of
the following names:

re2Config.cmake
re2-config.cmake

Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:153 (add_library):
add_library cannot create imported target "Brotli::brotlicommon" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:157 (add_library):
add_library cannot create imported target "Brotli::brotlienc" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindBrotliAlt.cmake:161 (add_library):
add_library cannot create imported target "Brotli::brotlidec" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findlz4Alt.cmake:29 (find_package):
By not providing "Findlz4.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "lz4", but
CMake did not find one.

Could not find a package configuration file provided by "lz4" with any of
the following names:

lz4Config.cmake
lz4-config.cmake

Add the installation prefix of "lz4" to CMAKE_PREFIX_PATH or set "lz4_DIR"
to a directory containing one of the above files. If "lz4" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:29 (find_package):
By not providing "Findzstd.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "zstd", but
CMake did not find one.

Could not find a package configuration file provided by "zstd" with any of
the following names:

zstdConfig.cmake
zstd-config.cmake

Add the installation prefix of "zstd" to CMAKE_PREFIX_PATH or set
"zstd_DIR" to a directory containing one of the above files. If "zstd"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:132 (add_library):
add_library cannot create imported target "zstd::libzstd_shared" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findre2Alt.cmake:29 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.

Could not find a package configuration file provided by "re2" with any of
the following names:

re2Config.cmake
re2-config.cmake

Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findutf8proc.cmake:114 (add_library):
add_library cannot create imported target "utf8proc::utf8proc" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/servicer/graphscope_one/service.py", line 245, in _RunStep
head, bodies = self._operation_executor.run_on_analytical_engine(
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/monitor.py", line 191, in runOnAnalyticalEngineWarp
res = func(instance, dag_def, dag_bodies, loader_op_bodies)
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 176, in run_on_analytical_engine
dag_def, dag_bodies = self.pre_process(dag_def, dag_bodies, loader_op_bodies)
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 168, in pre_process
op = self._maybe_register_graph(op)
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 293, in _maybe_register_graph
compiled_path = self._compile_lib_and_distribute(
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 409, in _compile_lib_and_distribute
lib_path, java_jar_path, java_ffi_path, app_type = compile_func(
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/utils.py", line 681, in compile_graph_frame
lib_path = compile_library(commands, library_dir, library_name, launcher)
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/utils.py", line 371, in compile_library
return _compile_on_local(commands, workdir, output_name)
File "/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/gscoordinator/utils.py", line 424, in _compile_on_local
raise CompilationError(
graphscope.framework.errors.CompilationError: Failed to compile 9170236ae051c913cc0197c0b09970571cb88a9327d305444ed0c62800ff73fd on platform system: Linux
machine: x86_64
platform: Linux-5.15.0-94-generic-x86_64-with-glibc2.17
uname: uname_result(system='Linux', node='yangyugang-virtual-machine', release='5.15.0-94-generic', version='#10420.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024', machine='x86_64', processor='x86_64')
kernel_ver: #104
20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0\nCopyright (C) 2019 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.13

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findlz4Alt.cmake:29 (find_package):
By not providing "Findlz4.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "lz4", but
CMake did not find one.

Could not find a package configuration file provided by "lz4" with any of
the following names:

lz4Config.cmake
lz4-config.cmake

Add the installation prefix of "lz4" to CMAKE_PREFIX_PATH or set "lz4_DIR"
to a directory containing one of the above files. If "lz4" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:29 (find_package):
By not providing "Findzstd.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "zstd", but
CMake did not find one.

Could not find a package configuration file provided by "zstd" with any of
the following names:

zstdConfig.cmake
zstd-config.cmake

Add the installation prefix of "zstd" to CMAKE_PREFIX_PATH or set
"zstd_DIR" to a directory containing one of the above files. If "zstd"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/FindzstdAlt.cmake:132 (add_library):
add_library cannot create imported target "zstd::libzstd_shared" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findre2Alt.cmake:29 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.

Could not find a package configuration file provided by "re2" with any of
the following names:

re2Config.cmake
re2-config.cmake

Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

CMake Error at /usr/lib/x86_64-linux-gnu/cmake/Arrow/Findutf8proc.cmake:114 (add_library):
add_library cannot create imported target "utf8proc::utf8proc" because
another target with the same name already exists.
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:109 (find_dependency)
/usr/lib/x86_64-linux-gnu/cmake/Arrow/ArrowConfig.cmake:132 (arrow_find_dependencies)
/home/yangyugang/anaconda3/envs/graphscope_env/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:386 (find_package)
CMakeLists.txt:242 (include)

Copy link

welcome bot commented Feb 8, 2024

Thanks for opening your first issue here! Be sure to follow the issue template! And a maintainer will get back to you shortly!
Please feel free to contact us on DingTalk, WeChat account(graphscope) or Slack. We are happy to answer your questions responsively.

@yyg192 yyg192 changed the title [BUG] Failed to compile when running builtin algorithm 【Bug】The built-in Louvain algorithm can only run on graphs where the node IDs (vid) are integers Feb 18, 2024
@yyg192 yyg192 changed the title 【Bug】The built-in Louvain algorithm can only run on graphs where the node IDs (vid) are integers 【Bug】The built-in Louvain algorithm can only run on graphs where the OID are integers Feb 19, 2024
@siyuan0322
Copy link
Collaborator

Perhaps the int version is shipped with precompiled library, but the string version needs compilation on the fly. But the cmake has some error. What's the arrow version, and how do u installed that?

@yyg192
Copy link
Author

yyg192 commented Feb 21, 2024

Perhaps the int version is shipped with precompiled library, but the string version needs compilation on the fly. But the cmake has some error. What's the arrow version, and how do u installed that?

Thank's for your response

  1. My arrow version is 1.3.0
  2. I installed graphscope version 0.26.0 using "pip install graphscope==0.26.0".

@siyuan0322
Copy link
Collaborator

1.3 有点太低了,现在已经 15.0 了 😿 能否升级一下呢,至少是6以上我记得

@yyg192
Copy link
Author

yyg192 commented Feb 21, 2024

1.3 有点太低了,现在已经 15.0 了 😿 能否升级一下呢,至少是6以上我记得

My arrow version is 1.3.0 and pyarrow version is 15.0.0. It seems that both of them are almost the latest versions.
我的arrow版本是1.3.0,pyarrow版本是15.0.0. 似乎这两个都几乎是最新版本了

@siyuan0322
Copy link
Collaborator

1.3 怎么会是最新的呢。如何安装的 c++ 的 arrow

@yyg192
Copy link
Author

yyg192 commented Feb 21, 2024

1.3 怎么会是最新的呢。如何安装的 c++ 的 arrow
My problem has just been resolved. The issue was due to a high version of pyarrow. I downgraded the pyarrow version from 15.0 to 14.0.1, and magically the problem was resolved.
我的问题刚刚得到了解决,原因是pyarrow版本太高了,我把pyarrow版本从15.0降低到14.0.1,这个问题就神奇的解决了。

@yyg192
Copy link
Author

yyg192 commented Feb 21, 2024

1.3 怎么会是最新的呢。如何安装的 c++ 的 arrow
还有我不是很理解您说的C++的arrow是什么?我是单机下安装的,所有安装步骤都是按照官方文档所述,仅通过一句pip install graphscope就把整个相关依赖都安装好了。

@siyuan0322
Copy link
Collaborator

我的问题刚刚得到了解决,原因是pyarrow版本太高了,我把pyarrow版本从15.0降低到14.0.1,这个问题就神奇的解决了

哦哦,好的,我们也尝试用 pyarrow 15 试一下看看

@yyg192
Copy link
Author

yyg192 commented Feb 21, 2024

我的问题刚刚得到了解决,原因是pyarrow版本太高了,我把pyarrow版本从15.0降低到14.0.1,这个问题就神奇的解决了

哦哦,好的,我们也尝试用 pyarrow 15 试一下看看

我发现pyarrow版本可能过高的动机是,你们发布的docker镜像(registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-dev:latest),里面的pyarrow版本是14.0.1,所以我抱着将信将疑的态度尝试了一下,结果很神奇的解决了。

@yyg192 yyg192 closed this as completed Feb 21, 2024
@yyg192
Copy link
Author

yyg192 commented Feb 23, 2024

我的问题刚刚得到了解决,原因是pyarrow版本太高了,我把pyarrow版本从15.0降低到14.0.1,这个问题就神奇的解决了

哦哦,好的,我们也尝试用 pyarrow 15 试一下看看

哥你好,我反馈一下最新问题。

我在vm虚拟机上新装了一个ubuntu20.04,在anaconda环境下用pip install graphscope==0.26.0,然后装了一个jdk11。
发现如果节点的oid是string的话就没办法跑任何的图分析内置算法(例如louvain)。于是乎,我尝试把pyarrow从15.0.0降到14.0.1,然后发现问题神奇的解决了。然后过了两天,我重启了一下自己的虚拟机,重新跑了一遍相同的代码(顶点oid为string的louvain小代码),然后莫名其妙的又报了一开始同样的bug(cmake问题)。我保证我的小代码是没有任何改动的,我也没有在虚拟机上装其它乱七八糟的东西,也没有做任何的改动,我只是单纯的重启虚拟机,重启了之后就莫名其妙的cmake问题了。

然后我重新装了一个ubuntu 22.04。然后在非anaconda环境下,pip install graphscope==0.26.0,然后装了一个jdk11,然后apt-get install cmake==3.22.1。然后问题解决了。

以上是我这周来回倒腾的坑,希望对您有帮助,另外环境问题感觉踩了挺多坑,graphscope项目组可以再多做一些基本测试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants