Release v0.19.0
We are glad to present the release of GraphScope 0.19.0, which brings a number of new features as well as performance and stability improvements to GraphScope. Specially, users can try GraphScope in python3.10 and python3.11 environments of Linux and MacOS by pip3 install graphscope
; This release also optimizes the memory usage for loading graphs, which allows users to load larger graphs on their machines. In addition, we improve Graph Interactive Engine (GIE) via a couple of bug fixes and improvements.
We highlight the following improvements included in this release:
1. Optimized memory usage for loading graphs:
- Improves memory usage during loading and projecting graphs, especially for graphs with string as OID type.
- Improves the performance of
project_to_simple
.
2. Bug fix and enhancements for GIE:
- Fix a bug in Pegasus that may block the execution of interactive queries in certain case.
- Fix a bug that fails to configure the server number for the GIE engine.
- Fix multiple dependencies in both Java and Rust codes.
- Resolve a issue that JNA could not map bool correctly.
3. Enhancements for GAE Java:
- Pack JNI lib into the grape-runtime jar and fix some dependency issues.
4. Standalone deployment:
- Components now have their own dedicated image, and user could configure a subset of engines to use when launching
session
.
5. Other bug fixes:
- Fix helm deployment could not delete role and rolebindings when uninstalling GraphScope.
- Fix compile error under the newer toolchain and arrow 10
- Rename
maxgraph
tographscope
and other refactors - Cleanup overlapping rust dependencies
Docker Image
# Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.19.0
# Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.19.0
# Graph Analytical Engine(GAE) Image with java SDK, which supports running Giraph and GraphX algorithms on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical-java:0.19.0
# Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.19.0
# Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.19.0
# Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.19.0
# GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.19.0
What's Changed
- Upgrade vineyard to v0.11.0 by @sighingnow in #2260
- [BUG] Fix bug in Pattern Match when project properties by @BingqingLyu in #2257
- [GIE POM] Ignore the poms generated by maven-flatten-plugin in git by @shirly121 in #2272
- Move the theme to furo, and add some markdown examples. by @sighingnow in #2291
- [docs CI] Choose stable/latest tag correctly by fixing the missing
$
in bash script by @sighingnow in #2293 - Don't delete the existing docs, if don't copy. by @sighingnow in #2294
- Pre-release v0.19.0 by @lidongze0629 in #2276
- Make sure reconnect behaves as expected by @sighingnow in #2297
- Add a write options to enable adding header row to OSS output by @sighingnow in #2296
- Support write string ids/context datas to OSS via vineyard by @sighingnow in #2295
- Use a self-hosted public image to avoid reaching the download limits by @sighingnow in #2308
- Enable plug udf cpp pregel algorithm to graphscope. by @siyuan0322 in #2312
- add structure of the next-gen docs. by @yecol in #2315
- Fix return type of cython combine by @siyuan0322 in #2314
- Disable dark theme even the browser is dark by @sighingnow in #2316
- Fixes: it is not a template by @sighingnow in #2318
- fix nightly networkx forward ci by @siyuan0322 in #2319
- Fix outdated vineyard version by @siyuan0322 in #2323
- Fix helm could not delete role and rolebindings when uninstalling GS by @siyuan0322 in #2324
- fix connect session logic and wait for gae ready by @siyuan0322 in #2326
- [GAE-Java] Automatically load
grape_jvm_opt
when create jvm instances through JNI by @zhanglei1949 in #2327 - Fix
grape-demo
shaded dependencies issue by @zhanglei1949 in #2229 - Accept a filetype arguments in loader for reading orc/parquet using prefix by @sighingnow in #2332
- Upgrade the fragment loader to reuse vineyard components by @sighingnow in #2331
- Launch engines with each components inside their own container. by @siyuan0322 in #2247
- Fix kafka version by @siyuan0322 in #2336
- fix nightly CI and remove redundant comments by @siyuan0322 in #2340
- Fixes CI by @lidongze0629 in #2343
- Fix k8s volumes in helm installation and a bug in get_service_endpoint by @siyuan0322 in #2346
- template helm charts before install by @siyuan0322 in #2348
- Use ownerReferences to replace finalizers during helm uninstall by @dashanji in #2350
- Update the CI badge in README. by @sighingnow in #2353
- Fixes compilation errors on Mac with LLVM. by @sighingnow in #2352
- Add docs for data scientists by @doudoubobo in #2339
- Add Java tutorial by @zhanglei1949 in #2320
- [GraphScope/docs]Add basic and featured functionalities by @LiSu in #2335
- Fix compile error under newer toolchain and arrow 10 by @siyuan0322 in #2355
- Add ownerreferences to all subresources created by coordinator by @dashanji in #2356
- Fixes the hangs up issue in Python test by @sighingnow in #2354
- [GAE-Java] Pack JNI lib
libgrape-jni.so
intogrape-runtime.jar
by @zhanglei1949 in #2330 - Fixes the dependentbot warnings in coordinator by @sighingnow in #2363
- Fix GAE v6d test with arrow projected fragment by @songqing in #2345
- Fix missing header files by @songqing in #2360
- Implement ToArrowArrays method for TensorContext by @acezen in #2351
- fix pytest warnings and install necessary plugins by @siyuan0322 in #2338
- fix building learning engine in CXX 17 by @siyuan0322 in #2364
- OpenMPI: bind to none to leverage all cores for when there are 2 processes by @sighingnow in #2365
- rename maxgraph to graphscope and other refactors by @siyuan0322 in #2367
- Some minor improvement in logs and configurations of groot. by @siyuan0322 in #2371
- Documentation enhancement by @yecol in #2358
- Remove pegasus.server.num and use pegasus.hosts by @siyuan0322 in #2372
- Fix images not shown in docs by @doudoubobo in #2373
- Install myst-parser for markdown pages. by @sighingnow in #2374
- [pegasus] fix operator blocking by @lnfjpt in #2347
- [GIE Doc] Add Tutorials for Gremlin Users by @shirly121 in #2369
- upgrade vineyard version to v0.11.4 by @siyuan0322 in #2375
- cleanup overlapping rust dependencies and bump up some to latest version by @siyuan0322 in #2377
- Resolve a issue that JNA could not map bool correctly by @siyuan0322 in #2376
- [GAE-Java] Remove some dummy java dep in gae java by @zhanglei1949 in #2380
- Upgrade graphlearn to latest for Python 3.11 by @sighingnow in #2382
- Optimize the memory usage of certain graphs by @sighingnow in #2381
- Fixes the performance issue in
Project()
by @sighingnow in #2383 - add graphscope executive script
gs
by @siyuan0322 in #2388 - [Benchmark Doc] add gae benchmark results in doc by @BingqingLyu in #2386
- Build wheel package on python3.10 and python3.11 by @lidongze0629 in #2379
New Contributors
Full Changelog: v0.18.0...v0.19.0