Release v0.12.0
The GraphScope v0.12.0 release is a major update on many aspects of the project including backend engines, APIs, and system stability. It introduces an intermediate representation (IR) layer into the graph interactive engine (GIE) GAIA, to decouple query languages from query execution engines. Meanwhile, this release supports Giraph APIs to allow Giraph apps running on the Graph Analytics Engine (GAE) of GraphScope.
We highlight the following improvements included in this release:
1. Introduce IR layer into GAIA:
- A completely redesigned IR layer to decouple the query language dependency, and further for query optimizations.
- Define the supported Gremlin's grammar via Antlr.
- Support
match
step in Gremlin, for graph pattern matching.
2. Add Giraph APIs to GAE:
- Support to load graphs with Giraph Formats, e.g.,
graph = sess.load_from(vertices="p2p-31.v", vformat="giraph:com.example.vformat",edges="p2p-31.e", eformat="giraph:com.example.vformat")
- Support Giraph APIs on GraphScope, and all algorithms implemented towards the original Giraph APIs can run on GraphScope without modifications. For example, to load Giraph app SSSP, users can just invoke
giraph_sssp = load_app(algo="giraph:com.alibaba.graphscope.example.giraph.SSSP")
- Users now can add jars by
sess.add_lib
interface.
3. Bug Fixes or other enhancements:
- Correct the lifecycle management of loaded graphs within a session.
- Make the graphlearn and tensorflow related logs more user-friendly.
- Fix
readwrite
failed on GraphScope Networkx module. - Enable to connect to the existed ETCD cluster in GraphScope.
- Support to launch GraphScope on K8s from an inner-pod environment.
Docker Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope:0.12.0
Commits
- [b0a0900]: Support launch GraphScope on K8s from inner-pod environment (#1434) (DongZe Li)
- [9e4e47f]: Add offline deployment doc for Helm (#1433) (DongZe Li)
- [4779315]: Migrate cargo rocksdb dependency to 0.18.0 version (#1430) (Zichao Zhang)
- [2e74e3c]: Split the builtin application distribution to 'gs-apps' package (#1429) (DongZe Li)
- [47b0d42]: Support string tensor for tensor context (#1425) (Weibin Zeng)
- [1068628]: Upgrade the version of databind, fixes the dependent bot warnings. (#1424) (Tao He)
- [ab77481]: Upgrade the required black version. (#1422) (Tao He)
- [92c4b15]: Attempt backoff and retry during handle GRPC error (#1421) (DongZe Li)
- [2de6b7e]: Bump commons-io from 2.6 to 2.7 in /research/query_service/ir/compiler (#1417) (dependabot[bot])
- [edb2493]: Retry 3 times and then report failure during HeartBeat process (#1419) (DongZe Li)
- [93ef1b5]: Try to fixes nightly CI on macOS by packaging 'string_view' into wheel package (#1420) (DongZe Li)
- [9d2c1e7]: Bump jackson-databind from 2.11.1 to 2.13.2.1 in /interactive_engine (#1415) (dependabot[bot])
- [64c77c1]: Add networkx tutorial and fixed vineyard version (#1412) (DongZe Li)
- [27400d1]: Bump protobuf-java in /research/query_service/ir/compiler (#1416) (dependabot[bot])
- [7d2f92c]: Introducing IR query service (#1407) (BingqingLyu)
- [88e7670]: [BugFix] Fix analytical engine can't not compile with NETWORKX=OFF (#1410) (Weibin Zeng)
- [ed6546d]: Push if condition down to steps to allow it be checkable. (#1404) (Tao He)
- [07cb0df]: Remove unused dependencies (#1403) (Zhang Lei)
- [bf69985]: Fix networkx forward nightly ci (#1387) (Weibin Zeng)
- [0191dd6]: Add dummy CI worflows to allow all status checkable. (#1402) (Tao He)
- [f5928a3]: Giraph on GraphScope implementation (#1386) (Zhang Lei)
- [e851014]: Merge lastest version of pegasus (#1376) (Neng Li)
- [0bf6686]: Upgrade vineyard to v0.3.21. (#1389) (Tao He)
- [3b520ca]: Remove gaia from GraphScope for code refactor (#1388) (shirly121)
- [91f4248]: Add role and rolebinding for graphscope charts (#1382) (DongZe Li)
- [c921cd6]: Try to upgrade tinkerpop version to 3.5.1 in maxgraph (#1349) (shirly121)
- [a314bbb]: Revert "Giraph on GraphScope (#1362)" (#1385) (Tao He)
- [c3903d5]: Refactor
DynamicFragment
withCSREdgecutFragmentBase
andMutableCSR
(#1328) (Weibin Zeng) - [0a9cda9]: Bump protobuf-java from 3.18.0 to 3.18.2 in /interactive_engine (#1381) (dependabot[bot])
- [83ebed5]: Upgrade proto to 3.18.0 && grpc to 1.42.1 (#1149) (shirly121)
- [ee81be7]: Bump zookeeper from 3.4.5 to 3.4.14 in /analytical_engine/java (#1372) (dependabot[bot])
- [1dbc373]: Giraph on GraphScope (#1362) (Zhang Lei)
- [4d8390a]: Disable noisy log inside gremlin-python, and fixes the hard-coded DEBUG. (#1368) (Tao He)
- [2c56d49]: Enable to connect to the existed ETCD cluster in GraphScope (#1359) (wuyueandrew)
- [5ea7c0d]: [Bug fix] Fix readwrite test failed on graphscope.nx (#1365) (Weibin Zeng)
- [c72da15]: Makes the graphlearn- and tf- related logs looks better. (#1367) (Tao He)
- [9d95f32]: Frontend async rpc (#1357) (tianliplus)
- [b61457c]: Upgrade version of formatter (#1363) (Siyuan Zhang)
- [79904fc]: Correct the lifecycle of graph with session (#1361) (DongZe Li)
- [9f29a7b]: Catch unknown exceptions in gRPC handlers. (#1358) (Tao He)
- [cf4284e]: Also tag latest when release new version (#1360) (Siyuan Zhang)
- [8a81ea2]: The GAIA ci should be disable months ago. (#1356) (Tao He)
- [e4040db]: It doesn't make sense to trigger those CI actions on forks. (#1354) (Tao He)
- [4f2a2e6]: Add an env
USE_GAIA_ENGINE
to allow testing gaia from Python client. (#1348) (Tao He)