vineyard v0.1.14

Vineyard v0.1.14 enhance the project operator on graph datastructures.

Commits

• [18e1a1a]: Support general project operator on graph. (#239) (Siyuan Zhang)

vineyard v0.1.13

jemalloc was introduced to libvineyard in release v0.1.13.

Commits

• [18982d5]: Check in artifacthub-repo.yaml. (Tao He)
• [82507be]: Move the chart hosting to aliyun oss. (Tao He)
• [6c82f8f]: Fixes memory alignment for jemalloc. (Tao He)
• [8e45edb]: Jemalloc: record the hooks struct, fixes previous use-after-free bug. (Tao He)
• [4730bfe]: Fixes several typos in docs. (#235) (Tao He)
• [b88d02d]: Hotfixes for #232. (Tao He)
• [09d5b4e]: Install customized cmake scripts during "make install". (#232) (Tao He)
• [b1c0880]: Enable use of jemalloc. (#224) (Tao He)

vineyard v0.1.12

The vineyard v0.1.12 release makes a lot of enhancement to the graph data structure, noteable the add vertices and add edges ability. A shared memory interface has been implemented for python SDK in this release.

Several bugs about metadata, helm, etc. have been fixed along with this release as well.

Commits

• [58b3c1f]: Add edges and vertices to existing graph (#222) (Siyuan Zhang)
• [a749f90]: Fixes a bug about the "image" argument in helm charts. (#225) (Tao He)
• [358eae2]: Reset the signature in deserialization. (#219) (Tao He)
• [1e3ee07]: Improve the docs, add a section about how we distrbute datas. (#218) (Tao He)
• [d70ee97]: Implements a shared_memory.{SharedMemory, ShareableList} interface on vineyard (#217) (Tao He)
• [1bbfacc]: Implements create/get blob over RPC client from remote. (#215) (Tao He)
• [b03412e]: Partitions on certail worker could be empty or null. (#216) (Tao He)
• [7a5b98b]: Use pickle, drop any ref about pa.serialize and pa.py_buffer. (#213) (Tao He)
• [57551ea]: Fixes arrow 0.17 compatiblity. (#214) (Tao He)
• [804ca53]: Force vineyard-io as a platlib, but with a universal tag. (#211) (Tao He)

vineyard v0.1.11

vineyard v0.1.11 fixes a bug in deleting remote objects, and improve the performance of deleting local objects a lot.

Migration of streams has been supported, and the ossfs support also got improved.

Commits

• [57869fa]: Add the Dockerfile for vineyardd alpine builder. (#210) (Tao He)
• [cb217bd]: Add a ObjectName type to indicate a str is a vineyard object. (#208) (Tao He)
• [570e791]: Optimize the performance of delete: avoid sync meta when deleting local objects. (#207) (Tao He)
• [09f066e]: Revise the behaviour of deleting objects, especially deleting remote objects. (#204) (Tao He)
• [35eef7d]: Add the "Join in the Slack channel" link. (Tao He)
• [de712d2]: More feature and tests for ossfs (#202) (Siyuan Zhang)
• [882e8fc]: Add a roadmap documentation. (Tao He)
• [74cce38]: Fixes signature marker and metadata reconstruct during migration. (#201) (Tao He)
• [450c10d]: Fixes a typo in READM. (Tao He)
• [09c337f]: Encapsulate platform/system related resolution into a env.h. (#198) (Tao He)
• [9b84e24]: Loading graph from global dataframe chunks. (#197) (Tao He)
• [e85833d]: Migration of stream: add a proc to read from one vineyardd and write to another instance (#196) (Diwen Zhu)
• [7249860]: Helm: avoid conflicit on hostpath directories. (Tao He)
• [1952ed5]: Support use externally installed etcd-cpp-apiv3. (#194) (Tao He)

vineyard v0.1.10

A bug in vineyardd has been fixed in this release, and we also have made a lot improvement for the io drivers.

Commits

• [9684b89]: Fixes persist error when the same object is refered multiple times in members. (#193) (Tao He)
• [96f2fbe]: Fixes the auto registry discovery. (#192) (Tao He)
• [8c0d3ea]: Store exception information in drivers (#190) (Siyuan Zhang)
• [1b5951c]: Fixes the distributed test case. (Tao He)
• [abc9c83]: Remove unnecessary import action (#191) (Zarca)

vineyard v0.1.9

Vineyard v0.1.9 improves the user experiences a lot.

• The vineyard-io package becomes stable since v0.1.9, which will registery necessary I/O drivers automatically.
• We have improved the platform compatibility a lot since this release.
• A .id property has been added to the BlobWriter.
• The vineyardd binary are bundled into the wheel packages and fixed a long-standing issue (#165)
• We also add a vineyard.deploy.kubernetes module for preliminary support to launch vineyard in a kubernetes cluster.

Vineyard v0.1.9 also enables the feature of object migration. It is still in experiment stage and will be improved in the next release cycle.

Commits

• [fc70863]: Include vineyardd into wheels. (#188) (Tao He)
• [1928814]: Expose object id for BlobWriter before sealing. (#187) (Tao He)
• [56c2cd2]: Force install grpc@1.33.2. (Tao He)
• [66027a7]: Remove Aliyun OSS CPP SDK related dependencies and codes. (#185) (Siyuan Zhang)
• [d5de1d5]: Add interface to deploy vineyard to kubernetes using python SDK. (#147, #174) (Diwen Zhu)
• [a751c75]: Object migration, and add a test for that API. (#183) (Tao He)
• [253accd]: Enable compatibility build on Ubuntu 18.04 and MacOS. (#181) (Tao He)
• [38a6a59]: Packaging IO driver registry to vineyard-io package, and revise the initialization process. (#175) (Tao He)

vineyard v0.1.8

Vineyard v0.1.8 supports a "signature" on objects, and refine the global object to disallow nested global objects. Vineyard v0.1.8 supports two new methods: vineyard.io.{serialize,deserialize} for serializing objects to extern storage and restore it back to vineyard, and release a python package vineyard-io for registering IO drivers into default context.

Vineyard v0.1.8 fixes a bug about unnecessary dependency on libgrape-lite from vineyard_basic.

Vineyard won't support Python 3.5 any longer since v0.1.8.

And thanks Rayan for fixing a wrong link in our documentation.

Commits

• [4eda77a]: Don't requires grapelite in vineyard_basic. (#167) (Tao He)
• [a5ebc44]: Add serialize and deserialize methods for objects. (#164) (Siyuan Zhang)
• [053fb41]: Drop python 3.5 support. (#163) (Tao He)
• [55b6df8]: fix missing link of boost-leaf (#162) (Rayan)
• [259b507]: Implements object signature, and limits GlobalObject's capability to disable nest. (#139) (Tao He)

vineyard v0.1.7

This is a minor release which only includes some bugfixes.

Commits

• [724bd2d]: Support streams to pull/get empty chunks. (#158) (Tao He)
• [c38ea47]: Fixes loading from streams when no chunk in some workers. (#159) (Tao He)
• [e78243e]: The header files generated contains attributes defined by vineyard. When an application includes them, "unknown attribute" warnings are issued during compilation. (#148) (zhiminch)
• [0d959c5]: Support read_vineyard_dataframe with ObjectID. (#149) (Tao He)

vineyard v0.1.6

vineyard v0.1.6 has greatly improved the compatibility with the Python ecosystem, including numpy, pandas, scipy and the mars project. This version also improves the semantic of vineyard stream to guarantee a stream can only be opened by producers once, as well as by consumers.

vineyard v0.1.6 replaces the old vineyard.io.open implementation by levaraging the standarized interface of filesystem-spec, making more I/O sources and sinks could be supported by vineyard.

Commits

• [4a9f81f]: Refactor file system API to adapt to filesystem-spec, and enhance OSS support(#142) (Siyuan Zhang)
• [02fe89a,4b0a086]: Kubernetes related docs in README.md. (#146) (Tao He)
• [ba75781]: Helm integration of vineyard. (#145) (Tao He)
• [329360d]: Add CNCF community related documents (#144) (Diwen Zhu)
• [1ceb4ad]: Fixes the behaviour of recursively delete. (#143) (Tao He)
• [b4eacb1]: Improves python compatible (with numpy, pandas, scipy, etc.) for tensors, dataframes and sparse tensors (#137) (Tao He)
• [b80529a]: Markstream to enable 1-producer-1-consumer on server side (#138) (Diwen Zhu)
• [a783e86]: Add distributed test cases, and fixes a bug in persist. (#134) (Tao He)
• [b2e3c4b]: Implement version validate: raise an warning if not compatible. (#132) (Tao He)

vineyard v0.1.5

Vineyard v0.1.5 replaces boost/property_tree with nlohmann/json for better performance and JSON conformance. This release also improves compatibility with pandas, especially the pd.DataFrame, as well as older version of etcd.

Older version of MacOS may suffer Reference not found: _aligned_alloc exception whenimport vineyard in python, which has been fixed in this release, please upgrade your vineyard installation by

pip3 install -U vineyard

To use vineyard v0.1.5, make sure your server version is also v0.1.5, which can be obtained from dockerhub or qury.io.

Commits

• [d1a4f00]: Find dependencies in vineyard-config.cmake, and drop a debug log. (Tao He)
• [609f59c]: Fixes MACOSX_DEPLOYMENT_TARGET and static build for mac. (#131) (Tao He)
• [2883fd4]: Allow DataFrame's columns names to be arbitary value that can be jsonified (#129) (Tao He)
• [60ab766]: Conform the max-txn-ops requirement of etcd. (#126) (Tao He)
• [4fdf5e9]: Replacing ptree with nlohmann-json. (#116) (Tao He)
• [4e7f4e2]: Fallback to picke when serializing pandas sparse data structures (#119) (Weibin Zeng)
• [db40550]: Implements builder and resolver for pandas.Series type (#118) (Weibin Zeng)
• [d87643c]: Support "index" field of dataframe (#110) (Weibin Zeng)
• [3f8a69c]: Fixes compatiblity bug for pandas 1.2.0. (#115) (Tao He)
• [a40180d]: Merge subtrees when persist. (#108) (Siyuan Zhang)