vineyard v0.3.3

Vineyard v0.3.3 is a bugfix release to supress errors on various platforms, e.g., MacOS built pypi wheels.

Vineyard v0.3.3 also brings experimental support for fuse.

Commits

• [b2ddbc6]: Fixes the : in LC_RPATH on Mac. (#562) (Tao He)
• [d103dbd]: Fixes backwards compatible with lower-version of apache-arrow. (#561) (Tao He)
• [0135c99]: Add more helpers in arrow utils. (#559) (Tao He)
• [5e912b1]: Enhance the assertion on typename for better error message. (#558) (Tao He)
• [5518147]: Fixes the nested namespace TODO in the code generator. (#557) (Tao He)

vineyard v0.3.2

Vineyard v0.3.2 has the following improvements:

1. relax the list_object() to allow vineyard::Blob been listed
2. implments a new API on client to check if given address is inside the shared memory segments.
3. enable experimental support for fuse, i.e., open vineyard objects as a file.

Commits

• [aa40322]: Add preliminary support for fuse on vineyard objects. (#553) (Tao He)
• [fa8089c]: Implements the API to check if a blob is inside the shared memory region. (#552) (Tao He)
• [2541bf9]: Disable the not-enough-shared-memory warnings on Mac. (#551) (Tao He)
• [f7482ca]: Reduce code duplication about how to view dataframe as a recordbatch. (#550) (Tao He)
• [74dc784]: Only create new ovg2l and ovgid if necessary. (#549) (Siyuan Zhang)
• [f842823]: Add an cmake option to control usage of asan. (#547) (Tao He)
• [646658e]: Enable lists "vineyard::Blob" in client.list_objects(). (#546) (Tao He)

vineyard v0.3.1

Vineyard v0.3.1 is a bugfix release, fixing the issues during launching vineyardd instance using python3 -m vineyard.deploy.

Commits

• [95db4c3]: Use os.execvp on Unix to make sure child process received signals correctly. (#543) (Tao He)

vineyard v0.3.0

Vineyard v0.3.0 resolves the ABI conflict issue when multiple python package depends on vineyard (i.e., libvineyard_client.so) at the same time.

Now the vineyard registry becomes a shared library, and will be loaded at runtime using dlopen when needed.

Commits

• [7206d33]: Refine the getenv related code to make it more clear and more efficient. (#540) (Tao He)
• [f168e3e]: Update GetEdgeNum API of ArrowFragment (#531) (Weibin Zeng)
• [ec42175]: Fixes resolving pd.DataFrame that has nested columns value. (#539) (Tao He)
• [8760c07]: Local metaservice to deploy as a single instance to avoid requiring etcd (#535) (Tao He)
• [ca85535]: Fixes bug for functional struct with clang on Mac. (#537) (Tao He)
• [a6235d0]: Update array module in Rust SDK (#534) (Sijie)
• [b57708d]: Fixes for conditions of link againist glog to vineyard_client. (Tao He)
• [5ff1e2a]: Fixes artifacts building on Mac and Linux. (Tao He)

vineyard v0.2.13

Bump up vineyard version to v0.2.13.

Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>

vineyard v0.2.12

Vineyard v0.2.12 is a bugfix release.

Commits

• [9b70e8a]: Refactored edge loader (#509) (Siyuan Zhang)

vineyard v0.2.11

Vineyard v0.2.11 is a bugfix release,

• fixes a syntax error in hash partitioner for folly::dynamic.
• fixes a compatibility bug with apache-arrow 5.0.

Commits

• [7968057]: Workaround for bug from apache-arrow 5.0 in FixedSizeBinaryBuilder. (#510) (Tao He)
• [19757b1]: Adds autocomplete functionality to vineyard-ctl (#508) (Rohan Gupta)
• [8a3563d]: Fixes the invalid syntax in HashPartitioner for folly::Dynamic oids (#507) (Weibin Zeng)
• [704a156]: Fixes the wheel name pattern for airflow-provider-vineyard. (Tao He)

vineyard v0.2.10

Vineyard v0.2.10 is a minor version, where,

1. a vineyard.init() and vineyard.shutdown() interface has been added to launch vineyard in eaiser way
2. a bug in dataframe builder has been fixed to ensure zero-copy and reusing chunks.

Commits

• [d492bc0]: Update dynamic hash partitioner (#506) (Weibin Zeng)
• [2b1cb09]: Update modules in client/ds and add singleton for Rust SDK (#502) (Sijie)
• [fed7981]: Reusing alreay-in-vineyard columns by inspecting blocks of dataframe. (#504) (Tao He)
• [4fc9247]: Fixes the missing header. (#500) (Tao He)
• [3f88a0b]: Fixes usage of start_vineyardd, formatting, and docs. (#499) (Tao He)
• [c20b406]: Add the pair of init() and shutdown() methods to help new users to deploy vineyardd easily (#498) (Diwen Zhu)
• [d6eb1b1]: Adds start command to vineyard-ctl (#497) (Rohan Gupta)
• [f09c028]: Make the distributed learning example runnable on a single machine (#495) (Diwen Zhu)
• [c8dc6cb]: Airflow: unitest, and support easier launching of vineyard server. (#494) (Tao He)

vineyard v0.2.9

Commits

• [75f0877]: Upgrade to vineyard v0.2.9 for bug fixes. (Tao He)
• [0e242c8]: Add a vineyard exception class in Python. (#493) (Tao He)
• [5e2125a]: Enable constexpr PRETTY_FUNCTION only for gcc >= 9.1.0. (#492) (Tao He)
• [2062fe3]: Adds memory_status option to query command in vineyard-ctl (#476) (Rohan Gupta)
• [f941ef7]: Update Rust SDK object_meta module (#478) (Sijie)
• [5218f24]: Upload more wheels to the tagged release. (#490) (Tao He)

vineyard v0.2.8

Vineyard v0.2.8 is a bugfix release.

Commits

• [94c5e54]: Update title markup. (Tao He)
• [534a1d8]: Add a notebook of a distributed learning example (#487) (Diwen Zhu)
• [b50106e]: Typename: compatible with higher version of GCC. (#486) (Tao He)
• [d88d31e]: Support injecting extra metadata in existing objects via a shallow copy. (#482) (Tao He)
• [d2d166a]: Support adding metadata with __setitem__ operator on ObjectMeta. (#480) (Tao He)
• [0856074]: Vineyard IO: raise exceptions when encounter errors in writers (in its join). (#481) (Tao He)
• [bf41f8b]: Fixes a crash when adding invalid metadata. (#479) (Tao He)
• [ae9afba]: Fixes the use-after-free bug for string-view in the oid array. (#475) (Tao He)
• [c4d8b90]: Add tree command in vineyard-ctl to output object lineage in tree-like style (#474) (Rohan Gupta)
• [3a8fb19]: Revisit the implementation of typename: more customizable and stable. (#472) (Tao He)
• [9f6d1ae]: Adds debug command to vineyard-ctl (#473) (Rohan Gupta)
• [9aed745]: Git attributes: assoicate .vineyard-mod to C++. (Tao He)
• [10a730e]: Ray dataset: from and to vineyard. (#470) (Tao He)
• [25f15d1]: Move the newly added item to the end of the enum. (#468) (Tao He)
• [7e1c672]: Adds DeepCopy function to vineyard and Python SDK and adds it to vineyard-ctl (#467) (Rohan Gupta)
• [f675381]: Update init.py to import VineyardXCom (#466) (andtheysay)
• [28856ae]: Add data structure date32 and date64 in C++ SDK (#439) (beiluo)
• [c0cf8ba]: Add more metrics for prometheus (#465) (Jiang Shanshan)
• [3de4b98]: Use a lock to protect the mutable write buffer queue. (#464) (Tao He)
• [3f7257a]: Add write table method to i_io_adaptor (#462) (Siyuan Zhang)
• [625b7d3]: Added MXNet Builders, Resolvers and Tests (#452) (Chaitravi Chalke)
• [3d842f4]: Vineyard tests: format & lint. (#461) (Tao He)
• [9ad80c6]: Add connect put/get/drop_name functions and tests for Rust. (#460) (Sijie)
• [73074f5]: Update Dask Doc (#458) (Diwen Zhu)
• [4b70931]: Feed a hand-written copy-ctor and copy-assignment to ObjectMeta. (#456) (Tao He)