-
Notifications
You must be signed in to change notification settings - Fork 584
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The dimension of my data is (269, 768). The build process was failed, with no errors returned. #10
Comments
puluwen
changed the title
The dimension of my data is (269, 768). The build process was failed, but no errors returned.
The dimension of my data is (269, 768). The build process was failed, with no errors returned.
Apr 17, 2019
It seems it failed in the build stage. Do you use float64 type? We currently only support float32 data type. |
Thanks. After some tests, I found this problem. I forced the input to numpy. float32, and it works. |
MaggieQi
added a commit
that referenced
this issue
Aug 9, 2019
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering
MaggieQi
added a commit
that referenced
this issue
Aug 9, 2019
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug
MaggieQi
added a commit
that referenced
this issue
Aug 20, 2019
… Reader (#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue
MaggieQi
added a commit
that referenced
this issue
Aug 21, 2019
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (#15) * fix maxcluster is -1 bug (#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues
MaggieQi
added a commit
that referenced
this issue
Aug 27, 2019
…ts.txt bug (#98) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (#15) * fix maxcluster is -1 bug (#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues * fix files in VectorSetReaders directory are not included in CMakeLists.txt bug * remove VectorSetReaders from indexbuilder * add copy right
MaggieQi
added a commit
that referenced
this issue
Dec 10, 2019
…efine iteration issue (#105) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (#15) * fix maxcluster is -1 bug (#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (#91) (#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (#85) (#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (#71) (#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues * fix files in VectorSetReaders directory are not included in CMakeLists.txt bug * remove VectorSetReaders from indexbuilder * add copy right * fix refine iterations usage * try to fix hash table size issue * try to use maxCheckForRefineGraph in the build stage * use maxcheckforrefinegraph * enlarge nodecheckstatus hash table size * fix pool size * try to fix FineGrainedLock * fix FineGrainLock concurrent issue * try to fix add meta concurrent issue * move AddIndex to each algorithm * avoid write lock in the FineGrainLock * optimize the insertneighbor performance * fix hashtable size issue * try to remove finegrained lock * remove finegrainlock and fix insertneighbors * fix CLR and Core Wrapper * remove add log * try to mergeindex in parallel add mode * remove parallel add * add parallel add * try to make it parallel * fix pool size * support rebuild tree in the backend * add background rebuild tree thread * add buildmetaindex support for addindex operation * fix some implementations * fix rebuild and search delete issues * fix refine for BKT * fix add rebuild tree job * fix compile issue in azure pipeline * enable AVX2 in Linux * change avx to sse * try to fix aligned_malloc * avx support check * add linux avx support flag * avoid exec jobs after destroy * fix all delete and then insert error * fix print percentage overflow * try to fix graph save issue and delete performance issue * Add RefineIndex to a newIndex and fix RefineIndex bugs * fix Dataset Refine must return a value issue * try to use one thread for tree rebuild * try to use one thread for tree rebuild * fix different compiler issue * fix BOOST_CHECK cannot be used in multi thread issue * fix set num of threads in the child thread issue * fix m_workspacepool init problem * change the swap interface to rebuild and remove the lock in the labelset * rename m_deleted in labelset to m_inserted
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
… Reader (microsoft#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
* remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (microsoft#15) * fix maxcluster is -1 bug (microsoft#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (microsoft#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
…ts.txt bug (microsoft#98) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (microsoft#15) * fix maxcluster is -1 bug (microsoft#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (microsoft#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues * fix files in VectorSetReaders directory are not included in CMakeLists.txt bug * remove VectorSetReaders from indexbuilder * add copy right
t-phada
pushed a commit
to t-phada/SPTAG
that referenced
this issue
Aug 19, 2020
…efine iteration issue (microsoft#105) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * remove spaces and fix newCount is zero issue * Merge from microsoft.SPTAG (microsoft#15) * fix maxcluster is -1 bug (microsoft#91) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix some type definition in the Reader and add more support to create Reader (microsoft#93) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * fix Reader type definition and add more support * fix maxcluster is -1 bug (microsoft#91) (microsoft#14) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * update fresh ANN implementation (microsoft#85) (microsoft#12) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * remove the tbb dependency (microsoft#71) (microsoft#10) * remove dup code * Update Readme.md * Fix DataSet GNU compile fail bug * fix GNU Windows align alloc bugs * add copyright in each file * fix copy right in dataset * change kdt distance judgement * change code structure and add more wrappers * Update docs * fix search result * change IndexBuilder to support binary input data * temp remove java related projects * remove javaclient and javacore from the windows build * Fix SetData issue * Add vector record count and dimension for reuse and debug * change default parameter definition * add uint8 support * small fix for cosine distance of uint8 * fix AVX distance calculation epu8 * update readme * Update DistanceUtils.h * fix python wrapper cannot load larger than 4G memory error * try to add C# wrapper * fix owner of C# wrapper * add C# cmake support * fix byte array copy * fix tab to space * Try to make shared_ptr<T> as Array template * fix copy * add Parameters documents * remove tbb dependency * fix concurrent_set * fix gcc 5.x cannot support shared_mutex * move concurrentset to Helper folder and change find to contains * Update README.md * try to use shared_lock to replace lock and unlock, try to use block to manage the increased memory * fix filling -1 * fix initialization * change to memset * add CLR CoreInterface for managed dll * try to reserve incBlocks capacity * fix return ErrorCode for AddBatch in Dataset.h * change return type to ErrorCode for AddBatch * fix type definition * change incremental update design * fix all type * fix debug mode memory delete assert * add deletePercentageForRefine judgement * add dump and load from byte array * add dump and load from byte array * fix getNumThreads * fix loadindex and add index bugs * Update AlgoTest to add metamapping test * fix compling error in g++7 * fix largest cluster cannot be split during clustering * fix maxcluster is -1 bug * move threadPool init into DefaultReader * try to move VectorsetReader into CordLibrary * fix bktree cluster split issue * fix merge issues * fix space issues * fix files in VectorSetReaders directory are not included in CMakeLists.txt bug * remove VectorSetReaders from indexbuilder * add copy right * fix refine iterations usage * try to fix hash table size issue * try to use maxCheckForRefineGraph in the build stage * use maxcheckforrefinegraph * enlarge nodecheckstatus hash table size * fix pool size * try to fix FineGrainedLock * fix FineGrainLock concurrent issue * try to fix add meta concurrent issue * move AddIndex to each algorithm * avoid write lock in the FineGrainLock * optimize the insertneighbor performance * fix hashtable size issue * try to remove finegrained lock * remove finegrainlock and fix insertneighbors * fix CLR and Core Wrapper * remove add log * try to mergeindex in parallel add mode * remove parallel add * add parallel add * try to make it parallel * fix pool size * support rebuild tree in the backend * add background rebuild tree thread * add buildmetaindex support for addindex operation * fix some implementations * fix rebuild and search delete issues * fix refine for BKT * fix add rebuild tree job * fix compile issue in azure pipeline * enable AVX2 in Linux * change avx to sse * try to fix aligned_malloc * avx support check * add linux avx support flag * avoid exec jobs after destroy * fix all delete and then insert error * fix print percentage overflow * try to fix graph save issue and delete performance issue * Add RefineIndex to a newIndex and fix RefineIndex bugs * fix Dataset Refine must return a value issue * try to use one thread for tree rebuild * try to use one thread for tree rebuild * fix different compiler issue * fix BOOST_CHECK cannot be used in multi thread issue * fix set num of threads in the child thread issue * fix m_workspacepool init problem * change the swap interface to rebuild and remove the lock in the labelset * rename m_deleted in labelset to m_inserted
PhilipBAdams
added a commit
that referenced
this issue
Jun 9, 2022
* MVP version of Data compress (#1) * Support delta-encoding (#2) * support config of compress level (#3) * integrate zstd with cmake (#4) * Bug Fix: wrong listPageCount when listTotalBytes % pageSize==0 (#5) * train & share dictionary (#6) * rearrange posting list (#7) * config minDictTraingBufferSize and dictBufferCapacity (#8) * cmake with local installed zstd (#9) * refine visual studio config (#10) * parallel for get compressed size (#11) * fix check truth bug (#12) * change zstd branch (#13) * remove verbose log in truth analysis; refine dockerfile * check rvalue in Compressor.h * resolve back compatibility by add a search option: WithDataCompressionFeatures * remove redundant configs, change head info format only when compression enabled * reuse buffer when decompression * remove exit(1) from search index * bug fix: reuse compression buffer in workspace # with '#' will be ignored, and an empty message aborts the commit. * code refine * optimize mem usage * replace vcpkg zstd with nuget * config issue * fix solution build issue Co-authored-by: Philip Adams <35666630+PhilipBAdams@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I used the code in demo.
The main function is :
The error message is:
The text was updated successfully, but these errors were encountered: