Permalink
Browse files

Merge branch upstream 'develop' into feature/jubacore

Conflicts:
	src/regression/regression_factory.cpp
	src/server/anomaly_serv.cpp
	src/server/graph_serv.cpp
	src/server/recommender_serv.cpp
	src/server/stat_serv.hpp
	src/stat/mixable_stat.cpp
	src/stat/mixable_stat_test.cpp
  • Loading branch information...
2 parents 360b5f9 + 0e415d1 commit 3cd1677947b9e4fef7feb301a6d213c551cc362e @suma suma committed Apr 4, 2013
Showing with 2,346 additions and 1,347 deletions.
  1. +5 −1 .gitignore
  2. +233 −0 ChangeLog.rst
  3. +41 −216 README.rst
  4. +14 −10 client/anomaly_client.hpp
  5. +13 −21 client/anomaly_types.hpp
  6. +15 −6 client/classifier_client.hpp
  7. +15 −26 client/classifier_types.hpp
  8. +27 −23 client/graph_client.hpp
  9. +23 −40 client/graph_types.hpp
  10. +19 −15 client/recommender_client.hpp
  11. +14 −22 client/recommender_types.hpp
  12. +15 −6 client/regression_client.hpp
  13. +13 −21 client/regression_types.hpp
  14. +20 −11 client/stat_client.hpp
  15. +9 −14 client/stat_types.hpp
  16. +2 −2 src/anomaly/lof_storage.cpp
  17. +8 −8 src/classifier/arow.cpp
  18. +4 −4 src/classifier/arow.hpp
  19. +5 −5 src/classifier/classifier.hpp
  20. +4 −0 src/classifier/classifier_base.cpp
  21. +2 −0 src/classifier/classifier_base.hpp
  22. +17 −13 src/classifier/classifier_factory.cpp
  23. +16 −5 src/classifier/classifier_test.cpp
  24. +14 −12 src/classifier/{cw.cpp → confidence_weighted.cpp}
  25. +9 −7 src/classifier/{cw.hpp → confidence_weighted.hpp}
  26. +12 −10 src/classifier/{nherd.cpp → normal_herd.cpp}
  27. +7 −7 src/classifier/{nherd.hpp → normal_herd.hpp}
  28. +5 −5 src/classifier/{pa.cpp → passive_aggressive.cpp}
  29. +5 −5 src/classifier/{pa.hpp → passive_aggressive.hpp}
  30. +10 −8 src/classifier/{pa1.cpp → passive_aggressive_1.cpp}
  31. +9 −7 src/classifier/{pa1.hpp → passive_aggressive_1.hpp}
  32. +11 −8 src/classifier/{pa2.cpp → passive_aggressive_2.cpp}
  33. +9 −7 src/classifier/{pa2.hpp → passive_aggressive_2.hpp}
  34. +5 −5 src/classifier/wscript
  35. +9 −8 src/cmd/jubactl.cpp
  36. +0 −45 src/common/config_util.hpp
  37. +0 −66 src/common/config_util_test.cpp
  38. +3 −3 src/common/key_manager.cpp
  39. +0 −1 src/common/mprpc/exception.hpp
  40. +112 −14 src/common/mprpc/rpc_client_test.cpp
  41. +135 −0 src/common/mprpc/rpc_util.hpp
  42. +3 −0 src/common/network.cpp
  43. +0 −59 src/common/rpc_util.hpp
  44. +2 −0 src/common/util.cpp
  45. +0 −2 src/common/wscript
  46. +0 −1 src/core/diffv.hpp
  47. +3 −0 src/core/linear_function_mixer_test.cpp
  48. +1 −0 src/core/mixable_weight_manager.cpp
  49. +0 −1 src/framework.hpp
  50. +6 −1 src/framework/keeper.cpp
  51. +19 −12 src/framework/keeper.hpp
  52. +2 −0 src/framework/server_helper.cpp
  53. +2 −0 src/framework/server_helper.hpp
  54. +5 −1 src/framework/server_util.cpp
  55. +2 −0 src/framework/server_util.hpp
  56. +18 −8 src/fv_converter/converter_config.cpp
  57. +10 −15 src/fv_converter/converter_config.hpp
  58. +4 −1 src/fv_converter/converter_config_test.cpp
  59. +1 −1 src/fv_converter/counter.hpp
  60. +46 −0 src/fv_converter/except_match.hpp
  61. +14 −15 src/{common/config_util.cpp → fv_converter/except_match_test.cpp}
  62. +1 −1 src/fv_converter/keyword_weights.cpp
  63. +1 −1 src/fv_converter/revert.cpp
  64. +16 −0 src/fv_converter/revert_test.cpp
  65. +5 −0 src/fv_converter/weight_manager.hpp
  66. +1 −0 src/fv_converter/wscript
  67. +4 −4 src/graph/graph_type.hpp
  68. +14 −13 src/jubavisor/jubavisor.cpp
  69. +10 −7 src/jubavisor/jubavisor.hpp
  70. +18 −9 src/jubavisor/main.cpp
  71. +20 −0 src/plugin/fv_converter/ux_splitter.cpp
  72. +4 −1 src/plugin/fv_converter/ux_splitter_test.cpp
  73. +3 −0 src/recommender/euclid_lsh.cpp
  74. +2 −1 src/recommender/lsh.cpp
  75. +25 −17 src/regression/{pa.cpp → passive_aggressive.cpp}
  76. +8 −6 src/regression/{pa.hpp → passive_aggressive.hpp}
  77. +1 −1 src/regression/regression.hpp
  78. +4 −0 src/regression/regression_base.cpp
  79. +2 −0 src/regression/regression_base.hpp
  80. +4 −3 src/regression/regression_factory.cpp
  81. +3 −2 src/regression/regression_factory_test.cpp
  82. +18 −1 src/regression/regression_test.cpp
  83. +1 −1 src/regression/wscript
  84. +14 −10 src/server/anomaly_client.hpp
  85. +9 −9 src/server/anomaly_impl.cpp
  86. +1 −0 src/server/anomaly_serv.cpp
  87. +10 −1 src/server/anomaly_test.cpp
  88. +3 −0 src/server/classifier.idl
  89. +15 −6 src/server/classifier_client.hpp
  90. +10 −5 src/server/classifier_impl.cpp
  91. +2 −0 src/server/classifier_keeper.cpp
  92. +8 −0 src/server/classifier_serv.cpp
  93. +2 −0 src/server/classifier_serv.hpp
  94. +2 −0 src/server/classifier_server.hpp
  95. +13 −2 src/server/classifier_test.cpp
  96. +27 −23 src/server/graph_client.hpp
  97. +22 −22 src/server/graph_impl.cpp
  98. +1 −0 src/server/graph_serv.cpp
  99. +8 −0 src/server/graph_test.cpp
  100. +19 −15 src/server/recommender_client.hpp
  101. +14 −14 src/server/recommender_impl.cpp
  102. +11 −1 src/server/recommender_test.cpp
  103. +3 −0 src/server/regression.idl
  104. +15 −6 src/server/regression_client.hpp
  105. +10 −5 src/server/regression_impl.cpp
  106. +2 −0 src/server/regression_keeper.cpp
  107. +7 −0 src/server/regression_serv.cpp
  108. +2 −0 src/server/regression_serv.hpp
  109. +2 −0 src/server/regression_server.hpp
  110. +10 −1 src/server/regression_test.cpp
  111. +3 −0 src/server/stat.idl
  112. +20 −11 src/server/stat_client.hpp
  113. +15 −10 src/server/stat_impl.cpp
  114. +2 −0 src/server/stat_keeper.cpp
  115. +6 −0 src/server/stat_serv.cpp
  116. +2 −0 src/server/stat_serv.hpp
  117. +2 −0 src/server/stat_server.hpp
  118. +9 −0 src/server/stat_test.cpp
  119. +6 −5 src/server/test_util.hpp
  120. +4 −1 src/server/wscript
  121. +1 −5 src/stat/mixable_stat.cpp
  122. +5 −0 src/stat/stat.cpp
  123. +2 −0 src/stat/stat.hpp
  124. +13 −0 src/stat/stat_test.cpp
  125. +2 −2 src/storage/bit_index_storage.cpp
  126. +5 −4 src/storage/inverted_index_storage.cpp
  127. +6 −0 src/storage/local_storage.cpp
  128. +2 −0 src/storage/local_storage.hpp
  129. +7 −0 src/storage/local_storage_mixture.cpp
  130. +2 −0 src/storage/local_storage_mixture.hpp
  131. +6 −6 src/storage/lsh_index_storage.cpp
  132. +1 −1 src/storage/lsh_index_storage.hpp
  133. +3 −3 src/storage/lsh_vector.hpp
  134. +1 −1 src/storage/norm_l1.cpp
  135. +1 −1 src/storage/norm_l2.cpp
  136. +2 −2 src/storage/sparse_matrix_storage.cpp
  137. +2 −0 src/storage/storage_base.hpp
  138. +46 −1 src/storage/storage_test.cpp
  139. +5 −2 tools/codestyle/pre-commit
  140. +1 −1 tools/jenerator/README.rst
  141. +4 −1 tools/jenerator/src/OMakefile
  142. +1 −1 tools/jenerator/src/config.ml
  143. +13 −93 tools/jenerator/src/cpp.ml
  144. +4 −2 tools/jenerator/src/jdl_parser.mly
  145. +109 −0 tools/jenerator/src/lib.ml
  146. +3 −3 tools/jenerator/src/main.ml
  147. +252 −0 tools/jenerator/src/python.ml
  148. +309 −0 tools/jenerator/src/ruby.ml
  149. +1 −1 tools/packaging/allinone/jubapkg
  150. +7 −7 tools/packaging/allinone/jubapkg_version
  151. +0 −27 tools/packaging/homebrew/jubatus-mpio.rb
  152. +0 −31 tools/packaging/homebrew/jubatus-msgpack-rpc.rb
  153. +0 −86 tools/packaging/homebrew/jubatus.rb
  154. +0 −25 tools/packaging/homebrew/pficommon.rb
  155. +7 −7 tools/packaging/rpm/package-config
  156. +1 −1 tools/packaging/rpm/package.sh
  157. +8 −8 tools/packaging/rpm/rpmbuild/jubatus/SPECS/jubatus.spec.in
  158. +1 −1 tools/packaging/rpm/rpmbuild/pficommon/SPECS/pficommon.spec.in
  159. BIN unittest_gtest.py
  160. +10 −5 wscript
View
@@ -16,4 +16,8 @@ callgrind.*
*.omakedb.lock
*.omc
*.cmi
-*.cmx
+*.cmx
+GPATH
+GRTAGS
+GSYMS
+GTAGS
View
@@ -0,0 +1,233 @@
+
+Release 0.4.2 - 2013/03/15
+--------------------------
+
+* Improvements
+ * Feature extraction configration supports exception rules (#253)
+ * Add 'clear' method for classifier, regression and stat (#200, #279)
+ * Keeper supports configuration of session pool (#266)
+ * Add 'get_client' method for each clients (related #244)
+ * Check if thread local variables are enable in configure (#283)
+ * Output logs when server started (#258)
+ * Output logs when server received signal (#208)
+
+* Bugfix
+ * fv_converter may revert wrong feature (#247)
+ * Fix PA update equation (#254)
+ * Fix CW update equation (#277)
+ * Segfaults when point-to-point (tap) interface is installed (#273)
+ * recommender/anomaly: does not call clear() for weight manager (#282)
+ * ux_splitter plug-in does not raise error when directory is specified for dict_path (#286)
+ * #229, #263, #267, #271, #278
+
+
+Release 0.4.1 - 2013/02/15
+--------------------------
+
+* Improvements
+ * New code generator 'jenerator' for framework users (#240)
+ * Applied coding rules based on Google C++ Style Guide
+ * jubaconv accepts v0.4.x configuration format (#223, #241)
+ * jubaconfig validates JSON syntax of configuration (#226, #245)
+ * server/keeper behaves more stably in distributed mode when failed to start listening (#201)
+ * pkg-config manifest for Jubatus clients (#228)
+
+* Bugfix
+ * jubastat returns min/max from values only the current window (#238, #242)
+ * #230, #231, #233, #234, #235, #237, #248
+
+
+Release 0.4.0 - 2013/01/11
+--------------------------
+
+* New machine learning service
+ * Distributed Anomaly Detection (jubaanomaly)
+ * Calculate anomaly measure value
+
+* Improvements
+ * Change RPC implementation to msgpack-rpc based (#27)
+ * [ATTENTION] Requires jubatus-mpio and jubatus-msgpack-rpc to install
+ * Add mpidl's output converter 'mpidlconv' (#210)
+ * Remove set_config API
+ * Standalone mode: specify config file using command option '-f, --configpath'
+ * Multinode mode: store config data to Zookeeper using jubaconfig (#164)
+ * More flexible configration (#38)
+ * Support hyper-parameters (#197)
+ * Commonize name of variables and functions (#203)
+ * Add or Change command options
+ * Add bind IP address option '-b, --listen_addr' (#152)
+ * Add bind network interfance option '-B, --listen_if' (#152, #214)
+ * Check if logging directory specified by '-l, --logdir' is writeable (#206)
+ * Add verbosity of log messages option '-e, --loglevel' (#207)
+ * Add configuration file option '-f, --configpath'
+ * Change '-d, --tmpdir' to '-d, --datadir' (#198)
+ * Improve logging
+ * Not separate log file for each log level (#207)
+ * Add start save/load logs (#195)
+ * Add many debug logs
+
+* Bugfix
+ * Client symbols may conflict because of using same namespace (#84)
+ * Fix shortest_path when target is found before reaching landmark (#177)
+ * Commonize RPC return types and values (#193)
+ * Segfaults when plugin throws JUBATUS_EXCEPTION (#211)
+ * Fix classifier AROW hyper-parameter conversion (#225)
+ * #86, #184, #204, #213, #219
+
+* Refactoring
+ * #186, #187, #191, #192, #199
+
+
+Release 0.3.4 - 2012/11/26
+--------------------------
+
+* Improvements
+ * Add --logdir option
+ * Add --enable-debug option to configure (#130)
+ * Catch bad cast of fv_converter (#170)
+
+* Bugfix
+ * Plugin basename specification does not work correctly (#57)
+ * MIX put_diff/get_diff and update/analyze RPC can be executed on the same time (#171)
+ * #121, #131, #136, #150, #155, #156, #157, #160, #163, #165, #167, #172, #179, #180
+
+
+Release 0.3.3 - 2012/10/29
+--------------------------
+
+* Improvements
+ * deb package (#14)
+ * Jubatus loads plugin from default directory (#57)
+ * Add hash_max_size option to learn in fixed-size memory (#67)
+ * OS X Homebrew packaging (#116)
+ * GCC compilation version <= 4.2 when zookeeper enabled (#60)
+ * Experimental support for Clang compilation (#100)
+ * Make the timeout smaller in unittest
+ * libmecab_splitter works well in multi-thread environment, and now only support mecab ver. 0.99 or later
+ * word_splitter::split method is now constant
+ * global_id_generator(standalone-mode) for graph, that supports 32 bit environment (#135)
+ * Use (document_frequency + 1) to calculate IDF weight to avoid inifinity
+
+* Bugfix
+ * #94, #104, #106, #108, #110, #111, #113, #114, #117, #118, #124, #126, #129, #133, #138, #139, #146, #148
+
+
+Release 0.3.2 - 2012/09/21
+--------------------------
+
+* Improvements
+ * jubavisor/jubactl support jubatus server options (#75)
+ * jubadoc: document generator (.idl => .rst) (#88)
+ * jenerator: enabled -o option to specify output directory
+ * yum (RPM) packaging (#40)
+
+* Bugfix
+ * #51, #76, #77, #79, #83, #90, #91, #96, #98, #99, #100, #101, #102, #103
+
+
+Release 0.3.1 - 2012/07/20
+--------------------------
+
+* Improvements
+ * RPC enhances to many exceptions and provide new error handling interface (#49)
+ * JSON interface for set_config APIs (#44)
+ * jubavisor close zk connection correctly (#74)
+
+* Bugfix
+ * #73, #69, #66, #65
+
+
+Release 0.3.0 - 2012/06/29
+--------------------------
+
+* Improvements
+ * Distributed Graph Processing
+ * Centrality computation
+ * Shortest path search
+ * New neighbor-search algorithm for recommender: minhash
+ * installs pkgconfig file (#42, jubatus.pc)
+ * jubavisor handling signal (#53)
+ * Exception handling and error outputs (#55)
+
+* Bugfix
+ * internal API get_storage implemented again (#21)
+ * Forgot ignoring signal in keeper #47
+ * #54, #45, #15
+
+
+Release 0.2.3 - 2012/06/08
+--------------------------
+
+* Improvements
+ * Asynchronous call to multiple servers at once, both keeper and mix - common/mprpc
+ * Refactor generator
+ * Error message improve
+ * Timeout in unittest expanded
+
+* Bugfix
+ * jubactl doesn't work ver 0.2 and later #13
+ * jubavisor doesn't work on daemon mode #5
+ * Asynchronous mprpc client critical bug
+ * #47, #50, #34, #36, #37, #31, #19, and other small bugfix
+
+
+Release 0.2.2 - 2012/04/06
+--------------------------
+
+* Improvements
+ * Simpler interfaces at classifier, regression and recommender
+ * Clients are *NOT COMPATIBLE* with previous releases
+ * Now mix works concurrently in multiple threads (except tf-idf counting)
+ * Asynchronous RPC to multiple servers at once
+ * Add --version option
+ * Interface description language changed from C++-like to Annotated MessagePack-IDL
+ * Minor error handling
+ * A bit more tested than previous releases
+
+* Bugfix
+ * #30, #29, #22
+
+
+Release 0.2.1 - 2012/03/13
+--------------------------
+
+* Bugfix
+ * #28
+
+
+Release 0.2.0 - 2012/02/16
+--------------------------
+
+* New Features
+ * recommender
+ * support fast similar item search, real-time update, distributed data management
+ * inverted index : exact result, fast search
+ * locality sensitive hash : approximate result, fast search, small working space
+ * regression
+ * online SVR using passive agressive algorithm
+ * as fast as current classifier
+ * stat
+ * a Key(string)-Value(queue<double>)
+ * O(1) cost of getting sum, standard deviation, max, min, statistic moments for each queue
+ * server framework
+ * less-tightly coupled distributed processing framework with each ML implementation
+ * idl & code generator - make it easy to write own jubatus system
+ * removed public release of client libraries (so easy to generate!)
+ * multiple mix - mutiple data objects can be mixed in one jubatus system
+
+* Bugfix
+ * duplicate key entry in fv_converter breaks the parameter
+
+
+Release 0.1.1 - 2011/11/15
+--------------------------
+
+Bugfix release
+
+
+Release 0.1.0 - 2011/10/26
+--------------------------
+
+Hello Jubatus!
+
+First release: including classifier, and mix operation
Oops, something went wrong.

0 comments on commit 3cd1677

Please sign in to comment.