73eb4f94741170da912ca4784bb88f1ea97d052c Eduardo Habkost ehabkost@raisama.net http://github.com/ehabkost/ferret/commit/0f70999292ee2c6dee59d99226e4eec5376c6c7c 0f70999292ee2c6dee59d99226e4eec5376c6c7c

2008-11-15T08:18:33-08:00

Compile fixes for inline-only functions on header files gcc 4.3.0-8 from Fedora 9 complains about duplicated definitions here, if using 'extern line'. Changing to use 'static inline' instead. Signed-off-by: Eduardo Habkost <ehabkost@raisama.net> 64b845b7b15429498fe65dfd86cf7565cb7849ce Eduardo Habkost ehabkost@raisama.net a249f609ee1784b37b8bce802dfa88406cc2c3fd Eduardo Habkost ehabkost@raisama.net http://github.com/ehabkost/ferret/commit/73eb4f94741170da912ca4784bb88f1ea97d052c 73eb4f94741170da912ca4784bb88f1ea97d052c

2008-11-12T20:16:19-08:00

Make t.prerequisites usage work on some Rakefile rules Signed-off-by: Eduardo Habkost <ehabkost@raisama.net> add20865127e324247d104a4601d1d3f73567d6e Eduardo Habkost ehabkost@raisama.net 97564968f9aed076ddedd60a97b504b972e3f7fc David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/a249f609ee1784b37b8bce802dfa88406cc2c3fd a249f609ee1784b37b8bce802dfa88406cc2c3fd

2008-06-21T22:15:45-07:00

Added term frequency field to TVTerm * You can now found out the frequency of a term in a document without having to store offsets or positions. 00694f93d162992a83b2e3d5c61a9ae7c592cb82 David Balmain dbalmain@gmail.com b82c99a2260ab756fe85d7b61da340581dc3b461 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/97564968f9aed076ddedd60a97b504b972e3f7fc 97564968f9aed076ddedd60a97b504b972e3f7fc

2008-06-21T18:38:00-07:00

Fixed ruby bindings and added Index#term_vector * Added Index#term_vector method * In Rakefile: need to use ln_sf instead of ln or we can't rebuild * Added ext/scanner_utf8.c to .gitignore * temporary fix to #define FRT_REALLOC_N REALLOC_N 82c27a22ed699f0d0f2f0a280a6201c34415425d David Balmain dbalmain@gmail.com 0c24555597e26ee38f38d8910d3f7a6612393ce1 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/b82c99a2260ab756fe85d7b61da340581dc3b461 b82c99a2260ab756fe85d7b61da340581dc3b461

2008-06-13T20:24:55-07:00

Added utf-8 standard analyzer. Back up to speed. Added utf-8 standard analyzer which is on par with the legacy standard analyzer. I'm still not happy with this solution though. I think the best idea right now is to write our own generator which can make use of C's standard multibyte functions. This shouldn't be too hard as we aren't using many of Ragel's advanced features anyway. 4e5a69b134663918413ee9226c18d9a3bb9917c9 David Balmain dbalmain@gmail.com e341b9f325248c54936e09a49b60688eeae8675f David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/0c24555597e26ee38f38d8910d3f7a6612393ce1 0c24555597e26ee38f38d8910d3f7a6612393ce1

2008-06-13T17:54:21-07:00

Readded LegacyStandardAnalyzer Turns out it is an order of magnitude faster. Ouch!!! Unless we can do something about this we need to think about promoting it back to standard analyzer. cbe0b3566b03f33a5e960c6a9d26fbd9a307fff4 David Balmain dbalmain@gmail.com 4f84dc86c4e1248501564a6ec72d641ae7f044f7 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/e341b9f325248c54936e09a49b60688eeae8675f e341b9f325248c54936e09a49b60688eeae8675f

2008-06-13T01:27:57-07:00

Added description to Rakefile tasks. Cleaned store.h * store.h had the method os_write_string_len which hadn't been prefixed with frt_. * Also added some descriptions to the rake show: tasks so that they show up with .rake -T` d24faba495a3a24084619aa4d868ff1746ef608c David Balmain dbalmain@gmail.com b41949970248718694169a0b3308b006814802b9 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/4f84dc86c4e1248501564a6ec72d641ae7f044f7 4f84dc86c4e1248501564a6ec72d641ae7f044f7

2008-06-13T00:57:02-07:00

Fixed global namespace of hash.h f61d29adc9650d34006953009e0d1c0860f4706c David Balmain dbalmain@gmail.com ef412e8a5380c00b588923cc5697d2ea5d55584e David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/b41949970248718694169a0b3308b006814802b9 b41949970248718694169a0b3308b006814802b9

2008-06-04T16:47:46-07:00

Fixed documentation for IndexReader#field_names 6c6d2962ab488fa35e7a07176e5d321d0c117f97 David Balmain dbalmain@gmail.com 3021e363641eff71706f13f24f0d3775d2645bfd David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/ef412e8a5380c00b588923cc5697d2ea5d55584e ef412e8a5380c00b588923cc5697d2ea5d55584e

2008-05-13T23:14:36-07:00

Fixed a couple of bugs in bitvector.h * bv_not wasn't setting bits above bv->size correctly * bitvector scanning was overrunning the bitvector db3bd8e2f50f9f3c977232d95bee0562e3ddaaa6 David Balmain dbalmain@gmail.com 4d029545b40f84527ced49dc4058d41efd235873 509f049ac9cf69528db8cc623f391741200e8499 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/3021e363641eff71706f13f24f0d3775d2645bfd 3021e363641eff71706f13f24f0d3775d2645bfd

2008-05-13T14:49:47-07:00

Merge branch 'master' of ssh://git@davebalmain.com/var/git/ferret d71b9efe1818de42145eb0ebfce8e65c8a0a1117 David Balmain dbalmain@gmail.com eab9f0d2223000ae286e7126d71ccf9f70b7cdd4 76d73d55aa0ba896da711c5ed3d0e2b3e236ef3e krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/509f049ac9cf69528db8cc623f391741200e8499 509f049ac9cf69528db8cc623f391741200e8499

2008-05-10T23:53:32-07:00

Merge branch 'master' of ssh://git@davebalmain.com/var/git/ferret Conflicts: c/include/hash.h c/include/index.h c/include/similarity.h 3868c7bf6892adc35d87931814e44d1e4cef9b73 krayouva krayouva@gmail.com 208885f7930551213d294117aa06fa7ebb1cf8b1 krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/eab9f0d2223000ae286e7126d71ccf9f70b7cdd4 eab9f0d2223000ae286e7126d71ccf9f70b7cdd4

2008-05-10T20:00:44-07:00

* Added attribution to unicode2ragel.rb de9c4d8f3ef7f7cb2a319e5558c22c87dca222c0 krayouva krayouva@gmail.com d0c804297259976d08303935ebc0332aec812118 krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/208885f7930551213d294117aa06fa7ebb1cf8b1 208885f7930551213d294117aa06fa7ebb1cf8b1

2008-05-10T19:33:25-07:00

* Finished refactoring bitvector implementation 09770ad14238dff0352a663607a4744edc1d6033 krayouva krayouva@gmail.com 1bc545c8942b47e034f824644b4834a991178afc krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/d0c804297259976d08303935ebc0332aec812118 d0c804297259976d08303935ebc0332aec812118

2008-04-30T22:21:03-07:00

* Inlined bitwise vector operations + added benchmarks d52efde4e3ff76711b38df25214fcb6c462426b9 krayouva krayouva@gmail.com 75ff31607066f7bcb0b471c3652443662c0f985f krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/1bc545c8942b47e034f824644b4834a991178afc 1bc545c8942b47e034f824644b4834a991178afc

2008-04-30T13:49:56-07:00

* Added unit tests to new bit counting routines - Also, the builtin routines aren't defined when the input is 0, so added special casing in that case. c5bc4a0414e9d1c36bc655d93656eb83f8011c9c krayouva krayouva@gmail.com 76d73d55aa0ba896da711c5ed3d0e2b3e236ef3e David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/4d029545b40f84527ced49dc4058d41efd235873 4d029545b40f84527ced49dc4058d41efd235873

2008-04-30T03:42:59-07:00

Full test coverage for RangeQuery 5e765d9654e85a1d76cf4e3dbdbed93f1cdd0532 David Balmain dbalmain@gmail.com 1c4d613e749d9e677b5d4a13214e93bfee485937 krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/75ff31607066f7bcb0b471c3652443662c0f985f 75ff31607066f7bcb0b471c3652443662c0f985f

2008-04-29T21:32:42-07:00

* Minor code refactoring - Added the frt_round2() method that rounds to the next 2nd power 35370fb14e83d1b4ad2a3510584a854978613789 krayouva krayouva@gmail.com ed4cf588b31c5ebb50b4d502802d243fec2cb338 krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/1c4d613e749d9e677b5d4a13214e93bfee485937 1c4d613e749d9e677b5d4a13214e93bfee485937

2008-04-29T19:52:10-07:00

* Forgot to removed factored out bv_unset f073817389e7b7ba9b0fb70ec85b03e15aa0e4f2 krayouva krayouva@gmail.com 3516e7ae3f4df445e780bee77b2a9a7f6ce7ddb8 krayouva krayouva@gmail.com http://github.com/ehabkost/ferret/commit/ed4cf588b31c5ebb50b4d502802d243fec2cb338 ed4cf588b31c5ebb50b4d502802d243fec2cb338

2008-04-29T19:45:38-07:00

* Optimized bitvector - Wrapped bitvector.h descriptions to fit 80 char width - Added malloc/inline/const/pure attributes where possible to improve compiler optimizations - Inlined most important functions [at least, the ones that are benched] - Refactored bv_set/unset by having a set_value they call to - Implemented optimized bicount routines that use gcc builtins where possible - Improved bv_recount to count by word 5648eb3b768b62903198dc7e69f44fb861f31c9f krayouva krayouva@gmail.com 8d89448795e517f0f1afd9bb633dc677fde09712 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/76d73d55aa0ba896da711c5ed3d0e2b3e236ef3e 76d73d55aa0ba896da711c5ed3d0e2b3e236ef3e

2008-04-29T04:55:34-07:00

Full gcov test coverage for term_vector.c Was actually able to delete a lot of code that wasn't being used anymore; a hang over from when term-vectors used to be stored seperately from documents. b9a8db1193a3433bf12b11949a16748a560358d9 David Balmain dbalmain@gmail.com 2ac444617a25eb599de0faec801ffa532425f554 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/8d89448795e517f0f1afd9bb633dc677fde09712 8d89448795e517f0f1afd9bb633dc677fde09712

2008-04-29T03:45:14-07:00

Full gcov test coverage for TermQuery 976d78a46c79f5b813aea1b116bfba5e62bfcdbd David Balmain dbalmain@gmail.com 88af924cc987bc50098df966cc16b84e4213a7fe David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/2ac444617a25eb599de0faec801ffa532425f554 2ac444617a25eb599de0faec801ffa532425f554

2008-04-27T21:54:33-07:00

Full test coverage for PhraseQuery and its variants Full test coverage for; * PhraseQuery * MultiPhraseQuery * PhraseQuery with slop * MultiPhraseQuery with slop dd0930571d5204aba831b244768de120b6562103 David Balmain dbalmain@gmail.com 7b606608302021d361c250f0cb83e6c92a50d294 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/88af924cc987bc50098df966cc16b84e4213a7fe 88af924cc987bc50098df966cc16b84e4213a7fe

2008-04-27T21:46:27-07:00

Reverted to correct Rakefile for Ruby bindings 76325e7b7dbeb94d0243ce261c79e4d84dab7449 David Balmain dbalmain@gmail.com 2f5dc9c8dce95e8e8ac5d32256e9c9ff16052fc8 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/7b606608302021d361c250f0cb83e6c92a50d294 7b606608302021d361c250f0cb83e6c92a50d294

2008-04-27T20:06:54-07:00

Fixed a bug in Searcher#get_weight * also improved test coverage for PhraseQuery 3abe0219f69a7cd8be50df5f2c02484ba3f22480 David Balmain dbalmain@gmail.com a2344576c2573c3b9a6fb40dfc614fd4cfe178f7 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/2f5dc9c8dce95e8e8ac5d32256e9c9ff16052fc8 2f5dc9c8dce95e8e8ac5d32256e9c9ff16052fc8

2008-04-27T18:57:07-07:00

Added documentation to PhraseQuery Actually just trying to get local-svn back in sync 3b55afe7638dd71e7e765fd1b851f6ce205c0312 David Balmain dbalmain@gmail.com e37ef045516872af81e36339debad2296a2d7506 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/a2344576c2573c3b9a6fb40dfc614fd4cfe178f7 a2344576c2573c3b9a6fb40dfc614fd4cfe178f7

2008-04-27T18:51:48-07:00

Fixing problem in local-svn b33bdf7f1534dcd957871f2fec728990afaf56be David Balmain dbalmain@gmail.com afa46936e67e892eb5c8429bd0991a4630cbd71f 8f4fd07de7bf767b30c219684608535cb9cb6f19 dave dave@06fd6eb0-0002-0410-a719-e5602cce40bc http://github.com/ehabkost/ferret/commit/e37ef045516872af81e36339debad2296a2d7506 e37ef045516872af81e36339debad2296a2d7506

2008-04-27T18:42:00-07:00

Merge branch 'master' into local-svn git-svn-id: svn+ssh://davebalmain.com/home/dave/repos/ferret/trunk@1046 06fd6eb0-0002-0410-a719-e5602cce40bc 3530b346a88b3622f671ab4e1cd8687e233aef9a dave dave@06fd6eb0-0002-0410-a719-e5602cce40bc a04da26a0a26ed33041c9059b44ece39727fc2a1 dave dave@06fd6eb0-0002-0410-a719-e5602cce40bc http://github.com/ehabkost/ferret/commit/afa46936e67e892eb5c8429bd0991a4630cbd71f afa46936e67e892eb5c8429bd0991a4630cbd71f

2008-04-27T18:28:25-07:00

Fixed `rake install` task. Can now install latest Ferret gem `rake install` was broken because I removed the old ruby/TODO list. It now links to the TODO list in the base directory. git-svn-id: svn+ssh://davebalmain.com/home/dave/repos/ferret/trunk@1045 06fd6eb0-0002-0410-a719-e5602cce40bc bef386a5dfafac8630af37a781369bd3d84afafa dave dave@06fd6eb0-0002-0410-a719-e5602cce40bc 56424f8d1cfd0e927e5e8f9e0c4329531221a966 David Balmain dbalmain@gmail.com http://github.com/ehabkost/ferret/commit/8f4fd07de7bf767b30c219684608535cb9cb6f19 8f4fd07de7bf767b30c219684608535cb9cb6f19

2008-04-27T18:06:13-07:00

Fixed repeated term bug in sloppy PhraseQuery Repeated terms were breaking sloppy PhraseQueries. For example, if you had the query "one two one"~2 it would match "one two". This has now been fixed. b33bdf7f1534dcd957871f2fec728990afaf56be David Balmain dbalmain@gmail.com