Permalink
Browse files

fixed ReindexSolrBusyThread new and unexpected repeat of same query with

low number of found documents - by adding additional end condition to 
remove processed query with number of found docs <= process-chunck-size.

Noticed on query h4_txt:[* TO *], found 21, process 21, call of commit happend
but on next cycle same query again 21 docs found (while h4_txt was removed 
from schema and committed inputdocuments).
  • Loading branch information...
reger24 committed Feb 27, 2017
1 parent 0aa0dd0 commit 86534a56f7c23c05be032a80e4a26b5b459017a3
Showing with 3 additions and 0 deletions.
  1. +3 −0 source/net/yacy/search/index/ReindexSolrBusyThread.java
@@ -144,6 +144,9 @@ public boolean job() {
Switchboard.getSwitchboard().index.putDocument(idoc);
processed++;
}
if (xdocs.size() >= docstoreindex) { // number processed docs >= found docs -> end condition for this query as no more docs avail-
querylist.delete(currentquery); // 2017-02-27 added on occurence of 21 docs found 21 processed but somehow on next call 21 docs again found (some commit issue ??)
}
}
} catch (final IOException ex) {
ConcurrentLog.warn("MIGRATION-REINDEX", "remove following query from list due to error, q=" + currentquery);

0 comments on commit 86534a5

Please sign in to comment.