found segfault error in summary capitalisation highlighting

[awakmu]

Hi,

Compared with original version of zettair, this fork have solved some bugs, like when executing zet -a. And I have still found segfault in summary capitalisation highlighting.

How to reproduce this error:
-download the html file with command: wget www.al-ilmu.com/magazines/detail.php?id=76
-index the file: /usr/local/zettair/bin/zet -i -c /usr/local/zettair/share/psettings.xml -t HTML -f debug detail.php?id=76
-and search with some term "tauhid", "pembeli" (indonesians term) using: /usr/local/zettair/bin/zet -n 10 -f debug --summary=capitalise
-the following lines is the output from search command:

      aris@aris-laptop:~/Documents$ /usr/local/zettair/bin/zet -n 10 -f debug --summary=capitalise
      AYXX: before reposset_set_record: rset->entries: 0. max: 1
      AYXX: many files, adding quantity: 1
      AYXX: reposset_set_record: rset->entries: 2
      AYXX: docmap load: rset->entries: 2
      > tauhid
      AYXX: doc_ord_eval
      AYXX: vocabsize[0]: 9, memsum: 9
      AYXX: fit in memory: 1, total: 1
      AYXX: searching in THRESH mode
      AYXX: searching in AND mode
      AYXX: remaining...
      AYXX: normal term: tauhid
      return from doc_ord_eval: 0, accs: 1
      ERROR: index_search (src/search.c::1365): AUX: file:///home/aris/Documents/detail.php?id=76 // just my line to show which file caused error.
      Segmentation fault

-If I'm not forgotten, there are another file that caused same error. I will post them after found.

-aris

[awakmu]

Another files that cause error (can be reproduce using above steps. maybe can help in problem solving) are:

• http://akhwat.web.id/muslimah-salafiyah/fatwa-ulama/apakah-wanita-menyusui-diperbolehkan-untuk-tidak-berpuasa/ and the term to search: "halangan" (I have repeated the steps)
• almakassari.com/profil-panitia-kajian-ikhwah-kab-pinrang?cp=1 and the term to search: "walaupun"

[ayourtch]

Thanks for the reports!

6252417 fixes these two crashes, so please give it a shot. I mark this one as resolved so far.

[awakmu]

Thank's, this revisions fixed them.

I plan to retest it with more documents tonight.

[awakmu]

After test indexing resulting with much of docs, I found a similar error (I found 2 but I can't reproduce the other yet):

1. url: http://almuslimah.wordpress.com/2008/04/10/hak-hak-wanita-dalam-islam/
   how to reproduce:
   a. wget almuslimah.wordpress.com/2008/04/10/hak-hak-wanita-dalam-islam
   b. /usr/local/zettair/bin/zet -i -c /usr/local/zettair/share/psettings.xml -t HTML -f debug index.html
   c. /usr/local/zettair/bin/zet -n 10 -f debug --summary=capitalise
   d. I search term "wanita", with outputs:

   AYXX: before reposset_set_record: rset->entries: 0. max: 1
   AYXX: many files, adding quantity: 1
   AYXX: reposset_set_record: rset->entries: 2
   AYXX: docmap load: rset->entries: 2

   wanita
   AYXX: doc_ord_eval
   AYXX: vocabsize[0]: 60, memsum: 60
   AYXX: fit in memory: 1, total: 1
   AYXX: searching in THRESH mode
   AYXX: searching in AND mode
   AYXX: remaining...
   AYXX: normal term: wanita
   return from doc_ord_eval: 0, accs: 1
   Segmentation fault

[ayourtch]

Try updating - should be ok now. I also put in the testcase (not any proper framework to start them yet though)