Highlighting for Conversation Search

[westei]

Add support for highlighting to the conversation search. Extend the search result format to include highlight information like with Solr search results

[westei]

This will require to delete and re-index the conversation index on the software update

[ruKurz]

The results of Smarti do not fit to ChatPal Search:

chatpal-search fails by executing:

/packages/chatpal-search/server/service/search_service.js

static alignResponse(result) {
  const docs = [];
  result.response.forEach(function(doc) {
    docs.push({
      type: doc.type,
      subtype: 'c',
      room: doc.meta_channel_id[0],
      id: doc.message_id,
      text: doc.message,
      highlight_text: result.highlighting[doc.id] ? result.highlighting[doc.id].message[0] : undefined,
      user: doc.user_id,
      date: doc.time
    });

    return {
      numFound: result.meta.numFound,
      start: result.meta.start,
      docs
    };
  }
});

The Smarti response of:
http://localhost:8080/rocket/localhost/search?sort=time%20desc&fl=id,message_id,meta_channel_id,user_id,time,message,type&hl=true&hl.fl=message&df=message&q=braunschweig

does not return the JSON-Format expected by chatpal search.
E.g.

• result.response is undefined
• the requested return fields: id,message_id,meta_channel_id,user_id,time,message,type do not persist in the response of Smarti

Not quiet sure if this has to be solved within chatpal or within Smarti.

[westei]

@ruKurz Have you deleted the 0.6.0 Solr Index before installing 0.6.1 RC1. If not this might be because we had to change the conversation index layout to support chatpal.

NOTE: with 0.6.1 RC2 the index will be fully rebuild on every startup (see #164) to avoid problems like this

[ruKurz]

works when using the right endpoint: http://localhost:8080/rocket/localhost/search-message

[ruKurz]

when switching to the Rocket.Chat Admin, there is a display/layout issue: While the RC-Chat panel gets shadowed, the search box of chatpal is in front.

How do we handle chapal-search RC related issues that are regarding our releases?
Should we create issues here?

[ruKurz]

@tkurz could you please test chatpal-search?

[ruKurz]

Can't reproduce that issue anymore