Add SMWSearch power profile form #3126

mwjames · 2018-04-14T20:33:44Z

This PR is made in reference to: #1233

This PR addresses or contains:

Adds a smw power form to Special:Search for when $wgSearchType = 'SMWSearch'; is used

This PR includes:

Tests (unit/integration)
CI build passed

Fixes: #1233

Example

mwjames · 2018-04-14T20:37:42Z

@kghbln @s7eph4n This is a WIP and came as left-over while experimenting with ES on excerpts and score sorting.

The power form adds some sorting Best Match, Most Recent... in order for results to be sorted differently. Of course, "Best Match" only makes sense in connection with ES where we get scores and can sort them accordingly.

Questions:

Do we want or need something like this in core?
Currently, the profile is called Extended any better name for such profile?

kghbln · 2018-04-15T07:22:49Z

Do we want or need something like this in core?

I believe that this is a nice feature especially for power-users or users who are desperate to find something a grab every straw to get something useful as results. Probably depending on the effort to make it happen.

Currently, the profile is called Extended any better name for such profile?

I am wondering if this could "also" be piggy-backed to the "Advanced" tab like Translate and/or SIL are doing it. Apart from that "Extended" appears fine to me.

mwjames · 2018-04-15T10:58:25Z

I am wondering if this could "also" be piggy-backed to the "Advanced" tab like

Well, there is a side story to the "Advanced" tab which can be extended with a hook called SpecialSearchPowerBox and as SIL has tried it is pretty much useless as soon as you click the paging >> button because the hook is missing a vital piece that would allow you to set your optional parameters (SpecialSearch::setExtraParam) so that they can be retained beyond the first page.

The "Advanced" tab and SpecialSearchPowerBox hook in MW-core could be fixed by allowing parameters to be transferred as in:

@@ -269,17 +269,21 @@ class SearchFormWidget {
 		}
 
 		$showSections = [
 			'namespaceTables' => "<table>" . implode( '</table><table>', $namespaceTables ) . '</table>',
 		];
-		Hooks::run( 'SpecialSearchPowerBox', [ &$showSections, $term, $opts ] );
+		Hooks::run( 'SpecialSearchPowerBox', [ &$showSections, $term, $opts, &$parameters ] );
 
 		$hidden = '';
 		foreach ( $opts as $key => $value ) {
 			$hidden .= Html::hidden( $key, $value );
 		}
 
+		foreach ( $parameters as $key => $value ) {
+			$this->specialSearch->setExtraParam( $key, $value );
+		}

Above is not going to happen and your left with creating your own tab via SpecialSearchProfileForm, copy the whole NS select form from the "Advanced" tab (seriously what a waste), and add your own form parameters to function correctly.

s7eph4n · 2018-04-15T10:59:32Z

I love it! Frankly, I am surprised that this is not a thing yet on the vanilla search.

Do we want or need something like this in core?

Yes, if you ask me. I think modularity is great, but users are already complaining about the complexity of the installation. So until we have a better way of installing extensions I'd go for including it directly.

Currently, the profile is called Extended any better name for such profile?

Would it be possible to not have it as a new profile, but as an additional option to all the other profiles? Sort order and search perimeter are orthogonal.
(Ok, just read your answer. What a shame. 👎 )

mwjames · 2018-04-15T11:06:00Z

Would it be possible to not have it as a new profile, but as an additional option to all the other profiles? Sort order and search perimeter are orthogonal.

I'd love to but see my comments on the issue that arises with SpecialSearchPowerBox. It would reduce the entire section to something like:

public function newSpecialSearchPowerBox( &$showSections, $term, $opts, &$parameters ) {

	$sort = $GLOBALS['wgRequest']->getVal( 'sort' );
	$parameters['sort'] = '';

	$html = '';

	foreach ( [ 'foo' => 'Foo', 'bar' => 'Bar' ] as $key => $value ) {
		$selected = '';

		if ( $sort === $key ) {
			$selected = 'selected';
			$parameters['sort'] = $key;
		}

		$html .= "<option value='$key' $selected>$value</option>";
	}

	$showSections['smw-sort'] = '<select name="sort">' . $html . '</select>';
	$parameters['profile'] = 'advanced';
}

mwjames · 2018-04-21T15:17:33Z

I understand that adding such profile is expedient for a user engagement, yet just having it for the sake of a sorting option seemed a bit exaggerated to justify the extra coding and hook complexity.

So, I pulled my magic hat over the last couple of hours to make this profile a meaningful endeavour by helping users to find things quick and easy. Saying that means, the profile is adding a form builder that let users define what search fields are relevant and provide a better existential means for the profile. To keep complexity low and the interface lean, fields are conjunctive which means if you need an OR, use the big long input field at the top with the well known [[ ... :: ...]] syntax.

The form builder uses a JSON definition [0] to define what property fields are to be displayed and in which order, whether they should have value autocompletion support or not, and so forth. The builder will create a HTML form that has a responsive design factor and is without any dependency to any other extension.

Why all this? SMW is mostly concerned with structured searches but combining them with a full-text search (as in case of ES) posses some challenges to find a simple interface. The complexity of Special:Ask might be overwhelming when you just need to find something and the new extended profile should allow novice as well as expert users to enjoy SMW's power search while freeing ourselves from support of a specific use case where users define their own search forms with the help of an extendable JSON schema.

It should enable users to provided different forms from within Special:Search without compromising the power of SMW and its selected query engine.

Form and definition

Definition

{
    "forms": {
        "Books and journals": [
            "Has title",
            "Has author",
            "Has year",
            {
                "Publication type": {
                    "autocomplete": true,
                    "tooltip": "Mandatory field, please select a type of publication because ...",
                    "required": true
                }
            },
            {
                "Publisher": {
                    "autocomplete": true
                }
            }
        ]
    }
}

Responsive form

JSON

Attributes	Values	Description
autocomplete	true, false	whether the field should add a autocomplete function or not
tooltip	text or msg key	shows a tooltip with either a text or retrieves information from a message key
placeholder	text	shown instead of the property name
required	true, false	whether the field input is required before submitting
type	HTML5	preselect a specific type field

kghbln · 2018-04-21T19:39:41Z

Were do you get all these cool ideas. Show me the place please. :) And the definition of the search templates is done in the "rule" namespace!?

s7eph4n · 2018-04-21T19:56:59Z

Wow! This is great!
Would it make sense to find some name other than "Extended", something that hints more at the functionality?

kghbln · 2018-04-21T20:11:56Z

Would it make sense to find some name other than "Extended", something that hints more at the functionality?

Perhaps "Structured" as in structured content. This will definitively make people curious even if they do not know what it means right away.

mwjames · 2018-04-22T03:21:04Z

templates is done in the "rule" namespace!?

First I had it as MediaWiki... but since you mentioned it, I created a new rule type and the definition is now expected at Rule:Search-profile-form-definition. The name is fixed, well you could go all willy nilly and search for all forms with the SEARCH_FORM_DEFINITION_RULE type but that's just too ...

I didn't spent too much time on the JSON schema but you got one rudimentary with search-form-definition-rule-schema.v1.json

Perhaps "Structured" as in structured content.

Currently it is maintained with "smw-search-profile": "Extended", and given that it is a msg key it can be easily renamed. If you think "Structured" is the term that makes a difference or for that matter any other term, go ahead.

kghbln · 2018-04-22T08:06:46Z

Placeholder page for the wikidocu:

https://www.semantic-mediawiki.org/wiki/Help:Rule/Type/SEARCH_FORM_DEFINITION_RULE

kghbln · 2018-04-22T08:13:00Z

First I had it as MediaWiki... but since you mentioned it, I created a new rule type and the definition is now expected at Rule:Search-profile-form-definition. The name is fixed, well you could go all willy nilly and search for all forms with the SEARCH_FORM_DEFINITION_RULE type but that's just too ...

Great. Still I have to dig into the mechanics of the new rule system since I am currently not sure how to set up more than one search template per wiki.

Currently it is maintained with "smw-search-profile": "Extended"

Thus everyone can adapt. "Extended" is fine with me too. The future will tell if there are other suggestions out there for the default naming. I do not expect any though.

mwjames · 2018-04-22T08:42:19Z

Great. Still I have to dig into the mechanics of the new rule system since I am currently not sure how to set up more than one search template per wiki.

``` { "type": "SEARCH_FORM_DEFINITION_RULE", "forms": { "My first form": [ // ---> Form "Property one", "Property two" ], "My second form": [ // ---> Form "Property One", { "Property three": { // Field with extra attributes "autocomplete": true } } ], "My third form": [ // ---> Form "Property Foo", "Property Bar" ] } } ``` If you call a form "Open" then this will create a predefined output. If I really have time I may make an discovery on the `SEARCH_FORM_DEFINITION_RULE` type but for the now all form definitions are expected to be hosted in `Rule:Search-profile-form-definition`. PS: Comment "// ..." should be removed from the real JSON.

…

On 4/22/18, Karsten Hoffmeyer ***@***.***> wrote: > First I had it as MediaWiki... but since you mentioned it, I created a new > rule type and the definition is now expected at > Rule:Search-profile-form-definition. The name is fixed, well you could go > all willy nilly and search for all forms with the > SEARCH_FORM_DEFINITION_RULE type but that's just too ... Great. Still I have to dig into the mechanics of the new rule system since I am currently not sure how to set up more than one search template per wiki. > Currently it is maintained with "smw-search-profile": "Extended" Thus everyone can adapt. "Extended" is fine with me too. The future will tell if there are other suggestions out there for the default naming. I do not expect any though. -- You are receiving this because you modified the open/close state. Reply to this email directly or view it on GitHub: #3126 (comment)

mwjames · 2018-04-22T12:28:18Z

Still I have to dig into the mechanics of the new rule system since I am currently not sure how to set up more than one search template per wiki.

https://sandbox.semantic-mediawiki.org/wiki/Rule:Search-profile-form-definition

Knock yourself out:

https://sandbox.semantic-mediawiki.org/w/index.php?search=%C2%A0&title=Sp%C3%A9cial%3ARecherche&profile=smw&fulltext=1&sort=best&smw-form=booksandjournals&hastitle%5B%5D=&hasauthor%5B%5D=&published%5B%5D=&hasgenre%5B%5D=Novel&haspublisher%5B%5D=&mediatype%5B%5D=&mimetype%5B%5D=&fileattachment.contenttype%5B%5D=&ns0=1&ns6=1&ns102=1&ns108=1

https://sandbox.semantic-mediawiki.org/w/index.php?search=%5B%5Bin%3AM%C3%BCnchen%5D%5D&title=Sp%C3%A9cial%3ARecherche&profile=smw&fulltext=1&sort=best&smw-form=mediaandfiles&hastitle%5B%5D=&hasauthor%5B%5D=&published%5B%5D=&hasgenre%5B%5D=&haspublisher%5B%5D=&mediatype%5B%5D=&mimetype%5B%5D=&fileattachment.contenttype%5B%5D=application%2Fpdf&ns0=1&ns6=1&ns102=1&ns108=1

https://sandbox.semantic-mediawiki.org/w/index.php?search=%5B%5Bin%3AM%C3%BCnchen%5D%5D&title=Sp%C3%A9cial%3ARecherche&profile=smw&fulltext=1&sort=best&smw-form=mediaandfiles&hastitle%5B%5D=&hasauthor%5B%5D=&published%5B%5D=&hasgenre%5B%5D=&haspublisher%5B%5D=&mediatype%5B%5D=&mimetype%5B%5D=&fileattachment.contenttype%5B%5D=&ns0=1&ns6=1&ns102=1&ns108=1

kghbln · 2018-04-22T13:27:57Z

Knock yourself out:

Thanks a lot for the kick-starting knock-out. 😄

krabina · 2018-04-25T08:28:42Z

This is great!
I'd prefer "Structured" over "Extended", but more importantly I would like so see alle Namespaces hidden from the user unless I want to show them. Every SMW installation has tons of namespaces that just confuse the user. It's nice to have the option to see them and filter for them, but the default should be: don't show the namespaces to start with.
One solution could be to hide the checkboxes via css and allow them to be extended/displayed if the users wants to.
Even better would be a way to configure this. In cases with heavy use of custom namespaces having the possibility is great, but maybe I want to only show them the custom (content) namespaces e. g. "Book:", "Journal:", "Media:" but not the "built in" namespaces like "Form:", "Widget:", "Template", "Property"....

kghbln · 2018-04-26T08:18:19Z

I'd prefer "Structured" over "Extended",

You will be able to adapt locally. See this #3126 (comment).

but more importantly I would like so see alle Namespaces hidden from the user unless I want to show them. ...

That's MediaWiki core and SMW cannot do anything to help here. I had the same issue on one wiki and our solution was to hide the namespace selection completely via CSS for good. This is however not the desired solution for most wikis. :|

Right now I cannot remember if I opened an issue on Phabricator or if I talked with one WMF employee about this referring to an existing issue on Phabricator. Currently I cannot point you to anything. I suggest to open an issue at Phabricator. The worst that can happen is that it gets duped to an existing issue. This however does not hurt since it tells people that there is interest in getting this improved. It will be cool if you could add me as CC to the task you created. Cheers and thanks!

mwjames · 2018-04-28T13:50:40Z

If I really have time I may make an discovery on the SEARCH_FORM_DEFINITION_RULE type but for the now all form definitions are expected to be hosted in Rule:Search-profile-form-definition.

See #3143.

I would like so see alle Namespaces hidden from the user unless I want to show them.

See #3143.

mwjames mentioned this pull request Apr 21, 2018

Add API pvalue browse module + autocompleter, refs 3126 #3129

Merged

2 tasks

Add SMWSearch power search profile form

4ca511d

mwjames force-pushed the search-profile branch from bcae0af to 4ca511d Compare April 22, 2018 02:19

mwjames merged commit adc9e11 into master Apr 22, 2018

mwjames deleted the search-profile branch April 22, 2018 03:21

mwjames added this to the SMW 3.0.0 milestone Apr 22, 2018

mwjames added new feature A new, or altered behaviour of an existing functionality that fundamentally impacts behaviour enhancement Alters an existing functionality or behaviour labels Apr 22, 2018

kghbln added the wikidocu missing Code changes (mostly features) what have not yet been documented label Apr 22, 2018

kghbln mentioned this pull request Apr 22, 2018

Add SMW_NS_RULE ns, refs 2273 #3019

Merged

2 tasks

mwjames mentioned this pull request Apr 28, 2018

Hide namespace section, auto-discovery, refs 3126 #3143

Merged

2 tasks

mwjames mentioned this pull request Sep 1, 2019

Search suggestion summaries #4280

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add SMWSearch power profile form #3126

Add SMWSearch power profile form #3126

mwjames commented Apr 14, 2018 •

edited

Loading

mwjames commented Apr 14, 2018

kghbln commented Apr 15, 2018

mwjames commented Apr 15, 2018

s7eph4n commented Apr 15, 2018 •

edited

Loading

mwjames commented Apr 15, 2018 •

edited

Loading

mwjames commented Apr 21, 2018

kghbln commented Apr 21, 2018 •

edited

Loading

s7eph4n commented Apr 21, 2018

kghbln commented Apr 21, 2018 •

edited

Loading

mwjames commented Apr 22, 2018

kghbln commented Apr 22, 2018

kghbln commented Apr 22, 2018

mwjames commented Apr 22, 2018 via email

mwjames commented Apr 22, 2018

kghbln commented Apr 22, 2018

krabina commented Apr 25, 2018

kghbln commented Apr 26, 2018

mwjames commented Apr 28, 2018

Add SMWSearch power profile form #3126

Add SMWSearch power profile form #3126

Conversation

mwjames commented Apr 14, 2018 • edited Loading

Example

mwjames commented Apr 14, 2018

kghbln commented Apr 15, 2018

mwjames commented Apr 15, 2018

s7eph4n commented Apr 15, 2018 • edited Loading

mwjames commented Apr 15, 2018 • edited Loading

mwjames commented Apr 21, 2018

Form and definition

Definition

Responsive form

JSON

kghbln commented Apr 21, 2018 • edited Loading

s7eph4n commented Apr 21, 2018

kghbln commented Apr 21, 2018 • edited Loading

mwjames commented Apr 22, 2018

kghbln commented Apr 22, 2018

kghbln commented Apr 22, 2018

mwjames commented Apr 22, 2018 via email

mwjames commented Apr 22, 2018

kghbln commented Apr 22, 2018

krabina commented Apr 25, 2018

kghbln commented Apr 26, 2018

mwjames commented Apr 28, 2018

mwjames commented Apr 14, 2018 •

edited

Loading

s7eph4n commented Apr 15, 2018 •

edited

Loading

mwjames commented Apr 15, 2018 •

edited

Loading

kghbln commented Apr 21, 2018 •

edited

Loading

kghbln commented Apr 21, 2018 •

edited

Loading