Use field tokenization options by default when searching in a field

[mikegoatly]

Given this:

bookIndex.WithItemTokenization<Book>(
                options => options
                    .WithKey(b => b.BookId)
                    .WithField("Title", b => b.Title, new TokenizationOptions(TokenizerKind.Default) { Stem = true }));

bookIndex.Search("Title=foo");

The search will not use stemming, so you may not get exactly the results you were expecting given the field was indexed with stemming enabled.

You can work around this by indicating that stemming should be used when searching:

bookIndex.Search("Title=foo", new TokenizationOptions(TokenizerKind.Default) { Stem = true });

But it would be much better if when doing a field search it used the tokenization options of the field by default.

[mikegoatly]

Done.