CharFilters not being invoked in Solr [LUCENE-3721]

[asfimport]

On Solr trunk, all CharFilters have been non-functional since #4469 was committed in r1175297 on 25 Sept 2011, until Yonik's fix today in r1235810; Solr 3.x was not affected - CharFilters have been working there all along.

---

Migrated from LUCENE-3721 by Mike Hugo (@mjhugo), resolved Jan 25 2012
Attachments: htmlstripfilter_test.patch
Linked issues:

• Make TokenStream Reuse Mandatory for Analyzers [LUCENE-3396] #4469

[asfimport]

Robert Muir (@rmuir) (migrated from JIRA)

According to the mailing thread, this has nothing to do with htmlstripcharfilter.

[asfimport]

Mike Hugo (@mjhugo) (migrated from JIRA)

Robert, does the attached test case work for you? If not, do you know how I can get it running the way it used to?

[asfimport]

Mike Hugo (@mjhugo) (migrated from JIRA)

Also - I'm happy to change the title if this isn't related to HTMLStripCharFilterFactory, I'm just seeing that the behavior we saw in Solr3.x is different (with the same configuration) in Solr4 - just trying to track down how we get it to work the way it used to! Thanks for the help!

[asfimport]

Yonik Seeley (@yonik) (migrated from JIRA)

OK, so it looks like all CharFilters were broken in Solr by #4469 (since last Sept!).
I just checked in a fix and added a test.
Thanks for bringing this to our attention Mike!

[asfimport]

Steven Rowe (@sarowe) (migrated from JIRA)

I just checked in a fix and added a test.

Mike's test succeeds for me with the fix.

Thanks Yonik.

[asfimport]

Steven Rowe (@sarowe) (migrated from JIRA)

I committed BasicFunctionalityTest.testHTMLStrip() to branch_3x - it succeeds for me with no changes required.

[asfimport]

Chris M. Hostetter (@hossman) (migrated from JIRA)

updated summary and description