RegEx for detecting words are not handling special characters correctly

[TrondTollefsen]

Hi,

In document.py, the line:

FIND_WORD_RE = re.compile(r"([a-zA-Z0-9]+|[^a-zA-Z0-9_\s]+)")

will either detect words that are only alfanumericals or words that are only special characters, but not words that are a combination of the two. See attached image.

As shown in picture, words containing both alfanumericals and special characters are split into several words.

I suggest changing RegEx to:

_FIND_WORD_RE = re.compile(r"([^\s])+

as used later in document.py.

This would also fix issue 1280

Regards,
Trond