Tokenizer: moved test-only tokenize() to SimpleTokenizer / several cleanups#6264

firewave merged 2 commits intocppcheck-opensource:maincppcheck-opensource/cppcheck:mainfrom

firewave:tok-test-simplefirewave/cppcheck:tok-test-simpleCopy head branch name to clipboard