Results Using Word List B (Lancs)
Word List B (commonwords.txt) from the Lancs University website [Ref: W12] contains 17396 words, 6241 strong barriers and 602 weak barriers.
When you open Word List B as File A in the List Analyser you will note that the unique word count is 17395 and it will show a message warning that it contains a duplicated word.
If you click on the Yes button it will list the word ban[2].
The results below were obtained without removing the duplicated word. The results in table 4 were obtained in List Analyser 1.0.4098 by using the word lists generated by Stemming Tester 1.4 when the Word List B was stemmed.
| UI | OI | SW | ERRT | |
|---|---|---|---|---|
| trunc4 | 0.048958 | 0.00061761 | 0.012615 | - |
| trunc5 | 0.211362 | 0.00013463 | 0.000637 | - |
| trunc6 | 0.445843 | 0.00003437 | 0.000077 | - |
| trunc7 | 0.693222 | 0.00000939 | 0.000014 | - |
| trunc8 | 0.871682 | 0.00000128 | 0.000001 | - |
| Porter | 0.375521 | 0.00001934 | 0.000052 | |
| dtSearch (default) | 0.384075 | 0.00001185 | 0.000031 | |