[2.7] bpo-33899: Make tokenize module mirror end-of-file is end-of-li…#8133

taleinat merged 1 commit intopython:2.7python/cpython:2.7from

ammaraskar:backport-c4ef489-2.7ammaraskar/cpython:backport-c4ef489-2.7Copy head branch name to clipboard