Skip to content

LC-John/Python-Tokenizer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python-Tokenizer

This is a tokenizer for Python3 implemented in python3.

Require

python3

How2Use

The executable is ./token. The first argument is the input file path, and the second is the output file path.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published