Replace tokens.py with an external tool. (#913)

wemake-services · Oct 17, 2019 · 01dbd54 · 01dbd54
1 parent fd4b203
commit 01dbd54
Show file tree

Hide file tree

Showing 5 changed files with 23 additions and 36 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -31,6 +31,9 @@ We used to have incremental versioning before `0.1.0`.
 - Fixes that `not not True` was not detected as `WPS330`
 - Fixes addition of ``MisrefactoredAssignmentViolation`` check
 
+### Misc
+
+- Replace `scripts/tokens.py` with an external tool.
 
 ## 0.12.5
 

diff --git a/docs/pages/api/debugging.rst b/docs/pages/api/debugging.rst
@@ -7,17 +7,16 @@ there are several ways to debug things.
 Viewing module contents
 -----------------------
 
-You can use ``./scripts`` folder with python scripts
-to reveal the internals of python files:
+To reveal internals of the Python files, you can use following options:
 
-1. ``./scripts/parse.py`` will show you
-   pretty-printed ``ast`` contents of a module
-2. ``./scripts/tokens.py`` will show you tokens that module consists off
+* ``./scripts/parse.py`` will show you pretty-printed ``ast`` contents
+  of a module
+* ``tokelor`` will show you tokens that module consists off
 
 We recommend to create a simple file with just the part that does not work.
 We usually call this file ``ex.py`` and remove it before the actual commit.
 
-It might not be enough to find some complex cases.
+It might not be enough to find some complex cases, but it helps.
 
 Test-driven development
 -----------------------

diff --git a/poetry.lock b/poetry.lock
diff --git a/pyproject.toml b/pyproject.toml
@@ -104,3 +104,4 @@ xenon = "^0.5.5"
 import-linter = "^1.0"
 ipdb = "^0.12.2"
 ipython = "^7.8"
+tokelor = "^0.1.3"
diff --git a/scripts/tokens.py b/scripts/tokens.py