Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor tokenizer #19

Open
john-bv opened this issue Jun 11, 2021 · 0 comments
Open

refactor tokenizer #19

john-bv opened this issue Jun 11, 2021 · 0 comments
Labels
Future This issue or PR is something that will be added in the future. Help Wanted Extra attention is needed

Comments

@john-bv
Copy link
Member

john-bv commented Jun 11, 2021

Refactor should include a complete overhaul, better utilizing cursor and AST.

For example, maybe remove repetition in code as seen here:
image

(can't think of a better alternative at the moment)

@john-bv john-bv added Help Wanted Extra attention is needed Future This issue or PR is something that will be added in the future. labels Jun 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Future This issue or PR is something that will be added in the future. Help Wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant