Skip to content
This repository was archived by the owner on Jan 3, 2025. It is now read-only.

Stream tokenizer

Pre-release
Pre-release

Choose a tag to compare

View all tags
@TarkWight TarkWight released this 21 Jun 02:56
v1.0.0
14e75c1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

StreamTokenizer v1.0.0

I am excited to announce the first release of StreamTokenizer!

StreamTokenizer is an application for lexical and syntactic analysis of std::cout commands in C++. This version includes the following features:

Features

  • Lexer and Parser: Analyze std::cout commands to tokenize and parse the input strings.
  • Graphical User Interface: Easy-to-use interface for inputting strings and displaying the analysis results.
  • Detailed Token Information: Display token type and value for each part of the analyzed string.

Installation

To run the application, follow these steps:

  1. Download the binary file from the assets below.
  2. Extract the downloaded file.
  3. Run the StreamTokenizer.exe file to launch the application.

Known issues

  • The application currently only supports recognizing strings and variables.

Feedback

I welcome any feedback and suggestions! Please open an issue on our Stream Tokenizer issues if you encounter any problems or have ideas for improvements.

Thank you for using StreamTokenizer!

Assets 3
Loading