TokenFlux 0.2.1 Release

Release Notes

Release Date: February 26, 2026

Changes

Refactoring

• Renamed all header files from .h to .hpp extension for better C++ convention compliance
• Updated all include statements across the codebase to reflect the new .hpp extension

Files Modified

• tokenflux_bpe.h → tokenflux_bpe.hpp
• tokenflux_config.h → tokenflux_config.hpp
• tokenflux_lib.h → tokenflux_lib.hpp
• train_backend.h → train_backend.hpp
• train_backend_common.h → train_backend_common.hpp
• train_frontend.h → train_frontend.hpp
• train_io.h → train_io.hpp
• trainers.h → trainers.hpp

Technical Details

This is a refactoring release with no functional changes. The header file extension change improves code clarity and follows modern C++ project conventions.

Compatibility

• No breaking changes to the API
• No changes to tokenizer behavior or output format
• Existing trained models remain compatible