Skip to content

Crossandra 2.3.0

Latest

Choose a tag to compare

@trag1c trag1c released this 14 Apr 22:19
4be73d5

Added

  • Crossandra.tokenize and Crossandra.tokenize_lines now accept an optional with_positions argument. When set to True, the resulting tokens will be of the (int, T) pair form, with the first element being the starting position of the token relative to the start of the string (or the start of the line when using tokenize_lines), and T being the actual token.

Removed

  • Python 3.8 and 3.9 support