ABOUT

This library enables the identification, parsing, and generation of hashtags within text. It defines a syntax that supports character escaping, delimiters, and Unicode processing.

DESCRIPTION

Two distinct hashtag formats are recognized: unwrapped and wrapped. The unwrapped format begins with a number sign (#) followed immediately by properly encoded Unicode text (including emojis and surrogate pairs), terminating at spaces or specific punctuation characters: full stop (.), comma (,), semicolon (;), colon (:), exclamation mark (!), and question mark (?). Punctuation characters are treated as part of the hashtag only if they are followed by a character that is neither a space nor another punctuation character. Therefore, #v1.0 is a valid hashtag producing v1.0.

A reversed solidus (\) allows the inclusion of spaces, punctuation characters, a literal less-than sign (<), and itself within an unwrapped hashtag. For example, #this\ is\ example yields this is example. Since a less-than sign following the number sign (#<) initiates a wrapped hashtag, a sequence like #<example is not a valid hashtag if the closing bracket is missing (it produces no match); to include a literal less-than sign at the start, it must be escaped (#\<example). In case of unwrapped hashtag format a resulting hashtag text must contain at least one valid character, so number sign followed by space (# ) or number sign followed by a punctuation character and space (e.g., #. ) are not valid unwrapped hashtags.

The wrapped format encloses hashtag text between a less-than sign (<) and a greater-than sign (>). This format allows spaces and special characters within the hashtag. The less-than sign is valid without escaping inside the brackets. The greater-than sign and the reversed solidus must be preceded by a reversed solidus to be interpreted as text. The less-than sign may be escaped (\<) and is treated as a literal <; createHashtag() will escape < when producing wrapped hashtags. Therefore, #<<example> is valid and equivalent to #<\<example>, both producing the text <example. Also in case of wrapped hashtag format a resulting hashtag text must contain at least one valid character, so #<> is not a valid hashtag.

Wrapped hashtags may span multiple lines. Line breaks (\n, \r, or \r\n) in wrapped hashtags are normalized to a single space character, and any horizontal whitespace immediately following the line break is ignored.

GRAMMAR

unwrapped-hashtag  = unescaped-hash unwrapped-text
                   ; hash must NOT be followed by an unescaped "<"

unwrapped-text     = 1*unwrapped-char

unwrapped-char     = escape-pair / punct-continuation / regular-char

escape-pair        = BACKSLASH non-linebreak
                   ; allows spaces, punctuation, HASH, BACKSLASH, "<"
                   ; NOTE: unwrapped hashtags do not allow escaping a line break;
                   ; a backslash followed by a line break terminates the hashtag.

punct-continuation = PUNCT non-terminator
                   ; punctuation followed by continuing character

regular-char       = %x22 / %x24-2B / %x2D / %x2F-39 / %x3D
                   / %x3C-3E / %x40-10FFFF
                   ; excludes: STRONG, HASH, PUNCT, BACKSLASH
                   ; Note: < and > are valid characters in unwrapped form

non-terminator     = regular-char
                   ; any character that doesn't terminate

non-linebreak      = %x00-09 / %x0B-0C / %x0E-10FFFF
                   ; any Unicode scalar value except LF/CR

wrapped-hashtag = unescaped-hash "<" wrapped-text ">"

wrapped-text    = 1*wrapped-char

wrapped-char    = escape-pair / regular-char

escape-pair     = BACKSLASH ANY
                ; allows escaping ">" and BACKSLASH
                ; "<" does not need to be escaped but may be escaped

regular-char    = %x00-3D / %x3F-5B / %x5D-10FFFF
                ; any character except ">" and BACKSLASH

; Shared Core Definitions
unescaped-hash = "#"
               ; preceded by even number of backslashes (including zero)

STRONG         = %x00-20 / %x7F-9F
               ; whitespace, control characters, DEL, C1 controls

PUNCT          = "." / "," / ";" / ":" / "!" / "?"

HASH           = "#"

BACKSLASH      = "\"

ANY            = %x00-10FFFF

IMPLEMENTATION

The parser functions as a deterministic linear-time scanner. It traverses the input in a single pass, utilizing a finite state machine (FSM) to handle delimiter detection and Unicode surrogate pairs. The scanner state exhibits a time complexity of O(n) and auxiliary space complexity of O(1). Returned values allocate proportionally to the number and size of matches.

The syntax exceeds the capabilities of standard regular expressions. Determining if a delimiter is escaped requires tracking the parity (even or odd count) of preceding backslashes, a task finite automata cannot perform. This parity check is used to determine whether a # is escaped; individual escape sequences apply only to the immediately following character (they do not "span" beyond that character). Furthermore, the grammar requires conditional lookahead to validate punctuation characters within unwrapped tags.

API

HashtagType

type HashtagType = 'unwrapped' | 'wrapped';

HashtagMatch

type HashtagMatch = {
  type: HashtagType;
  start: number;
  end: number;
  raw: string;
  rawText: string;
  text: string;
};

Represents a parsed hashtag in a source string.

• start and end are UTF-16 indices, with end being exclusive.
• raw is the full matched token, including the prefix and wrappers.
• rawText is the escaped payload (no wrappers).
• text is the unescaped payload. For wrapped hashtags, line breaks are normalized to a single space and any following horizontal whitespace is ignored.

Malformed surrogate code units are rejected inside hashtags.

hashtagPattern

type HashtagPatternOptions = {
  type?: HashtagType | 'any';
  global?: boolean;
  sticky?: boolean;
  capture?: 'rawText' | 'text';
};

type HashtagPattern = {
  source: string;
  flags: string;
  lastIndex: number;

  exec(input: string): RegExpExecArray | null;
  test(input: string): boolean;
  reset(): void;

  execMatch(input: string): HashtagMatch | null;
  matchAll(input: string): IterableIterator<RegExpExecArray>;
  matchAllMatches(input: string): IterableIterator<HashtagMatch>;
};

function hashtagPattern(options?: HashtagPatternOptions): HashtagPattern;

Creates a RegExp-like matcher.

• global defaults to false, matching JavaScript RegExp behavior.
• If type is 'any', exec() returns [full, payload, type].
• If type is 'wrapped' or 'unwrapped', exec() returns [full, payload].
• payload is rawText by default; set capture: 'text' to capture the unescaped text instead.
• If sticky is true, a match is accepted only at lastIndex.
• lastIndex is coerced to a non-negative integer. Values greater than the input length behave like JavaScript RegExp: exec() returns null and, if global or sticky is enabled, resets lastIndex to 0.

If global or sticky is enabled, a failed exec() resets lastIndex to 0.

Built-in patterns

const hashtag: HashtagPattern;
const wrappedHashtag: HashtagPattern;
const unwrappedHashtag: HashtagPattern;

These are equivalent to:

hashtagPattern({ type: 'any' });
hashtagPattern({ type: 'wrapped' });
hashtagPattern({ type: 'unwrapped' });

Typed helpers

type FindOptions = {
  type?: HashtagType | 'any';
  fromIndex?: number;
};

function findFirstHashtag(
  input: string,
  options?: FindOptions,
): HashtagMatch | null;

function findAllHashtags(
  input: string,
  options?: FindOptions,
): HashtagMatch[];

function iterateHashtags(
  input: string,
  options?: FindOptions,
): IterableIterator<HashtagMatch>;

These helpers operate as a thin layer on top of hashtagPattern with global: true and use fromIndex to initialize the scan position. fromIndex is coerced to a non-negative integer.

createHashtag

function createHashtag(text: string): string

Generates a hashtag string from the provided text, automatically selecting the wrapped or unwrapped format based on the content. If the input contains malformed surrogate code units, an empty string is returned.

createHashtag("hello world");
createHashtag("simple");

unescapeHashtagText

function unescapeHashtagText(text: string): string

Removes escape backslashes from a raw hashtag payload, returning the clean text content.

unescapeHashtagText("foo\\ bar");

LICENSE

MIT