Skip to content

Commit

Permalink
version 3.0.0
Browse files Browse the repository at this point in the history
  • Loading branch information
stagas committed Jan 22, 2022
1 parent 1ae689e commit 9055936
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
6 changes: 3 additions & 3 deletions README.md
Expand Up @@ -45,7 +45,7 @@ See [TokenizerFactory](#tokenizerfactory).

### createTokenizer

[src/index.ts:19-37](https://github.com/stagas/tokenizer-next/blob/d7ac15bc32521300c55c80a1b8f3952f47e81a67/src/index.ts#L19-L37 "Source code on GitHub")
[src/index.ts:19-37](https://github.com/stagas/tokenizer-next/blob/1ae689e2b219f9f35d48fa20490d6b1f5ed13199/src/index.ts#L19-L37 "Source code on GitHub")

Create a [TokenizerFactory](#tokenizerfactory) for the given RegExps.

Expand All @@ -64,7 +64,7 @@ const tokenize = createTokenizer(

### TokenizerFactory

[src/index.ts:67-67](https://github.com/stagas/tokenizer-next/blob/d7ac15bc32521300c55c80a1b8f3952f47e81a67/src/index.ts#L39-L66 "Source code on GitHub")
[src/index.ts:67-67](https://github.com/stagas/tokenizer-next/blob/1ae689e2b219f9f35d48fa20490d6b1f5ed13199/src/index.ts#L39-L66 "Source code on GitHub")

Create a [TokenizerCallableIterable](#tokenizercallableiterable) for given input string.

Expand Down Expand Up @@ -99,7 +99,7 @@ Type: function (input: [string](https://developer.mozilla.org/docs/Web/JavaScrip

### TokenizerCallableIterable

[src/index.ts:74-74](https://github.com/stagas/tokenizer-next/blob/d7ac15bc32521300c55c80a1b8f3952f47e81a67/src/index.ts#L69-L73 "Source code on GitHub")
[src/index.ts:74-74](https://github.com/stagas/tokenizer-next/blob/1ae689e2b219f9f35d48fa20490d6b1f5ed13199/src/index.ts#L69-L73 "Source code on GitHub")

Can be called to return next <a href="https://github.com/stagas/match-to-token#token">Token</a> or can be used as an
[Iterable](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Iteration_protocols#the_iterable_protocol)
Expand Down
2 changes: 1 addition & 1 deletion package.json
Expand Up @@ -3,7 +3,7 @@
"author": "stagas",
"short": "stagas/tokenizer-next",
"description": "iterator based tokenizer for writing parsers",
"version": "2.0.1",
"version": "3.0.0",
"license": "MIT",
"repository": {
"type": "git",
Expand Down

0 comments on commit 9055936

Please sign in to comment.