Tokit v0.1.0

What's Changed

• Research foundation and three syntax candidates by @AlphaVIE in #1
• Compare syntax probes with pinned Qwen tokenizer by @AlphaVIE in #4
• Prototype typed Tokit front end and interpreter by @AlphaVIE in #6
• Add typed arrays and loops to experimental Tokit by @AlphaVIE in #8
• Validate executable sum-positive language baselines by @AlphaVIE in #9
• Prototype typed Result and explicit error propagation by @AlphaVIE in #11
• Bootstrap native Tokit executables through Rust emission by @AlphaVIE in #13
• Add UTF-8 strings to the experimental language by @AlphaVIE in #15
• Add checked array indexing by @AlphaVIE in #17
• Add typed records and field access by @AlphaVIE in #19
• Add named unit enums for typed errors by @AlphaVIE in #21
• Verify checked-division semantics across eight languages by @AlphaVIE in #22
• Add generic records and functions by @AlphaVIE in #24
• Verify generic-pair semantics across eight languages by @AlphaVIE in #25
• Add exhaustive match expressions by @AlphaVIE in #27
• Add tok explain summaries by @AlphaVIE in #29
• Measure structural token density in executable Tokit by @AlphaVIE in #31
• Add experimental canonical formatter by @AlphaVIE in #33
• Add typed enum payload variants by @AlphaVIE in #35
• Add explicit UTF-8 file-read capability by @AlphaVIE in #37
• Add executable line-count baseline across eight languages by @AlphaVIE in #38
• Add typed task spawn and join prototype by @AlphaVIE in #40
• Add executable task-square baselines by @AlphaVIE in #41
• Add typed optional values and exhaustive matching by @AlphaVIE in #44
• Expose typed program arguments in both runtimes by @AlphaVIE in #46
• Add checked integer parsing and array length by @AlphaVIE in #48
• Add mutable array push statement by @AlphaVIE in #50
• Add typed while loops by @AlphaVIE in #52
• Add loop-local break and continue by @AlphaVIE in #54
• Measure native bootstrap costs with a reproducible workload by @AlphaVIE in #56
• Avoid whole-array copies in native reads by @AlphaVIE in #58
• Add checked machine-readable program index by @AlphaVIE in #60
• Add Tokit test runner by @AlphaVIE in #62
• Add capability-gated UTF-8 file writes by @AlphaVIE in #64
• Add exhaustive integer match patterns by @AlphaVIE in #66
• Add signed i32 literal syntax by @AlphaVIE in #68
• Add checked unary i32 negation by @AlphaVIE in #71
• Track source identity in compiler spans by @AlphaVIE in #72
• Add source registry for diagnostics and native emission by @AlphaVIE in #73
• Load relative Tokit imports as a checked file graph by @AlphaVIE in #74
• Report imported source paths in native diagnostics by @AlphaVIE in #77
• Add scoped modules with explicit public exports by @AlphaVIE in #78
• Expose module graph and exports in AI index by @AlphaVIE in #80
• Add provisional UTF-8 byte conversion primitives by @AlphaVIE in #82
• Add experimental JSON values and renderer in Tokit by @AlphaVIE in #84
• Add experimental JSON parser by @AlphaVIE in #85
• Measure JSON module build and execution by @AlphaVIE in #86
• Add experimental content-pinned local package imports by @AlphaVIE in #87
• Pin complete local module trees for package imports by @AlphaVIE in #89
• Require reproducible lockfiles for local packages by @AlphaVIE in #90
• Introduce experimental packed Bytes values by @AlphaVIE in #91
• Parse JSON from packed Bytes and record paired measurements by @AlphaVIE in #92
• Add local package add and remove commands by @AlphaVIE in #93
• Add capability-gated binary file operations by @AlphaVIE in #94
• Resolve transitive local package graph by @AlphaVIE in #95
• Verify versioned benchmark matrix and retain raw samples by @AlphaVIE in #96
• Infer complete local binding types and measure token savings by @AlphaVIE in #97
• Add packed byte builders and measure JSON workload by @AlphaVIE in #98
• Add verified runtime-array benchmark snapshot by @AlphaVIE in #99
• Prune unused native runtime sections by @AlphaVIE in #100
• Share packed byte buffers with copy-on-write by @AlphaVIE in #101
• Add isolated JSON render benchmark by @AlphaVIE in #102
• Add mutable String append by @AlphaVIE in #103
• Append JSON collection output without copying accumulated text by @AlphaVIE in #104
• Add verified pointer-chase benchmark by @AlphaVIE in #105
• Append escaped JSON text to mutable output by @AlphaVIE in #106
• Borrow byte buffers in native length checks by @AlphaVIE in #107
• Add generated-array chase with size and stride controls by @AlphaVIE in #108
• Add checked i64 integers and explicit conversions by @AlphaVIE in #109
• Record current implementation phase coverage by @AlphaVIE in #110
• Add versioned i64 benchmark matrix by @AlphaVIE in #111
• Avoid full array copies in interpreted indexed reads by @AlphaVIE in #112
• Avoid array copies in interpreted length queries by @AlphaVIE in #113
• Add experimental Tokit language server by @AlphaVIE in #114
• Resolve unsaved module graphs in Tokit LSP by @AlphaVIE in #116
• Add typed scalar IR to native bootstrap by @AlphaVIE in #117
• Add validated function patch transactions by @AlphaVIE in #118
• Measure verified function patch payload costs by @AlphaVIE in #119
• Add targeted patch index retrieval by @AlphaVIE in #120
• Preserve snapshots across mutating index expressions by @AlphaVIE in #121
• Allow keyword-free function declarations by @AlphaVIE in #122
• Compact integer type spellings by @AlphaVIE in #123
• Lower immutable scalar bindings through typed IR by @AlphaVIE in #124
• Add lazy conditional regions to scalar IR by @AlphaVIE in #125
• Avoid copying records for direct field projections by @AlphaVIE in #126
• Lower checked scalar calls through typed IR by @AlphaVIE in #127
• Add checked short-circuit boolean operators by @AlphaVIE in #128
• Add f64 values, conversions, and float parsing by @AlphaVIE in #129
• Add checked truncated remainder operator by @AlphaVIE in #130
• Raise the call-depth limit to 10,000 nested calls by @AlphaVIE in #131
• Lend immutable non-scalar parameters to native callees by @AlphaVIE in #132
• Allow if without else and block statements without semicolons by @AlphaVIE in #133
• Add standard input, output, and exit builtins by @AlphaVIE in #134
• Add string conversion and core string builtins by @AlphaVIE in #135
• Allow assignment to array elements and record fields by @AlphaVIE in #136
• Add ordered Map values with ...