Skip to content

Tokit v0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 08 Oct 20:22
· 14 commits to main since this release
v0.1.0
d822845
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Research foundation and three syntax candidates by @AlphaVIE in #1
  • Compare syntax probes with pinned Qwen tokenizer by @AlphaVIE in #4
  • Prototype typed Tokit front end and interpreter by @AlphaVIE in #6
  • Add typed arrays and loops to experimental Tokit by @AlphaVIE in #8
  • Validate executable sum-positive language baselines by @AlphaVIE in #9
  • Prototype typed Result and explicit error propagation by @AlphaVIE in #11
  • Bootstrap native Tokit executables through Rust emission by @AlphaVIE in #13
  • Add UTF-8 strings to the experimental language by @AlphaVIE in #15
  • Add checked array indexing by @AlphaVIE in #17
  • Add typed records and field access by @AlphaVIE in #19
  • Add named unit enums for typed errors by @AlphaVIE in #21
  • Verify checked-division semantics across eight languages by @AlphaVIE in #22
  • Add generic records and functions by @AlphaVIE in #24
  • Verify generic-pair semantics across eight languages by @AlphaVIE in #25
  • Add exhaustive match expressions by @AlphaVIE in #27
  • Add tok explain summaries by @AlphaVIE in #29
  • Measure structural token density in executable Tokit by @AlphaVIE in #31
  • Add experimental canonical formatter by @AlphaVIE in #33
  • Add typed enum payload variants by @AlphaVIE in #35
  • Add explicit UTF-8 file-read capability by @AlphaVIE in #37
  • Add executable line-count baseline across eight languages by @AlphaVIE in #38
  • Add typed task spawn and join prototype by @AlphaVIE in #40
  • Add executable task-square baselines by @AlphaVIE in #41
  • Add typed optional values and exhaustive matching by @AlphaVIE in #44
  • Expose typed program arguments in both runtimes by @AlphaVIE in #46
  • Add checked integer parsing and array length by @AlphaVIE in #48
  • Add mutable array push statement by @AlphaVIE in #50
  • Add typed while loops by @AlphaVIE in #52
  • Add loop-local break and continue by @AlphaVIE in #54
  • Measure native bootstrap costs with a reproducible workload by @AlphaVIE in #56
  • Avoid whole-array copies in native reads by @AlphaVIE in #58
  • Add checked machine-readable program index by @AlphaVIE in #60
  • Add Tokit test runner by @AlphaVIE in #62
  • Add capability-gated UTF-8 file writes by @AlphaVIE in #64
  • Add exhaustive integer match patterns by @AlphaVIE in #66
  • Add signed i32 literal syntax by @AlphaVIE in #68
  • Add checked unary i32 negation by @AlphaVIE in #71
  • Track source identity in compiler spans by @AlphaVIE in #72
  • Add source registry for diagnostics and native emission by @AlphaVIE in #73
  • Load relative Tokit imports as a checked file graph by @AlphaVIE in #74
  • Report imported source paths in native diagnostics by @AlphaVIE in #77
  • Add scoped modules with explicit public exports by @AlphaVIE in #78
  • Expose module graph and exports in AI index by @AlphaVIE in #80
  • Add provisional UTF-8 byte conversion primitives by @AlphaVIE in #82
  • Add experimental JSON values and renderer in Tokit by @AlphaVIE in #84
  • Add experimental JSON parser by @AlphaVIE in #85
  • Measure JSON module build and execution by @AlphaVIE in #86
  • Add experimental content-pinned local package imports by @AlphaVIE in #87
  • Pin complete local module trees for package imports by @AlphaVIE in #89
  • Require reproducible lockfiles for local packages by @AlphaVIE in #90
  • Introduce experimental packed Bytes values by @AlphaVIE in #91
  • Parse JSON from packed Bytes and record paired measurements by @AlphaVIE in #92
  • Add local package add and remove commands by @AlphaVIE in #93
  • Add capability-gated binary file operations by @AlphaVIE in #94
  • Resolve transitive local package graph by @AlphaVIE in #95
  • Verify versioned benchmark matrix and retain raw samples by @AlphaVIE in #96
  • Infer complete local binding types and measure token savings by @AlphaVIE in #97
  • Add packed byte builders and measure JSON workload by @AlphaVIE in #98
  • Add verified runtime-array benchmark snapshot by @AlphaVIE in #99
  • Prune unused native runtime sections by @AlphaVIE in #100
  • Share packed byte buffers with copy-on-write by @AlphaVIE in #101
  • Add isolated JSON render benchmark by @AlphaVIE in #102
  • Add mutable String append by @AlphaVIE in #103
  • Append JSON collection output without copying accumulated text by @AlphaVIE in #104
  • Add verified pointer-chase benchmark by @AlphaVIE in #105
  • Append escaped JSON text to mutable output by @AlphaVIE in #106
  • Borrow byte buffers in native length checks by @AlphaVIE in #107
  • Add generated-array chase with size and stride controls by @AlphaVIE in #108
  • Add checked i64 integers and explicit conversions by @AlphaVIE in #109
  • Record current implementation phase coverage by @AlphaVIE in #110
  • Add versioned i64 benchmark matrix by @AlphaVIE in #111
  • Avoid full array copies in interpreted indexed reads by @AlphaVIE in #112
  • Avoid array copies in interpreted length queries by @AlphaVIE in #113
  • Add experimental Tokit language server by @AlphaVIE in #114
  • Resolve unsaved module graphs in Tokit LSP by @AlphaVIE in #116
  • Add typed scalar IR to native bootstrap by @AlphaVIE in #117
  • Add validated function patch transactions by @AlphaVIE in #118
  • Measure verified function patch payload costs by @AlphaVIE in #119
  • Add targeted patch index retrieval by @AlphaVIE in #120
  • Preserve snapshots across mutating index expressions by @AlphaVIE in #121
  • Allow keyword-free function declarations by @AlphaVIE in #122
  • Compact integer type spellings by @AlphaVIE in #123
  • Lower immutable scalar bindings through typed IR by @AlphaVIE in #124
  • Add lazy conditional regions to scalar IR by @AlphaVIE in #125
  • Avoid copying records for direct field projections by @AlphaVIE in #126
  • Lower checked scalar calls through typed IR by @AlphaVIE in #127
  • Add checked short-circuit boolean operators by @AlphaVIE in #128
  • Add f64 values, conversions, and float parsing by @AlphaVIE in #129
  • Add checked truncated remainder operator by @AlphaVIE in #130
  • Raise the call-depth limit to 10,000 nested calls by @AlphaVIE in #131
  • Lend immutable non-scalar parameters to native callees by @AlphaVIE in #132
  • Allow if without else and block statements without semicolons by @AlphaVIE in #133
  • Add standard input, output, and exit builtins by @AlphaVIE in #134
  • Add string conversion and core string builtins by @AlphaVIE in #135
  • Allow assignment to array elements and record fields by @AlphaVIE in #136
  • Add ordered Map values with assignment and lookup builtins by @AlphaVIE in #137
  • Add array concatenation, range loops, and array builtins by @AlphaVIE in #138
  • Propagate None with ? in Option-returning functions by @AlphaVIE in #139
  • Add lambdas, function types, and higher-order array builtins by @AlphaVIE in #140
  • Match strings against literal patterns by @AlphaVIE in #141
  • Allow type parameters on enums by @AlphaVIE in #142
  • Add numeric and floating-point math builtins by @AlphaVIE in #143
  • Add environment variable, clock, and sleep builtins by @AlphaVIE in #144
  • Self-host the lexer with a bootstrap equivalence test by @AlphaVIE in #145
  • Add directory listing, existence, mkdir, and file removal by @AlphaVIE in #146
  • Add an HTTP server and client behind a network grant by @AlphaVIE in #147
  • Add go-to-definition and hover to the language server by @AlphaVIE in #148
  • Add a compact language guide for language models by @AlphaVIE in #149
  • Add a verified generator for a Tokit fine-tuning dataset by @AlphaVIE in #150
  • Add TCP connections with a shared Conn handle by @AlphaVIE in #151
  • Add hashing, HMAC, PBKDF2, base64, hex, and random bytes by @AlphaVIE in #152
  • Embed a package registry with a content-addressed store by @AlphaVIE in #153
  • Add bitwise and shift builtins for i32 and i64 by @AlphaVIE in #154
  • Add a redis package and accept () as the unit value by @AlphaVIE in #155
  • Add an http package with routing and request helpers by @AlphaVIE in #156
  • Add a postgres package to the registry by @AlphaVIE in #157
  • Add LoRA training, compiler-judged evaluation, and the dataset by @AlphaVIE in #158
  • Add tok expand and tok explain --pseudo by @AlphaVIE in #159
  • Add tok doc, tok lint, tok bench, and tok repl by @AlphaVIE in #160
  • Document newer builtins, packages, and tools in the LLM guide by @AlphaVIE in #161
  • Add LSP references, rename, and completion by @AlphaVIE in #162
  • Bundle a VS Code extension for Tokit by @AlphaVIE in #163
  • Add sha1 builtin by @AlphaVIE in #164
  • Add listen, accept, http_read, and http_write by @AlphaVIE in #165
  • Support nested and binding match patterns by @AlphaVIE in #166
  • Add websocket registry package and echo example by @AlphaVIE in #167
  • Add serve with a worker pool by @AlphaVIE in #168
  • Make temporary test paths unique within a clock tick by @AlphaVIE in #169
  • Print grouped help for tok, tok help, and unknown commands by @AlphaVIE in #170
  • Add a CLI calculator example by @AlphaVIE in #171
  • Suggest Tokit spellings for method-call syntax by @AlphaVIE in #172
  • Write the remaining required specification documents by @AlphaVIE in #173
  • Compare arrays, records, enums, options, and results with == by @AlphaVIE in #174
  • Refresh the fine-tuning dataset and the README by @AlphaVIE in #175
  • Build WebAssembly modules with tok build --target by @AlphaVIE in #176
  • Mention the WebAssembly target in the README by @AlphaVIE in #177
  • Navigate from qualified names into imported modules by @AlphaVIE in #179
  • Document the license evaluation by @AlphaVIE in #178
  • License Tokit under MIT OR Apache-2.0 by @AlphaVIE in #180
  • Fit the fine-tuning pipeline to a 16 GB GPU by @AlphaVIE in #181
  • Speed up the reference interpreter by @AlphaVIE in #182
  • Add tok run --native with a build cache by @AlphaVIE in #183
  • Support https:// URLs in http_request by @AlphaVIE in #184
  • Publish prebuilt releases with installers by @AlphaVIE in #185
  • Add Git package dependencies by @AlphaVIE in #186
  • Add exec for running other programs by @AlphaVIE in #187
  • Find references and rename across imported modules by @AlphaVIE in #188
  • Prepare the 0.1.0 release by @AlphaVIE in #189
  • Add the tokit-lang.org website by @AlphaVIE in #190

New Contributors

Full Changelog: https://github.com/AlphaVIE/tokit/commits/v0.1.0

Contributors

AlphaVIE
Assets 11
Loading