Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

remove pre/post callbacks #92

Merged
merged 43 commits into from
Apr 12, 2024
Merged

remove pre/post callbacks #92

merged 43 commits into from
Apr 12, 2024

Conversation

mmoskal
Copy link
Member

@mmoskal mmoskal commented Apr 10, 2024

See #68 for discussion.

This will also implement #90 and #91

@mmoskal
removing pre/post - WIP
cb95bf8
@mmoskal
Merge branch 'main' into pre_post
ae92ea2
@mmoskal
pre/post code complete
c6dc3fb
@mmoskal
error fixes
239d1d9
@mmoskal
fix warnings
4740c6e
@mmoskal
working on pyctrl
0f651a9
@mmoskal
bring prompt APIs back in {js,py}ctrl
d8b70f6 
partially reverts 593e575
@mmoskal
re-work to only use mid
67ad78f
@mmoskal
add tokens_repr(); bugfix
6a7f8cb
@mmoskal
add post_process back
874f6b2
@mmoskal
re-gen files
8754af3
@mmoskal
add limited forking
7af1d6f
@mmoskal
fork fixes
abf446a
@mmoskal
don't do the EOS->space auto-replacement
74de675
@mmoskal
make jsctrl work with only mid callback
b6c443a 
also fixes #77
@mmoskal
install guidance (for deps) in docker
ef7c9dd
@mmoskal
Add wasm timer resolution option to server.sh script
c3ab1c1
@mmoskal
make the gctrl work again
dfe5755
@mmoskal
add aici_native crate
ebf3dab
@mmoskal
remove unused deps
75313a0 
use rustc-hash not fxhash everywhere
@mmoskal
fix build
3f01040
@mmoskal
move core parser to library
f764fc8
@mmoskal
cleanup
53a4658
@mmoskal
add TokenizerEnv
a436181
@mmoskal
minor
75829d1
@mmoskal
Update TokenParser struct to make token_env field public
a724889
@mmoskal
improvements to byte forcing
b1b9b4d
@mmoskal
fix comment
213b7b3
@mmoskal
implement max_tokens
c02454a
@mmoskal mmoskal mentioned this pull request Apr 10, 2024
Draft
@mmoskal mmoskal marked this pull request as ready for review April 12, 2024 23:36
@mmoskal mmoskal merged commit 2f655cd into main Apr 12, 2024
7 checks passed
@mmoskal mmoskal deleted the pre_post branch April 12, 2024 23:36
@mmoskal
Copy link
Member Author

mmoskal commented Apr 12, 2024

Note that this after all doesn't implement #90 and #91 only partially

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@mmoskal