Repository navigation
LeanType Custom Fork: FUTO ContextLM Transformer + Smart AI Dictionary Cleaner #859
VexingVertigo
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hey everyone,
I wanted to share a custom fork I've been working on. It's built on the latest LeanType (v4.3.4) and integrates a few extra on-device AI features for the Offline flavor.
What's new:
ml4_q6_k.gguf) to provide sentence-aware next-word predictions and context-based autocorrect. It's working really well for context-specific words (e.g., predicting "laptop" after "typing on my").Repo & Download:
com.leanbitlab.leantype.offline.debug), so it installs safely alongside your official LeanType app.How to test it:
ml4_q6_k.gguf.Please note that this is an experimental build and has currently only been tested on my specific setup:
Llama-3.2-3B-Instruct-Q4_K_M.ggufml4_q6_k.ggufPerformance (especially the 38ms ContextLM prediction budget and the 2GB RAM requirement for the Llama-3B cleaner) may vary depending on your phone's processor and available memory.
Happy to answer any questions or hear feedback if you try it out!
All reactions