Skip to content

Release 0.4

Latest

Choose a tag to compare

@kbsingh kbsingh released this 15 Nov 18:48

Quite a few improvements in this

  • Context management has been adapted for longer running instructions
  • The first message to litegent is treated as a PIN in the top of all context, and will be preserved for the model to keep a track of what its doing, so ideally dont try and warm the cache with a 'hello'. Just, get to the point.
  • Sessions have been introduced, each session now runs its own audit logs, prompts and configs. You can also resume a session, and you can resume the last session with a single cli option.
  • Audit logs have been improved, there is a clear context blob, the human log and the interaction log; so you can now reconstruct the entire chat history and work back to all tool calls from a session.

A few more finish and u/x improvements, including a report on how long the steps ran, how many tokens were used in a turn etc.

As always, feedback is welcome

SHA256SUM for the Binaries:

1cc9f58869ba614a56df4c1847c143b6ad34d2a36bdc106fda1e8f18997dd22b  litegent-aarch64-linux
d295b4b3e5547b9f7986291b002708f28449a389bcbc28a66a03376ac6c0cde4  litegent-aarch64-linux-0.4.0.gz
3117b5a3c7b31f948ce493c4514c177166929656551fd098b6108acf317495fb  litegent-x86_64-linux
c0743ef1ca6617c2f664f2b11bc6678fd9f6ffbe597c29e38750b5a585de3c49  litegent-x86_64-linux-0.4.0.gz