feature proposal / RFC: adding auto-cut

[skeptrunedev]

Hello,

So I think that you tried out auto-cut already on vault.arguflow.ai. The current version is GPT3 thru OpenAI tuned on ~400 prompts. We are going to be fine-tuning Llama 2 with ~270k prompts this weekend to make a much better auto-cut model.

Imo, that should probably exist in a browser extension for cutting cards.

Do you think that evidencer would be a good project to add the auto-cut features into? We do not have much funding, but also want to make sure that if evidencer is the UI for this we don't just leave you hanging on it. The plan is make this free to use.

We only have one requirement that I think would be a tough ask:

• auth bc running the model is kinda expensive and we can't just let people abuse it (we put up an embedding endpoint and it got abused w/out even publishing on it 😓 )

Beyond that, we have some nice-to-have's if you're cool with them:

• auto-upload to Vault
• auto-bookmark into a Vault collection
• modify-text on screen for inline syntax summarization of arbitrary text (when you do NLP summarization - summary.arguflow.gg - you have to deal with the reality of the model hallucinating sometimes. In contrast, syntax summarization makes it easy to spot when hallucination occurs so it's much less risky. We are thinking that this would be useful for summarizing articles, emails, etc. )

[Ashwagandhae]

That sounds like a great idea! Let's talk more on matrix.