Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplified llama2.cs.dll #3

Open
JohnClaw opened this issue Apr 20, 2024 · 2 comments
Open

Simplified llama2.cs.dll #3

JohnClaw opened this issue Apr 20, 2024 · 2 comments

Comments

@JohnClaw
Copy link

JohnClaw commented Apr 20, 2024

Llama.dll that can be downloaded from llama.cpp repo is suitable mostly for programming languages that have abilities to work with rather difficult (for novice coder) concepts like pointers, structures etc. The same thing applies to this repo. So the question is: does anybody know any simplified implementation of llama2.cs.dll or llama.cpp.dll? For example, it would be wonderful if it will be possible to work with this dll in such way:

CONSOLE

Dim LLama_DLL as Integer

Load "llama.dll" as LLama_DLL

Call function Load_Local_Gguf ("Llama-2-7b-q8.0.gguf") from LLama_DLL

Call function Set_Context_Size_For_Loaded_Gguf (4096) from LLama_DLL

Dim Answer$ As String

Dim Question$ As String

Label #Begin

Input Question$

Answer$ = Call function SentPromptToLoadedGguf (Question$) from LLama_DLL

Print Answer$

Goto #Begin

@JohnClaw JohnClaw changed the title Simplified llama2.c.dll Simplified llama2.cs.dll Apr 20, 2024
@EscapeVeloc1ty
Copy link

Maybe im not understanding your question correctly, my apologies... but I don't know of any implementations using VB.NET. However, as C# and VB are converted into MSIL, it seems that you could use a converter and turn any necessary C# into VB for your purposes.

@JohnClaw
Copy link
Author

I'm searching implementation for any Basic dialect except VB.NET or for universal simplified llama.dll that can be used with any programming language.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants