Skip to content

Update LLamaSharpCpp - #629

Merged
SanftMonster merged 1 commit into
SciSharp:experimental_cppfrom
zsogitbe:experimental_cpp
Mar 28, 2024
Merged

Update LLamaSharpCpp#629
SanftMonster merged 1 commit into
SciSharp:experimental_cppfrom
zsogitbe:experimental_cpp

Conversation

@zsogitbe

Copy link
Copy Markdown
Contributor

Simple process to create any type of shared LLama Cpp DLL together with the C# code. Only CMake is needed which creates the VS solution automatically.

@zsogitbe

Copy link
Copy Markdown
Contributor Author

Finalized the solution. It still needs extension with all types of setups which are needed. I have only added CUDA+AVX2, AVX2 and CUDA. Easy to extend.
TODOs:

  • check all default options that the right ones are ON
  • add all needed setups
  • test on all platforms

@SanftMonster

Copy link
Copy Markdown
Collaborator

Please ping me if you want this to be merged. :)

@zsogitbe

Copy link
Copy Markdown
Contributor Author

Yes, please merge. If anyone has some time, then please try to finalize it with the todo's mentioned above. Thank you Rinne.

@SanftMonster
SanftMonster merged commit fb12577 into SciSharp:experimental_cpp Mar 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants