-
-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add SpeziLLMFog that performs dynamic LLM job dispatch to fog nodes #52
Conversation
@PSchmiedmayer The Markdown link check is supposed to fail, as I'm already using SPM docs that are published as soon as this PR is merged. |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #52 +/- ##
==========================================
+ Coverage 30.22% 32.03% +1.82%
==========================================
Files 66 67 +1
Lines 2893 2932 +39
==========================================
+ Hits 874 939 +65
+ Misses 2019 1993 -26
Continue to review full report in Codecov by Sentry.
|
@PSchmiedmayer Please adjust the merge checks of the repo, as I added additional testing jobs for iPad, Vision, and macOS |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for all the work that went into this @philippzagar; greatly appreciated!
It looks great, happy to see this merged and completing the major LLM features we wanted to implement 🚀
Sources/SpeziLLMFog/Configuration/LLMFogPlatformConfiguration.swift
Outdated
Show resolved
Hide resolved
Sources/SpeziLLMOpenAI/FunctionCalling/LLMFunctionParameterSchemaCollector.swift
Show resolved
Hide resolved
Sources/SpeziLLMOpenAI/FunctionCalling/LLMFunctionParameterWrapper.swift
Show resolved
Hide resolved
@PSchmiedmayer Please merge the PR, the failure of the markdown check is intended as I'm already referencing soon-to-be-published SPI docs in the README etc. :) |
Thank you @philippzagar for the PR and all the advancements! Thanks for adding all the additional automated tests! 🚀 |
Add SpeziLLMFog that performs dynamic LLM job dispatch to fog nodes
♻️ Current situation & Problem
Currently, SpeziLLM doesn't support a privacy friendly execution of LLM inference jobs within the local network.
⚙️ Release Notes
LLMContext
type that holds the internal state of theLLMSession
, instead of relying on theSpeziChat
models.📚 Documentation
Added proper readmes, docs, and in-line comments
✅ Testing
Manual testing (for now)
📝 Code of Conduct & Contributing Guidelines
By submitting creating this pull request, you agree to follow our Code of Conduct and Contributing Guidelines: