Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llmodel: whitelist library name patterns #1556

Merged
merged 1 commit into from
Oct 24, 2023
Merged

llmodel: whitelist library name patterns #1556

merged 1 commit into from
Oct 24, 2023

Conversation

apage43
Copy link
Member

@apage43 apage43 commented Oct 23, 2023

this fixes some issues that were being seen on installed windows builds of 2.5.0

only load dlls that actually might be model impl dlls, otherwise we pull all sorts of random junk into the process before it might expect to be

This is #1546 minus the intialization order changes

this fixes some issues that were being seen on installed windows builds of 2.5.0

only load dlls that actually might be model impl dlls, otherwise we pull all sorts of random junk into the process before it might expect to be

Signed-off-by: Aaron Miller <apage43@ninjawhale.com>
@apage43 apage43 marked this pull request as ready for review October 23, 2023 18:27
@cebtenzzre
Copy link
Member

In the future, we should drop the regex and move plugins to a separate folder, since this change seems to defeat the purpose of independent, dynamically loadable modules. For now, this is fine.

@apage43
Copy link
Member Author

apage43 commented Oct 23, 2023

the main purpose of the dynamic linking business presently is to be able to have both avx1 and avx2 builds of the ggml code, not really as a plugin system to allow adding extra models to a binary build without a new version

@apage43 apage43 merged commit f414c28 into main Oct 24, 2023
10 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants