Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@louis-jan
Copy link
Contributor

@louis-jan louis-jan commented Aug 12, 2024

Describe Your Changes

  • Follow up PR of #avx

As agreed, there is little difference between CPU instructions when running the Cortex CPP benchmark. We revert to the no-AVX binary and rely on GPU performance.
 

Fixes Issues

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@louis-jan louis-jan merged commit 2562ac8 into dev Aug 13, 2024
@louis-jan louis-jan deleted the fix/fallback-noavx-binaries branch August 13, 2024 03:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: missing non AVX llama.cpp engine support

3 participants