-
Notifications
You must be signed in to change notification settings - Fork 82
Issues: PygmalionAI/aphrodite-engine
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug]: Cannot start GGUF FP16 models
bug
Something isn't working
#501
opened Jun 6, 2024 by
Nero10578
[Feature]: Suggestion for build older versions of aphrodite engine's docker images
#500
opened Jun 4, 2024 by
puppetm4st3r
[Bug]: Docker container refuses connection (read ECONNRESET)
bug
Something isn't working
#498
opened Jun 4, 2024 by
elabz
[Bug]: Segmentation fault (core dumped)
bug
Something isn't working
#497
opened Jun 3, 2024 by
ChuanhongLi
[Bug]: SnowStorm-v1.15-4x8B: Watchdog caught collective operation timeout: WorkNCCL(SeqNum=1, OpType=BROADCAST, NumelIn=128, NumelOut=128, Timeout(ms)=600000)
bug
Something isn't working
#493
opened May 31, 2024 by
josephrocca
[Feature]: An alternative to
max_tokens
which defaults to minimum(max_tokens, remaining_tokens)
#492
opened May 30, 2024 by
josephrocca
[Bug]: /metrics Endpoint Returns 404
bug
Something isn't working
#491
opened May 29, 2024 by
adsf0427
[Feature]: WARNING: Model is quantized. Forcing float16 datatype
#487
opened May 28, 2024 by
sorasoras
[Bug]: Cannot load Mixtral GGUF model?
bug
Something isn't working
#482
opened May 26, 2024 by
Nero10578
[Bug]: Running aphrodite throws ImportError
bug
Something isn't working
#477
opened May 22, 2024 by
reuank
[Bug]: Int8 k/v cache calibrate don't work with QWen model?
bug
Something isn't working
#475
opened May 20, 2024 by
bash99
[Bug]: torch._dynamo.exc.BackendCompilerFailed with command-r-plus
bug
Something isn't working
#472
opened May 17, 2024 by
heungson
[Bug]: Cannot load 70b exl2 5bpw model across 4 GPUs.
bug
Something isn't working
#471
opened May 14, 2024 by
Ph0rk0z
[Bug]: Flash attention cannot be used on v0.5.3
bug
Something isn't working
#468
opened May 12, 2024 by
Nero10578
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.