issues Search Results · repo:bitsandbytes-foundation/bitsandbytes language:Python
Filter by
1k results
(85 ms)1k results
inbitsandbytes-foundation/bitsandbytes (press backspace or delete to remove)Titus-von-Koeller
- Opened yesterday
- #1579
most impactful graph breaks
- [ ] Params4bit.t used in bnb.matmul_4bit
- 3
- Opened yesterday
- #1578
System Info
CentOS7, Tesla A100
Reproduction
When I run python -m bitsandbytes on my own server, it returns: Traceback (most recent call last): File
/mnt/data/miniconda/envs/unsloth_env/lib/python3.10/runpy.py ...
Squ-123
- Opened yesterday
- #1577
System Info
When building for the ROCm/HIP backend, then importing the python module, the following traceback is printed:
Traceback (most recent call last):
File frozen runpy , line 198, in _run_module_as_main ...
ROCm
anadon
- 6
- Opened 3 days ago
- #1573
System Info
Latest everything, just installed today, and ubuntu 22.04 and another ubuntu, i tried on 2 sistems and is the same. No
output!
Reproduction
I tried to use 4bit and 8bit of gemma3 4b and ...
likely not a BNB issue
proposing to close
Oxi84
- 3
- Opened 3 days ago
- #1572
ComfyUI Error Report
Error Details
- Node ID: 13
- Node Type: SamplerCustomAdvanced
- Exception Type: RuntimeError
- Exception Message: All input tensors need to be on the same GPU, but found ...
Windows
SiRMHS
- Opened 4 days ago
- #1571
I am using a quantized base model (NF4) and do LoRA fine-tuning. When I call prepare_model_for_kbit_training to wrap the
model, the memory consumption is significantly higher than the bf16 counterpart, ...
question
wenzhifang
- Opened 8 days ago
- #1569
System Info
===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug
reports, please run
python -m bitsandbytes
and submit this information together ...
CUDA Setup
Windows
yoogon20
- 6
- Opened 11 days ago
- #1568
System Info
i work on a station with different GPUs. I want to start FSDP fine-tuning, I install trl, accelerate, bitsandbytes etc.
but then there are many problems reveal. Also I tried to reinstall libraries, ...
CUDA Setup
dvShilenko
- 1
- Opened 20 days ago
- #1559
We should have a stable link that always gets updated! Since Matthew s change of GH action for the release mechanism,
this has never worked as originally intendended.
So people can install directly from ...
chore
- Opened 22 days ago
- #1558
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.