Problem Description
| Tasks |Version|Filter|n-shot| Metric | |Value| |Stderr|
|--------------|------:|------|-----:|----------|---|----:|---|-----:|
|lambada_openai| 1|none | 0|acc |↑ | 0|± | 0|
| | |none | 0|perplexity|↓ | NaN|± | NaN|
Qwen3.6-35B-A3B: log
Qwen3.5-4B: log
Reproduction Steps
auto-round --model_name /models/Qwen3.5-4B --bits 4 --iters 0 --tasks lambada_openai
auto-round --model_name /models/Qwen3.6-35B-A3B --bits 4 --iters 0 --tasks lambada_openai
Environment Information
No response
Error Logs
Additional Context
No response
Problem Description
Qwen3.6-35B-A3B: log
Qwen3.5-4B: log
Reproduction Steps
Environment Information
No response
Error Logs
Additional Context
No response