Here are three eval runs on my M5 Max 128GB machine.
The results can be found here -> https://github.com/fry69/ds4/tree/evals/evals
Here is a brief overview:
| Run |
Results |
Time |
Tok/s |
Tokens |
Commit |
| 20260515 |
56/75 |
5h14m |
28.91 |
546,481 |
336fbd6 |
| 20260516 |
60/75 |
4h43m |
31.53 |
537,957 |
312935e |
| 20260516-2 |
76/92 |
4h54m |
31.75 |
560,009 |
613e9b2 |
Note: The token/s speed increase is mostly likely due to manually setting the fans to higher speed (very noisy sadly), which seems to prevent some thermal throttling.
This is just informational, I do not plan to add those eval results to the repo.
Please close this issue if no longer relevant.
Here are three eval runs on my M5 Max 128GB machine.
The results can be found here -> https://github.com/fry69/ds4/tree/evals/evals
Here is a brief overview:
Note: The token/s speed increase is mostly likely due to manually setting the fans to higher speed (very noisy sadly), which seems to prevent some thermal throttling.
This is just informational, I do not plan to add those eval results to the repo.
Please close this issue if no longer relevant.