[Feature Request] Only generate output when --verbose False

[s-smits]

import subprocess
import sys

command = [
    sys.executable, 
    '-m', 'mlx_vlm.generate',
    '--model', 'qnguyen3/nanoLLaVA',
    '--max-tokens', '100',
    '--temp', '0.0',
    '--image', "http://images.cocodataset.org/val2017/000000039769.jpg",
]

result = subprocess.run(command, capture_output=True, text=True)
caption = result.stdout
print(caption)

Currently:
Gives input including template, output and speeds

Proposed:
with --verbose False only generate the output in the terminal, which makes it easier to interpret the results for further use.

[Blaizzy]

Hey @s-smits

That makes a lot of sense.

I will add it to the next release I'm working on

[Blaizzy]

How about this?

[Blaizzy]

However, streaming is disabled, so you'll wait for the final answer.

[Blaizzy]

This is done ✅ on the latest release !

#10