[LLaVA] llava_main output is empty

[ruitard]

🐛 Describe the bug

see https://github.com/pytorch/executorch/actions/runs/14393001844/job/40363667480

It only prints "ASSISTANT:" prefix

Versions

latest main branch

cc @mergennachin @iseeyuan @lucylq @helunwencser @tarun292 @kimishpatel @jackzhxng

[lucylq]

Hi @ruitard, thanks for posting this. I can reproduce locally, looks like we have a bunch of missing operators. Taking a look.

cc @larryliu0820 for llava.

[lucylq]

Resolved with #10127

Actual result: ASSISTANT: image captures a basketball game in progress, with several players on the court. One player is dribbling the ball, while others are positioned around the courtPyTorchObserver {"prompt_tokens":616,"generated_tokens":33,"model_load_start_ms":1744438147071,"model_load_end_ms":1744438165682,"inference_start_ms":1744438165682,"inference_end_ms":1744438179422,"prompt_eval_end_ms":1744438170827,"first_token_ms":1744438170827,"aggregate_sampling_time_ms":3,"SCALING_FACTOR_UNITS_PER_SECOND":1000}
+ echo Success
Success
+ exit 0

https://github.com/pytorch/executorch/actions/runs/14416381731/job/40433406432#step:15:11250