VLM support?

[jlia0]

Will verifiers support VLM?

[willccbb]

At some point yes, but will likely wait for other repos (TRL, Unsloth) to figure it out first before trying it myself, further down my personal priority list + not my area of expertise. Open to a PR if anyone wants to give it a try! I'd suggest DocVQA (validation set) as a good first reference task with Qwen2.5-VL-2B or 7B.

[skoshx]

Here's a VLM (Qwen 2.5 VL 3B) example building on verifiers: https://github.com/groundlight/r1_vlm

I'm also currently working on getting VLM working with verifiers, and yeah there are some things that need patching

[willccbb]

As of now, adding multimodal support is a bit far down my feature priority list; open to a PR if someone wants to try, but going to close this for now.

[Bhavkumar2]

Reopening this—any chance we get VLM support soon :)