Model: Granite Docling

[gabe-l-hart]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Model support ticket for https://huggingface.co/ibm-granite/granite-docling-258M

Motivation

We just released it and there's a lot of interest in running it with llama.cpp and adjacent runtimes

Possible Implementation

Already in the works!

[gabe-l-hart]

WIP branch: https://github.com/ggml-org/llama.cpp/tree/gabe-l-hart/GraniteDocling