Answer bounding box

[horiacristescu]

Hi,

I appreciate very much this simple and effective approach to information extraction. My question is - can the model produce the bounding box for the extracted text?

As a workaround I am thinking of fuzzy matching the text an OCR with bounding boxes, but if the data is replicated on the page in multiple locations then it becomes difficult to know where the answer was copied from.

Thanks

[gwkrsrch]

Hi :)

#16 would be helpful to you.

donut does not require any bounding box annotation/supervision during the model training. But, as a result, there are no actual boxes in the model output. Instead, you can get an attention heatmap that could be used for your purpose.

Or, you may try your fuzzy matching logic with the attention heatmap.

I hope this comment is useful to you. Please let me know if you are still confused.

[SamSamhuns]

I've found some updates at #45