SmolDocling on Windows (was a 245KB file takes forever in the UI)

[thistleknot]

Windows 11
RTX 5000
python 3.10

pip install docling-serve[ui]

docling-serve run --enable-ui

[dolfim-ibm]

The options you selected rely on running SmolDocling. I don't know actual details on how to efficiently run the model on Windows. For context, on macOS we had to switch to mlx-vlm, otherwise the usual runtimes are very inefficient.

[dolfim-ibm]

I think this is an issue which should be moved to the main docling repository, since it is basically "How to run SmolDocling efficiently on Windows".

[dolfim-ibm]

@thistleknot can you share your test file?

[thistleknot]

Sure when I get home

…

On Tue, May 6, 2025, 7:11 AM Michele Dolfi ***@***.***> wrote: *dolfim-ibm* left a comment (docling-project/docling#1510) <#1510 (comment)> @thistleknot <https://github.com/thistleknot> can you share your test file? — Reply to this email directly, view it on GitHub <#1510 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABHKKORUABMYNBHJA4NJGGL25C7KZAVCNFSM6AAAAAB4JMZ7EOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDQNJUG4ZTANRZGA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[thistleknot]

Actually it's an arxiv paper. Replace the _ w . And go to arxiv.com/pdf/####.##### On Tue, May 6, 2025, 7:13 AM Joshua Laferriere ***@***.***> wrote:

…

Sure when I get home On Tue, May 6, 2025, 7:11 AM Michele Dolfi ***@***.***> wrote: > *dolfim-ibm* left a comment (docling-project/docling#1510) > <#1510 (comment)> > > @thistleknot <https://github.com/thistleknot> can you share your test > file? > > — > Reply to this email directly, view it on GitHub > <#1510 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ABHKKORUABMYNBHJA4NJGGL25C7KZAVCNFSM6AAAAAB4JMZ7EOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDQNJUG4ZTANRZGA> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

[dolfim-ibm]

Got it. Posting here for reference: https://arxiv.org/pdf/1301.3781