Extending LLM usage for PDFs when the extracted text is empty after pdfminer #1285
Conversation
gjmveloso
changed the title
|
@microsoft-github-policy-service agree |
- Proper handling of file_stream positioning after an empty result from pdfminer
| prompt=llm_prompt, | ||
| ) | ||
|
|
||
| return DocumentConverterResult(markdown=str(markdown)) |
There was a problem hiding this comment.
There is an issue of PDFs containing both mineable text and images that contain text. It would be nice to have a more sophisticated branching mechanism that accounts for this and/or allowing an API to override by the markitdown caller.
There was a problem hiding this comment.
Are you thinking on something like replacing the usage of extract_text with extract_pages and iterate over its non-text elements, like LTImage and LTFigure?
Layout system reference:
https://pdfminersix.readthedocs.io/en/latest/topic/converting_pdf_to_text.html#topic-pdf-to-text-layout
There was a problem hiding this comment.
Yes - that would allow a much more reliable, predictable, and comprehensive text extraction.
Initial work to attempt to use LLM to perform OCR operations within a PDF when
pdfminerreturns empty text