Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model is not implemented ? #13

Closed
adesgautam opened this issue Aug 11, 2020 · 4 comments
Closed

Model is not implemented ? #13

adesgautam opened this issue Aug 11, 2020 · 4 comments

Comments

@adesgautam
Copy link

Hi, I saw the invoicenet.commom.model module, it is not implemented yet ?
When it will be implemented ?
And what kind of model is used here ?

@naiveHobo
Copy link
Owner

That's just an interface class that's used to implement the main ACP and Parser models.

The main ACP model is implemented here. You can find the deeper model architecture and the parser models by following the imports from this module.

@adesgautam
Copy link
Author

Okay thanks!
I just want to clarify about the process.
The model uses pdf text to parse the required data right ? Or you can please clarify the process.

@naiveHobo
Copy link
Owner

Nope, PDF text is never used. I tested on a dataset of about 10000 documents and I finally decided to use an OCR in all cases. Using an OCR at the initial stage of data processing had some benefits:

  • Enabled a universal pipeline for PDFs with embedded text, scanned documents, and images
  • Some PDFs that had embedded text sometimes missed out on some important sections in the PDF (eg. the logo). Using the embedded text in this case meant there was no way to verify if I'm actually able to extract all readable significant text from the PDF or not.

Each input document is first converted to an image and the text along with the bounding box information is extracted using Tesseract. Using an OCR here means that the performance of the model will always be limited by the performance of the OCR, but I can say that Tesseract performed well for documents with a good resolution (which was true for about 95% of the dataset I used).

@naiveHobo
Copy link
Owner

Closing this issue for now since it's not exactly an error. We can still continue the discussion here if you have any more questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants