Flow Diagram

[abhaytiwari262000]

Hello Omris Sir. I must say that I really like your work and you are an inspiration to me. Also, I have a doubt related to the flow diagram. I want to understand what happens under the hood. when a user uploads an input then what function accepts it and what are the other classes and objects which it calls? (the internal flow diagram )
(PS: I am clear with the concept of regex, context, and Spacy NER. )

[omri374]

Hi @abhaytiwari262000, thanks for the kind words. Could you please provide more details on which flow you refer to? We have three main flows in Presidio: text analysis, text anonymization and image analysis+redaction.

[abhaytiwari262000]

Sir, text anonymization. In that which is the main class and how does it call other recognizers. Does all recognizers have any base interface ? (So basically, I wanna know the flow )

[omri374]

Hi @abhaytiwari262000. The entry point is AnalyzerEngine. In the analyze method it calls all defined recognizers. See code here.
Each recognizer has its own logic for detecting PII, but most of them leverage patterns so they inherit from the PatternRecognizer class.

See this diagram for more information on the structure of recognizers:

Another part is the NLP analysis, which is done for every request. Here the NlpEngine (default is spaCy but the user can select stanza too) creates NLP artifacts (NlpArtifacts class) that are passed for each recognizer in case the logic requires tokens, lemmas, named entities or other artifacts created by the NlpEngine

See the NLP class structure for more info:

[abhaytiwari262000]

Thankyou So Much Sir.