Architecture

1. MVC Architecture Of the Software
   

1. Description:
   View contains graphical user interface of the software that provides user interaction components such url bar, query field, buttons, listview of data.
   These components will take user inputs to provide the information to the Controller and Model.

Controller contains the components such Data Validator, File Format Identifier, Depth Controller. All these components are connected to view and model to control the finding data set.
Crawler Controllers: Control Crawlers, and provide a bridge to communication channel between Model and the View.
File Format Identifier: Identifies file type by analyzing file url.
Depth Controller: Controls how depth the crawler will go on to a website.

Model contains the components are Text Crawler, Media Crawler, File Crawler, Interesting File Crawler those are directly depend upon the data source is target website.
Text Crawler: Looks for the url that contains query text.
*

Media Crawler: Looks for the url that contains images, audio, video.
*

File Crawler: Looks for the file url with any valid format that contains query text.
*

Interesting File Crawler: Looks for the url that contains any kinds of credentials or configuration files.
*

Http Connector: An unavoidable, crucial Module that connects the application with a data source or website.