Skip to content
This repository was archived by the owner on Apr 19, 2024. It is now read-only.

First Release (v1.0.0)

Choose a tag to compare

@wqyeo wqyeo released this 18 Oct 04:19
· 7 commits to main since this release
24ff612

First Release of the application, contain the these main features:

Site Crawler

Crawl through a site and outputs a data file. For now, it can only crawl through ScamAlert site, with the option to either crawl through news page, or stories page.

Deep Crawler

The data crawled from sites might contain references to other site, mostly news agencies. Deep Crawler adds more details by further crawling into those referenced sites.

Analyze Data

The given data will be bundled and analyzed first, before being plotted into various charts to be shown. The analyzed data and charts will be saved.

Merge Data

The 2 given data file will be merged, and then analyzed.

Notes

All data files are in .json format.

Issue #12 is not fixed, so you will have to close the running Python Console after closing the app.

#46 and #41 is not implemented, so Deep Crawler may not work for some of the indicated sites.