Skip to content
This repository was archived by the owner on Apr 19, 2024. It is now read-only.

Releases: wqyeo/ScamDataAnalysis

Update Support for Python3.11

Choose a tag to compare

@wqyeo wqyeo released this 04 Sep 10:06

Update Support for Python3.11, see this link for the breaking change, and the fix done.

Otherwise, use the previous release (v1.0.0) if you are running an older version of python.

First Release (v1.0.0)

Choose a tag to compare

@wqyeo wqyeo released this 18 Oct 04:19
24ff612

First Release of the application, contain the these main features:

Site Crawler

Crawl through a site and outputs a data file. For now, it can only crawl through ScamAlert site, with the option to either crawl through news page, or stories page.

Deep Crawler

The data crawled from sites might contain references to other site, mostly news agencies. Deep Crawler adds more details by further crawling into those referenced sites.

Analyze Data

The given data will be bundled and analyzed first, before being plotted into various charts to be shown. The analyzed data and charts will be saved.

Merge Data

The 2 given data file will be merged, and then analyzed.

Notes

All data files are in .json format.

Issue #12 is not fixed, so you will have to close the running Python Console after closing the app.

#46 and #41 is not implemented, so Deep Crawler may not work for some of the indicated sites.