A toolkit for clustering web pages based on various similarity measures.
Java JavaScript Scala HTML CSS
Switch branches/tags
Nothing to show
Clone or download
Pull request Compare This branch is 68 commits ahead, 1 commit behind thammegowda:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
apted
autoext-spark
autoext
screenshots
visuals
.gitignore
LICENSE
NOTICE.txt
OPENSOURCE-LICENCES.md
README.md
pom.xml

README.md

Auto Extractor

An intelligent extractor library which learns the structures of the input web pages and then figures out a strategy for scraping the structured content.

Links

Developers:

Citation:

If you use this work, please cite:

@inproceedings{gowda2016clustering,
  title={Clustering Web Pages Based on Structure and Style Similarity (Application Paper)},
  author={Gowda, Thamme and Mattmann, Chris A},
  booktitle={Information Reuse and Integration (IRI), 2016 IEEE 17th International Conference on},
  pages={175--180},
  year={2016},
  organization={IEEE}
}

References :

  • K. Zhang and D. Shasha. 1989. "Simple fast algorithms for the editing distance between trees and related problems". SIAM J. Comput. 18, 6 (December 1989), 1245-1262.
  • Jarvis, R.A.; Patrick, Edward A., "Clustering Using a Similarity Measure Based on Shared Near Neighbors," in Computers, IEEE Transactions on , vol.C-22, no.11, pp.1025-1034, Nov. 1973