Look at Your Website the Way Google Does
This is a demo of several of Algorithmia's website inspection and text analysis tools, including:
- Get Links - examines a webpage and returns links to other pages
- Page Rank - a simple implementation of the PageRank algorithm
- URL2Text - extracts the main content from a webpage
- Summarizer - creates a summary by extracting key topic sentences
- Auto-Tag - generates keywords via Latent Dirichlet Allocation
With this demo, one can quickly crawl an entire website, rank its pages, summarize and extract tags and sentiment from ech page, and view the sitemap in a D3 force-directed graph.
See this demo in action
This demo can be viewed at https://demos.algorithmia.com/sitemap
Run it yourself
This demo only contains frontend code and requires no specialized hosting (or even a server).
- download the repository
- if you have not already, run the setup steps outlined in /PUBLISH.md
- build the demo:
- open /build/sitemap/index.html in a web browser