Skip to content

v2.1.0

Latest

Choose a tag to compare

@3nock 3nock released this 01 Aug 10:49
· 6 commits to main since this release

Features

  • Added Interactive Crawler (for manually/automatically crawling complex webpages) (Experimental)
  • Added Archive Crawler (For crawling links from web archives i.e. waybackmachine & commoncrawl) (Experimental)
  • Added Graph coloring by page type e.g. (html, js, css, doc, image etc.)

Improvements

  • Improved Headless crawling (more efficient and faster)
  • Removed Onion crawler (since you can easily use socks5 proxy to connect any crawler to tor)
  • Improved graph nodes information

Fixes

  • Fixed Blocking highlighting (now highlighting of the source is done in async)
  • Fixed random crashes by the interceptor