Fast website link checker in Go
Clone or download
Latest commit 36ee916 Nov 15, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.circleci Push docker image only when version is changed Aug 21, 2018
snap Remove a space Aug 21, 2018
test Allow spaces in URLs in HTML Aug 18, 2018
.gitignore Ignore snap files Aug 21, 2018
Dockerfile Fix docker image Aug 21, 2018
LICENSE Prepare readme and license files Apr 20, 2018
README.md Modify badges Aug 19, 2018
arguments.go Bump version Nov 16, 2018
arguments_test.go Add --exclude option May 28, 2018
cache.go Fix cache lock bug Nov 16, 2018
cache_test.go Add cache struct Sep 14, 2018
checker.go Share HTTP client over checkers Sep 13, 2018
checker_option.go Share HTTP client over checkers Sep 13, 2018
checker_option_test.go Add --timeout option May 8, 2018
checker_test.go Check status code Sep 13, 2018
concurrent_string_set.go Refactor checker.go Apr 21, 2018
concurrent_string_set_test.go Test concurrent_string_set.go Apr 23, 2018
daemons.go Don't scrape websites recursively Apr 23, 2018
daemons_test.go Don't scrape websites recursively Apr 23, 2018
defaults.go Add --timeout option May 8, 2018
fetch_result.go Refactor fetch result Sep 14, 2018
fetch_result_test.go Refactor fetch result Sep 14, 2018
fetcher.go Set connection: close Nov 16, 2018
fetcher_option.go Share HTTP client over checkers Sep 13, 2018
fetcher_option_test.go Add --timeout option May 8, 2018
fetcher_test.go Test HTTP request concurrency Sep 30, 2018
main.go Share HTTP client over checkers Sep 13, 2018
main_test.go Add --exclude option May 28, 2018
page.go Fix page structure Jun 10, 2018
page_result.go Improve result output format Apr 28, 2018
page_result_test.go result -> pageResult Apr 28, 2018
page_test.go Fix page structure Jun 10, 2018
rakefile.rb Define version in source file Aug 21, 2018
scraper.go Allow spaces in URLs in HTML Aug 18, 2018
scraper_test.go Allow spaces in URLs in HTML Aug 18, 2018
semaphore.go Regulate number of concurrent HTTP connections Apr 20, 2018
semaphore_test.go Regulate number of concurrent HTTP connections Apr 20, 2018
setup_test.go Visit URLs only once Aug 28, 2018
url_inspector.go Check status code Sep 13, 2018
url_inspector_test.go Test URL inspector with all options pairs on self certified server Sep 13, 2018

README.md

Muffet

Circle CI Codecov Go Report Card Docker Snap License

asciicast

Muffet is a website link checker which scrapes and inspects all pages in a website recursively.

Features

  • Massive speed
  • Colored outputs
  • Different tags support (a, img, link, script, etc)

Installation

go get -u github.com/raviqqe/muffet

Usage

muffet https://shady.bakery.hotland

For more information, see muffet --help.

License

MIT