• A little like that j-thing, only in Go.

    Go 6,334 550 BSD-3-Clause Updated Oct 14, 2018
  • Polite, slim and concurrent web crawler.

    Go 1,667 175 BSD-3-Clause Updated Apr 29, 2018
  • A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

    Go 685 92 BSD-3-Clause Updated Mar 10, 2018
  • tiny Go library to normalize URLs

    Go 313 40 BSD-3-Clause Updated Mar 10, 2018
  • Package rehttp implements a Go HTTP transport that handles retries.

    Go 152 7 BSD-3-Clause Updated Mar 10, 2018
  • Proper URL escaping as per RFC3986

    Go 11 8 BSD-3-Clause Updated Aug 10, 2017