Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
R
fix parse_robotstxt() -- closes #60
Aug 19, 2020
benchmarks
major : future (parallel download), spiderbar (check speedup)
Oct 20, 2017
inst
Add regression test against error in rt_get_fields
Jul 31, 2020
logo
readme
Aug 20, 2017
man
too lax checking in is_valid_robotstxt() -- fixes issue #58
Aug 2, 2020
misc
tests : paths_allowed()
Oct 22, 2017
tests
fix parse_robotstxt() -- closes #60
Aug 19, 2020
vignettes
CRAN compliance
Sep 2, 2020
.Rbuildignore
CRAN compliance
Sep 2, 2020
.Rprofile
fixes #50
May 4, 2020
.gitignore
CRAN compliance
Sep 2, 2020
.travis.yml
Update .travis.yml
May 17, 2020
DESCRIPTION
CRAN compliance
Sep 3, 2020
LICENSE
CRAN compliance
Sep 2, 2020
NAMESPACE
get event http handling right
May 28, 2020
NEWS.md
CRAN compliance
Sep 3, 2020
README.Rmd
CRAN compliance
Sep 3, 2020
README.md
CRAN compliance
Sep 3, 2020
_old_.travis.yml
switch to new travis
Apr 26, 2016
autotest.Rexec
developing
Mar 20, 2016
codecov.yml
readme : fix : broken links
Aug 27, 2017
cran-comments.md
CRAN compliance
Sep 3, 2020
dev.r
major restructure to handle redirects - introducing event handler
Nov 9, 2018
robotstxt.Rproj
minor: travis and project option adjustment
Nov 22, 2018