Skip to content

Protego 0.1.16

Choose a tag to compare

View all tags
@Gallaecio Gallaecio released this 09 Dec 12:26
· 125 commits to master since this release
0.1.16
b5175c0

Protego 0.1.16 fixes (#8) an issue with robots.txt files containing absolute URLs as values for allow and disallow directives, where their path would be interpreted ignoring their protocol and netloc, leading to unexpected results (#4). Now, values of allow and disallow directives are always interpreted as if they started with a /, as Google’s specification dictates that they must always start with /.

We’ve also improved (#3) our test coverage for malformed disallow directives.

Assets 2
Loading