Skip to content

ranvis/robots-txt-processor-test

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Research script of robots.txt parsers for PHP and other languages

See the feature/behavior test result in wiki.

TODO: describe usage and YAML schema

Note

This project is started as a research of robots.txt parsers to find out which one is best suited for my need. While the test runner can show failing tests on third party modules, A failure doesn't necessarily mean a bug of the module. Since there's no real RFC for robots.txt, there are no correct behaviors for some of notations and each module is more or less implemented in its own right way.

About

robots.txt processor feature/behavior test

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published