cf. https://github.com/aws/homebrew-tap
brew install peaceiris/tap/robots
$ curl -s "https://github.com/robots.txt" --output robots.txt
$ robots robots.txt Googlebot "https://github.com/google"
user-agent 'Googlebot' with URI 'https://github.com/google': ALLOWED