Skip to content

v6.15.0

Choose a tag to compare

View all tags
@questionlp questionlp released this 31 Mar 04:12
· 25 commits to main since this release
v6.15.0
fc43ae6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Version 6.15.0

Application Changes

  • Refactored how AI robots list is included in the rendered robots.txt file if the block_ai_scrapers application configuration key is set to True
    • Added the robots.ai.txt file that contains the latest version of the robots.txt file from ai-robots-txt/ai.robots.txt
    • When block_ai_scrapers is set to True, include Content-Signal: ai-train=no, search=yes, ai-input=no in the rendered robots.txt file
    • When block_ai_scrapers is set to False, include Content-Signal: search=yes in the rendered robots.txt file

Development Changes

  • Changed tests to use response.text rather than response.data when checking contents of the page to remove the need to use b""

Pull Requests(s): #150

Full Changelog: v6.14.1...v6.15.0

Assets 2
Loading