fix(blog): разблокировать индексацию для поисковиков и LLM#248
Merged
Conversation
Adding .gitkeep for PR creation (default mode). This file will be removed when the task is complete. Issue: #244
konard
changed the title
Collaborator
Author
Working session summaryImplemented and pushed the fix to PR 248: #248 What changed:
Verification:
PR 248 is marked ready for review. There are no GitHub Actions runs/status checks configured for this branch, and the local working tree is clean. This summary was automatically extracted from the AI working session output. |
Collaborator
Author
🤖 Solution Draft LogThis log file contains the complete execution trace of the AI solution draft process. 💰 Cost estimation:
📊 Context and tokens usage:
Total: (117.1K + 4.3M cached) input tokens, 17.8K output tokens, $6.296352 cost 🤖 Models used:
📎 Log file uploaded as Gist (24867KB)Now working session is ended, feel free to review and add any feedback on the solution draft. |
Collaborator
Author
✅ Ready to mergeThis pull request is now ready to be merged:
Monitored by hive-mind with --auto-restart-until-mergeable flag |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #244
Что изменено
<meta name="robots" content="index, follow, max-image-preview:large, max-snippet:-1" />в общий Astro layout блога.blog-v2/public/robots.txt: явно разрешены классические поисковики и LLM-краулеры из паттерна PR fix(seo): разблокировать индексацию для поисковиков и LLM #202./llms.txtдляblog.ideav.ru: он собирает опубликованные Markdown-статьи, категории, ключевые темы и абсолютные ссылки на посты.robots.txtи наличие LLM-индекса.Как воспроизвести проблему
До правки у блога не было
/llms.txt(https://blog.ideav.ru/llms.txtотдавал 404), аrobots.txtразрешал общий обход, но не фиксировал отдельные user-agent для LLM/search crawlers по аналогии с PR #202.Проверка
node --test tests/blog-indexing-llm.test.mjsnpm testnpm run buildnpm --prefix blog-v2 run buildnpm --prefix blog-v2 run buildгенерируетdist/llms.txtи включает в него 53 опубликованные статьи блога.