[SUCCESS] [docusaurus-plugin-llms-txt] Plugin completed successfully - processed 0 documents

[kirillzyusko]

I tried to integrate that package into my website: kirillzyusko/react-native-keyboard-controller#976

However I always get processed 0 documents 🤯

Would appreciate any advice what can I do in order to fix it 🙏

I'm getting this warning:

[WARNING] [docusaurus-plugin-llms-txt] Route Error: Failed to process route /react-native-keyboard-controller/docs/troubleshooting: Failed to process HTML file: ENOENT: no such file or directory, open '/Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/react-native-keyboard-controller/docs/troubleshooting/index.html'

And indeed /Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/react-native-keyboard-controller/docs/troubleshooting/index.html route doesn't exist, but /Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/docs/troubleshooting/index.html should exist 🤔 How to point plugin to a correct route?

[Devon-White]

I tried to integrate that package into my website: kirillzyusko/react-native-keyboard-controller#976

However I always get processed 0 documents 🤯

Would appreciate any advice what can I do in order to fix it 🙏

I'm getting this warning:

[WARNING] [docusaurus-plugin-llms-txt] Route Error: Failed to process route /react-native-keyboard-controller/docs/troubleshooting: Failed to process HTML file: ENOENT: no such file or directory, open '/Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/react-native-keyboard-controller/docs/troubleshooting/index.html'

And indeed /Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/react-native-keyboard-controller/docs/troubleshooting/index.html route doesn't exist, but /Users/kirylziusko/IdeaProjects/react-native-keyboard-controller/docs/build/docs/troubleshooting/index.html should exist 🤔 How to point plugin to a correct route?

Thanks for opening a issue! I'll need to investigate more to understand why this is happening with your site. The routes are provided by Docusaurus during postBuild as seen here. We then take these routes and confirm there is a corresponding file with it.

My immediate suspicion is the Docusaurus version you are on (3.4.0), the furthest back i've tested the plugin is 3.6.3. I'll get a test site up with this version to see if I can experience the same issue.

[g-despot]

Not sure if it's the same cause, but I am also running into similar error messages:

[INFO] [docusaurus-plugin-llms-txt] DEBUG: Processing: /docs/academy/js/starter_text_data/text_searches/keyword_hybrid
[INFO] [docusaurus-plugin-llms-txt] DEBUG: Error processing /Users/user/dev/docs/build/docs/academy/js/starter_text_data/text_searches/keyword_hybrid/index.html: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/academy/js/starter_text_data/text_searches/keyword_hybrid/index.html'
[WARNING] [docusaurus-plugin-llms-txt] Route Error: Failed to process route /docs/academy/js/starter_text_data/text_searches/keyword_hybrid: Failed to process HTML file: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/academy/js/starter_text_data/text_searches/keyword_hybrid/index.html'

The plugin assumes that the path is build/docs/ while it's build/ in our case. Link to the docusaurus.config.js.

[kirillzyusko]

@g-despot eventually I fixed it by using a patch-package by replacing "undesirable" path (this is more like a workaround, but I'm able to generate the llm.txt and super happy about that - incredible work @Devon-White 🔥).

[Devon-White]

@kirillzyusko @g-despot I went ahead and released a new canary version. I had cloned @kirillzyusko doc repo into my plugin repo to test, and it seemed to be working. I yarn linked my local plugin and removed the patch logic to ensure everything seemed valid.

Mind giving the below version a try and letting me know if its working as intended? If it is, i can go ahead and release version 1.0.2.

npm i @signalwire/docusaurus-plugin-llms-txt@0.0.0-canary-20250613185215

[g-despot]

Thanks for the quick support 🥳
Sadly, the canary version didn't work for me. This is the behavior I'm still experiencing.

[INFO] [docusaurus-plugin-llms-txt] DEBUG: Processing: /docs/weaviate/tutorials/wikipedia
[INFO] [docusaurus-plugin-llms-txt] DEBUG: Error processing /Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html'
[WARNING] [docusaurus-plugin-llms-txt] Route Error: Failed to process route /docs/weaviate/tutorials/wikipedia: Failed to process HTML file: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html'

This is my package.json and docusaurus.config.js.
As our routeBasePath is /, the site is generated directly under the /build directory.

[Devon-White]

Thanks for the quick support 🥳 Sadly, the canary version didn't work for me. This is the behavior I'm still experiencing.

[INFO] [docusaurus-plugin-llms-txt] DEBUG: Processing: /docs/weaviate/tutorials/wikipedia
[INFO] [docusaurus-plugin-llms-txt] DEBUG: Error processing /Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html'
[WARNING] [docusaurus-plugin-llms-txt] Route Error: Failed to process route /docs/weaviate/tutorials/wikipedia: Failed to process HTML file: ENOENT: no such file or directory, open '/Users/user/dev/docs/build/docs/weaviate/tutorials/wikipedia/index.html'

This is my package.json and docusaurus.config.js. As our routeBasePath is /, the site is generated directly under the /build directory.

I've gone ahead and opened the following pr. Give a try locally and see if its working as intended: weaviate/docs#68

I actually found when cloning your repo locally, that the last canary version was working. By chance did you forget to reinstall the package when you swapped the version? If you did reinstall the package, then we need to dive deeper as to why the files are able to resolve locally for me, and not you.

Before canary version 0.0.0-canary-20250613185215 we were not accounting for how the html files will generate when someone has trailingSlash set to false. You can read about how the file generation behavior is different depending on the setting here: https://docusaurus.io/docs/advanced/routing#routes-become-html-files

This was added in the last canary version to account for this. Now in the latest canary version: 0.0.0-canary-20250614144042, we now support llms-full.txt. I added this option to the plugin config in the PR above to debug. It shows that we are not only finding the files, but also finding the contents to copy.

Feel free to remove the option :)

[kirillzyusko]

@Devon-White so far it seems like the fix works for me 👍

[g-despot]

My bad, thanks a lot for pointing it out @Devon-White, I needed to completely remove the module and now it works for me as well. I probably didn't reinstall it correctly the first time.

[Devon-White]

Release 1.1.0 is now out which includes the fix. Since the issue seems to be resolved, I'll go ahead and close out the ticket. Feel free to reopen if you experience the same issue again. :)