[BUG]: Youtube transcript retrieves an empty file o some channels

[brianorca]

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I can get transcripts for some channels, such as https://www.youtube.com/watch?v=O5GY7_aVBtk

But other channels fail, such as https://www.youtube.com/watch?v=V9KJ7nvhRWk
This results in a zero-byte file in the AppData\Roaming\anythingllm-desktop\storage\documents[channelname] folder.

I did confirm that Youtube shows a transcript for that video. This seems to be across all videos in a channel.

Are there known steps to reproduce?

Select data connectors-Youtube Trascript in the document upload.
use https://www.youtube.com/watch?v=V9KJ7nvhRWk as the video link.
Check if it found any data in the file.

[shatfield4]

Have you tried this again recently? I have tried both links you provided and I'm able to get the transcript for both videos. I think you may have been rate limited from pulling in too many video transcripts, too quickly. This might happen because we are leveraging a hidden/undocumented API by YouTube in order to pull in all the transcripts (with unknown rate limits).