Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running check on Channel fails #51

Open
entmike opened this issue Dec 6, 2019 · 4 comments
Open

Running check on Channel fails #51

entmike opened this issue Dec 6, 2019 · 4 comments
Labels
bug Something isn't working low-priority

Comments

@entmike
Copy link

entmike commented Dec 6, 2019

When running Check on YT Channel, process fails with exit code 1
For this example, I used Linus Tech Tips channel. I add his channel, but do not mark to do initial download (only want new episodes for example). Log fails with this:

{"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw  Video And Audio   any [] 12-06-2019 21:04:42 30 Channel /channels/%(uploader)s/video/%(title)s.%(ext)s}","time":"2019-12-06T21:15:56Z"}
{"level":"info","msg":"downloading video","time":"2019-12-06T21:15:56Z"}
{"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --playlist-end 1 -o downloads/channels/%(uploader)s/video/%(title)s.%(ext)s https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw","time":"2019-12-06T21:15:56Z"}
{"level":"error","msg":"exit status 1/usr/local/bin/youtube-dl --playlist-end 1 -o downloads/channels/%(uploader)s/video/%(title)s.%(ext)s https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw","time":"2019-12-06T21:16:08Z"}
{"level":"info","msg":"returning response: {Error ERROR_CHECKING_PLAYLIST There was an error while checking the channel: v.Download: exit status 1}","time":"2019-12-06T21:16:08Z"}
{"level":"error","msg":"exit status 1/usr/local/bin/youtube-dl -o downloads/videos/%(uploader)s/audio/%(title)s.%(ext)s https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw","time":"2019-12-06T21:17:33Z"}

To get more information, I try to run the youtube-dl command directly from sh session inside the container:

/app # /usr/local/bin/youtube-dl --playlist-end 1 -o downloads/channels/%\(uploader\)s/video/%\(title\)s.%\(ext\)s https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw
[youtube:channel] UCXuqSBlHAE6Xw-yeJA0Tunw: Downloading channel page
[youtube:playlist] UUXuqSBlHAE6Xw-yeJA0Tunw: Downloading webpage
[download] Downloading playlist: Uploads from Linus Tech Tips
[youtube:playlist] playlist Uploads from Linus Tech Tips: Downloading 1 videos
[download] Downloading video 1 of 1
[youtube] mpxBmxj5mP0: Downloading webpage
[youtube] mpxBmxj5mP0: Downloading video info webpage
[download] downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.f313.webm has already been downloaded
[download] 100% of 969.74MiB
[download] downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.f251.webm has already been downloaded
[download] 100% of 13.69MiB
[ffmpeg] Merging formats into "downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.webm"
ERROR: Conversion failed!

I did some Googling, and it appears that if I add a -x flag, it will work:

/app # /usr/local/bin/youtube-dl --playlist-end 1 -x -o downloads/channels/%\(uploader\)s/video/%\(title\)s.%\(ext\)s https://www.youtube.com/channel/UCXuqSBlHAE6Xw-yeJA0Tunw
[youtube:channel] UCXuqSBlHAE6Xw-yeJA0Tunw: Downloading channel page
[youtube:playlist] UUXuqSBlHAE6Xw-yeJA0Tunw: Downloading webpage
[download] Downloading playlist: Uploads from Linus Tech Tips
[youtube:playlist] playlist Uploads from Linus Tech Tips: Downloading 1 videos
[download] Downloading video 1 of 1
[youtube] mpxBmxj5mP0: Downloading webpage
[youtube] mpxBmxj5mP0: Downloading video info webpage
[download] Destination: downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.webm
[download] 100% of 13.69MiB in 00:04
[ffmpeg] Destination: downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.opus
Deleting original file downloads/channels/Linus Tech Tips/video/Backing Up Your Life is THIS Easy.webm (pass -k to keep)
[download] Finished downloading playlist: Uploads from Linus Tech Tips
@XiovV XiovV added the bug Something isn't working label Dec 6, 2019
@entmike
Copy link
Author

entmike commented Dec 6, 2019

I'd like to add some more information to this one... I think my use case may be an unsupported one. This only occurs when I to check or download in full a YT channel when the downloads folder is backed by an rclone map to Google Drive. In either case of a check or a full download, it will fail (albeit silent for the full download that ignores errors) and leave behind 4 files:

/app # tail -10 log.log 
{"level":"error","msg":"exit status 1/usr/local/bin/youtube-dl --playlist-end 1 -o downloads/channels/%(uploader)s/video/%(title)s.%(ext)s https://www.youtube.com/user/LinusTechTips","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"updating latest downloaded video id","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"latest downloaded video id updated successfully","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"updating download history","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"[{https://www.youtube.com/user/LinusTechTips mpxBmxj5mP0 Video And Audio Uploads from Linus Tech Tips  any [mpxBmxj5mP0] 12-06-2019 22:47:39  Channel /channels/%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"returning response: {Error ERROR_DOWNLOADING_ENTIRE_CHANNEL There was an error downloading the entire channelv.Download: exit status 1}","time":"2019-12-06T22:49:45Z"}
{"level":"info","msg":"getting checking interval","time":"2019-12-06T22:51:24Z"}
{"level":"info","msg":"checking interval not yet specified","time":"2019-12-06T22:51:24Z"}
{"level":"info","msg":"getting checking interval","time":"2019-12-06T22:51:24Z"}
{"level":"info","msg":"checking interval not yet specified","time":"2019-12-06T22:51:24Z"}
/app # ls -lart downloads/channels/Linus\ Tech\ Tips/video/
total 1012166
-rw-r--r--    1 root     root      14357006 Dec  6 20:58 Backing Up Your Life is THIS Easy.f251.webm
-rw-r--r--    1 root     root     1016848951 Dec  6 21:23 Backing Up Your Life is THIS Easy.f313.webm
-rw-r--r--    1 root     root             0 Dec  6 22:49 Backing Up Your Life is THIS Easy.f313.webm.part
-rw-r--r--    1 root     root       5250939 Dec  6 22:49 Backing Up Your Life is THIS Easy.temp.webm
/app # ps
PID   USER     TIME  COMMAND
    1 root      0:00 su -s /bin/ash -c umask 022;PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin;./main goautoyt
   11 goautoyt  0:00 ./main
   33 goautoyt  0:27 {youtube-dl} python /usr/local/bin/youtube-dl --ignore-errors -o downloads/channels/%(uploader)s/video/%(title)s.%(ext)s https://www.youtube.com/user/LinusTechTips
   35 root      0:00 sh
   84 goautoyt  0:00 ffmpeg -y -loglevel repeat+info -i file:downloads/channels/Linus Tech Tips/video/The SUPER CLEAN PC Build [GIVEAWAY].f313.webm -i file:downloads/channels/Linus Tech Tips/video/The 
   87 root      0:00 ps
/app # 

I know this project is new (and awesome, keep up the good work!) but I wanted to let you know that I do NOT have this error when downloading to a 'normal' directory that is not backed by rclone. It's a weird problem, however maybe I can work around it some other way.

@XiovV
Copy link
Owner

XiovV commented Dec 9, 2019

Did you manage to work around it? I honestly have no idea how to work around this on my end.

@entmike
Copy link
Author

entmike commented Dec 9, 2019

I haven't. I am having to download direct to local filesystem and then move the file. Not that efficient... Could you provide a hook or script that we could designate to fire off after a check/download completes? I could then just have the script move it afterwards.

@XiovV
Copy link
Owner

XiovV commented Dec 10, 2019

I'll think about it, but that won't be high on my priority list since I have to work on stability and adding few more essential features.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working low-priority
Projects
None yet
Development

No branches or pull requests

2 participants