Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cron woes with Russian letters #17067

Closed
Freezl opened this issue Jul 26, 2018 · 2 comments
Closed

Cron woes with Russian letters #17067

Freezl opened this issue Jul 26, 2018 · 2 comments

Comments

@Freezl
Copy link

@Freezl Freezl commented Jul 26, 2018

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.07.21. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2018.07.21

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

[youtube:subscriptions] Downloading login page
[youtube:subscriptions] Looking up account info
[youtube:subscriptions] Logging in
[youtube:subscriptions] Checking cookie
[youtube:subscriptions] Youtube Subscriptions: Downloading webpage
[download] Downloading playlist: Youtube Subscriptions
[youtube:subscriptions] playlist Youtube Subscriptions: Downloading 30 videos
[download] Downloading video 1 of 30
[youtube] Downloading login page
[youtube] Looking up account info
[youtube] Logging in
[youtube] Checking cookie
[youtube] uYnzUha0Bmw: Downloading webpage
[youtube] uYnzUha0Bmw: Downloading video info webpage
[debug] Invoking downloader on u'https://r3---sn-n3toxu-axql.googlevideo.com/videoplayback?gir=yes&dur=933.601&mn=sn-n3toxu-axql%2Csn-axq7sn76&mm=31%2C29&ms=au%2Crdu&mv=m&mt=1532613255&clen=11279460&lmt=1532611175483959&ipbits=0&key=yt6&ip=188.242.150.218&ei=9tJZW5H_HtDS7QSH_46AAg&id=o-ABLr47BuRH4bQ77YFiLv9eUaJBzhKW3p-_eNrc7asLmT&initcwndbps=1278750&c=WEB&nh=%2CIgphcjAyLmxlZDAzKgkxMjcuMC4wLjE&pl=19&fvip=16&requiressl=yes&signature=9AE54EBCE2A8E6A17CF584BCEC3778A05CC6D58C.B59C7FB0D9D2E1534F42A8644C4DDA83936B9F61&keepalive=yes&mime=audio%2Fwebm&pcm2cms=yes&source=youtube&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpcm2cms%2Cpl%2Crequiressl%2Csource%2Cexpire&expire=1532634966&itag=251&ratebypass=yes'
[download] Destination: /media/Youtube/Audio/___.webm
[download] 100% of 10.76MiB in 00:0115MiB/s ETA 00:00known ETA
[debug] ffmpeg command line: ffprobe -show_streams 'file:/media/Youtube/Audio/___.webm'
[ffmpeg] Destination: /media/Youtube/Audio/___.ogg
[debug] ffmpeg command line: ffmpeg -y -i 'file:/media/Youtube/Audio/___.webm' -vn -acodec libvorbis '-q:a' 5 'file:/media/Youtube/Audio/___.ogg'
Deleting original file /media/Youtube/Audio/___.webm (pass -k to keep)
[download] Downloading video 2 of 30
[youtube] 9Q_VqHFnthk: Downloading webpage
[youtube] 9Q_VqHFnthk: Downloading video info webpage
[debug] Invoking downloader on u'https://r1---sn-n3toxu-axql.googlevideo.com/videoplayback?source=youtube&keepalive=yes&ei=FtNZW4y_MJjt7ATZ85DgCA&ms=au%2Crdu&ipbits=0&mv=m&pl=19&id=o-AETNPGz3aYzinagOqmWmLccsYAv52nZfNFyxHoLPvMa6&mm=31%2C29&expire=1532634998&ip=188.242.150.218&mn=sn-n3toxu-axql%2Csn-axq7sn76&itag=251&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpcm2cms%2Cpl%2Crequiressl%2Csource%2Cexpire&signature=4B13763BA89A5043916AE80F4BBD42B0B993A359.0B15E2534F5D01308D2CFACD8EB6824457C6F2E6&mt=1532613320&requiressl=yes&initcwndbps=1278750&gir=yes&mime=audio%2Fwebm&key=yt6&nh=%2CIgphcjAyLmxlZDAzKgkxMjcuMC4wLjE&pcm2cms=yes&clen=10933557&dur=921.221&lmt=1532609346020733&fvip=15&c=WEB&ratebypass=yes'
[download] Destination: /media/Youtube/Audio/___15000.webm
[download] 100% of 10.43MiB in 00:0121MiB/s ETA 00:00known ETA
[debug] ffmpeg command line: ffprobe -show_streams 'file:/media/Youtube/Audio/___15000.webm'
[ffmpeg] Destination: /media/Youtube/Audio/___15000.ogg
[debug] ffmpeg command line: ffmpeg -y -i 'file:/media/Youtube/Audio/___15000.webm' -vn -acodec libvorbis '-q:a' 5 'file:/media/Youtube/Audio/___15000.ogg'
Deleting original file /media/Youtube/Audio/___15000.webm (pass -k to keep)
[download] Downloading video 3 of 30
[youtube] 9hDv0CvbcZY: Downloading webpage
[youtube] 9hDv0CvbcZY: Downloading video info webpage
[debug] Invoking downloader on u'https://r3---sn-n3toxu-axql.googlevideo.com/videoplayback?signature=136BD6A181B2D3B97804242EAA18D2C572487865.85A7DC8E95FDCD3F045AF73E8CEB698978386F7E&c=WEB&key=yt6&lmt=1532607960010019&pcm2cms=yes&keepalive=yes&itag=171&fvip=12&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpcm2cms%2Cpl%2Crequiressl%2Csource%2Cexpire&clen=8960680&source=youtube&nh=%2CIgphcjAyLmxlZDAzKgkxMjcuMC4wLjE&dur=637.342&initcwndbps=1278750&mv=m&ei=NdNZW_LxLZG17QSNgKjIAg&expire=1532635029&mm=31%2C29&mn=sn-n3toxu-axql%2Csn-axq7sn76&mime=audio%2Fwebm&id=o-ANUQrSDe-iShi0aKbYDFlRm0VgxI1Gz9m9lgM77HyEXG&pl=19&ipbits=0&ip=188.242.150.218&requiressl=yes&mt=1532613320&gir=yes&ms=au%2Crdu&ratebypass=yes'
[download] Destination: /media/Youtube/Audio/___.webm
[download] 100% of 8.55MiB in 00:0113MiB/s ETA 00:003
[debug] ffmpeg command line: ffprobe -show_streams 'file:/media/Youtube/Audio/___.webm'
[ffmpeg] Destination: /media/Youtube/Audio/___.ogg
[debug] ffmpeg command line: ffmpeg -y -i 'file:/media/Youtube/Audio/___.webm' -vn -acodec copy 'file:/media/Youtube/Audio/___.ogg'
Deleting original file /media/Youtube/Audio/___.webm (pass -k to keep)
[download] Downloading video 4 of 30
[youtube] _7czZyvIM7U: Downloading webpage
[youtube] _7czZyvIM7U: Downloading video info webpage
[debug] Invoking downloader on u'https://r3---sn-n3toxu-axql.googlevideo.com/videoplayback?ip=188.242.150.218&mm=31%2C29&mn=sn-n3toxu-axql%2Csn-axq7sn76&key=yt6&gir=yes&id=o-AK4oYTL6d-w00rRa_tsqE5CA98FPo0o6qhNJzVkjane_&mime=audio%2Fwebm&pl=19&mt=1532613320&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpcm2cms%2Cpl%2Crequiressl%2Csource%2Cexpire&mv=m&fvip=5&ms=au%2Crdu&signature=06CB7357F219A00BA442D723610F08C7BBF28AF8.620A9141F5E4E299D54ACFC4EC5077111C6F6B98&requiressl=yes&keepalive=yes&pcm2cms=yes&itag=251&ei=ONNZW7zZM8qZyAWH8LSwBA&expire=1532635033&nh=%2CIgphcjAyLmxlZDAzKgkxMjcuMC4wLjE&clen=9080682&dur=704.281&source=youtube&initcwndbps=1278750&lmt=1532604390384373&c=WEB&ipbits=0&ratebypass=yes'
[download] Destination: /media/Youtube/Audio/__F_m_n.webm
[download] 100% of 8.66MiB in 00:0111MiB/s ETA 00:006
[debug] ffmpeg command line: ffprobe -show_streams 'file:/media/Youtube/Audio/__F_m_n.webm'
[ffmpeg] Destination: /media/Youtube/Audio/__F_m_n.ogg
[debug] ffmpeg command line: ffmpeg -y -i 'file:/media/Youtube/Audio/__F_m_n.webm' -vn -acodec libvorbis '-q:a' 5 'file:/media/Youtube/Audio/__F_m_n.ogg'
^C

For example links


Hi!
I am trying to implement downloading video and audio in cron. I'm do it on the CentOS 7

youtube-dl --version
2018.07.21

I created bash script

#!/bin/bash
/usr/bin/youtube-dl -wi --yes-playlist --extract-audio -f 'bestaudio[tbr<=127]' --audio-format vorbis -o /media/Youtube/Audio/"%(uploader)s_%(title)s.%(ext)s" --dateafter now-1day --playlist-end 30 https://www.youtube.com/feed/subscriptions >> /var/log/youtube-dl.log

Added task to the crontab:

crontab -u ftp -l
00 7,17 * * * /opt/yoursub_a.sh

And get audio files without Russian letters in the title

ll /media/Youtube/Audio/
-rwxr--r-- 1 ftp www-data 10355025 Jul 26 15:49 ___15000.ogg 
-rwxr--r-- 1 ftp www-data 47733057 Jul 25 22:12 Dmitry_Puchkov_1946.ogg 
-rwxr--r-- 1 ftp www-data 47765858 Jul 25 16:57 Dmitry_Puchkov__.ogg
-rwxr--r-- 1 ftp www-data 9344667 Jul 26 14:26 __F_m_n.ogg 
-rwxr--r-- 1 ftp www-data 2088960 Jul 26 16:39 FORUMHOUSE__FORUMHOUSE.webm.part 
-rwxr--r-- 1 ftp www-data 8791308 Jul 26 15:26 ___.ogg

If started script in the console

sudo -u ftp /opt/yoursub_a.sh

This worked fine!

-rwxr--r-- 1 ftp www-data 47733057 Jul 25 22:12 Dmitry Puchkov_Клим Жуков о ядерных испытаниях 1946 года на атолле Бикини.ogg
-rwxr--r-- 1 ftp www-data 47765858 Jul 25 16:57 Dmitry Puchkov_Павел Перец про покушение на Константина Победоносцева.ogg
-rwxr--r-- 1 ftp www-data 4583864 Jul 25 22:30 FORUMHOUSE_Изготавливаем тротуарную плитку самостоятельно _ FORUMHOUSE.ogg
-rwxr--r-- 1 ftp www-data 7400611 Jul 26 13:01 FORUMHOUSE_Уютный дом для небольшой семьи. Своими руками _ FORUMHOUSE.ogg
@bato3
Copy link
Contributor

@bato3 bato3 commented Jul 27, 2018

@Freezl usually cron have minimal env. So you must set language, etc.

Use printenv > ~/env.list.txt in console and cron

@Freezl
Copy link
Author

@Freezl Freezl commented Jul 27, 2018

Hi @bato3
You're right! I made printenv > /tmp/env.user.txt from user and added task to crontab. I compared these files after that.
Changed my script

#!/bin/bash
export LANG=en_US.UTF-8
/usr/bin/youtube-dl -wi --yes-playlist --extract-audio -f 'bestaudio[tbr<=127]' --audio-format vorbis -o /media/Youtube/Audio/"%(uploader)s_%(title)s.%(ext)s" --dateafter now-1day --playlist-end 30 https://www.youtube.com/feed/subscriptions >> /var/log/youtube-dl.log

And it's work! Thanks so much

@Freezl Freezl closed this Jul 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.