Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

batch-file function fails on some websites #17546

Closed
jewshawn2 opened this issue Sep 11, 2018 · 2 comments
Closed

batch-file function fails on some websites #17546

jewshawn2 opened this issue Sep 11, 2018 · 2 comments
Labels
invalid

Comments

@jewshawn2
Copy link

@jewshawn2 jewshawn2 commented Sep 11, 2018 •
edited

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.09.10. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • [x ] I've verified and I assure that I'm running youtube-dl 2018.09.10

Before submitting an issue make sure you have:

  • [x ] At least skimmed through the README, most notably the FAQ and BUGS sections
  • [x ] Searched the bugtracker for similar issues including closed ones
  • [x ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • [x ] Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

D:\FOOD\yt-dl>youtube-dl -F -v -a list.txt
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-F', '-v', '-a', 'list.txt']
[debug] Batch file urls: ['https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606563/ragin
g-rapids/', 'https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606552/double-dog-dare/']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.09.10
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-91790-g23fe072e43, ffprobe N-91790-g23fe072e43
[debug] Proxy map: {}
[scrippsnetworks:watch] 3606563: Downloading JSON metadata
[scrippsnetworks:watch] 3606563: Downloading XML
[scrippsnetworks:watch] 3606563: Downloading JSON metadata
[debug] Using fake IP 3.190.16.238 (US) as X-Forwarded-For.
[Anvato] 4410751: Fetching server time
[Anvato] 4410751: Downloading JSON metadata
[Anvato] 4410751: Downloading m3u8 information
[info] Available formats for 4410751:
format code  extension  resolution note
hls-364      mp4        448x252     364k , avc1.640015, 30.0fps, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.64001e, 30.0fps, mp4a.40.2
hls-1696     mp4        960x540    1696k , avc1.64001f, 30.0fps, mp4a.40.2
hls-4328     mp4        1920x1080  4328k , avc1.640028, 30.0fps, mp4a.40.2 (best)
[scrippsnetworks:watch] 3606552: Downloading JSON metadata
[scrippsnetworks:watch] 3606552: Downloading XML
[scrippsnetworks:watch] 3606552: Downloading JSON metadata
[Anvato] 4410749: Downloading JSON metadata
[Anvato] 4410749: Downloading m3u8 information
[info] Available formats for 4410749:
format code  extension  resolution note
hls-364      mp4        448x252     364k , avc1.640015, 30.0fps, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.64001e, 30.0fps, mp4a.40.2
hls-1696     mp4        960x540    1696k , avc1.64001f, 30.0fps, mp4a.40.2
hls-4328     mp4        1920x1080  4328k , avc1.640028, 30.0fps, mp4a.40.2 (best)


D:\FOOD\yt-dl>youtube-dl -f hls-364 -v -a list.txt
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-f', 'hls-364', '-v', '-a', 'list.txt']
[debug] Batch file urls: ['https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606563/ragin
g-rapids/', 'https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606552/double-dog-dare/']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.09.10
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-91790-g23fe072e43, ffprobe N-91790-g23fe072e43
[debug] Proxy map: {}
[scrippsnetworks:watch] 3606563: Downloading JSON metadata
[scrippsnetworks:watch] 3606563: Downloading XML
[scrippsnetworks:watch] 3606563: Downloading JSON metadata
[debug] Using fake IP 3.230.95.156 (US) as X-Forwarded-For.
[Anvato] 4410751: Fetching server time
[Anvato] 4410751: Downloading JSON metadata
[Anvato] 4410751: Downloading m3u8 information
[debug] Invoking downloader on 'http://dcs-vod.apis.anvato.net/vod/p/414200/prog.m3u8?i=i177602643-n
94a15bc1-2229-445c-ae7a-ee7037ad3583&anvtrid=b34ce2b5a944499487ec8fe106236cfc'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 143 (not including 3 ad)
[download] Destination: Raging Rapids-4410751.mp4
[download] 100% of 63.36MiB in 01:12
[debug] ffmpeg command line: ffprobe -show_streams "file:Raging Rapids-4410751.mp4"
[ffmpeg] Fixing malformed AAC bitstream in "Raging Rapids-4410751.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:Raging Rapids-4410751.mp4" -c copy -f mp4 "-bsf:a" a
ac_adtstoasc "file:Raging Rapids-4410751.temp.mp4"
[scrippsnetworks:watch] 3606552: Downloading JSON metadata
[scrippsnetworks:watch] 3606552: Downloading XML
[scrippsnetworks:watch] 3606552: Downloading JSON metadata
[Anvato] 4410749: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please r
eport this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtub
e-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete outp
ut.
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp0icdbhzn\build\youtube_dl\extra
ctor\common.py", line 599, in _request_webpage
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp0icdbhzn\build\youtube_dl\Youtu
beDL.py", line 2211, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
...
<end of log>

Description of your issue, suggested solution and other information

youtube-dl list-formats of batch-file works fine. Never had a problem on any websites including youtube.
However downloading videos from travelchannel using batch-file function will fail on the second download link with the error above. First link in list.txt will be downloaded. However, nothing is downloaded for the second link in list.txt. No temporary files are created. I am using a very recent September build of ffmpeg (20180903).

Steps to reproduce the error:
Create a file "list.txt"

https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606563/raging-rapids/
https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606552/double-dog-dare/

Run command:
youtube-dl -f hls-364 -v -a list.txt

I've been working around the problem doing this, youtube-dl works fine like this batch download without using batch-file function:

youtube-dl -f hls-364 "https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606563/raging-rapids/" & ^ 
youtube-dl -f hls-364 "https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606552/double-dog-dare/" & ^
@jewshawn2
Copy link
Author

@jewshawn2 jewshawn2 commented Sep 11, 2018

Still using the same batch-file function, but short 1 minute clips from the same website works perfectly fine.

D:\FOOD\yt-dl>youtube-dl -f hls-364 -v -a list.txt
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-f', 'hls-364', '-v', '-a', 'list.txt']
[debug] Batch file urls: ['https://watch.travelchannel.com/show/tccgd/new-orleans/3842220/the-music-
box-village/', 'https://watch.travelchannel.com/show/tccgd/new-orleans/3842219/the-best-of-new-orlea
ns/', 'https://watch.travelchannel.com/show/tccgd/las-vegas/3808461/red-rock-canyon/', 'https://watc
h.travelchannel.com/show/tccgd/las-vegas/3808460/old-las-vegas/']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.09.10
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-91790-g23fe072e43, ffprobe N-91790-g23fe072e43
[debug] Proxy map: {}
[scrippsnetworks:watch] 3842220: Downloading JSON metadata
[scrippsnetworks:watch] 3842220: Downloading XML
[scrippsnetworks:watch] 3842220: Downloading JSON metadata
[debug] Using fake IP 3.254.219.66 (US) as X-Forwarded-For.
[Anvato] 4304835: Fetching server time
[Anvato] 4304835: Downloading JSON metadata
[Anvato] 4304835: Downloading m3u8 information
[debug] Invoking downloader on 'http://dcs-vod.apis.anvato.net/vod/p/414200/prog.m3u8?i=i177602643-n
22966f93-7fb3-46f0-89f7-cff63bbee228&anvtrid=e2371328f1d878c539904e5cb27fe90c'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 9 (not including 3 ad)
[download] Destination: The Music Box Village-4304835.mp4
[download] 100% of 3.79MiB in 00:05
[debug] ffmpeg command line: ffprobe -show_streams "file:The Music Box Village-4304835.mp4"
[ffmpeg] Fixing malformed AAC bitstream in "The Music Box Village-4304835.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:The Music Box Village-4304835.mp4" -c copy -f mp4 "-
bsf:a" aac_adtstoasc "file:The Music Box Village-4304835.temp.mp4"
[scrippsnetworks:watch] 3842219: Downloading JSON metadata
[scrippsnetworks:watch] 3842219: Downloading XML
[scrippsnetworks:watch] 3842219: Downloading JSON metadata
[Anvato] 4358867: Downloading JSON metadata
[Anvato] 4358867: Downloading m3u8 information
[debug] Invoking downloader on 'http://dcs-vod.apis.anvato.net/vod/p/414200/prog.m3u8?i=i177602643-n
bb7b3414-524c-4459-a98f-15082c1fdaf5&anvtrid=98cd2c89c07480a0612b34f64972ff33'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 9 (not including 3 ad)
[download] Destination: The Best of New Orleans-4358867.mp4
[download] 100% of 3.67MiB in 00:07
[debug] ffmpeg command line: ffprobe -show_streams "file:The Best of New Orleans-4358867.mp4"
[ffmpeg] Fixing malformed AAC bitstream in "The Best of New Orleans-4358867.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:The Best of New Orleans-4358867.mp4" -c copy -f mp4
"-bsf:a" aac_adtstoasc "file:The Best of New Orleans-4358867.temp.mp4"
[scrippsnetworks:watch] 3808461: Downloading JSON metadata
[scrippsnetworks:watch] 3808461: Downloading XML
[scrippsnetworks:watch] 3808461: Downloading JSON metadata
[Anvato] 4358860: Downloading JSON metadata
[Anvato] 4358860: Downloading m3u8 information
[debug] Invoking downloader on 'http://dcs-vod.apis.anvato.net/vod/p/414200/prog.m3u8?i=i177602643-n
d76595df-3852-4cba-9aa2-ea158c098461&anvtrid=0b17c969d91031680dbbaf04f39d5c16'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 7 (not including 3 ad)
[download] Destination: Red Rock Canyon-4358860.mp4
[download] 100% of 2.98MiB in 00:03
[debug] ffmpeg command line: ffprobe -show_streams "file:Red Rock Canyon-4358860.mp4"
[ffmpeg] Fixing malformed AAC bitstream in "Red Rock Canyon-4358860.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:Red Rock Canyon-4358860.mp4" -c copy -f mp4 "-bsf:a"
 aac_adtstoasc "file:Red Rock Canyon-4358860.temp.mp4"
[scrippsnetworks:watch] 3808460: Downloading JSON metadata
[scrippsnetworks:watch] 3808460: Downloading XML
[scrippsnetworks:watch] 3808460: Downloading JSON metadata
[Anvato] 4304776: Downloading JSON metadata
[Anvato] 4304776: Downloading m3u8 information
[debug] Invoking downloader on 'http://dcs-vod.apis.anvato.net/vod/p/414200/prog.m3u8?i=i177602643-n
48889423-fa51-4f06-8534-30b08ca3d559&anvtrid=5e6643d44d2607e844d9f6a06798fc5c'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 9 (not including 3 ad)
[download] Destination: Old Las Vegas-4304776.mp4
[download] 100% of 3.76MiB in 00:06
[debug] ffmpeg command line: ffprobe -show_streams "file:Old Las Vegas-4304776.mp4"
[ffmpeg] Fixing malformed AAC bitstream in "Old Las Vegas-4304776.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:Old Las Vegas-4304776.mp4" -c copy -f mp4 "-bsf:a" a
ac_adtstoasc "file:Old Las Vegas-4304776.temp.mp4"

https://watch.travelchannel.com/show/tccgd/new-orleans/3842220/the-music-box-village/
https://watch.travelchannel.com/show/tccgd/new-orleans/3842219/the-best-of-new-orleans/
https://watch.travelchannel.com/show/tccgd/las-vegas/3808461/red-rock-canyon/
https://watch.travelchannel.com/show/tccgd/las-vegas/3808460/old-las-vegas/
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Sep 12, 2018

Nothing to do with batches at all. https://watch.travelchannel.com/show/twpd/xtreme-waterparks/3606552/double-dog-dare/ is only available with TV provider,
@dstftw dstftw closed this Sep 12, 2018
@dstftw dstftw added the invalid label Sep 12, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
invalid
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@dstftw @jewshawn2
You can’t perform that action at this time.