Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Scrippsnetworks Extractor No Longer Working (HGTV.com, Foodnetwork.com, etc.) #14389
Comments
|
All of the Scripps Networks have changed their URL format: Cooking Channel: http://watch.cookingchanneltv.com/show/CCSHA/Big-Bad-BBQ-Brawl/3820590/Chicago-Italian-Beef-BBQ-Brawl/ Travel Channel: http://watch.travelchannel.com/show/TFP/Food-Paradise/3703822/Food-Paradise-XL/ DIY Network: http://watch.diynetwork.com/show/DSAL/Salvage-Dawgs/2656646/Covington-Church/ HGTV: http://watch.hgtv.com/show/HHALF/Hawaii-Life/3547066/Living-Large-on-The-Big-Island/ |
awalz92
changed the title
|
Also diynetwork.com |
|
I'm also having this issue, but I discovered it goes a bit deeper than just not finding the URL. Let's say you actually discover the m3u8 filename and use that as the target address. It will then hand off to ffmpeg which will start to download segments and convert them to .mp4 (which is major problem number 1 for me personally - I don't need the output as .mp4, I actually need to convert it back to a .ts file afterwards). But right around the first commercial break it starts displaying thousands of errors of this form: [mp4 @ 0x58e66c0] Non-monotonous DTS in output stream 0:1; previous: 26703410, current: 14303232; changing to 26703411. This may result in incorrect timestamps in the output file. And once it does that, the file is completely hosed. But further examination indicates this is a ffmpeg bug - something about the way it combines the files is off. In reality it may be as little as one of the fragments that has that issue, but for some reason ffmpeg corrupts everything after that. If you try to play the resulting file, it plays fine to the first commercial break, but then horrible things happen, and then it usually ends prematurely (even though the whole file is there, it's so corrupted nothing will play it). Now if you use wget to download that first .m3u8 file and open it in a text editor, you will see it contains links to other .m3u8 files of various screen resolutions. If you take the one for 1920x1080 and download that one and open it, you will see it contains links to all the various .ts fragments, in the order they should be played. If you wget all those files individually, and then join them using ffmpeg (but doing a straight copy using the -c copy option, and making the output file another .ts file you will probably only see one or two of those errors, not thousands. Kodi can use the .ts file directly and it plays fine. So to recap, the fix for that issue is this:
|
|
@tv21 What is your ffmpeg command string? The hls saves fine into a ts file container for me. Alternatively, the legacy "theplatform" pid is still available - which allows http mp4 progressive transfer. There are a series of requests to It probably will be a fair bit of work to fix the extractor for the scripps sites. There is one signature for the series of requests that I suspect is being done on the server side. I'm not sure if "theplatform" is being entirely transitioned out in favor of the new hls system, or just depreciated but kept on. |
|
stinkteeth, the ONLY part of your post that I understood was "What is your ffmpeg command string?" Well, that and your comments in your last paragraph. I only use ffmpeg to combine the individual .ts files into one large one, so I use: ffmpeg -f concat -safe 0 -i fflist.txt -c copy "../out.ts" || { echo "ffmpeg failed to concatenate files"; exit 1; } fflist text contains a list of files in the format: file 'first.ts' etc. Not sure why ffmpeg requires the word "file" and the single quotes around the filenames, but it does. I use this in a small bash script I have written to automate some of the process (not all of it; you still have to figure out the correct m3u8 filename manually), which is why the error exit is present. Also the output filename is specified as "../out.ts" because this is running in a temporary directory off the main user directory, but I want the out.ts file to be in the actual user directory. I will also note that I have not encountered any more errors in the files since the first time I tried this, so the errors must have been a oddity in that one program. Oh, and after reading your post again, I'm not sure if you were asking this, but most of this stuff does require a provider login. |
|
Thanks a lot @dstftw ! |
|
@tv21 If they're simply transport stream files, you can just cat them, e.g. cat file000.ts file001.ts file002.ts > combined.ts |
|
They updated the site again. Should I post a new issue? |
|
@remitamine Thank you. |
Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2017.10.01. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.What is the purpose of your issue?
If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included:
Description of your issue, suggested solution and other information
Both sites received updates, which now have differently formatted URLs, and no longer work. The other Scripps sites (Travel Channel, DIY Network, etc.) aesthetically appear to be the same, but I'm unable to determine single video URLs to test them.