Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

plugins.vimeo: connection is closing after every full hour of written data #3492

Open
1 of 2 tasks
Shmi911 opened this issue Jan 17, 2021 · 6 comments
Open
1 of 2 tasks

plugins.vimeo: connection is closing after every full hour of written data #3492

Shmi911 opened this issue Jan 17, 2021 · 6 comments
Assignees
@mkbloke
Labels
plugin enhancement A new feature for a working Plugin

Comments

@Shmi911
Copy link

Shmi911 commented Jan 17, 2021 •
edited
Loading

Plugin Issue

  • This is a plugin issue and I have read the contribution guidelines.
  • I am using the latest development version from the master branch.

Description

After every full hour written data streamlink is unable to open URL (Failed to reload playlist) - (403 Client Error: Forbidden for url).

Streamlink closes currently open stream.

BUT, stream is still running and you are still able to start recording again. Every connection just ends after 1 hour and you need to make a new connection.

The problem is that streamlink needs about 1 minute to close down the connection. And my running loop script starts looping after the connection is closed. That means I'm losing at least about 1 minute of possible written data after every full hour.

Reproduction steps / Explicit stream URLs to test

  1. Find a running livestream on vimeo (not a vod)
  2. Download using a link that should look like this "https://vimeo.com/501264363" with streamlink
  3. Command example: streamlink https://vimeo.com/501264363 best -o C:\Users\Yourname\Desktop\filename.ts
  4. Write data for 1 hour and receive a closing connection (while stream is still running)

Log output

[cli][info] Found matching plugin vimeo for URL https://vimeo.com/501264363
[cli][info] Available streams: 240p_alt (worst), 240p, 360p_alt, 360p, 540p_alt, 540p, 720p_alt, 720p, 1080p_alt, 1080p (best)
[cli][info] Opening stream: 1080p (hls)
[download] Written 2.28 GB (59m58s @ 813.4 KB/s)                         
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
[stream.hls][warning] Failed to reload playlist: Unable to open URL: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8 (403 Client Error: Forbidden for url: https://live-ak.vimeocdn.com/exp=1610843372~acl=%2F85c31005-7e84-4535-b3f4-96dc518a6730%2F%2A~hmac=534e6e8ff3af358e93c3a156cf6eb691f1f576b663e237925694a867328356f0/85c31005-7e84-4535-b3f4-96dc518a6730/chunklist_b6256000.m3u8)
error: Error when reading from stream: Read timeout, exiting
[cli][info] Stream ended
[cli][info] Closing currently open stream...

Gewartet wird  0 Sekunden. Drücken Sie STRG+C, um den Vorgang zu beenden...
[cli][info] Found matching plugin vimeo for URL https://vimeo.com/501264363
[cli][info] Available streams: 240p_alt (worst), 240p, 360p_alt, 360p, 540p_alt, 540p, 720p_alt, 720p, 1080p_alt, 1080p (best)
[cli][info] Opening stream: 1080p (hls)
[download] Written 587.3 MB (15m2s @ 620.4 KB/s)

Additional comments, etc.

I think streamlink is fetching & using a temporary HLS link that works for 1 hour max?
Hopefully there is a workaround.
@back-to back-to added the plugin enhancement A new feature for a working Plugin label Jan 23, 2021
@back-to
Copy link
Collaborator

back-to commented Jan 23, 2021

the video url expires after 60 minutes,
the plugin would need something like a session reload similar to the filmon plugin.

Ref #2626

@2ShedsJackson
Copy link

The problem is that streamlink needs about 1 minute to close down the connection. And my running loop script starts looping after the connection is closed. That means I'm losing at least about 1 minute of possible written data after every full hour.

I've been saving two copies of a stream simultaneously, one of them offset by several minutes. Editing the resulting files into one video is inconvenient but this approach prevents losing any data.

@Shmi911
Copy link
Author

Shmi911 commented Mar 19, 2021

The problem is that streamlink needs about 1 minute to close down the connection. And my running loop script starts looping after the connection is closed. That means I'm losing at least about 1 minute of possible written data after every full hour.

I've been saving two copies of a stream simultaneously, one of them offset by several minutes. Editing the resulting files into one video is inconvenient but this approach prevents losing any data.

Thank you. I didn't think about that. The problem is that most of the time I don't want to have extra connections, because at times I'm running a lot of those.

Btw, command "--hls-timeout 10" closes down the connection way faster than without the command. So I'm losing less data with that.

@pateljoel
Copy link

Is there an update on this, this has been affecting me as well.

@lucacris72
Copy link

Hi, any update on this?

@mkbloke mkbloke self-assigned this Jun 11, 2022
@mkbloke
Copy link
Member

mkbloke commented Jun 15, 2022

Does anybody have examples of regular live streams that are DASH based? They will show something like:

[cli][info] Opening stream: QUALITY_VALUE_HERE (dash)

in the Streamlink output when opened.

I'm not interested in streams that are shown as hls or hls-multi within the parenthesis of this output, I already have a fix for those. Thanks.

@mkbloke mkbloke mentioned this issue Jun 15, 2022
Closed
@bastimeyer bastimeyer changed the title Vimeo - connection is closing after every full hour of written data plugins.vimeo: connection is closing after every full hour of written data Aug 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mkbloke mkbloke

Labels
plugin enhancement A new feature for a working Plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

stream.hls/plugins.vimeo: update/fix mkbloke/streamlink
6 participants
@mkbloke @back-to @2ShedsJackson @pateljoel @Shmi911 @lucacris72