Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UpRide.cc support #7858

Open
9 of 11 tasks
NothingSpecific opened this issue Aug 16, 2023 · 3 comments
Open
9 of 11 tasks

UpRide.cc support #7858

NothingSpecific opened this issue Aug 16, 2023 · 3 comments
Labels
site-request Request to support a new website

Comments

@NothingSpecific
Copy link

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

  • I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

Region

United States

Example URLs

Provide a description that is worded well enough to be understood

UpRide.cc is a site for cyclists to upload video evidence of incidents.

Provide verbose output that clearly demonstrates the problem

  • Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
  • If using API, add 'verbose': True to YoutubeDL params instead
  • Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output

[debug] Command-line config: ['-vU', 'https://upride.cc/incident/shoulder-pass-at-light/']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8 (No ANSI), error utf-8 (No ANSI), screen utf-8 (No ANSI)
[debug] yt-dlp version stable@2023.07.06 [b532a3481] (debian*)
[debug] Python 3.9.2 (CPython x86_64 64bit) - Linux-6.4.9-1-liquorix-amd64-x86_64-with-glibc2.31 (OpenSSL 1.1.1n  15 Mar 2022, glibc 2.31)
[debug] exe versions: ffmpeg 4.3.6-0, ffprobe 4.3.6-0, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.9.7, brotli-1.0.9, certifi-2020.06.20, mutagen-1.45.1, pyxattr-0.7.2, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1855 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.07.06, Current version: stable@2023.07.06
yt-dlp is up to date (stable@2023.07.06)
[generic] Extracting URL: https://upride.cc/incident/shoulder-pass-at-light/
[generic] shoulder-pass-at-light: Downloading webpage
WARNING: [generic] Falling back on generic information extractor
[generic] shoulder-pass-at-light: Extracting information
[debug] Looking for embeds
ERROR: Unsupported URL: https://upride.cc/incident/shoulder-pass-at-light/
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/yt_dlp/YoutubeDL.py", line 1560, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/yt_dlp/YoutubeDL.py", line 1688, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/common.py", line 710, in extract
    ie_result = self._real_extract(url)
  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/generic.py", line 2568, in _real_extract
    raise UnsupportedError(url)
yt_dlp.utils.UnsupportedError: Unsupported URL: https://upride.cc/incident/shoulder-pass-at-light/
@NothingSpecific NothingSpecific added site-request Request to support a new website triage Untriaged issue labels Aug 16, 2023
@garret1317
Copy link
Collaborator

garret1317 commented Sep 25, 2023

embedded cloudflare stream player, metadata in the html

<iframe
  src="https://customer-xje7fu6unkwpaymh.cloudflarestream.com/eaef9dea5159cf968be84241b5cedfe7/iframe?startTime=0"
  style="border: none"
  height="720"
  width="1280"
  allow="accelerometer; gyroscope; autoplay; encrypted-media; picture-in-picture;"
  allowfullscreen="true"
  id="stream-player"
></iframe>
</script></div><!-- .single-incident-container --></div><!-- .single-incident --><div class="incident-camera-type"><a href="https://cycliq.com/bike-cameras/fly6ce/" target="_blank">Filmed on the Fly6</a></div><div class="single-incident-content-inner"><h3 class="incident-title"><img decoding="async" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%200%200'%3E%3C/svg%3E" id="incident_type-close-call" data-type="close-call" class="marker-icon" data-lazy-src="https://upride.cc/wp-content/plugins/cycliq-upride/images/marker-red-192x192.png" /><noscript><img decoding="async" src="https://upride.cc/wp-content/plugins/cycliq-upride/images/marker-red-192x192.png" id="incident_type-close-call" data-type="close-call" class="marker-icon" /></noscript>Shoulder Pass at Light</h3><p class="incident-summary clear"><a id="incident-details-toggle" href="#">1291 views. <attr title="06/07/2023 04:47PM">3 months ago</attr><span class="mobile-more-info">...more</span></a></p><div id="incident-details"><blockquote><p>Car riding on shoulder, comes up behind me at red light to make a right turn at frame 4:47 to 5:03.</p>
</script><hr /><h4>Incident details</h4><dl><dt>Date of incident</dt><dd>06/07/2023 04:47PM</dd><dt>Incident type</dt><dd><a href="/incidents/close-calls/">Close call</a></dd><dt>Location of incident</dt><dd><a href="/incidents/?country=US&street=Cane Island Parkway" target="_blank">Cane Island Parkway</a>, <a href="/incidents/?country=US&place=Katy" target="_blank" title="View more incidents">Katy</a>, <a href="/incidents/?country=US&region=TX" target="_blank" title="View more incidents">Texas</a> <a href="/incidents/?country=US&postcode=77494" target="_blank" title="View more incidents in 77494, United States">77494</a>, <a href="/incidents/?country=US" target="_blank" title="View more incidents in United States">United States</a></dd></dl><hr /></p></div><!-- #incident-details -->

probably just needs the embed regex in extractor/cloudflarestream.py to work with iframes for generic extractor to be able to handle it
still need a site-specific one if you want the metadata though

@garret1317 garret1317 removed the triage Untriaged issue label Sep 25, 2023
@bashonly
Copy link
Member

bashonly commented Feb 9, 2024

related #9171

@ilikenwf
Copy link

ilikenwf commented Feb 24, 2024

Please see my comment here: #9171 (comment) @bashonly

If we see a cloudflare iframe like this, replacing the "customer-whatever" piece of the url with "watch" allows us to download the video successfully but it is currently a manual process.

bashonly added a commit that referenced this issue Feb 24, 2024
Partially addresses #7858
Authored by: bashonly
aalsuwaidi pushed a commit to aalsuwaidi/yt-dlp that referenced this issue Apr 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
site-request Request to support a new website
Projects
None yet
Development

No branches or pull requests

4 participants