Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[site-support-request] tutsplus.com #3662

Closed
brennebeck opened this issue Sep 2, 2014 · 18 comments
Closed

[site-support-request] tutsplus.com #3662

brennebeck opened this issue Sep 2, 2014 · 18 comments

Comments

@brennebeck
Copy link

@brennebeck brennebeck commented Sep 2, 2014

[22:14:19] ❯
youtube-dl --verbose -t -A https://code.tutsplus.com/courses/one-two-knockout/lessons/introduction --username=xxx --password=xxx
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', '-t', '-A', 'https://code.tutsplus.com/courses/one-two-knockout/lessons/introduction', '--username=xxx', '--password=xxx']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.09.01.1
[debug] Python version 2.7.8 - Darwin-13.4.0-x86_64-i386-64bit
[debug] Proxy map: {}
[generic] introduction: Requesting header
[redirect] Following redirect to http://code.tutsplus.com/courses/one-two-knockout/lessons/introduction
[generic] introduction: Requesting header
WARNING: Falling back on generic information extractor.
[generic] introduction: Downloading webpage
[generic] introduction: Extracting information
ERROR: Unsupported URL: http://code.tutsplus.com/courses/one-two-knockout/lessons/introduction; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 530, in _real_extract
    doc = parse_xml(webpage)
  File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 1472, in parse_xml
    tree = xml.etree.ElementTree.XML(s.encode('utf-8'), **kwargs)
  File "/usr/local/opt/pyenv/versions/2.7.8/lib/python2.7/xml/etree/ElementTree.py", line 1300, in XML
    parser.feed(text)
  File "/usr/local/opt/pyenv/versions/2.7.8/lib/python2.7/xml/etree/ElementTree.py", line 1642, in feed
    self._raiseerror(v)
  File "/usr/local/opt/pyenv/versions/2.7.8/lib/python2.7/xml/etree/ElementTree.py", line 1506, in _raiseerror
    raise err
ParseError: not well-formed (invalid token): line 3, column 383
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 521, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 178, in extract
    return self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 869, in _real_extract
    raise ExtractorError('Unsupported URL: %s' % url)
ExtractorError: Unsupported URL: http://code.tutsplus.com/courses/one-two-knockout/lessons/introduction; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.

As with #3661 -

I can try working on a pr, but python is definitely not my forte. If you could help by pointing me in the direction of an extractor that would work similar to this (I'm not sure but maybe I should look at the Lynda extractor?) then I'll give it a shot.

So, the same applies here 😄

@MHM5000
Copy link

@MHM5000 MHM5000 commented Oct 17, 2014

There are lot's of courses (both free and premium) in this site which uses wistia for it's videos.
I recommend adding it to the system

naglis pushed a commit that referenced this issue Oct 17, 2014
)

Also, improve detection (Addresses #3662)
@Ayman97
Copy link

@Ayman97 Ayman97 commented Apr 27, 2016

if this was a porn site, i don't think that i will wait all this time

@remitamine
Copy link
Collaborator

@remitamine remitamine commented May 19, 2016

works with the latest version.

@remitamine remitamine closed this May 19, 2016
@manniR
Copy link

@manniR manniR commented May 29, 2016

works only on free ;(

@yan12125
Copy link
Collaborator

@yan12125 yan12125 commented May 29, 2016

--cookies should work for non-free videos. If not, please open a new issue.

@manniR
Copy link

@manniR manniR commented May 29, 2016

works great - thanks ;)

@brennebeck
Copy link
Author

@brennebeck brennebeck commented May 31, 2016

@manniR - Are you able to download an entire playlist/course with a single command (e.g. just using the course URL to get all vids) or are you running the command for each video?

@manniR
Copy link

@manniR manniR commented Jun 1, 2016

@brennebeck - tutsplus-cookie.txt (extracted cookie) - playlist-links.txt (copied playlist links)

youtube-dl -v --cookies tutsplus-cookie.txt -a playlist-links.txt -o '#%(autonumber)s - %(title)s.%(ext)s'

@ahmadawais
Copy link

@ahmadawais ahmadawais commented Aug 2, 2016

@manniR All I get by running your command is this error

youtube-dl --verbose https://code.tutsplus.com/courses/one-two-knockout/lessons/introduction --username=mrahmadawais@gmail.com --password=rajuhaigul -a playlist-links.txt
[debug] System config: [u'--abort-on-error', u'--no-mtime', u'--cookies', u'cookies.txt', u'--console-title', u'--continue', u'--autonumber-size', u'2', u'--retries', u'infinite', u'-o', u'%(chapter_number)s.%(autonumber)s- %(chapter)s\u2014 %(title)s-%(resolution)s.%(ext)s']
[debug] User config: []
[debug] Command-line args: [u'--verbose', u'https://code.tutsplus.com/courses/one-two-knockout/lessons/introduction', u'--username=mrahmadawais@gmail.com', u'--password=rajuhaigul', u'-a', u'playlist-links.txt']
ERROR: batch file could not be read

Any help would be appreciated?

@brennebeck
Copy link
Author

@brennebeck brennebeck commented Aug 2, 2016

@ahmadawais you'll need to save the list of URLs you want to download in the playlist-links.txt file, if you use a queue file. So put https://code.tutsplus.com/courses/one-two-knockout/lessons/introduction in the playlist-links.txt and any other URLs on a new line each and run the command from the same directory, without the URL flag:
youtube-dl --verbose --username=mrahmadawais@gmail.com --password=rajuhaigul -a playlist-links.txt

@ahmadawais
Copy link

@ahmadawais ahmadawais commented Aug 3, 2016

@brennebeck Thanks for that! Is there any way for me to automate the link capture and playlist-links.txt file formation process on Tuts+?

@brennebeck
Copy link
Author

@brennebeck brennebeck commented Aug 5, 2016

I have a jquery script I've been using in chrome devtools. The same could be done in Phantom probably so that you get the auto write. I'll post the script when I'm back at my Mac 👍

Sent from my iPhone

On Wed, Aug 3, 2016 at 7:26 PM +0800, "Ahmad Awais" notifications@github.com wrote:

@brennebeck Thanks for that! Is there any way for me to automate the link capture and playlist-links.txt file formation process on Tuts+?


You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@ahmadawais
Copy link

@ahmadawais ahmadawais commented Aug 5, 2016

@brennebeck Great! Looking forward!

@brennebeck
Copy link
Author

@brennebeck brennebeck commented Aug 5, 2016

@ahmadawais here ya' go: https://gist.github.com/brennebeck/fa9f45c6bef202c75ced4509e326462f

So I have those two scripts saved as snippets in devtools. Here are the steps:

  1. Navigate to the page you want the URLs from (e.g. https://webdesign.tutsplus.com/courses/make-the-leap-from-static-mockups-to-moving-prototypes)
  2. Run the jquerify.js first
  3. Run get-urls.js
  4. The console will have a list of URLs that you can copy and paste now 👍

It wouldn't take too much work to get this to work outside of a browser, but this is quick enough for me. Hope it helps.

@ahmadawais
Copy link

@ahmadawais ahmadawais commented Aug 5, 2016

@brennebeck Thank! Where am I supposed to run these scripts? A gif maybe. I will work it out and convert them to bash.

@ahmadawais
Copy link

@ahmadawais ahmadawais commented Aug 5, 2016

@brennebeck Thanks!

I spent some time and built a bash function for this scrapping.

You need to have pup installed.
Just put it inside your alias file and run elinks http://domain.com/ playlist-links.txt

https://gist.github.com/ahmadawais/065cad34038201d97c257daaddeb2237

Cheers!

@neilbannet
Copy link

@neilbannet neilbannet commented Oct 1, 2016

Awesome it works ;) Thanks guys

@a-eid
Copy link

@a-eid a-eid commented Jun 12, 2017

How did you get it to work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
10 participants
You can’t perform that action at this time.