add pluralsight.com extractor

[chovy]

I'd like to download some videos from pluralsight.com

[jaimeMF]

Post an example url

[chovy]

You would need credentials to download from pluralsight.

[jaimeMF]

It doesn't matter, please post an example url so that if someone wants to work on it they can easily have an example to start with.

[anthonyettinger]

Video player window:
http://www.pluralsight.com/training/player?author=jeremy-foster&name=nodejs-internet-of-things-using-intel-edison-m1&mode=live&clip=0&course=nodejs-internet-of-things-intel-edison

Course page:
http://www.pluralsight.com/courses/nodejs-internet-of-things-intel-edison

[edwardchanjw]

I don't know if the following still work, a free technet's subscription on PluralSight. End within few day.

https://offers.pluralsight.com/technet?loc=zTS3z&prod=zOTprodz&tech=zOttechz&prog=zOTprogz&type=zSOz&media=zOTmediaz&country=zUSz

[dstftw]

Pluralsight will be supported in the next version.

[chovy]

awesome.

[poudigne]

is the pluralsight downloader released yet ?
Edit: Sorry saw the commit after the comment.

One last question, is it possible to do the same for Digital Tutors (which is owned by Pluralsight now)

Here's a sample URL that plays the video : http://www.digitaltutors.com/tutorial/2160-Creating-a-Turn-Based-Game-in-Unity-and-PlayMaker#play-50967

[chovy]

I opened a ticket for digitaltutors.com
#6658

[kasibkismath]

youtube-dl downloads for Pluralsight is not working from today

[chovy]

+1 for a fix

[tfrangio]

First Thanks for the _youtube-dl_ it _ROCKS!_

Can some one post the correct command to download from Pluralsight once it is fixxed. Right now I am using:

youtube-dl --username <myusername> --password <mypassword> <Pluralsight Video URL>

I am on windows 7 - 64 bit. Here is the result of the _youtube-dl.exe -v_:

C:\Users\efrangio\Downloads>youtube-dl.exe -v
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2016.01.15
[debug] Python version 2.7.10 - Windows-7-6.1.7601-SP1
[debug] exe versions: none
[debug] Proxy map: {}
Usage: youtube-dl.exe [OPTIONS] URL [URL...]

youtube-dl.exe: error: You must provide at least one URL.
Type youtube-dl --help to see a list of all options.

C:\Users\efrangio\Downloads>

I get this error:

[generic] player?course=linux-managing-dns-servers-lpic-2: Requesting header
WARNING: Could not send HEAD request to https://app.pluralsight.com/player?cours
e=linux-managing-dns-servers-lpic-2: HTTP Error 400: Bad Request
[generic] player?course=linux-managing-dns-servers-lpic-2: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 400: Bad Request (caused by HTTPEr
ror()); please report this issue on https://yt-dl.org/bug . Make sure you are us
ing the latest version; type  youtube-dl -U  to update. Be sure to call youtube-
dl with the --verbose flag and include its complete output.
'author' is not recognized as an internal or external command,
operable program or batch file.
'name' is not recognized as an internal or external command,
operable program or batch file.
ERROR: Invalid argument/option - '=0'.
Type "CLIP /?" for usage.
Invalid parameter - =live

Any ideas on how to get this working would be infinitely appreciated?

[yan12125]

Looks like you need some more quotation marks in your command. See this FAQ entry. If the problem is still, feel free to open a new issue with the full command you're using and the output.

[tfrangio]

Thanks for your quick help. I tried to put the url in double quotes like this:

youtube-dl --username <myusername> --password <mypassword> "<Pluralsight Video URL>"

Here was the result:

[generic] player?course=linux-managing-dns-servers-lpic-2&author=andrew-mallett&
name=linux-managing-dns-servers-lpic-2-m1&clip=0&mode=live: Requesting header
WARNING: Falling back on generic information extractor.
[generic] player?course=linux-managing-dns-servers-lpic-2&author=andrew-mallett&
name=linux-managing-dns-servers-lpic-2-m1&clip=0&mode=live: Downloading webpage
[generic] player?course=linux-managing-dns-servers-lpic-2&author=andrew-mallett&
name=linux-managing-dns-servers-lpic-2-m1&clip=0&mode=live: Extracting informati
on
ERROR: Unsupported URL: https://app.pluralsight.com/player?course=linux-managing
-dns-servers-lpic-2&author=andrew-mallett&name=linux-managing-dns-servers-lpic-2
-m1&clip=0&mode=live

This was definitely one of my issues but I am getting a _Unsupported URL_ error now.

[mousepotato]

You may not be able to download using a specific video URL page, but the course URL page is OK.
e.g., youtube-dl --username --password "https://app.pluralsight.com/library/courses/using-wmi-and-cim-powershell"

[tfrangio]

Thanks a bunch mousepotato,

The solution to my issue was to use the _course URL page_ in double quotes just as shown above. As soon as I did that I got the videos to download.

[vnpnlz]

This doesn't work for me. I got an error Unable to download the page : <urlopen error [Errno 8]]> __ssl.c:510 EOF occured in violation of protocol>

[trashbat]

Be warned that you may find yourself locked out of your account if you download too much data from them, this is the email I received earlier:

We have blocked your account because our security systems have flagged your Pluralsight account for an unusual amount activity. This does mean a high volume of requests that are in the realm of a request every 10-30 seconds for a prolonged period of time. Please note that this high volume of activity is in violation of our terms of service [https://www.pluralsight.com/terms].

In my case I'd just downloaded a single course and I was halfway through downloading a second one. Easy enough to get it unblocked, though, you just have to email support.

[dstftw]

@trashbat what version have you used? Post the output of youtube-dl -v.

[trashbat]

@dstftw I was using latest master, output is 2016.01.27. It did pause between each video to avoid throttling, but Pluralsight still didn't like the volume of data that I was downloading from them (~1.1GB from 2 courses when they locked my account).

[dstftw]

Have you downloaded courses in parallel? What was the --sleep-interval you used? There is already a anti-throttling sleep that previously worked in most of the cases.

[trashbat]

@dstftw No I downloaded them sequentially, and I didn't specify a --sleep-interval. Perhaps I was just unlucky; the first course that I downloaded was rather large (691MB), and I managed to get 426M of the second one downloaded before my account was locked. Could also be due to my fast connection speed at work (~750 Mbit/s), which meant that the data was downloaded in a short space of time.

[tfrangio]

I had a problem with getting locked out of this site as well. I found that crawling the site like a snail has worked for me. As I am in no rush to download an entire course this is fine with me. I set this in the morning and by the end of the day I have a course downloaded. I did this because I had already been locked out once and did not want to have that happen again.

The two parameters that dictate the speed are "--rate-limit 50K" and "--sleep-interval 600" notice that I am only fetching another video every 10 min with the sleep-interval set to 600.

youtube-dl.exe --verbose  --username <<YOUREMAIL>> --password <<YOURPASSWORD>> --rate-limit 50K --sleep-interval 600 -o "%(autonumber)s - %(title)s.%(ext)s" "https://app.pluralsight.com/library/courses/bash-shell-scripting"

[bruinebeer]

@tfrangio hi, i am using your settings and it works, but it is really really slow.. the 600 sleep-interval seems excessive though? would it hurt to make it wait less? and maybe speed up a lil bit?

[tfrangio]

@bruinebeer I guess you could experiment with the values of "sleep-interval" and "rate-limit" but you will risk having your account shut off. Sleep - interval is specified on seconds so 600 is 10 minutes you could try 300 that would be every 5 min.

[bruinebeer]

@tfrangio Thx! Is it possible to continue a download when it gets interrupted?

[chovy]

I'm curious about that too. If there is a --resume flag where it would start from the last incomplete file.

[N1t1nA]

@mousepotato Thanks!

[chovy]

i found i could download 2-3 courses, then I got banned. So be careful.

[chovy]

Actually. I think I had not updated to latest version yet, so there was no delay. I had updated and saw it waits 10 minutes between videos. But I had been banned by this time already.

I just emailed them they wanted me to acknowledge that auto-downloading is against their ToS, they re-enabled my account.

[bruinebeer]

@chovy With tfrangio's options i don't think pluralsight will notice it. It's takes almost a full day to download a course.

[chovy]

is there anyway to resume? i tried doing this but my laptop went to sleep on me

[chovy]

I did not pass any options like -c -- is that required? or is it smart enough to just resume from the last incomplete file?

[N1t1nA]

hi @xikaos can you please provide the syntax of (safe to download at full speed --sleep-interval of 5 minutes)

[maestrofx]

hi @xikaos, which version do you use to work well?

[maestrofx]

Ok, I am in a new VPS to try this with latest version (2016.02.22). But, I have a weird error [1].
I assumed this latest version not working, so I have downgrade to 2016.02.13. But, the same error come.

Is this issue for youtube-dl or anything else?

Thanks

[1] error

ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 354, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1905, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 410, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 523, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 448, in error
return self._call_chain(_args)
File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
result = func(_args)
File "/usr/lib/python2.7/urllib2.py", line 531, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

[maestrofx]

Ok, here are my updates:

• I've been still playing with some versions to check which one is working for me
• I've read some issues and comments related to this error and come back later to update
• no problem with the authentication problem or credentials or another params to the script
• I can open videos with the player, so no problem with banned status by pluralsight.
• Also, I've tried this with one of my banned account.

Thanks

[mirfilip]

@xikaos

I wonder how the hell they can make the assumption that you are a script, not a regular person watching the videos for like 5 minutes then going to the next one.

Looking at the explaination they give you when your account gets banned, it's a matter of

high volume of requests that are in the realm of a request every 10-30 seconds for a prolonged period of time

which

this high volume of activity is in violation of our terms of service

So, I would recommend to set a

• good User Agent
• sleep-interval to something like ~120 sec

[jasminetracey]

Anybody tried with 120s?

[maestrofx]

@readergirltracey try --sleep-interval 300, it works well. But, your account will be absolutely blocked if you run the command over and over again due to a file that's skipped in the playlist during the process.

Say the playlist has 32 files and the 10th file was skipped. When you run the command again, it's risky to block by Pluralsight's system.

[damianopetrungaro]

It would be awesome if also the "skills" url could be grabbed

Link sample https://app.pluralsight.com/paths/skill/docker

Of course it need auth =)

[yan12125]

@damianopetrungaro Please open a new issue for that.

[Ebram-Tharwat]

Can anyone please, share his experience when setting --sleep-interval set to 120s ?
Is 120s enough or it should be more longer?

[damianopetrungaro]

120 is ok.

[Ebram-Tharwat]

@damianopetrungaro , do you use --rate-limit option to limit your download speed or you use your max speed (if max speed, can you mention it)?
Also, do you download courses sequentially or in parallel?

Thank you in advance.

[damianopetrungaro]

@Ebram-Tharwat i used --sleep-interval only at 120 sequentially.

[sonhoang0611]

120s works fine for me tks. I used: youtube-dl --username yourname --password yourpassword --verbose --sleep-interval 120s --all-subs "yourlink"

[shekhtman]

Recently I was redirected, after login, to a page asking me to accept/decline their terms of use. Did any one get this?

[yan12125]

@shekhtman There are quite a few similar reports. You'll need to accept the ToS manually in browsers.