Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Strange behaviour of --download-archive #15714

Closed
urza opened this issue Feb 27, 2018 · 3 comments
Closed

Strange behaviour of --download-archive #15714

urza opened this issue Feb 27, 2018 · 3 comments
Labels

Comments

@urza
Copy link

@urza urza commented Feb 27, 2018

Hello,

I have debian server downloading every night (with command in crontab -e calling simple script to download my vimeo liked videos) and saving downloaded ids to "downloaded.txt" file.

But it behaves strangely and I dont understand what is going on.

First, here is my crontab -e:
screenshot 2018-02-27 13 50 05

here is the youtube-dl command that gets executed:
screenshot 2018-02-27 13 49 45

and finally here is the problem:
screenshot 2018-02-27 13 49 08

The file gets downloaded every day, looks like there is some problem writing archive to downloaded.txt, but the file is owned by me and has write for everybody.

Furthermore, strange behaviour: If I delete the duplicate files and leave only one of them, then it will stop donwnloading them again, and will leave just the one there.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Feb 27, 2018

Carefully read new issue template and provide all requested information.

@dstftw dstftw closed this Feb 27, 2018
@dstftw dstftw added the incomplete label Feb 27, 2018
@urza
Copy link
Author

@urza urza commented Feb 27, 2018

Here you go dear dstftw

I AM AT THE LATETS VERSION

  • [X ] I've verified and I assure that I'm running youtube-dl 2018.02.26

Before submitting an issue make sure you have:

  • [ X] At least skimmed through the README, most notably the FAQ and BUGS sections
    I SPENT LIKE AN HOUR TRYING TO FIGURE IT OUT FROM YOUR DOCUMENTATION
  • [X ] Searched the bugtracker for similar issues including closed ones
  • [X ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • [X ] Question (I KNOW IT IS CONFUSING BECAUSE I DIDNT PUT THE QUESTION MARK, BUT I AM ACTUALLY ASKING WHAT IS GOING ON WITH THE COMMAND AND WHY IS IT NOT WORKING AS INTENDED)

SINCE MY SCRIPT RUNS FROM CRONTAB, I BELIEVE THE SCREENSHOTS AND DESCRIPTIONS WOULD BE HELPFUL, BUT LET ME KNOW IF YOU NEED KNOW ANYTHING ELSE OR FILL ANY MORE OF YOUR FORMS.

@urza
Copy link
Author

@urza urza commented Feb 27, 2018

And here is your DEBUG LOG, you have some BUG there as it turns out:

./dl_vimeoL.sh
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'--download-archive', u'/media/strix/urza/multimedia/VIDEOS/SHORT/vimeo-likes/downloaded.txt', u'-o', u'/poolgarden/urza/media/VIDEOS/SHORT/vimeo-likes/20180227-%(uploader)s-%(title)s-%(id)s.%(ext)s', u'-w', u'--restrict-filenames', u'vimeo.com/user755559/likes']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.02.26
[debug] Python version 2.7.13 (CPython) - Linux-4.9.0-4-amd64-x86_64-with-debian-9.3
[debug] exe versions: none
[debug] Proxy map: {}
WARNING: The url doesn't specify the protocol, trying with http
[generic] likes: Requesting header
[redirect] Following redirect to https://vimeo.com/user755559/likes
[vimeo:likes] 755559: Downloading webpage
[download] Downloading playlist: Videos urza likes
[vimeo:likes] 755559: Downloading page 1/34
[vimeo:likes] 755559: Downloading page 2/34
[vimeo:likes] 755559: Downloading page 3/34
[vimeo:likes] 755559: Downloading page 4/34
[vimeo:likes] 755559: Downloading page 5/34
[vimeo:likes] 755559: Downloading page 6/34
[vimeo:likes] 755559: Downloading page 7/34
[vimeo:likes] 755559: Downloading page 8/34
[vimeo:likes] 755559: Downloading page 9/34
[vimeo:likes] 755559: Downloading page 10/34
[vimeo:likes] 755559: Downloading page 11/34
[vimeo:likes] 755559: Downloading page 12/34
[vimeo:likes] 755559: Downloading page 13/34
[vimeo:likes] 755559: Downloading page 14/34
[vimeo:likes] 755559: Downloading page 15/34
ERROR: Unable to download webpage: HTTP Error 503: Service Unavailable (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 519, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2199, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.