Files are downloaded, but not uploaded #61
Comments
|
Since I'm not in my pc now, could you paste the output of using |
|
Closing because it's a duplicate of #48 @rudolphos I would advise against running tubeup as root. |
|
Don't censor your URLs, periscope videos tend to vanish and we need the full URLs to test against.
Whatever Tubeup does inbetween youtube-dl finishing downloads and internetarchive doing uploads, thats's where it's dying. If we slay this dragon most of the issues Tubeup had vanishes. I also think this issue is in one of the dependencies of tubeup. We might be able to nip it in the bud by force-reverting the dependency to a version not affected. Also @refeed is right we should lock down specific versions of dependencies from now on. |
|
Based on a tubeup run I executed today, this might be caused by the annotations.xml file being 0 bytes. Will provide an update after further testing. |
|
@brandongalbraith I think it's JSON based because it does it sometimes for Youtube but always for Periscope and Facebook. Fails every time. I just don't know what's causing it. |
|
This happens on channels/playlists that have more than ~40+ videos, I've tried channels with 12 videos and it was successful. Probably because there's more probability that there's something wrong with json between larger number of files. Or as @brandongalbraith said annotations.xml being 0 bytes. |
|
hmm, interesting. Could anyone give me a link to a sample channel? so I can test it in my environment |
|
@refeed Pick any Periscope channel. I will fail to upload either single videos or channels. |
refeed
added a commit
to refeed/tubeup
that referenced
this issue
Sep 11, 2018
Fix some logic when removing description and annotations file in `TubeUp.upload_ia()`. Fixes bibanon#61
refeed
added a commit
to refeed/tubeup
that referenced
this issue
Sep 11, 2018
Fix some logic when removing description and annotations file in `TubeUp.upload_ia()`. Fixes bibanon#61
vxbinaca
pushed a commit
that referenced
this issue
Sep 12, 2018
* Bump `internetarchive` version in tests * .gitignore: Add .cache/ `.cache/` directory is used by pytest, and we never want to commit it to this git repo. Adding it to `.gitignore` will make `.cache/` dir be ignored. * utils: Fix `check_is_file_empty()` logic when filepath doesn't exist Fix `check_is_file_empty()` logic when the filepath doesn't exist, now, it will raise a `FileNotFoundError` exception. * Print traceback when an exception is occured * TubeUp: Fix some logic when removing description and annotations file Fix some logic when removing description and annotations file in `TubeUp.upload_ia()`. Fixes #61
|
I updated tubeup and this happened again when archiving channel with 5-10 videos. When archiving individually youtube urls, it works. |
|
@rudolphos Fow now where's what you do: use youtube-dl to print out the IDs which is Stop censoring your URLs I keep having to tell you this. Then create commands for each video ID, that's the safest way. Also this isn't realted to the lat bug. So Make a issue next time. |
Closed
https://archive.org/details/facebook-1661500077336192 ..couldn't help myself 💯 |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Since the latest updates to tubeup archiving is not working for youtube channels or playlists, it only works for one URL at a time. Whole channel can't be archived, it downloads everything, but doesn't even start uploading. The same problem is also happening when trying to archive vid.me - tubeup downloads everything and doesn't upload. Also Periscope and facebook urls are having the same issue.
Just ran an update for components
sudo -H pip3 install -U pip tubeupbut the problem is still occurring.The text was updated successfully, but these errors were encountered: