Symlink Downloader is not creating symlinks #449
Comments
|
Yeah, i was having the same issue and opened a post as well, many others have opened similar ones too. Although i don't know what i did to fix other then just tinkering with the settings. I'm running it on windows at the moment but i have also ran it on ubuntu in docker. I followed this guide for ubuntu https://puksthepirate.notion.site/eebe27d130fa400c8a0536cab9d46eb3?v=0cf094af30854b628e47ec17010725a5. |
I think the pukabyte rdtclient fork is the difference. unfortunately that particular build only works with AMD64 and not ARM64 like i have |
|
I will see if I can merge those changes in RDT here, not sure why there's such a separate build. I did find an issue with the download client setting that would try to wrong downloader, so maybe that has something to do with it? I will push a fix for that in the next build. |
Its working fairly well now on windows, but it does occasionally break. I think it seems to depend on which torrent it grabs, not sure why tho. Looking forward to the new build, thanks. |
|
I pushed a new build now, check if it's more reliable. Also it's now hard failing when the process fails instead of endlessly retrying with no real feedback. Hopefully this will show errors quicker and make it easier to fix. |
Seems like its working well so far. I'll update again if I encounter an issue. Log file (v2.0.65): rdtclient_039.log Snippet from log where its getting stuck: |
|
confirm here too its doing the symlinks, but stuck on queued for unpacking also once one link gets into that mode the other links don't get processed until the one marked unpacking gets deleted |
|
@ArrJayyy the logs indicate: Does this file not exist in Z:\torrents? |
|
I setup a raidrive myself and started testing, there were some oddities in the symlink downloader. Try the latest version and see if it works better. |
Ill try it out. As for ur other comment, the file did exist in the rclone mount i could also play it too but that torrent that got downloaded had additional files i didnt need and that was one of them, but that was due to it being over the 100MB limit so i increased that. I think i just chose a different torrent after that manually, didn't retest the same one. I wonder now tho maybe it has issues when a torrent contains multiple files cuz that was just one example. |
|
I'm seeing this too (v2.0.66 and possibly since v2.0.65 or .64): No way to get around this unfortunately. Even retrying or deleting and starting over didn't do anything. Then after some time the UI shows "Downloading file 1/1 (90.00% - 1 B/s) " even though RD shows it's cached 100%. |
|
Can also confirm the same issue on my install of .66. downloads are 100% on RD and extracted etc. but RDTC doesn't seem to want to symlink the files. I'll gather some log snippets for you Edit 1: RDTC gives this error: EDIT 2. This is from the RDTC log
|
|
Could you please post full logs, the snippets aren't giving enough information to see the actual errors. |
|
Sure thing. Here you go. The torrent is 100% on RD and the file is available in the expected path. Still running v2.0.66. |
|
I reverted back to 2.0.65 and it's working great! So I'll use that for now but definitely the change that got in for .66 broke things. |
|
So the error is: Could you show the full path of where this file is located on your webdav? And also what your rmount path in the settings? I found that RD does some odd things with the folders when it puts them in webdav. |
|
I'm on phone now so can't but I verified that the path is correct (and consistent with #449 (comment)). The mount path is Again going back to .65 fixed it all for me (with no other changes made). |
|
My mount paths are exactly the same as in this guide. I have also reverted back to 65 and all working again although getting an awful lot of stalled downloads for some reason. So I'll have to test that part. I'll also get you a full log although my log seems to be quite large in terms of size so might be worth adding some form of log rotation so they are a more manageable size for uploading etc. |
|
Nvm happening for some torrents on .65 as well. Same logs structure, and I've made sure that rdt container has access to the files created, and the permissions are okay as well. On 65, most finish just fine but some are stuck on unpacking. |
|
I added another fix that fixes the issue from @d3mystified. But please, if a torrent is stuck I cannot do anything without full logs, at least the magnet to the torrent as a pastebin. |
|
I am also facing same issue. Last working rdt version is 6.0.65 for me. below is logs for version 6.0.68 and 6.0.65
EDIT: I started getting Queued for unpack error on 6.0.55 below is logs and magnet Files are there in folder. I can see all the files from rdtclient container EDIT: same torrent works fine in 6.0.33 |
|
@rogerfar with the .69 version the rclone path still isnt working as it still throwing this error
Here is the full log with a magnet link for one of the offending downloads the rclone mount is 100% mounted and working as plex etc is still working |
|
@maulik9898 I tried both your magnets on 69 and they worked for me. @eoghan2t9 also that magnet worked for me, so not sure what's different. I will add some logging in .70 to see what it's trying to search for and what is available. |
|
@rogerfar perfect mate thanks I have double checked the rclone path and it's valid I even chmod 777 the folder in case it was a random permissions issue and still no joy. |
|
If you can update to. 70 and post logs then I can see what it's trying to do. |
|
Hey @rogerfar! Thanks for this - I can reproduce the above problem in .70 - I'm using zurg and yet, on the filesystem: |
|
@rogerfar which machine are you using ( Windows or linux ). I think this issue only happens with linux machine. |
|
Yeah I'm using windows, I see some If it still happens, if you could wait till attempt #9 and get the actual error to pop up in the logs, it outputs a log of the mount path directory structure, then I can compare what it's looking for and what there is. |
|
outof curiosity why don't we use Directory.GetFiles method to find file. This is what codebase uses in 6.0.63 and its working flowless. https://learn.microsoft.com/en-us/dotnet/api/system.io.directory.getfiles?view=net-8.0 The reason for |
Does it successfully unpack the downloads now? |
1 similar comment
Does it successfully unpack the downloads now? |
|
@eoghan2t9 have you been able to get the logs? @ashipaek0 Maybe wrong issue? This shouldn't affect unpacking as it's all symlinked. |
|
So I was able to do a few more tests but not that many unfortunately as I have run in other unrelated issue and I will be away for a while. Besides the fact that it still takes radarr a while to figure out it finished "downloading" all good so far, maybe the others that had the same issue can report further. Many thanks @rogerfar for what you are doing! |
|
@rogerfar yes mate I have a few logs for you I let them fail over and over again just to get you as much info as possible rdtclient_001.log |
|
Thanks @eoghan2t9, strangely I downloaded the exact same torrent and Real-Debrid put it on a different path in my webdav drive than it's showing on yours. I have added another path search in .73, that should resolve that. |
|
@rogerfar Thanks mate ive updated so lets see how this one goes |
|
@rogerfar Still getting the odd rclone mount errors heres the latest logs |
|
Is it Can you show a |
|
@rogerfar oddly that folder is no longer there so not sure if sonarr removed it or real debrid |
|
v2.0.73, i'm having the "Could not find file from rclone mount!" |
|
Same for me v.2.0.73, torrents seems stuck to "waiting_files_selection" or "magnet_conversion" until i got to real debrid site with the popup file selection on Torrents page and do the selection |
|
Guys I really need logs, those messages are impossible to troubleshoot without them. @eoghan2t9 I checked the logs and if I do a search for that title through all files I can't find any occurrences of RDT deleting it. As a test could you re-add it to RDT or directly to read-debrid and see if it shows up? |
The fact is that they don't even log in rdt logs : My files still waiting on rd: |
|
@PrevotYann can you post logs in debug mode. |
Sure : rdtclient_006.log Oh, this is maybe because of rclone_rd that puts torrents in /shows or /movies or /default ? So it doesn't find the file at the root of the rclone mount ? |
|
RDTclient searches the path that you give in the settings under |
|
I'd be great to put more than one maybe ? As rclone_rd creates 3 sub folders
Le lun. 15 avr. 2024, 02:34, Roger Far ***@***.***> a écrit :
… RDTclient searches the path that you give in the settings under rclone
mount. If it doesn't exist there, it will fail yeah.
—
Reply to this email directly, view it on GitHub
<#449 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ALQBKSYYA7C4T3PIRP7JKELY5MOCZAVCNFSM6AAAAABFVL5246VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJUGI2DIMJUG4>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
@PrevotYann can you show an example path of where the file is and what your mount path setting is? |
|
It looks like : This is how it is mapped with rclone_rd ! Note that I fixed my issue by mounting with classic rclone as webdav, then pointing my rclone Path to the webdavmount/torrents |
|
I see, I'm not too familiar with how rclone_rd works, but how does it decide where to put a file? |
|
It use a go script with regexp to détermine if this is a show or movie, if
it doesn't find for each other it will put it in default.
(So for example : mount/movies/pathtomovie/movie.mkv)
Le lun. 15 avr. 2024, 15:44, Roger Far ***@***.***> a écrit :
… I see, I'm not too familiar with how rclone_rd works, but how does it
decide where to put a file?
—
Reply to this email directly, view it on GitHub
<#449 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ALQBKS4T727G5ZF44PT7IILY5PKSFAVCNFSM6AAAAABFVL5246VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJWHA4TOMJXGE>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
I seem to be having permission issues with the internal /app folder. Whenever a symlink is created to my downloads folder, instead of linking to the file, it creates a folder with the same name as the file. This is causing problems for Plex and the arrs, as they are unable to detect the file. Any assistance with this issue would be greatly appreciated. |
|
seems i came across a version of this suddenly my entire TV Shows library symlinks stopped working Dunno how to make RDT fix them |
|
@ashipaek0 you reported this issue yourself 2 weeks ago, are you saying it's still not working? Please post new logs with the latest version. @PrevotYann I can add an option to specify the mount path like this: |
The symlinks now work. I just had a strange situation where all the symlinks in TV folder stopped working, but the Movies folder kept working fine. I just deleted the symlinks folder as it didn't seem to be worth while chasing how to repair over 10k symlinks didn't see anything in the logs when i checked. |
|
@PrevotYann I pushed an update that allows searching for subfolders. If you change the setting of your mount path from |
**What version are you using?
latest docker version
**Wat OS are you running?
Ubuntu 20.04
**Are you using Docker or as a service?
Docker
**Which debrid provider are you using?
Real-Debrid
**Which downloader are you using?
*Please attach a log file here with the log setting set to debug
The text was updated successfully, but these errors were encountered: