Issues with mounts in v2.1.0 #36

deedeefink · 2018-11-12T10:20:33Z

I made a fresh install of Ubuntu 18.04.1 and Gooby 2.1.0 and I'm experiencing stability issues with the Rclone/MergerFS mount. Basically it drops when I do a System Clean and I would have to reboot to get it online again. However, reboot does not always help and it seems overall that the mount is very unstable and not persistent.

Not sure how I can provide more info for debugging, but please let me know .

Rclone setup is:
[Gdrive]
type = drive
scope = drive
root_folder_id = 1hiddenn
token ={"access_token":"hidden","token_type":"Bearer","refresh_token":"1/hidden","expiry":"2018-11-12T12:18:37.767056944+01:00"}

deedeefink · 2018-11-12T10:30:44Z

When I navigate via CLI, I can access /mnt/rclone and my files show up, but when I navigate to /mnt/google/ the folder is empty.

When I navigate via Plex to add a library, the folder /Media is empty

nesbcn · 2018-11-12T14:31:18Z

The exact same thing happened to me yesterday. A reboot seemed to fix things, will watch out if it happens again.

TechPerplexed · 2018-11-12T15:45:21Z

Hmmm a few of us have run it on Ubuntu 18 for several months. It's solid as a rock, I wouldn't release an unstable product (at least not willingly).

How often do you experience a drop of the mount? Is it consistent with certain actions?

If it's truly unstable for you you can always go back to the old Rclone only solution, but I'm hoping this can be sorted :)

deedeefink · 2018-11-12T17:25:00Z

I know, I've been using 18.04.0 since it came out and with Gooby 2.0 it worked like a charm. Yesterday I installed 18.04.1 and Gooby 2.1 to get the new mergerfs up and running. But not so lucky I guess.

It seems to drop after each System reset. Then I have to reboot 1 or more times to get the mount online. So yes, it's consistent. I'm not aware of where a log would be store, but if you point into the direction I'll be happy to share it.

TechPerplexed · 2018-11-12T17:32:59Z

From what you're telling me, it's just MergerFS that is giving you trouble right? As in: /mnt/rclone is still showing your files, but /mnt/google is empty?

When that happens, please type

sudo systemctl status mnt-google.mount

What does it report back to you?

(you can escape that with Ctrl-Z)

deedeefink · 2018-11-12T18:28:37Z

I just performed a System Clean and same problem. See the result below. I also noted that when I entered Midnight Commander to visually check the mount, it complains about the permission. Could this be linked?

● mnt-google.mount - MergerFS overlay writable storage
Loaded: loaded (/etc/systemd/system/mnt-google.mount; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2018-11-12 19:22:39 CET; 4min 4s ago
Where: /mnt/google
What: ${UPLOADS}:${RCLONEMOUNT}

Nov 12 19:22:39 Ubuntu-1804-bionic-64-minimal systemd[1]: Mounting MergerFS overlay writable storage...
Nov 12 19:22:39 Ubuntu-1804-bionic-64-minimal mount[28158]: fuse: missing mountpoint parameter
Nov 12 19:22:39 Ubuntu-1804-bionic-64-minimal systemd[1]: mnt-google.mount: Mount process exited, code=exited status=1
Nov 12 19:22:39 Ubuntu-1804-bionic-64-minimal systemd[1]: mnt-google.mount: Failed with result 'exit-code'.
Nov 12 19:22:39 Ubuntu-1804-bionic-64-minimal systemd[1]: Failed to mount MergerFS overlay writable storage.
Nov 12 19:24:43 Ubuntu-1804-bionic-64-minimal systemd[1]: /etc/systemd/system/mnt-google.mount:10: Not an absolute path, ignoring: ${MOUNTTO}
Nov 12 19:25:19 Ubuntu-1804-bionic-64-minimal systemd[1]: /etc/systemd/system/mnt-google.mount:10: Not an absolute path, ignoring: ${MOUNTTO}
Nov 12 19:25:19 Ubuntu-1804-bionic-64-minimal systemd[1]: /etc/systemd/system/mnt-google.mount:10: Not an absolute path, ignoring: ${MOUNTTO}
Nov 12 19:25:19 Ubuntu-1804-bionic-64-minimal systemd[1]: /etc/systemd/system/mnt-google.mount:10: Not an absolute path, ignoring: ${MOUNTTO}

deedeefink · 2018-11-12T18:29:25Z

Here is what MC is reporting. Again. It only happens after System Clean:

plexuser@Ubuntu-1804-bionic-64-minimal:~$ sudo mc
Directory /tmp/mc-root is not owned by you
Temporary files will be created in /tmp
Press any key to continue...

TechPerplexed · 2018-11-12T18:59:17Z

Hmmm interesting... I researched the message and it dates back to 2012!

You said it only happens after a system clean - but not when you reboot right? Or how do you get the mount to come back at all?

Can you try this please:

sudo systemctl stop gooby.service gooby-rclone.service gooby-find.service mnt-google.mount
sudo systemctl disable gooby.service gooby-rclone.service gooby-find.service mnt-google.mount

Check if both /mnt/rclone and /mnt/google are empty before you proceed... (they should be) then

sudo chown -R $USER:$USER /tmp /mnt
sudo systemctl enable gooby.service gooby-rclone.service gooby-find.service mnt-google.mount
sudo systemctl daemon-reload
sudo systemctl start gooby.service

First check if your mounts are there (both /mnt/rclone and /mnt/google, there should also be a /mnt/uploads/Downloads present)

Then run another system clean - did the problem come back?

deedeefink · 2018-11-12T19:08:01Z

Yes, only after system clean

Stopped service = mounts disappear
Ran commands = mounts are back, also download folder
Ran System Clean= All is working :-)

However, I still get the error with MC as mentioned above after step 2

TechPerplexed · 2018-11-12T19:11:49Z

Ok if everything is working properly I wouldn't worry about that particular error.... the real question is of course: will it keep on working?! Please let me know 😸

deedeefink · 2018-11-12T19:15:25Z

Wait... I were too trigger happy.
After the system clean the mounts are back, but:

Plex URL not working. I get Chrome privacy error
Sonarr 502 Bad Gateway
Radarr, Jackett, Netdata, Tautulli and OMBI are working just fine

A reboot fixed this though.

Seems like I should be careful about System clean :-)

deedeefink · 2018-11-12T19:18:37Z

I'll close now and cross my fingers :-)

TechPerplexed · 2018-11-12T19:21:50Z

LOL well a system clean doesn't do too many exciting things... basically it

Takes all containers and gooby.service down
Updates Rclone if there is a newer version
Updates Gooby to latest version
Brings gooby.service up
Brings all containers back up, updating the ones that have an update
Runs Linux patches for updated packages
Makes sure all permissions are set properly

It really doesn't need to be run on a VERY regular basis, just when you experience some issues really.

That said, it SHOULD work properly and not CAUSE any issues 😆

deedeefink · 2018-11-12T20:29:40Z

Hmmm, something is not right.
I still have issues which a reboot cannot fix. Now Rclone service is also down, also after reboot.

I'll reset the server and reinstall ubuntu / gooby and let you know if the issues persist afterwards

TechPerplexed · 2018-11-12T20:53:18Z

Oof, sorry you're having such a hard time with it!

TechPerplexed · 2018-11-13T00:42:21Z

@deedeefink I just did a system clean and I ran into the same issue as yourself! I made a change in the script, please update Gooby and see if that sorts it for you - once again apologies it's causing you grief!

TechPerplexed · 2018-11-13T04:59:29Z

Mind is suddenly behaving weird too... It's not you. I'll look into this tomorrow!

Edit: I think I know what it is, it's not quitting the mount properly so after a reboot it won't have the proper permissions... I promise this will be sorted :)

deedeefink · 2018-11-13T09:58:25Z

Pheww. I was going crazy...
Did a fresh install of ubuntu and Gooby and so far it seems to work as intended. Hopefully that will be the end of this issue :-)

deedeefink · 2018-11-13T13:30:45Z

I guess we're not that lucky :-(

Did a fresh ubuntu and gooby install.
All worked great until I did a System Clean. After that the Rclone mount went offline and only after a reboot I got it working again.
I then remove an app/container and the Google mount stopped working. Rclone worked
And now even after a reboot I have issue with the Rclone mount (Several reboots fixed it though)

Could this still be a permissions problem or what kind of witchcraft is going on?

Here are the error codes I get with the services AFTER reboot:

gooby-find.service - Gooby Pre-Cacher
Loaded: loaded (/etc/systemd/system/gooby-find.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Tue 2018-11-13 14:36:20 CET; 7min ago
Process: 1823 ExecStart=/bin/sh -c /bin/sleep 10 ; /usr/bin/find ${RCLONEMOUNT} > ${LOGS}/precache (code=exited, status=1/FAILURE)
Main PID: 1823 (code=exited, status=1/FAILURE)

Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/task/5004/fd’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/task/5004/fdinfo’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/task/5004/ns’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/fd’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/map_files’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/fdinfo’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal sh[1823]: /usr/bin/find: ‘./proc/5004/ns’: Permission denied
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-find.service: Main process exited, code=exited, status=1/FAILURE
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-find.service: Failed with result 'exit-code'.
Nov 13 14:36:20 Ubuntu-1804-bionic-64-minimal systemd[1]: Failed to start Gooby Pre-Cacher.

gooby-rclone.service - Mount Google Drive (rclone)
Loaded: loaded (/etc/systemd/system/gooby-rclone.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Tue 2018-11-13 14:34:50 CET; 7min ago
Process: 1193 ExecStart=/usr/bin/rclone mount --allow-other --buffer-size 1G --dir-cache-time 72h --drive-chunk-size 32M --fast-list --gid ${USERID} --log-level INFO --log-file ${
Process: 1867 ExecStartPre=/bin/mkdir -p ${RCLONEMOUNT} (code=exited, status=1/FAILURE)
Main PID: 1193 (code=killed, signal=TERM)

Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: Starting Mount Google Drive (rclone)...
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Control process exited, code=exited status=1
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Failed with result 'exit-code'.
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: Failed to start Mount Google Drive (rclone).
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Service hold-off time over, scheduling restart.
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Scheduled restart job, restart counter is at 5.
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: Stopped Mount Google Drive (rclone).
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Start request repeated too quickly.
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: gooby-rclone.service: Failed with result 'exit-code'.
Nov 13 14:34:50 Ubuntu-1804-bionic-64-minimal systemd[1]: Failed to start Mount Google Drive (rclone).

mnt-google.mount - MergerFS overlay writable storage
Loaded: loaded (/etc/systemd/system/mnt-google.mount; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Tue 2018-11-13 14:24:14 CET; 4min 38s ago
Where: /mnt/google
What: ${UPLOADS}:${RCLONEMOUNT}
Process: 5105 ExecUnmount=/bin/umount /mnt/google -c (code=exited, status=0/SUCCESS)
Process: 5903 ExecMount=/bin/mount ${UPLOADS}:${RCLONEMOUNT} /mnt/google -t fuse.mergerfs -o use_ino,hard_remove,auto_cache,sync_read,allow_other,category.action=all,category.crea
Tasks: 0 (limit: 4915)
CGroup: /system.slice/mnt-google.mount

Nov 13 14:24:14 Ubuntu-1804-bionic-64-minimal systemd[1]: Mounting MergerFS overlay writable storage...
Nov 13 14:24:14 Ubuntu-1804-bionic-64-minimal mount[5903]: fuse: missing mountpoint parameter
Nov 13 14:24:14 Ubuntu-1804-bionic-64-minimal systemd[1]: mnt-google.mount: Mount process exited, code=exited status=1
Nov 13 14:24:14 Ubuntu-1804-bionic-64-minimal systemd[1]: mnt-google.mount: Failed with result 'exit-code'.
Nov 13 14:24:14 Ubuntu-1804-bionic-64-minimal systemd[1]: Failed to mount MergerFS overlay writable storage.

bdschuster · 2018-11-13T15:04:26Z

This is really making me think that 18.04.1 has changed some things. I kept having issues like this, I reverted back to 18.04.0 and no issues anymore. It also seems like they changed the repository as well since you can no longer access some common tools like fail2ban from the repository any longer in 18.04.1.

deedeefink · 2018-11-13T15:15:29Z

Could very well be. In this case @TechPerplexed should experience the same issues as I believe we're both using Hetzner who only offers 16.04.5 and 18.04.1 as default Ubuntu images.

But I'll consider to downgrade if we cannot get around this

TechPerplexed · 2018-11-13T15:49:59Z

I'm sure we can get around this, no worries... I'm pretty much sure I know where the problem lies, so all that needs to be done now is implement the correct solution!

TechPerplexed · 2018-11-13T22:18:10Z

Guys, it's definitely something to do with whatever change happened between v18.04.0 and 18.04.1 - in fact I can reproduce the issue 100% now. That also explains why it ran flawlessly on our own systems for months before going live.

The positive news is that I am pretty sure I have a solution... which I'm going to implement in a test branch and will probably ask you to test before going live with it.

If you want the technical details:

Currently Gooby creates a single service that calls upon Rclone and MergerFS and boots them up one by one in sequence through the script. This worked like a charm in the past, but it's broken on the latest Ubuntu. It's not even intermittent any longer, it just crashes.

The solution is to go back to two separate scripts, which is the conventional way of running scripts anyway and seems to work fine.

I hope to have more news tomorrow and a place for you to test my theories :)

bdschuster · 2018-11-14T00:40:33Z

Woohoo!! I knew something happened! Lol...what about missing packages in 18.04.1?

TechPerplexed · 2018-11-14T01:15:43Z

Lol, I have no idea, but frankly it's driving me nuts... I can make it work now on one machine (Hetzner) but not on my regular dedi... but eh I'm not going to give up that easily! I love using MergerFS because it prevents so many bans and other problems.

New day tomorrow with some fresh and innovative thoughts - hopefully 😆

TechPerplexed · 2018-11-15T01:27:24Z

Oh one more note: I actually tested the reboot while the Crontab that runs on reboot was disabled and the mount came back each and every time (it didn't with the other service scripts). I haven't tested it WITH cron yet... but will do so tomorrow. In the meantime let me know your findings.

I'm a little encouraged now that it does come up after a reboot by itself. So if the script breaks that, at least now we FINALLY have a basis to work with!

HitsvilleUK · 2018-11-15T03:39:19Z

3 cleanups and 4 reboots performed and both /mnt/google & /mnt/clone come back each time.

deedeefink · 2018-11-15T07:36:30Z

After 2x system clean and 2x reboot both Rclone and MergerFS mounts are coming back online... Wuhuuuu.... but (sorry).....theres more......

After my first system clean non of the containers worked and I could not access any apps - But mounts were up though :-). I rebooted and checked mounts. All okay. But still Docker were not working. I performed a new system clean but it never completed as it got stuck at "Bringing services back online". It gave me time to notice the following error:

Taking containers down
Removing network docker_default
WARNING: Network docker_default not found.

I wanted to double check that I could reproduce the above. When I tired, I encountered no problems with docker_network, but the mounts were empty...arrrggghhhh....I tried to system clean and switching back and forth between the "stable" and test version for the N number of times and:

Sometime it works
Sometimes I get stuck at "Bringing services back online"
Sometime docker_default is not working
Sometimes mounts are failing
Sometimes I smile and sometimes I cry

@nesbcn, @bdschuster and @HitsvilleUK can you please check. I'm loosing track of all the things I tried and need a second opinion

HitsvilleUK · 2018-11-15T07:45:08Z

Interesting @deedeefink
After all my system cleans all the containers loaded fine. I just double checked again now and they're all up including my custom containers,
I suddenly started getting issues a day or so ago scanning my TV shows into Emby and even that's working now, Sorry I cant be of more help.

deedeefink · 2018-11-15T09:29:05Z

I tried a system clean again. It completed and the mounts are working, but the docker_network is not responding and I cannot access my apps. Also after a reboot.

I then make another system clean and get this error again:

Taking containers down
Removing network docker_default
WARNING: Network docker_default not found.

And "Bringing services back online" gets stuck

@TechPerplexed / @ALL I'll fly off to the beach now , so I might not be online for testing that much the coming days.

TechPerplexed · 2018-11-15T16:46:08Z

@deedeefink first of all, have a wonderful vacation (or holiday, depending on where you live 🤣 )

I'm glad the mount problem seems to be resolved... tentatively of course.

As for the message "docker_default not found", this is normal and should not have any other effect (it's just to make sure everything is cleaned out properly). It is also normal for the containers not to always show the "Ok" message (that always makes me nervous too).

HOWEVER your system should come back of course... unfortunately I can't reproduce it myself. For the record there have been absolutely no changes in the network settings or the rest of the script - I have only been "messing" with the mount settings.

I suggest that if the mount is fine (in the new test setting), but if you continue to have problems with the docker_network not responding, that you create a new issue so we can start troubleshooting that separately...

If you guys all confirm that the new services setting solves the mount problem I'll push that to stable - and then we can start afresh with new problems (YIKES I hope not...)

Today I am going to take a day off too, because three days of non stop troubleshooting sort of made me neglect all my regular activities, heh. Tomorrow I'll be back with renewed vim and vigor!

HitsvilleUK · 2018-11-15T17:53:38Z

Yeah I should have said....in case it's relevant to deedeefink.
The containers take a couple of minutes to load (which is fine) Plex and and Emby especially a minute or so longer still.
When I tested I think I got the 502 (or whichever) error. Leaving it a few minutes all was good.

Enjoy your day off Sophia and have a great holiday deedeefink.

TechPerplexed · 2018-11-16T00:02:09Z

Ok my friendlies, this is what I'm going to do... since it seems that is new script has solved the mount problems, I'll push it to the "master" repository tomorrow. If you wish you can update Gooby from the menu (option E - A) and go with that (tomorrow that is, not just yet).

However, we're not done yet with the test script.... with the help of my good friend kelinger we have made more improvements to the mount check, basically that it won't start any of the containers until it verifies that both the Rclone AND the MergerFS mount are in place and running.

After I push this test repository to the live environment I'll update the test place with the improvements he has made - which will then be pushed soon afterwards hopefully after your approval :)

But all that is for tomorrow, today was strictly a script free day for me 😴

TechPerplexed · 2018-11-16T16:47:46Z

Done! The version you guys tested is now live - and I have updated the test environment with the built in mount checks (to make sure they are really up before proceeding). Hopefully this can go live by the weekend 👍

bdschuster · 2018-11-16T19:04:17Z

lol...i will install and check everything out shorty and report back...get some rest.

deedeefink · 2018-11-17T14:26:04Z

Hi from the beach 👋
I updated to the new test version and when I run a system clean, I get this looping error:

EDIT: This also applies to the Master version (I'll do a clean ubuntu install).

Job for rclonefs.service failed because the control process exited with error code.
See "systemctl status rclonefs.service" and "journalctl -xe" for details.
Job for mergerfs.service failed because the control process exited with error code.
See "systemctl status mergerfs.service" and "journalctl -xe" for details.
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...

I wouldn't necessarily trust my setup as I previously experienced issues you guys didn't. I will soon make a fresh install and test it again. But would be good to know if it's just me or a general problem though.

deedeefink · 2018-11-17T15:25:22Z

So did a clean install of ubuntu and installed master version of Gooby and I still got this error when I ran a system clean

Cleaning mount leftovers

Job for rclonefs.service failed because the control process exited with error code.
See "systemctl status rclonefs.service" and "journalctl -xe" for details.
Job for mergerfs.service failed because the control process exited with error code.
See "systemctl status mergerfs.service" and "journalctl -xe" for details.
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...

rclonefs.service - Mount Google Drive (rclone)
   Loaded: loaded (/etc/systemd/system/rclonefs.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Sat 2018-11-17 16:21:12 CET; 3min 7s ago
  Process: 31838 ExecStartPre=/bin/mkdir -p ${RCLONEMOUNT} (code=exited, status=1/FAILURE)
 Main PID: 29298 (code=exited, status=0/SUCCESS)

mergerfs.service - MergerFS overlay writable storage
   Loaded: loaded (/etc/systemd/system/mergerfs.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Sat 2018-11-17 16:21:12 CET; 2min 23s ago
  Process: 31839 ExecStartPre=/bin/mkdir -p ${UPLOADS} ${MOUNTTO} (code=exited, status=1/FAILURE)
 Main PID: 29455 (code=exited, status=0/SUCCESS)

TechPerplexed · 2018-11-17T17:28:11Z

Well at least with the new built in checks it will show you that there is a problem somewhere... rather than ignoring it altogether and proceeding without the mount. Which I realize is only a very small comfort...

That said, I have no idea why yours would still be so stubborn! In fact we now reverted almost all the way back to the old tried and proven GooPlex method of first mounting Rclone (absolutely no changes from how it ran before, except it's properly mounted as your user instead of root), then MergerFS (which should not be able to cause Rclone to crash).

As for the messages "mountpoint: /mnt/rclone: No such file or directory" etc - that is what is supposed to happen (though obviously not in a never ending loop). The way the script runs now, first it shuts down the containers, then the mergerfs service, then rclone. Those seem to work fine for you (it loops until done).
Then it makes sure the services are up and loops until that is done too - that is where yours seems to halt.

Ok, some troubleshooting actions:

Can you please verify that the line user_allow_other is uncommented in the file /etc/fuse.conf?
(sudo nano /etc/fuse.conf)

Also please verify the permissions are correct (they should be... but...)
sudo chown -R $USER:$USER /mnt

When the script is stuck in its loop, is it possible for you to open another session and verify that when you type nano /var/local/Gooby/Docker/.env all the fields are present like so:

RCLONESERVICE=Gdrive
RCLONEFOLDER=Media
RCLONEMOUNT=/mnt/rclone
MOUNTTO=/mnt/google
UPLOADS=/mnt/uploads
GOOGLE=/mnt/google
MEDIA=/mnt/google
MOVIES=/mnt/google/Movies
TV=/mnt/google/TV
DOWNLOADS=/home/you/Downloads

Something else for you to try: rebooting with and without the cron enabled. To disable the cron, type crontab -e and find the line
@reboot /opt/Gooby/scripts/cron/rclean.sh > /dev/null 2>&1
Then just add a # in front of it:
#@reboot /opt/Gooby/scripts/cron/rclean.sh > /dev/null 2>&1

When you uncomment the line some unexpected things may happen with the rest of your containers (because the script makes sure things happen in the correct order), but I'd like to focus on getting your mount stable first.... so when you do a "vanilla" reboot and or "cron assisted" reboot, do you have your mounts?

Oh and have a wonderful time at the beach 🌞 , I'm jealousssssssssssss (looking at the first snow here) ❄️

nesbcn · 2018-11-17T17:34:58Z

My system is also stuck at this:

mountpoint: /mnt/rclone: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
Waiting on mounts to be created...

this is after updating gooby and system clean. Any suggestion?

TechPerplexed · 2018-11-17T17:42:05Z

How long does it stay stuck in that loop? Forever or a certain amount of time?

Also lots of suggestions in the post above you :)

Edit: can you update Gooby and try again please?

nesbcn · 2018-11-17T18:35:10Z

I tried everything in the post, still looping forever:

The latest version of rclone rclone v1.44 is already installed.


Cleaning mount leftovers

Job for rclonefs.service failed because the control process exited with error code.
See "systemctl status rclonefs.service" and "journalctl -xe" for details.
Job for mergerfs.service failed because the control process exited with error code.
See "systemctl status mergerfs.service" and "journalctl -xe" for details.
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...
mountpoint: /mnt/rclone: No such file or directory
mountpoint: /mnt/google: No such file or directory
Waiting on mounts to be created...

TechPerplexed · 2018-11-17T18:49:59Z

Can you try once more to set the permissions? Problem is I can't reproduce this any longer... testing on two systems and it just seems to work fine for me.

So try this:

sudo systemctl stop mergerfs
sudo systemctl stop rclonefs
sudo systemctl daemon-reload
sudo chown -R $USER:$USER /mnt

Then make sure Gooby is updated and try the cleanup again from the menu...

nesbcn · 2018-11-17T19:43:49Z

Well I didn't try the permissions, I updated Gooby again, rebooted then reinstalled rclone (Beta version this time), then proceeded to system clean. It worked!

nesbcn · 2018-11-17T19:45:20Z

Also, would it be possible to launch rclone mount with --rc option? I like to review the stats from time to time, to check everything is going smoothly...

deedeefink · 2018-11-17T19:46:54Z

I tested what you suggested in the above comment #36 (comment)

user_allow_other is uncommented
I chown /mnt folder

Here is my env.:

RCLONESERVICE=Gdrive
RCLONEFOLDER=
RCLONEMOUNT=/mnt/rclone
MOUNTTO=/mnt/google
UPLOADS=/mnt/uploads
GOOGLE=/mnt/google
MEDIA=/mnt/google
MOVIES=/mnt/google/Movies
TV=/mnt/google/TV
DOWNLOADS=/home/plexuser/Downloads

Note that I define the root folder in my rclone settings. Don't think it's relevant, but my TV folder is actual TVshows

When i reboot with / without disabled crontab mounts are not working. When I test it, the result is:

$ sudo systemctl status gooby-rclone.service  
Unit gooby-rclone.service could not be found.

$ sudo systemctl status mnt-google.mount
Unit mnt-google.mount could not be found.

nesbcn · 2018-11-17T19:51:57Z

Well that was too quick... Mounts seem to be working, now Plex somehow doesn't find the files when transcoding ... I'm looking into it atm

deedeefink · 2018-11-17T19:54:26Z

sudo systemctl stop mergerfs
sudo systemctl stop rclonefs
sudo systemctl daemon-reload

Followed this, updated Gooby, reinstalled rclone and ran system clean and it worked :-)

I did not add my media just yet, so can't verify @nesbcn Plex problem

TechPerplexed · 2018-11-17T20:01:17Z

Also, would it be possible to launch rclone mount with --rc option? I like to review the stats from time to time, to check everything is going smoothly...

Absolutely! You can edit your rclonefs.service to your liking - it won't be overwritten unless you uninstall/reinstall :)
sudo nano /etc/systemd/system/rclonefs.service then run a daemon reload sudo systemctl daemon-reload

Well that was too quick... Mounts seem to be working, now Plex somehow doesn't find the files when transcoding ... I'm looking into it atm

Did you restart the containers though? After all we stopped the services without stopping the containers first... just to make sure the permissions were correct. Do you still have the problem after a "proper" system clean?

Followed this, updated Gooby, reinstalled rclone and ran system clean and it worked :-)

Oh I hope so.... fingers crossed... toes crossed... eyes crossed........

bdschuster · 2018-11-19T15:24:10Z

I'm not having any issues so far with the new version. :-)

TechPerplexed · 2018-11-19T22:29:02Z

Pfew!! Now if deedeefink and others can confirm it's working for them too, we may be able to finally close this nasty chapter 🗡

deedeefink · 2018-11-20T05:23:48Z

Pfew!! Now if deedeefink and others can confirm it's working for them too, we may be able to finally close this nasty chapter 🗡

All seems to be working again. Thank you :-)

HitsvilleUK · 2018-11-20T05:31:33Z

Yep. I just had real life cause to use a system clean up.
It definitely works for me here too. Nice work Sophia and Kelinger.

nesbcn · 2018-11-20T08:19:08Z

after several system cleanups, everything is still working.
case closed!

deedeefink mentioned this issue Nov 12, 2018

Deluge - 502 Bad Gateway #37

Closed

deedeefink closed this as completed Nov 12, 2018

deedeefink reopened this Nov 13, 2018

TechPerplexed self-assigned this Nov 13, 2018

TechPerplexed added the bug Something isn't working label Nov 13, 2018

deedeefink closed this as completed Nov 20, 2018

deedeefink mentioned this issue Nov 22, 2018

Securing a server does not work on a fresh install #45

Closed

Issues with mounts in v2.1.0 #36

Issues with mounts in v2.1.0 #36

Comments

deedeefink commented Nov 12, 2018 • edited

deedeefink commented Nov 12, 2018

nesbcn commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

deedeefink commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

deedeefink commented Nov 12, 2018

deedeefink commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

deedeefink commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

deedeefink commented Nov 12, 2018 • edited

deedeefink commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

deedeefink commented Nov 12, 2018

TechPerplexed commented Nov 12, 2018

TechPerplexed commented Nov 13, 2018

TechPerplexed commented Nov 13, 2018 • edited

deedeefink commented Nov 13, 2018

deedeefink commented Nov 13, 2018 • edited

bdschuster commented Nov 13, 2018

deedeefink commented Nov 13, 2018 • edited

TechPerplexed commented Nov 13, 2018 • edited

TechPerplexed commented Nov 13, 2018 • edited

bdschuster commented Nov 14, 2018

TechPerplexed commented Nov 14, 2018

TechPerplexed commented Nov 15, 2018

HitsvilleUK commented Nov 15, 2018

deedeefink commented Nov 15, 2018

HitsvilleUK commented Nov 15, 2018

deedeefink commented Nov 15, 2018

TechPerplexed commented Nov 15, 2018

HitsvilleUK commented Nov 15, 2018 • edited

TechPerplexed commented Nov 16, 2018 • edited

TechPerplexed commented Nov 16, 2018

bdschuster commented Nov 16, 2018

deedeefink commented Nov 17, 2018 • edited

deedeefink commented Nov 17, 2018

TechPerplexed commented Nov 17, 2018 • edited

nesbcn commented Nov 17, 2018

TechPerplexed commented Nov 17, 2018 • edited

nesbcn commented Nov 17, 2018

TechPerplexed commented Nov 17, 2018

nesbcn commented Nov 17, 2018

nesbcn commented Nov 17, 2018

deedeefink commented Nov 17, 2018

nesbcn commented Nov 17, 2018

deedeefink commented Nov 17, 2018

TechPerplexed commented Nov 17, 2018 • edited

bdschuster commented Nov 19, 2018

TechPerplexed commented Nov 19, 2018

deedeefink commented Nov 20, 2018

HitsvilleUK commented Nov 20, 2018 • edited

nesbcn commented Nov 20, 2018

deedeefink commented Nov 12, 2018 •

edited

deedeefink commented Nov 12, 2018 •

edited

TechPerplexed commented Nov 13, 2018 •

edited

deedeefink commented Nov 13, 2018 •

edited

deedeefink commented Nov 13, 2018 •

edited

TechPerplexed commented Nov 13, 2018 •

edited

TechPerplexed commented Nov 13, 2018 •

edited

HitsvilleUK commented Nov 15, 2018 •

edited

TechPerplexed commented Nov 16, 2018 •

edited

deedeefink commented Nov 17, 2018 •

edited

TechPerplexed commented Nov 17, 2018 •

edited

TechPerplexed commented Nov 17, 2018 •

edited

TechPerplexed commented Nov 17, 2018 •

edited

HitsvilleUK commented Nov 20, 2018 •

edited