OS5 packages

[stefaang]

I've got the new toolchain for OS5. Only minor changes for 3rd party packages.
I'll probably do an overhaul over the project soon.

Stay tuned.

[stefaang]

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

[cmd430]

clarification on what FW is OS5?

[Vendo232]

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Any chance adding WDMyCloudMirrorGen2_docker_19.03.8.bin for OS5?

[Vendo232]

clarification on what FW is OS5?

5.02.134

[stefaang]

root@4762f36cacea:/wdpksrc# ./mksapkg-OS5
ERROR: model_name not specify

Usage: mksapkg-OS5 -E -s -m [model_name]


Supported model_name:
		WDMyCloud
		WDMyCloudEX4100
		WDMyCloudDL4100
		WDMyCloudEX2100
		WDMyCloudDL2100
		WDMyCloudMirror
		MyCloudEX2Ultra
		MyCloudPR4100
		MyCloudPR2100
		WDCloud

root@4762f36cacea:/wdpksrc# ./mksapkg-OS3
ERROR: model_name not specify

Usage: mksapkg -E -s -m [model_name]


Supported model_name:
		WDMyCloudEX4
		WDMyCloudEX2
		WDMyCloudMirror
		WDMyCloud
		WDMyCloudEX4100
		WDMyCloudDL4100
		WDMyCloudEX2100
		WDMyCloudDL2100
		WDMyCloudMirrorGen2
		MyCloudEX2Ultra
		MyCloudPR4100
		MyCloudPR2100

Seems like it is no longer supported. Which is odd as you are on OS5.
I'll ask for clarification.

[stefaang]

You may try the other packages, I'm fairly sure one of the other packages should work fine.

[Vendo232]

I have tried all from your zip file and all failed

https://community.wd.com/t/my-cloud-os-5-firmware-for-my-cloud-mirror/256504

The OS is still Indexing , not sure if this might influence the installation.

[Vendo232]

hello Stefaan , do you see any major roadblocks on your end to extend the DOCKER packages to WD My Cloud Gen 2?

[D-stefaang]

docker_19.03.8_OS5.zip

@Vendo232 try the Mirror package in this new zip. I think they just renamed the MirrorV2 to simply Mirror.
The old V1 did not support Docker so it was not part of the build script.

[ricardoespinobon]

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Works on PR2100 OS5

[irctrakz]

So are these OS5 packages still valid for the PR4100/PR2100 NAS units? Seeing seriously mixed messages between here and the WD forum?

[ricardoespinobon]

So are these OS5 packages still valid for the PR4100/PR2100 NAS units? Seeing seriously mixed messages between here and the WD forum?

The zip on this thread works just fine for me in PR2100.

[irctrakz]

@ricardoespinobon thanks! I just updated to OS5 and installed the Docker app without issue! (PR4100)

[mrmatt]

Verified docker for PR2100 OS5 -- Happy to test entware for OS5... though i was able to get Transmission & Flexget configured in a container (wiserain/docker-transmission) so that not be necessary

[Avian-Flew]

Entware failing on upload into OS5.

[Perlets9]

Not works on EX2Ultra, it fails on docker run with this error:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"rootfs_linux.go:58: mounting \\\"mqueue\\\" to rootfs \\\"/mnt/HD/HD_a2/Nas_Prog/_docker/vfs/dir/c13d78eea5a514e034fcaa369fdd8fb2d9d0e2c647437e1e5ce100dd186e5780\\\" at \\\"/dev/mqueue\\\" caused \\\"no such device\\\"\"": unknown.

[JediNite]

@Perlets9 yeah this is the same error as what I was getting on the EX4100. The kernel WD have supplied does not have mqueue support compiled in.

JediNite

[koehn]

Under OS5, I am suddenly unable to connect from one Docker container to another. That is, if I run

docker run --name $NAME -p 9001:9000 --restart=always -d -v /mnt/HD/HD_a2/minio:/data -e "MINIO_ACCESS_KEY=$ACCESS_KEY" -e "MINIO_SECRET_KEY=$SECRET_KEY" minio/minio server /data

and try to access that container from an nginx container (or whatever), and run:

curl -v 10.0.1.232:9001
* Expire in 0 ms for 6 (transfer 0x5588b8cfff50)
*   Trying 10.0.1.232...
* TCP_NODELAY set
* Expire in 200 ms for 4 (transfer 0x5588b8cfff50)
* Connected to 10.0.1.232 (10.0.1.232) port 9001 (#0)
> GET / HTTP/1.1
> Host: 10.0.1.232:9001
> User-Agent: curl/7.64.0
> Accept: */*
> 
* Empty reply from server
* Connection #0 to host 10.0.1.232 left intact
curl: (52) Empty reply from server

Curiously, I can still access minio remotely (the same curl command from MyCloud outside of Docker or from another machine works fine). It's only from one container to another that's broken.

This worked prior to upgrading to OS 5. Now I need to figure out an alternative somehow.

Update: I switched nginx to host networking, and am able to connect to the other container. Something isn't working with bridge networking in OS5.

[brentgl]

Not works on EX2Ultra, it fails on docker run with this error:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"rootfs_linux.go:58: mounting \\\"mqueue\\\" to rootfs \\\"/mnt/HD/HD_a2/Nas_Prog/_docker/vfs/dir/c13d78eea5a514e034fcaa369fdd8fb2d9d0e2c647437e1e5ce100dd186e5780\\\" at \\\"/dev/mqueue\\\" caused \\\"no such device\\\"\"": unknown.

Exactly the same here.

Are we SOL then without mqueue support in kernel?
Thanks
Brent

[JediNite]

@koehn.

Update: I switched nginx to host networking, and am able to connect to the other container. Something isn't working with bridge networking in OS5.

Did you try creating a custom bridge network or are you using the default bridge network that is installed with docker ?

https://docs.docker.com/network/bridge/ may help ?

Cheers,

JediNite

[Vendo232]

docker_19.03.8_OS5.zip

@Vendo232 try the Mirror package in this new zip. I think they just renamed the MirrorV2 to simply Mirror.
The old V1 did not support Docker so it was not part of the build script.

Stefan I was able to install Docker on Mirror V2 but the :9000 Portainer is not opening, any idea what could be wrong?

[koehn]

Did you try creating a custom bridge network or are you using the default bridge network that is installed with docker ?

I was just using the default bridge network, trying to communicate between two containers launched thusly:

Minio:

docker run --name $NAME -p 9111:9000 --restart=always -d -v /mnt/HD/HD_a2/minio:/data -e "MINIO_ACCESS_KEY=$ACCESS_KEY" -e "MINIO_SECRET_KEY=$SECRET_KEY" minio/minio server /data

Nginx:

docker run --restart=always --name=$NAME -d -p 9443:443 -p 9080:80 -v $PWD/nginx.conf:/etc/nginx/nginx.conf -v $PWD/conf.d:/etc/nginx/conf.d nginx

Nothing fancy, and those same scripts worked prior to the OS 5 upgrade. Now the nginx container cannot communicate with the port that the minio container is exposing (10.0.1.123:9111, where the WD's IP is 10.0.1.123) unless nginx is run on the "host" network. It's not a show-stopper for me, and you should be able to reproduce it with those scripts (or a variation), but I thought you'd want to know.

Thanks for all your hard work on this project! Much appreciated!

[JediNite]

@koehn,

Double check within the "daemon.sh" script that it has this line :
${DOCKERD} --ip-masq=true >> /var/lib/docker/docker.log 2>&1 &

If this is missing, it may also be the cause. For some reason I found on the EX4100 (prior to OS5), that IP masquerading was not being enabled by default unless the daemon was started explicitly with the option. I know @stefaang has added this into the branch code though, so you should have it there if using the latest. If you really do want to try and use bridge networking, would recommend creating a custom bridge network and see if it makes a difference.

Cheers,

JediNite

[koehn]

I'm sorry; where do I find daemon.sh? I've looked in a bunch of locations but it hasn't turned up.

[JediNite]

I'm sorry; where do I find daemon.sh? I've looked in a bunch of locations but it hasn't turned up.

@koehn ,

Try looking in "/mnt/HD/HD_a2/Nas_Prog/docker"

Cheers,

JediNite

[koehn]

Thanks! I found the file, and it has the line you indicated, exactly as you mentioned it above. A quick ps shows that it is running with --ip-masq=true.

[maxnl]

I had the same issue trying to get two containers to communicate with each other using the default bridge network. I ended up creating a new bridge network and assigned the containers to that, and the issue appeared to be resolved. I'm on a PR4100

[akanoodles]

I had the same issue trying to get two containers to communicate with each other using the default bridge network. I ended up creating a new bridge network and assigned the containers to that, and the issue appeared to be resolved. I'm on a PR4100

@maxnl Can you detail how to do that in portainer? or did you have to sshd into it?

[vacovnik]

@JediNite, are there any workarounds for the issue @Perlets9 and @brentgl encountered since I have the same problem with mqueues.
I would really appreciate a working docker since Transmission app is missing and the sql database is limited to localhost access on My Cloud OS 5.

Best regards,
Marko

[JediNite]

@JediNite, are there any workarounds for the issue @Perlets9 and @brentgl encountered since I have the same problem with mqueues.

I would really appreciate a working docker since Transmission app is missing and the sql database is limited to localhost access on My Cloud OS 5.

Best regards,

Marko

@vacovnik,

There is nothing that can be done as a workaround as the kernel needs to be rebuilt with mqueue support. I saw recently on the WD forums that a large number of people have raised concerns about docker being removed from the OS5 release so at least it is on their radar to fix. The post appeared to indicate WD are looking to fix in a future release.

Cheers

JediNite

[akanoodles]

@D-stefaang how do you run the 'portainer-ce' image instead of the 'portainer' image?

[caglaraydin]

Will there be any apps for My Cloud Gen2?

[Myron-S]

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Works on a DL4100. :-)

[kueblert]

Hey there,
bintray seems to shut down and does not allow downloads without a paid account anymore.
I found the build artifacts for Docker. Are there also suck for syncthing or any cloud software (nextcloud,...)?

[Myron-S]

He's already on it. See the announcement.

[sheel]

Hello, I was able to download the .zip above and install on my PR4100, firmware 5.15.106.

However, when I go to configure, it's an empty page (:9000).

I ssh'd into the PR4100, and there is nothing listening on :9000 and no docker processes running.

netstat

root@illmatic docker # netstat -tulpn | grep 9000
root@illmatic docker #

docker ps

root@illmatic docker # docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
root@illmatic docker #

docker is running

root@illmatic docker # ls -l /var/run/docker.sock
srw-rw---- 1 root root 0 Aug 9 23:49 /var/run/docker.sock

I tried running the portainer command, and get a cgroup mount error

root@illmatic docker # docker run -d -p 9000:9000 --restart always -v /var/run/docker.sock:/var/run/docker.sock -v $(pwd)/portainer:/data portainer/portainer
73b72f8dfd01384bde20af579e86d904367bb807ccee69ff777768f333eec0f3
docker: Error response from daemon: cgroups: cannot find cgroup mount destination: unknown.

docker info

root@illmatic docker # docker info
Client:
Debug Mode: false

Server:
Containers: 4
Running: 0
Paused: 0
Stopped: 4
Images: 1
Server Version: 19.03.8
Storage Driver: vfs
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
init version: fec3683
Security Options:
seccomp
Profile: default
Kernel Version: 4.14.22
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 3.708GiB
Name: illmatic
ID: ZXDP:4LW5:ROQL:V4ZT:LZIJ:SYRC:JAVL:DBXP:SN4Q:QMS3:67GS:PUZS
Docker Root Dir: /mnt/HD/HD_a2/Nas_Prog/_docker
Debug Mode: false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine

WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No kernel memory TCP limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support

docker version

root@illmatic cgroup # docker version
Client: Docker Engine - Community
Version: 19.03.8
API version: 1.40
Go version: go1.12.17
Git commit: afacb8b7f0
Built: Wed Mar 11 01:22:56 2020
OS/Arch: linux/amd64
Experimental: false

Server: Docker Engine - Community
Engine:
Version: 19.03.8
API version: 1.40 (minimum version 1.12)
Go version: go1.12.17
Git commit: afacb8b7f0
Built: Wed Mar 11 01:30:32 2020
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: v1.2.13
GitCommit: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc:
Version: 1.0.0-rc10
GitCommit: dc9208a3303feef5b3839f4323d9beb36df0a9dd
docker-init:
Version: 0.18.0
GitCommit: fec3683

[s0th1s]

Stefaan, I found your Cloudsmith bin files for OS5 Docker and Entware installers, do you have an updated location to get your Tautulli installer for OS5, specifically for the PR4100? Tautulli is the only bin installer I do not have. I found and installed it previously from the bintray link, but it appears bintray is no longer around and your posted links no longer work. Any help is appreciated.

First tests with the new kernel look promising, but it's not flawless yet. Kudos to @JediNite for testing it. I see a fair chance they'll take it along in one of the upcoming updates.

Tautulli installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/Tautulli?tab=overview

Syncthing installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/Syncthing?tab=overview

NZBGet installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/NZBGet?tab=overview

[PaoloP74]

Hi all,
where can I find the latest OS5 Docker package for the EX2 Ultra?

[h3pdesign]

Hi these binary Links- Do not work. Please post some working links here. The provided links are a dead end stating that "Bintray has been deprecated
The JFrog Platform offers many solutions to distribute your software internally or externally."

[h3pdesign]

Me too Hi all,
where can I find the latest OS5 Docker package for the EX2 Ultra?

[PaoloP74]

I found this repo: https://cloudsmith.io/~wd-community/repos/#

[ufcpride]

HI, is there an updated Tautulli installer for OS5 for WDPR4100 at all please? I've installed Entware and Docker, but need the bin for Tautulli. The old respisitories seem to have gone. The links just keep taking me back to this page. TIA

[Kale-Tech]

I managed to download all of the OS 5 packages before the site went down.

I uploaded them to google drive for anyone who needs it:

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

[Kale-Tech]

Me too Hi all, where can I find the latest OS5 Docker package for the EX2 Ultra?

HI, is there an updated Tautulli installer for OS5 for WDPR4100 at all please? I've installed Entware and Docker, but need the bin for Tautulli. The old respisitories seem to have gone. The links just keep taking me back to this page. TIA

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

[ufcpride]

@Kale-Tech Thank you so much, that's excellent. I've managed to install it with no issues.

Thanks again,

[Myron-S]

Thank-you Kale-Tech. 👍🏻

[Kale-Tech]

@ufcpride @Myron-S No problem. Glad to help!

[ArthurSav]

I found this repo: https://cloudsmith.io/~wd-community/repos/#

I was beginning to lose hope. Installed the image for EX2 Ultra and it works!

[stephanmax]

COPS packages for OS5: https://bintray.com/beta/#/tfl/wdpksrc/COPS?tab=overview

@stefaang, sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

[Kale-Tech]

COPS packages for OS5: https://bintray.com/beta/#/tfl/wdpksrc/COPS?tab=overview

@stefaang, sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

Hey, I managed to download those packages before the link stopped working. I uploaded them for anyone who needs it:

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

[qiancasper]

sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

happy new year first, im running with os 5.18.117 with my dl2100 unable to finish the installation of WDMyCloudDL2100_docker_19.03.8 is there any alternatives to get docker install on my os5.18.117 device. cheers

[rongchun]

Hasn't the docker OS5 been updated? Cannot be used in firmware 5.20.113.

[JediNite]

Docker packages are now updated at https://github.com/WDCommunity/wdpksrc/releases/tag/docker-v20.10.14.

[Jazjo]

Hello, on MyCloudEX2Ultra with FW 5.23.114 getting message - unable to finish the installation of MyCloudEX2Ultra_docker_20.10.14. Would it be please possible to update package for this FW? Many thanks in advance.

[LeHGlobeTrotter]

@Kale-Tech @JediNite You both are awesome! I installed using the 19.03.8 bin file shared by @Kale-Tech then realized that @JediNite provided a newer version an upgraded after. Everything went smooth as silk.

[technotiger]

Why no packages for single bay WdMyCloud? Can we get entware atleast? Where is mksapkg-OS5?

Edit: Answering my own question. mksapkg-OS5 is missing in master but it is available in other branches. I was able to build and install entware for single bay WdMyCloud. It would be nice if these packages (for single bay WdMyCloud) can also be made available on Cloudsmith. I am not sure why they have been omitted.

[rcknr]

@technotiger Can you please share Entware package you've built?

Okay, it turns out building these is quite easy.
@stefaang @WD-stefaang But still how about making a release of Entware for OS5?

[technotiger]

@technotiger Can you please share Entware package you've built?

Okay, it turns out building these is quite easy. @stefaang @WD-stefaang But still how about making a release of Entware for OS5?

Glad you figured it out. It's been long since my post. I see that built packages for the single bay WdMyCloud have not yet been published. Well, building the packages yourself is better anyway (security wise).