Errors downloading modpack when starting server.

[FlyxHub]

Hey all, I HAD a server set up and working well running this modpack

Last night, while attached to the Docker container, I stupidly hard-stopped the server with CTRL+C.
In Portainer, I simply restarted the container thinking it would just restart the server and everything would be back to normal.
The server seemed to start normally, but when I tried to join I would be met with a huge wall of text that could not be closed upon loading the world.

After some digging it seemed that it was caused by a modpack version mismatch between the client and the server, so I thought I'd just recreate the container thinking it would just redownload the latest version of the modpack.

I tried to just recreate the container with Portainer and, for reasons I'm not sure of, it only deleted the container without recreating it.

I'm trying to recreate it manually how I had it set up before, but I'm getting errors.

Here's the ENV variables I configured in Portainer:

MEMORY - 64G
VERSION - 1.20.1
TYPE - AUTO_CURSEFORGE
CF_API_KEY - (Omitted because you don't need my API key)
CF_PAGE_URL - https://www.curseforge.com/minecraft/modpacks/bigchadguys-plus-non-cobblemon
CF_DOWNLOADS_REPO - /data/downloads

Here's the log:

[mc-image-helper] 16:30:59.146 INFO  : Mod file ./mods/DarkUtilities-Fabric-1.20.1-17.0.3.jar already exists

[mc-image-helper] 16:30:59.150 INFO  : Mod file ./mods/moonlight-1.20-2.8.82-fabric.jar already exists

[mc-image-helper] 16:30:59.152 WARN  : [96fbaaf7-6, L:/172.17.0.6:40750 ! R:api.curseforge.com/13.227.37.127:443] The connection observed an error

reactor.netty.http.client.PrematureCloseException: Connection prematurely closed BEFORE response

[mc-image-helper] 16:30:59.157 INFO  : Mod file ./mods/mcw-windows-2.2.1-mc1.20.1fabric.jar already exists

[mc-image-helper] 16:30:59.155 ERROR : Operator called default onErrorDropped

reactor.netty.http.client.PrematureCloseException: Connection prematurely closed BEFORE response

	Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: 

Error has been observed at the following site(s):

	*__checkpoint ⇢ Getting mod info for 435044

	|_ checkpoint ⇢ Downloading file from modpack 435044:4596636

Original Stack Trace:

[mc-image-helper] 16:30:59.161 INFO  : Mod file ./mods/mcw-furniture-3.2.1-mc1.20.1fabric.jar already exists

[mc-image-helper] 16:30:59.168 ERROR : 'install-curseforge' command failed. Version is 1.37.8

reactor.core.Exceptions$ReactiveException: java.nio.file.AccessDeniedException: ./mods/clickadv-fabric-1.20.1-3.7.jar

	at reactor.core.Exceptions.propagate(Exceptions.java:408)

	at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:101)

	at reactor.core.publisher.Mono.block(Mono.java:1712)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.processModpack(CurseForgeInstaller.java:552)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.resolveModpackFileAndProcess(CurseForgeInstaller.java:367)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.installByRetrievingModpackZip(CurseForgeInstaller.java:235)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.lambda$install$3(CurseForgeInstaller.java:164)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:200)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:163)

	at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:214)

	at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:29)

	at picocli.CommandLine.executeUserObject(CommandLine.java:2041)

	at picocli.CommandLine.access$1500(CommandLine.java:148)

	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)

	at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)

	at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)

	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)

	at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)

	at picocli.CommandLine.execute(CommandLine.java:2170)

	at me.itzg.helpers.McImageHelper.main(McImageHelper.java:157)

	Suppressed: java.lang.Exception: #block terminated with an error

		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:103)

		... 18 common frames omitted

Caused by: java.nio.file.AccessDeniedException: ./mods/clickadv-fabric-1.20.1-3.7.jar

	at java.base/sun.nio.fs.UnixException.translateToIOException(Unknown Source)

	Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: 

Error has been observed at the following site(s):

	*__checkpoint ⇢ Downloading file from modpack 511733:4979404

Original Stack Trace:

		at java.base/sun.nio.fs.UnixException.translateToIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixException.rethrowAsIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixException.rethrowAsIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(Unknown Source)

		at java.base/java.nio.file.Files.newByteChannel(Unknown Source)

		at java.base/java.nio.file.Files.newByteChannel(Unknown Source)

		at me.itzg.helpers.files.ReactiveFileUtils.lambda$copyByteBufFluxToFile$2(ReactiveFileUtils.java:41)

		at reactor.core.publisher.MonoCallable.call(MonoCallable.java:72)

		at reactor.core.publisher.FluxFlatMap.trySubscribeScalarMap(FluxFlatMap.java:127)

		at reactor.core.publisher.MonoFlatMap.subscribeOrReturn(MonoFlatMap.java:53)

		at reactor.core.publisher.Flux.subscribe(Flux.java:8759)

		at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:195)

		at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99)

		at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:174)

		at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:172)

		at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435)

		at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:710)

		at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205)

		at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466)

		at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:715)

		at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:114)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

		at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

		at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)

		at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1475)

		at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1338)

		at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1387)

		at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:529)

		at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:468)

		at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)

		at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:800)

		at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:509)

		at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407)

		at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)

		at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

		at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

		at java.base/java.lang.Thread.run(Unknown Source)

[init] ERROR failed to auto-install CurseForge modpack

Any help would be greatly appreciated because I am at a loss and my friends are rioting at my door.

Edit:
Could be of note:
I've configured the new container to use the same volume/directory of the old volume, within which nothing has changed since the problems started.

[itzg]

It sounds like you need to pin a specific version/file of that modpack. (I only skimmed since the wall of text seems to have nothing to do with docker or this image)

[itzg]

FYI there's also something going on with file permissions/ownership

java.nio.file.AccessDeniedException: ./mods/clickadv-fabric-1.20.1-3.7.jar

The server runs as user ID 1000 by default if that helps.

[FlyxHub]

I updated CF_PAGE_URL to https://www.curseforge.com/minecraft/modpacks/bigchadguys-plus-non-cobblemon/download/5039311

Here's the log after the change:

[mc-image-helper] 17:59:17.154 INFO  : Mod file ./mods/friendsandfoes-flowerymooblooms-fabric-mc1.20-1.1.0.jar already exists

[mc-image-helper] 17:59:17.154 INFO  : Mod file ./mods/MagnumTorch-v8.0.1-1.20.1-Fabric.jar already exists

[mc-image-helper] 17:59:17.154 INFO  : Mod file ./mods/Bookshelf-Fabric-1.20.1-20.1.8.jar already exists

[mc-image-helper] 17:59:17.154 INFO  : Mod file ./mods/mythicmetals-0.19.2+1.20.1.jar already exists

[mc-image-helper] 17:59:17.155 INFO  : Mod file ./mods/Chimes-v2.0.1-1.20.1-Fabric.jar already exists

[mc-image-helper] 17:59:17.155 INFO  : Mod file ./mods/Incendium_1.20.4_v5.3.4.jar already exists

[mc-image-helper] 17:59:17.157 INFO  : Mod file ./mods/Terralith_1.20.4_v2.4.11.jar already exists

[mc-image-helper] 17:59:17.183 INFO  : Mod file ./mods/villagernames-1.20.1-7.3.jar already exists

[mc-image-helper] 17:59:17.196 INFO  : Mod file ./mods/bettercombat-fabric-1.8.3+1.20.1.jar already exists

[mc-image-helper] 17:59:17.200 INFO  : Mod file ./mods/travelers-backpack-1.20.1-9.1.6.jar already exists

[mc-image-helper] 17:59:17.205 INFO  : Mod file ./mods/endermanoverhaul-fabric-1.20.1-1.0.4.jar already exists

[mc-image-helper] 17:59:17.210 ERROR : 'install-curseforge' command failed. Version is 1.37.8

reactor.core.Exceptions$ReactiveException: java.nio.file.AccessDeniedException: ./mods/clickadv-fabric-1.20.1-3.7.jar

	at reactor.core.Exceptions.propagate(Exceptions.java:408)

	at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:101)

	at reactor.core.publisher.Mono.block(Mono.java:1712)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.processModpack(CurseForgeInstaller.java:552)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.resolveModpackFileAndProcess(CurseForgeInstaller.java:367)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.installByRetrievingModpackZip(CurseForgeInstaller.java:235)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.lambda$install$3(CurseForgeInstaller.java:164)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:200)

	at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:163)

	at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:214)

	at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:29)

	at picocli.CommandLine.executeUserObject(CommandLine.java:2041)

	at picocli.CommandLine.access$1500(CommandLine.java:148)

	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)

	at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)

	at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)

	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)

	at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)

	at picocli.CommandLine.execute(CommandLine.java:2170)

	at me.itzg.helpers.McImageHelper.main(McImageHelper.java:157)

	Suppressed: java.lang.Exception: #block terminated with an error

		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:103)

		... 18 common frames omitted

Caused by: java.nio.file.AccessDeniedException: ./mods/clickadv-fabric-1.20.1-3.7.jar

	at java.base/sun.nio.fs.UnixException.translateToIOException(Unknown Source)

	Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: 

Error has been observed at the following site(s):

	*__checkpoint ⇢ Downloading file from modpack 511733:4979404

Original Stack Trace:

		at java.base/sun.nio.fs.UnixException.translateToIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixException.rethrowAsIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixException.rethrowAsIOException(Unknown Source)

		at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(Unknown Source)

		at java.base/java.nio.file.Files.newByteChannel(Unknown Source)

		at java.base/java.nio.file.Files.newByteChannel(Unknown Source)

		at me.itzg.helpers.files.ReactiveFileUtils.lambda$copyByteBufFluxToFile$2(ReactiveFileUtils.java:41)

		at reactor.core.publisher.MonoCallable.call(MonoCallable.java:72)

		at reactor.core.publisher.FluxFlatMap.trySubscribeScalarMap(FluxFlatMap.java:127)

		at reactor.core.publisher.MonoFlatMap.subscribeOrReturn(MonoFlatMap.java:53)

		at reactor.core.publisher.Flux.subscribe(Flux.java:8759)

		at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:195)

		at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99)

		at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:174)

		at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:172)

		at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435)

		at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:710)

		at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205)

		at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466)

		at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:715)

		at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:114)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

		at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

		at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:333)

		at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:454)

		at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290)

		at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1475)

		at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1338)

		at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1387)

		at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:529)

		at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:468)

		at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

		at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

		at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

		at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)

		at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:800)

		at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:509)

		at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407)

		at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)

		at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

		at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

		at java.base/java.lang.Thread.run(Unknown Source)

[init] ERROR failed to auto-install CurseForge modpack

[FlyxHub]

I also receive the same output after running the command chown 1000 /var/lib/docker/volumes/(long volume string)/_data

[itzg]

I also receive the same output after running the command chown 1000 /var/lib/docker/volumes/(long volume string)/_data

You really shouldn't be traversing the internally managed volumes directory, but that's something you should address for next time. See this page for related info https://docker-minecraft-server.readthedocs.io/en/latest/data-directory/ .

You'll need to add -R to that chown to recursively apply the change; however, before you do that I'd really prefer you specifically investigate the file in the error using ls -l to see exactly the file permissions and ownership. It might also be the mods directory itself that has incompatible permissions.

[FlyxHub]

The permissions issue seems to have been fixed with recursive chown . However, now the server seems to start, but cannot be connected to either locally or over the internet.