SteamCMD error with new container using sourcemod tag

[sploittastic]

When deploying a new container, steamcmd is failing to update the csgo dedicated server. After downloading the ~25GB dedicated server files, steamcmd throws an error:
"SteamCMD - App state is 0x602 after update job"

Appid 740 files are still in the temp download directory.

When running steamcmd manually, I experienced:
"Loading Steam API...Warning: failed to init SDL thread priority manager: SDL not found"

I believe this is caused by the absence of a 32bit SDL library, possibly now required by steam after a recent update?

I encountered these issues when I noticed a very long delay changing maps on the server, and after pulling the container fresh, the server will not start at all.

[CM2Walki]

The SDL warning is normal and happens always, it's not the cause of the issue. Make sure that you have enough space on disk, it sounds like it's running out during the download.

[sploittastic]

There's definitely enough space, my docker's storage is using a 512 gig SSD array that's only at about 5% used. Later today I can do a fresh attempt on a new container and capture all of the logs for you, and then I can also run steamCMD interactively and capture the error there too. Would it be better to email you the logs or post them in the GitLab issue? Thanks for looking into this! I'm running the container on a Synology NAS, ds1019+. It was working fine for weeks but then level changes took a long time and I saw an error about CMD updating in the log, that's when I purged the container and rebuilt from scratch and after several attempts I still can't get it to work. Jeffrey

…

On Sat, Jun 20, 2020, 6:12 AM Walentin L. ***@***.***> wrote: The SDL warning is normal and happens always, it's not the cause of the issue. Make sure that you have enough space on disk, it sounds like it's running out during the download. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#25 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEOSCDSZNYT3UNG32AT32GDRXSYUHANCNFSM4NWLSTBA> .

[CM2Walki]

Later today I can do a fresh attempt on a new container and capture all of the logs for you, and then I can also run steamCMD interactively and capture the error there too. Would it be better to email you the logs or post them in the GitLab issue?

You can post them here, so the next person that has this problem will know how to fix it :).

[sploittastic]

Added a "sleep 3600" to the end of /home/steam/csgo-dedicated/entry.sh so the container would not exit.

Logs from a fresh container start (newest on top)

2020-06-20 20:52:22 stdout /home/steam/csgo-dedicated/entry.sh: 4: /home/steam/csgo-dedicated/entry.sh: /home/steam/csgo-dedicated/srcds_run: not found
2020-06-20 20:52:22 stdout CWorkThreadPool::~CWorkThreadPool: work processing queue not empty: 2 items discarded.
2020-06-20 20:52:22 stdout Error! App '740' state is 0x602 after update job.
2020-06-20 20:52:21 stdout Update state (0x61) downloading, progress: 99.85 (24488434739 / 24526147791)
2020-06-20 20:52:19 stdout Update state (0x61) downloading, progress: 99.64 (24437983769 / 24526147791)
2020-06-20 20:52:17 stdout Update state (0x61) downloading, progress: 99.46 (24393232944 / 24526147791)
2020-06-20 20:52:15 stdout Update state (0x61) downloading, progress: 99.24 (24340502927 / 24526147791)
2020-06-20 20:52:13 stdout Update state (0x61) downloading, progress: 99.06 (24294712957 / 24526147791)
...
2020-06-20 20:39:47 stdout Update state (0x61) downloading, progress: 0.72 (176457480 / 24526147791)
2020-06-20 20:39:45 stdout Update state (0x61) downloading, progress: 0.42 (101939600 / 24526147791)
2020-06-20 20:39:43 stdout Update state (0x61) downloading, progress: 0.32 (77619671 / 24526147791)
2020-06-20 20:39:41 stdout Update state (0x61) downloading, progress: 0.16 (38547411 / 24526147791)
2020-06-20 20:39:39 stdout Update state (0x61) downloading, progress: 0.04 (10668782 / 24526147791)
2020-06-20 20:39:37 stdout Update state (0x61) downloading, progress: 0.01 (2076506 / 24526147791)
2020-06-20 20:39:35 stdout Update state (0x61) downloading, progress: 0.00 (802673 / 24526147791)
2020-06-20 20:39:33 stdout Update state (0x61) downloading, progress: 0.00 (513052 / 24526147791)
2020-06-20 20:39:31 stdout Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
2020-06-20 20:39:29 stdout Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
2020-06-20 20:39:29 stdout Waiting for user info...OK
2020-06-20 20:39:25 stdout Connecting anonymously to Steam Public...Logged in OK
2020-06-20 20:39:24 stdout
2020-06-20 20:39:24 stdout OK.
2020-06-20 20:39:24 stdout Loading Steam API...Warning: failed to init SDL thread priority manager: SDL not found
2020-06-20 20:39:24 stdout -- type 'quit' to exit --
2020-06-20 20:39:24 stdout Steam Console Client (c) Valve Corporation
2020-06-20 20:39:24 stdout [----] Verifying installation...
2020-06-20 20:39:23 stdout [ 0%] Checking for available updates...
2020-06-20 20:39:23 stdout Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'
2020-06-20 20:39:23 stdout WARNING: setlocale('en_US.UTF-8') failed, using locale: 'C'. International characters may not work.
2020-06-20 20:39:23 stdout [----] Update complete, launching...
2020-06-20 20:39:23 stdout [----] Cleaning up...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Installing update...
2020-06-20 20:39:23 stdout [----] Extracting package...
2020-06-20 20:39:22 stdout [----] Extracting package...
2020-06-20 20:39:20 stdout [----] Extracting package...
2020-06-20 20:39:17 stdout [----] Extracting package...
2020-06-20 20:39:17 stdout [----] Applying update...
2020-06-20 20:39:17 stdout [100%] Download Complete.
2020-06-20 20:39:17 stdout [ 98%] Downloading update (51248 of 51248 KB)...
2020-06-20 20:39:17 stdout [ 96%] Downloading update (50554 of 51248 KB)...
2020-06-20 20:39:17 stdout [ 94%] Downloading update (49481 of 51248 KB)...
...
2020-06-20 20:39:09 stdout [ 13%] Downloading update (8633 of 51248 KB)...
2020-06-20 20:39:09 stdout [ 8%] Downloading update (6719 of 51248 KB)...
2020-06-20 20:39:08 stdout [ 4%] Downloading update (4608 of 51248 KB)...
2020-06-20 20:39:08 stdout [ 0%] Downloading update (2092 of 51248 KB)...
2020-06-20 20:39:08 stdout [----] Downloading update (0 of 51248 KB)...
2020-06-20 20:39:07 stdout [ 0%] Checking for available update...
2020-06-20 20:39:07 stdout ILocalize::AddFile() failed to load file "public/steambootstrapper_english.txt".
2020-06-20 20:39:07 stdout Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'

It's not a disk space issue:

steam@cm2network-csgo1:~/csgo-dedicated$ df -h /home/steam/csgo-dedicated/
Filesystem Size Used Avail Use% Mounted on
/dev/vg1000/lv 443G 46G 397G 11% /home/steam/csgo-dedicated

I see a new image was pushed 7 hours ago, I will try that one and see if I get the same result.

[sploittastic]

Similar problem with the new container, also getting the "state is 0x602" error. I'll poke around with it more later.

2020-06-20 21:33:01 stdout bash: /home/steam/csgo-dedicated/srcds_run: No such file or directory
2020-06-20 21:33:01 stdout sed: cannot rename /home/steam/csgo-dedicated/csgo/cfg/sedUaCIde: Device or resource busy
2020-06-20 21:33:00 stdout Error! App '740' state is 0x602 after update job.
2020-06-20 21:33:00 stdout Update state (0x61) downloading, progress: 99.97 (24518807759 / 24526147791)
2020-06-20 21:32:58 stdout Update state (0x61) downloading, progress: 99.74 (24463293336 / 24526147791)
2020-06-20 21:32:56 stdout Update state (0x61) downloading, progress: 99.54 (24412656581 / 24526147791)
2020-06-20 21:32:54 stdout Update state (0x61) downloading, progress: 99.33 (24361830342 / 24526147791)
...
2020-06-20 21:20:18 stdout Update state (0x61) downloading, progress: 0.44 (107527486 / 24526147791)
2020-06-20 21:20:16 stdout Update state (0x61) downloading, progress: 0.38 (91977074 / 24526147791)
2020-06-20 21:20:14 stdout Update state (0x61) downloading, progress: 0.29 (70754801 / 24526147791)
2020-06-20 21:20:12 stdout Update state (0x61) downloading, progress: 0.12 (30650251 / 24526147791)
2020-06-20 21:20:10 stdout Update state (0x61) downloading, progress: 0.05 (13241808 / 24526147791)
2020-06-20 21:20:08 stdout Update state (0x61) downloading, progress: 0.01 (2387477 / 24526147791)
2020-06-20 21:20:06 stdout Update state (0x1) running, progress: 0.00 (44304 / 11166861808)
2020-06-20 21:20:04 stdout Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
2020-06-20 21:20:02 stdout Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
2020-06-20 21:20:02 stdout Waiting for user info...OK
2020-06-20 21:19:58 stdout Connecting anonymously to Steam Public...Logged in OK
2020-06-20 21:19:57 stdout
2020-06-20 21:19:57 stdout OK.
2020-06-20 21:19:57 stdout Loading Steam API...Warning: failed to init SDL thread priority manager: SDL not found
2020-06-20 21:19:57 stdout -- type 'quit' to exit --
2020-06-20 21:19:57 stdout Steam Console Client (c) Valve Corporation
2020-06-20 21:19:57 stdout [----] Verifying installation...
2020-06-20 21:19:56 stdout [ 0%] Checking for available updates...
2020-06-20 21:19:56 stdout Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'
2020-06-20 21:19:56 stdout WARNING: setlocale('en_US.UTF-8') failed, using locale: 'C'. International characters may not work.

[sploittastic]

I figured it out. I had some files mounted into the container as read only:

/home/steam/csgo-dedicated/csgo/cfg/gamemode_casual.cfg
/home/steam/csgo-dedicated/csgo/cfg/server.cfg
/home/steam/csgo-dedicated/csgo/addons/sourcemod/plugins/buyzonesimulator.smx

Apparently when I flushed the container and it tried to re-download game files, it couldn't complete the app update because those files couldn't be overwritten since they were mapped as read only. It was this line that helped me figure it out:

2020-06-20 21:33:01 stdout sed: cannot rename /home/steam/csgo-dedicated/csgo/cfg/sedUaCIde: Device or resource busy