Update to v0.5.0 discussion thread

[bbilly1]

I've read the documentation

• I'm running the latest version of Tube Archivist and have read the release notes.
• I have read the how to open an issue guide, particularly the bug report section.

Operating System

any

Your Bug Report

There are breaking changes in the v0.5.0 release.

First make sure you read the release notes:

https://github.com/tubearchivist/tubearchivist/releases/tag/v0.5.0

If you encounter any other problems, share them here or on discord.

Relevant log output

...

Anything else?

No response

[sienar1]

Redis appears borked in my install.

1:C 09 Mar 2025 17:02:40.757 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.

1:C 09 Mar 2025 17:02:40.757 * oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo

1:C 09 Mar 2025 17:02:40.757 * Redis version=7.4.2, bits=64, commit=00000000, modified=0, pid=1, just started

1:C 09 Mar 2025 17:02:40.757 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf

1:M 09 Mar 2025 17:02:40.758 * monotonic clock: POSIX clock_gettime

1:M 09 Mar 2025 17:02:40.758 * Running mode=standalone, port=6379.

1:M 09 Mar 2025 17:02:40.758 * Server initialized

1:M 09 Mar 2025 17:02:40.758 * Loading RDB produced by version 6.2.13

1:M 09 Mar 2025 17:02:40.758 * RDB age 7050 seconds

1:M 09 Mar 2025 17:02:40.758 * RDB memory usage when created 0.99 Mb

1:M 09 Mar 2025 17:02:40.758 # The RDB file contains AUX module data I can't load: no matching module 'scdtype00'

Which is causing TA to just cycle trying to connect to Redis:

#######################

#  Connection check   #

#######################

[1] connect to Redis

    ... retry Redis connection

    ... retry Redis connection

I found a StackOverflow link that seems to be what might be necessary to correct this issue.

Anyone else running into this and try that fix?

[bbilly1]

You need to delete the rdb file. They are not compatible with each other. See the release notes with all the details.

[sienar1]

Nevermind on that work around. I missed the step in the update note about deleting the dump.rdb in the Redis volume. After I did that, I was able to proceed with the rest of the version update/migration.

[sienar1]

You need to delete the rdb file. They are not compatible with each other. See the release notes with all the details.

I had just figured that out and came back to reply. Thanks @bbilly1!

[nicleary]

I'm receiving an error at step 5 of the migration guide:

tubearchivist    |
tubearchivist    | #######################
tubearchivist    | #  Application Start  #
tubearchivist    | #######################
tubearchivist    |
tubearchivist    | [1] create expected cache folders
tubearchivist    |     ✓ expected folders created
tubearchivist    | [2] clear leftover keys in redis
tubearchivist    |     ✓ cleared key reindex:ta_video
tubearchivist    |     ✓ cleared key reindex:ta_channel
tubearchivist    | [3] clear task leftovers
tubearchivist    |     ✓ cleared 1 messages
tubearchivist    | [4] clear leftover files from dl cache
tubearchivist    | clear download cache
tubearchivist    |     no files found
tubearchivist    | [5] check for first run after update
tubearchivist    | Traceback (most recent call last):
tubearchivist    |   File "/app/manage.py", line 23, in <module>
tubearchivist    |     main()
tubearchivist    |   File "/app/manage.py", line 19, in main
tubearchivist    |     execute_from_command_line(sys.argv)
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
tubearchivist    |     utility.execute()
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/django/core/management/__init__.py", line 436, in execute
tubearchivist    |     self.fetch_command(subcommand).run_from_argv(self.argv)
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/django/core/management/base.py", line 413, in run_from_argv
tubearchivist    |     self.execute(*args, **cmd_options)
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/django/core/management/base.py", line 459, in execute
tubearchivist    |     output = self.handle(*args, **options)
tubearchivist    |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/app/config/management/commands/ta_startup.py", line 49, in handle
tubearchivist    |     self._version_check()
tubearchivist    |   File "/app/config/management/commands/ta_startup.py", line 134, in _version_check
tubearchivist    |     new_version = ReleaseVersion().is_updated()
tubearchivist    |                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/app/appsettings/src/config.py", line 236, in is_updated
tubearchivist    |     message = self.get_update()
tubearchivist    |               ^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/app/appsettings/src/config.py", line 251, in get_update
tubearchivist    |     message = RedisArchivist().get_message_dict(self.NEW_KEY)
tubearchivist    |               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/app/common/src/ta_redis.py", line 75, in get_message_dict
tubearchivist    |     reply = self.conn.execute_command("GET", self.NAME_SPACE + key)
tubearchivist    |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/client.py", line 559, in execute_command
tubearchivist    |     return self._execute_command(*args, **options)
tubearchivist    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/client.py", line 567, in _execute_command
tubearchivist    |     return conn.retry.call_with_retry(
tubearchivist    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/retry.py", line 62, in call_with_retry
tubearchivist    |     return do()
tubearchivist    |            ^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/client.py", line 568, in <lambda>
tubearchivist    |     lambda: self._send_command_parse_response(
tubearchivist    |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/client.py", line 542, in _send_command_parse_response
tubearchivist    |     return self.parse_response(conn, command_name, **options)
tubearchivist    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/client.py", line 584, in parse_response
tubearchivist    |     response = connection.read_response()
tubearchivist    |                ^^^^^^^^^^^^^^^^^^^^^^^^^^
tubearchivist    |   File "/root/.local/lib/python3.11/site-packages/redis/connection.py", line 616, in read_response
tubearchivist    |     raise response
tubearchivist    | redis.exceptions.ResponseError: WRONGTYPE Operation against a key holding the wrong kind of value
tubearchivist exited with code 0

It seems like there's some unexpected value in my redis file. Based on my reading of the upgrade instructions, the deleting the dump.rdb file isn't to be done until after the first successful boot, is that correct?

[bbilly1]

Ah, yes, that shouldn't have happened. The update notification will be in the old data type, that's unfortunate.

• you can delete the rdb file now, but your appsettings won't transfer.
• or delete the version key in redis by opening a redis shell with redis-cli in the redis container, then DEL ta:versioncheck:new to delete the key. Then restart and that should proceed.

EDIT:
Oneliner to do the above:

docker compose exec -it archivist-redis redis-cli DEL ta:versioncheck:new

[Jay4242]

Minor note, sudo docker-compose exec tubearchivist python manage.py ta_config_backup is what created the migration.json on my ubuntu 24.04.2. Great, thanks!

[nicleary]

Ah, yes, that shouldn't have happened. The update notification will be in the old data type, that's unfortunate.

* you can delete the rdb file now, but your appsettings won't transfer.

* delete the version key in redis by opening a redis shell with `redis-cli` in the redis container, then `DEL ta:versioncheck:new` to delete the key. Then restart and that should proceed.

This worked, thanks @bbilly1 !

[ThaMunsta]

Pretty smooth. Don't ask me how I know this but if anyone finds clicking buttons just kicks them back to the login screen for a second it's because you thought you read the instructions but you skimmed over how TA_HOST now needs http or https and you just assumed you already had that for some reason 😂 again, don't ask how I know this lmao well done on this update 💪
UNRELATED (sorry) anyone else noticed a lot of "members only" videos throwing off the "found videos" counts in notifications? It would be cool to have a toggle to ignore those or something.

[jeffreyswiggins]

I put this in the tubearchivist-plex bug report as it seems this upgrade has broken that "plugin"

Here is the errors from the Plex Log. I am on latest version of Plex in docker and the latest TubeArchivist in docker now.

rror in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 588, in Scan
if season not in episode_counts[show]:
UnboundLocalError: local variable 'season' referenced before assignment
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 588, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
The '--scan' operation is deprecated and will be removed in future versions of Plex Media Server.
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined
Error in Python: Running scanner:
Traceback (most recent call last):
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 522, in Scan
TA_CONFIG["online"], TA_CONFIG["version"] = test_ta_connection()
File "/config/Library/Application Support/Plex Media Server/Scanners/Series/TubeArchivist Series Scanner.py", line 367, in test_ta_connection
raise e
NameError: global name 'urllib' is not defined

[lamusmaser]

Yes, it'll come out when I can update the Plex integrations.

[jeffreyswiggins]

Yes, it'll come out when I can update the Plex integrations.

okay thanks.... appreciate the work.... it is how we use it so will just wait..

[noconnor29]

On Ubuntu 24.04.2, docker compose exec -it tubearchivist python manage.py ta_config_backup worked to create the backup but docker compose exec -it tubearchivist python manage.py ta_config_restore resulted in no config found/restored.

Thanks to @Jay4242 for the suggestion to use docker-compose exec instead. That restored successfully.

[Froghut]

Might be worth adding to the docs that the TA_HOST also needs the port if its not the default one, i.e. - TA_HOST=https://tube.example.com:1234