Unable to load metadata from catalog

[Rillke]

After upgrading to Opencast 19 we see

admin container logs:

2026-08-14T17:18:04,516 | WARN  | (WorkspaceImpl:479) - Received unexpected response status 403 while trying to download from https://staging-presentation.opencast.example.com/static/mh_default_org/engage-player/00000df4-4dec-43c4-b716-00000c6c3521/178621be-3104-4128-b8c6-e55147cf8000/dublincore.xml
2026-08-14T17:18:04,521 | ERROR | (DublinCoreUtil:78) - Unable to load metadata from catalog 'https://staging-presentation.opencast.example.com/static/mh_default_org/engage-player/00000df4-4dec-43c4-b716-00000c6c3521/178621be-3104-4128-b8c6-e55147cf8000/dublincore.xml'
org.opencastproject.util.NotFoundException: null
     at org.opencastproject.workspace.impl.WorkspaceImpl.downloadIfNecessary(WorkspaceImpl.java:530) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.lambda$downloadIfNecessary$2(WorkspaceImpl.java:551) ~[?:?]
     at org.opencastproject.util.IoSupport.locked(IoSupport.java:418) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.get(WorkspaceImpl.java:401) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.read(WorkspaceImpl.java:436) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadDublinCore(DublinCoreUtil.java:75) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.lambda$loadEpisodeDublinCore$0(DublinCoreUtil.java:63) ~[?:?]
     at java.util.Optional.map(Unknown Source) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadEpisodeDublinCore(DublinCoreUtil.java:63) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:286) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:276) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.addSynchronously(SearchServiceIndex.java:255) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.lambda$process$0(SearchServiceImpl.java:264) ~[?:?]
     at org.opencastproject.security.util.SecurityUtil.runAs(SecurityUtil.java:80) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.process(SearchServiceImpl.java:262) ~[?:?]
     at org.opencastproject.job.api.AbstractJobProducer$JobRunner.call(AbstractJobProducer.java:314) ~[?:?]
     at org.opencastproject.job.api.AbstractJobProducer$JobRunner.call(AbstractJobProducer.java:272) ~[?:?]
     at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
     at java.lang.Thread.run(Unknown Source) [?:?]
2026-08-14T17:18:04,546 | INFO  | (ServiceRegistryJpaImpl:2217) - State set to WARNING for current service org.opencastproject.search on host https://staging-admin.opencast.example.com
2026-08-14T17:18:04,587 | ERROR | (AbstractJobProducer$JobRunner:344) - Error handling operation 'Add':
org.opencastproject.serviceregistry.api.ServiceRegistryException: Error handling operation 'Add'
     at org.opencastproject.search.impl.SearchServiceImpl.process(SearchServiceImpl.java:290) ~[?:?]
     at org.opencastproject.job.api.AbstractJobProducer$JobRunner.call(AbstractJobProducer.java:314) ~[?:?]
     at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
     at java.lang.Thread.run(Unknown Source) [?:?]
Caused by: java.lang.RuntimeException: org.opencastproject.util.NotFoundException
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadDublinCore(DublinCoreUtil.java:79) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.lambda$loadEpisodeDublinCore$0(DublinCoreUtil.java:63) ~[?:?]
     at java.util.Optional.map(Unknown Source) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadEpisodeDublinCore(DublinCoreUtil.java:63) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:286) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:276) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.addSynchronously(SearchServiceIndex.java:255) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.lambda$process$0(SearchServiceImpl.java:264) ~[?:?]
     at org.opencastproject.security.util.SecurityUtil.runAs(SecurityUtil.java:80) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.process(SearchServiceImpl.java:262) ~[?:?]
     ... 6 more
Caused by: org.opencastproject.util.NotFoundException
     at org.opencastproject.workspace.impl.WorkspaceImpl.downloadIfNecessary(WorkspaceImpl.java:530) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.lambda$downloadIfNecessary$2(WorkspaceImpl.java:551) ~[?:?]
     at org.opencastproject.util.IoSupport.locked(IoSupport.java:418) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.get(WorkspaceImpl.java:401) ~[?:?]
     at org.opencastproject.workspace.impl.WorkspaceImpl.read(WorkspaceImpl.java:436) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadDublinCore(DublinCoreUtil.java:75) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.lambda$loadEpisodeDublinCore$0(DublinCoreUtil.java:63) ~[?:?]
     at java.util.Optional.map(Unknown Source) ~[?:?]
     at org.opencastproject.metadata.dublincore.DublinCoreUtil.loadEpisodeDublinCore(DublinCoreUtil.java:63) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:286) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.indexMediaPackage(SearchServiceIndex.java:276) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceIndex.addSynchronously(SearchServiceIndex.java:255) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.lambda$process$0(SearchServiceImpl.java:264) ~[?:?]
     at org.opencastproject.security.util.SecurityUtil.runAs(SecurityUtil.java:80) ~[?:?]
     at org.opencastproject.search.impl.SearchServiceImpl.process(SearchServiceImpl.java:262) ~[?:?]
     ... 6 more
2026-08-14T17:18:08,391 | ERROR | (WorkflowOperationWorker:140) - Workflow operation 'operation:'publish-engage, state:'FAILED'' failed
org.opencastproject.workflow.api.WorkflowOperationException: Mediapackage 00000df4-4dec-43c4-b716-00000c6c3521 could not be published
     at org.opencastproject.workflow.handler.distribution.PublishEngageWorkflowOperationHandler.start(PublishEngageWorkflowOperationHandler.java:485) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowOperationWorker.start(WorkflowOperationWorker.java:212) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowOperationWorker.execute(WorkflowOperationWorker.java:117) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowServiceImpl.runWorkflowOperation(WorkflowServiceImpl.java:734) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowServiceImpl.process(WorkflowServiceImpl.java:1777) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowServiceImpl$JobRunner.call(WorkflowServiceImpl.java:2151) ~[?:?]
     at org.opencastproject.workflow.impl.WorkflowServiceImpl$JobRunner.call(WorkflowServiceImpl.java:2117) ~[?:?]
     at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
     at java.lang.Thread.run(Unknown Source) [?:?]

while attempting to publish the recording.

We have separate admin and presentation VMs using a shared NFS. admin container runs alongside with worker container on the same VM; presentation container on other VM. When I login to staging-presentation.opencast.example.com and attempt to download the file manually, I can download it without any issue. Why can't Opencast itself (403 Forbidden) download the file and why does it attempt to download the file over HTTP at all and does not stick to NFS sharing.

Edit:

Opencast docker's opencast.sh configured org.opencastproject.organization-mh_default_org.cfg

prop.org.opencastproject.file.repo.url=$\{prop.org.opencastproject.admin.ui.url}

Will the backslash between the dollar sign and opening parenthesis cause any trouble?

[Rillke]

We can't reproduce this in our production environment.