Chat download finishes, but does not progress to convert

[russelg]

First time I've seen this one happen.

Most relevant lines:

2024-04-30T07:14:06.190777634Z {"level":"debug","service":"worker","ActivityID":"11","ActivityType":"KillTwitchLiveChatDownload","Attempt":1,"Namespace":"default","RunID":"de326a92-2f35-4e7e-9376-658fa59ceb54","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-04-30T15:14:06+08:00","message":"ExecuteActivity"}
2024-04-30T07:14:06.201158691Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killing chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.204682074Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"found pid 42\n for chat_downloader"}
2024-04-30T07:14:06.207549412Z error in chat_downloader for live chat download: signal: terminated
2024-04-30T07:14:06.207616538Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"finished downloading live chat for 41261224199"}
2024-04-30T07:14:06.207687877Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"moving file: /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json to /vods/ezorisu_/2024-04-30-41261224199-live-752758d6-06b9-11ef-be89-0242ac120009/41261224199-live-chat.json"}
2024-04-30T07:14:06.208994918Z {"level":"error","service":"worker","ActivityType":"DownloadTwitchLiveChat","Attempt":1,"Error":"error opening file: open /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json: no such file or directory","Namespace":"default","RunID":"9850914f-5b48-47ee-87e0-f882ac3549b3","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_39","time":"2024-04-30T15:14:06+08:00","message":"Activity error."}
2024-04-30T07:14:06.209350643Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"stopping heartbeat download-livechat-41261224199"}
2024-04-30T07:14:06.209426377Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killed chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.241353163Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"checking if tasks are done for video 41261224199"}

State it ends up in:

The error opening file: open /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json: no such file or directory is quite suspicious here, not sure why it would be trying to open that tmp file again, right after it has moved it to the vods directory.

Full log for this VOD:

2024-04-30T06:18:27.597999943Z {"level":"debug","time":"2024-04-30T14:18:27+08:00","message":"ezorisu_ is now live"}
2024-04-30T06:18:27.713806700Z {"level":"debug","time":"2024-04-30T14:18:27+08:00","message":"workflow id 752758d6-06b9-11ef-be89-0242ac120009 started for live stream 41261224199"}
2024-04-30T06:18:27.715459026Z {"level":"debug","time":"2024-04-30T14:18:27+08:00","message":"Live notification is disabled"}
2024-04-30T06:18:27.769426339Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_5","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"CreateDirectoryWorkflow","time":"2024-04-30T14:18:27+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:27.870156229Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"f855b6c1-5a76-4f17-98d0-a9200a42edae","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-04-30T14:18:27+08:00","message":"ExecuteActivity"}
2024-04-30T06:18:27.918857200Z {"level":"debug","time":"2024-04-30T14:18:27+08:00","message":"creating folder: ezorisu_/2024-04-30-41261224199-live-752758d6-06b9-11ef-be89-0242ac120009"}
2024-04-30T06:18:29.653897650Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_14","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-04-30T14:18:29+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:29.749430511Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"3c449d1b-5aed-40c3-8738-c48f8ca8e283","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-04-30T14:18:29+08:00","message":"ExecuteActivity"}
2024-04-30T06:18:30.051732245Z {"level":"debug","time":"2024-04-30T14:18:30+08:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_ezorisu_-1920x1080.jpg"}
2024-04-30T06:18:31.676340401Z {"level":"debug","time":"2024-04-30T14:18:31+08:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_ezorisu_-640x360.jpg"}
2024-04-30T06:18:32.523287088Z {"level":"debug","time":"2024-04-30T14:18:32+08:00","message":"checking if tasks are done for video 41261224199"}
2024-04-30T06:18:32.536282758Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_23","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflowWait","time":"2024-04-30T14:18:32+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:32.536297981Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_24","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-04-30T14:18:32+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:32.791612438Z {"level":"debug","service":"worker","Attempt":1,"Duration":600000,"Namespace":"default","RunID":"cfeaffa3-a7ad-4c89-af39-f59fad488a43","TaskQueue":"archive","TimerID":"5","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_23","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflowWait","time":"2024-04-30T14:18:32+08:00","message":"NewTimer"}
2024-04-30T06:18:32.798979824Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"fd3fb525-bb0b-4f32-a146-b7fa4afe6429","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_24","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-04-30T14:18:32+08:00","message":"ExecuteActivity"}
2024-04-30T06:18:33.123417809Z {"level":"debug","time":"2024-04-30T14:18:33+08:00","message":"checking if tasks are done for video 41261224199"}
2024-04-30T06:18:33.144285621Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_34","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"ArchiveTwitchLiveChatWorkflow","time":"2024-04-30T14:18:33+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:33.312477934Z {"level":"debug","time":"2024-04-30T14:18:33+08:00","message":"Live chat archive workflow ID: 59452458-9952-42e0-8e64-8dd0edd59f39_34"}
2024-04-30T06:18:33.312508021Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_39","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"DownloadTwitchLiveChatWorkflow","time":"2024-04-30T14:18:33+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:33.349981295Z {"level":"debug","time":"2024-04-30T14:18:33+08:00","message":"Live chat workflow ID: 59452458-9952-42e0-8e64-8dd0edd59f39_39"}
2024-04-30T06:18:33.350016604Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_44","Namespace":"default","RunID":"59452458-9952-42e0-8e64-8dd0edd59f39","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"752758d6-06b9-11ef-be89-0242ac120009","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-04-30T14:18:33+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:33.402379933Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_5","Namespace":"default","RunID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_44","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-04-30T14:18:33+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T06:18:33.472618898Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"de326a92-2f35-4e7e-9376-658fa59ceb54","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-04-30T14:18:33+08:00","message":"ExecuteActivity"}
2024-04-30T06:18:33.483082723Z {"level":"debug","time":"2024-04-30T14:18:33+08:00","message":"starting heartbeat download-livevideo-41261224199"}
2024-04-30T06:18:34.483207605Z {"level":"debug","time":"2024-04-30T14:18:34+08:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/ezorisu_ best,best --http-header Authorization=OAuth [...] --twitch-low-latency --twitch-disable-hosting -o /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video.mp4]"}
2024-04-30T06:18:34.484190263Z {"level":"debug","time":"2024-04-30T14:18:34+08:00","message":"running: streamlink --progress=force --force https://twitch.tv/ezorisu_ best,best --http-header Authorization=OAuth [...] --twitch-low-latency --twitch-disable-hosting -o /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video.mp4"}
2024-04-30T06:18:34.484907497Z {"level":"debug","time":"2024-04-30T14:18:34+08:00","message":"notifying chat download that video download is about to start"}
2024-04-30T06:18:34.485664626Z 2024/04/30 14:18:34 INFO  No logger configured for temporal client. Created default one.
2024-04-30T06:18:34.501179027Z {"level":"info","time":"2024-04-30T14:18:34+08:00","message":"Connected to temporal at ganymede-temporal:7233"}
2024-04-30T06:18:34.610003089Z {"level":"info","time":"2024-04-30T14:18:34+08:00","message":"Received signal: {true}"}
2024-04-30T06:18:34.610040596Z {"level":"debug","service":"worker","ActivityID":"9","ActivityType":"DownloadTwitchLiveChat","Attempt":1,"Namespace":"default","RunID":"9850914f-5b48-47ee-87e0-f882ac3549b3","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_39","WorkflowType":"DownloadTwitchLiveChatWorkflow","time":"2024-04-30T14:18:34+08:00","message":"ExecuteActivity"}
2024-04-30T06:18:34.640856081Z {"level":"debug","time":"2024-04-30T14:18:34+08:00","message":"setting chat start time"}
2024-04-30T06:18:34.643737992Z {"level":"debug","time":"2024-04-30T14:18:34+08:00","message":"starting heartbeat download-livechat-41261224199"}
2024-04-30T06:28:32.840702198Z {"level":"debug","service":"worker","ActivityID":"10","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"cfeaffa3-a7ad-4c89-af39-f59fad488a43","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_23","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflowWait","time":"2024-04-30T14:28:32+08:00","message":"ExecuteActivity"}
2024-04-30T06:28:33.100718756Z {"level":"debug","time":"2024-04-30T14:28:33+08:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_ezorisu_-1920x1080.jpg"}
2024-04-30T06:28:36.608358195Z {"level":"debug","time":"2024-04-30T14:28:36+08:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_ezorisu_-640x360.jpg"}
2024-04-30T06:28:38.458525863Z {"level":"debug","time":"2024-04-30T14:28:38+08:00","message":"checking if tasks are done for video 41261224199"}
2024-04-30T07:14:05.435844178Z {"level":"debug","time":"2024-04-30T15:14:05+08:00","message":"finished downloading live video for 41261224199"}
2024-04-30T07:14:05.437574038Z {"level":"debug","time":"2024-04-30T15:14:05+08:00","message":"getting video duration"}
2024-04-30T07:14:05.898902580Z {"level":"debug","time":"2024-04-30T15:14:05+08:00","message":"video duration: 3322"}
2024-04-30T07:14:06.168836387Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"no vod found for livestream 41261224199, keeping live stream ID as external id"}
2024-04-30T07:14:06.168884283Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"stopping heartbeat download-livevideo-41261224199"}
2024-04-30T07:14:06.190777634Z {"level":"debug","service":"worker","ActivityID":"11","ActivityType":"KillTwitchLiveChatDownload","Attempt":1,"Namespace":"default","RunID":"de326a92-2f35-4e7e-9376-658fa59ceb54","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-04-30T15:14:06+08:00","message":"ExecuteActivity"}
2024-04-30T07:14:06.201158691Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killing chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.204682074Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"found pid 42\n for chat_downloader"}
2024-04-30T07:14:06.207549412Z error in chat_downloader for live chat download: signal: terminated
2024-04-30T07:14:06.207616538Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"finished downloading live chat for 41261224199"}
2024-04-30T07:14:06.207687877Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"moving file: /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json to /vods/ezorisu_/2024-04-30-41261224199-live-752758d6-06b9-11ef-be89-0242ac120009/41261224199-live-chat.json"}
2024-04-30T07:14:06.208994918Z {"level":"error","service":"worker","ActivityType":"DownloadTwitchLiveChat","Attempt":1,"Error":"error opening file: open /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json: no such file or directory","Namespace":"default","RunID":"9850914f-5b48-47ee-87e0-f882ac3549b3","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_39","time":"2024-04-30T15:14:06+08:00","message":"Activity error."}
2024-04-30T07:14:06.209350643Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"stopping heartbeat download-livechat-41261224199"}
2024-04-30T07:14:06.209426377Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killed chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.241353163Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"checking if tasks are done for video 41261224199"}
2024-04-30T07:14:06.270422799Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_14","Namespace":"default","RunID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_44","WorkflowType":"PostprocessVideoWorkflow","time":"2024-04-30T15:14:06+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T07:14:06.320003715Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"PostprocessVideo","Attempt":1,"Namespace":"default","RunID":"8c0f9a7e-9d91-444d-9213-a53de67318a9","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_14","WorkflowType":"PostprocessVideoWorkflow","time":"2024-04-30T15:14:06+08:00","message":"ExecuteActivity"}
2024-04-30T07:14:06.329173331Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"video convert args: [-y -hide_banner -i /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video.mp4 -fflags +discardcorrupt -c:v copy -c:a copy /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video-convert.mp4]"}
2024-04-30T07:14:06.329455401Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"starting heartbeat postprocess-video-41261224199"}
2024-04-30T07:14:10.667758168Z {"level":"debug","time":"2024-04-30T15:14:10+08:00","message":"finished vod video convert for 41261224199"}
2024-04-30T07:14:10.679159167Z {"level":"debug","time":"2024-04-30T15:14:10+08:00","message":"deleting original video file for 41261224199 to save space"}
2024-04-30T07:14:16.484704846Z {"level":"debug","time":"2024-04-30T15:14:16+08:00","message":"finished vod video convert - hls for 41261224199"}
2024-04-30T07:14:16.501671614Z {"level":"debug","time":"2024-04-30T15:14:16+08:00","message":"stopping heartbeat postprocess-video-41261224199"}
2024-04-30T07:14:16.567750720Z {"level":"debug","time":"2024-04-30T15:14:16+08:00","message":"checking if tasks are done for video 41261224199"}
2024-04-30T07:14:16.622114057Z {"level":"debug","service":"worker","Attempt":1,"ChildWorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_23","Namespace":"default","RunID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"59452458-9952-42e0-8e64-8dd0edd59f39_44","WorkflowType":"MoveVideoWorkflow","time":"2024-04-30T15:14:16+08:00","message":"ExecuteChildWorkflow"}
2024-04-30T07:14:16.710624602Z {"level":"debug","service":"worker","ActivityID":"5","ActivityType":"MoveVideo","Attempt":1,"Namespace":"default","RunID":"5b3d1c50-c7c4-45a9-8c24-c77eb3618759","TaskQueue":"archive","WorkerID":"92130082d211","WorkflowID":"33eaf76d-1983-48be-af1f-7b10ab5a8f79_23","WorkflowType":"MoveVideoWorkflow","time":"2024-04-30T15:14:16+08:00","message":"ExecuteActivity"}
2024-04-30T07:14:16.726137491Z {"level":"debug","time":"2024-04-30T15:14:16+08:00","message":"starting heartbeat move-video-41261224199"}
2024-04-30T07:14:30.863030810Z {"level":"debug","time":"2024-04-30T15:14:30+08:00","message":"deleting file: /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video.mp4"}
2024-04-30T07:14:30.863350931Z {"level":"info","error":"error deleting file: remove /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-video.mp4: no such file or directory","time":"2024-04-30T15:14:30+08:00","message":"error deleting source file for vod 752758d6-06b9-11ef-be89-0242ac120009"}
2024-04-30T07:14:30.864429565Z {"level":"debug","time":"2024-04-30T15:14:30+08:00","message":"stopping heartbeat move-video-41261224199"}
2024-04-30T07:14:30.880146250Z {"level":"debug","time":"2024-04-30T15:14:30+08:00","message":"checking if tasks are done for video 41261224199"}

[russelg]

This also occurred on my local instance for the same stream in the same way

2024-04-30T07:14:06.419106024Z {"level":"debug","service":"worker","ActivityID":"11","ActivityType":"KillTwitchLiveChatDownload","Attempt":1,"Namespace":"default","RunID":"be448df0-da3c-47dc-ac06-c33270453534","TaskQueue":"archive","WorkerID":"ce899fafbab7","WorkflowID":"10ac4c44-0e4d-4940-b68e-6d1600642738_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-04-30T15:14:06+08:00","message":"ExecuteActivity"}
2024-04-30T07:14:06.424880332Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killing chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.430760643Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"found pid 56\n for chat_downloader"}
2024-04-30T07:14:06.432027106Z {"level":"info","time":"2024-04-30T15:14:06+08:00","message":"killed chat downloader for channel ezorisu_"}
2024-04-30T07:14:06.433507998Z error in chat_downloader for live chat download: signal: terminated
2024-04-30T07:14:06.433519417Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"finished downloading live chat for 41261224199"}
2024-04-30T07:14:06.433539198Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"moving file: /tmp/41261224199_8b66cebc-06b9-11ef-8a26-0242ac120007-live-chat.json to /vods/ezorisu_/2024-04-30-41261224199-live-8b66cebc-06b9-11ef-8a26-0242ac120007/41261224199-live-chat.json"}
2024-04-30T07:14:06.435384487Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"stopping heartbeat download-livechat-41261224199"}
2024-04-30T07:14:06.435508271Z {"level":"error","service":"worker","ActivityType":"DownloadTwitchLiveChat","Attempt":1,"Error":"error opening file: open /tmp/41261224199_8b66cebc-06b9-11ef-8a26-0242ac120007-live-chat.json: no such file or directory","Namespace":"default","RunID":"2ca3a5d1-55eb-4262-bd5e-66cd322f2e9c","TaskQueue":"archive","WorkerID":"ce899fafbab7","WorkflowID":"f36d8c17-5591-4857-88cc-1ab0477c61da_39","time":"2024-04-30T15:14:06+08:00","message":"Activity error."}
2024-04-30T07:14:06.443616844Z {"level":"debug","time":"2024-04-30T15:14:06+08:00","message":"checking if tasks are done for video 41261224199"}

[Zibbp]

Looks like it failed moving, the debug message before it, is just saying that it is about to move, but errors right after as the file is not found. If you exec into the API container, does /tmp/41261224199_752758d6-06b9-11ef-be89-0242ac120009-live-chat.json (or the other file in your local instance) exist? Is this channel's chat very active?

[russelg]

Is this channel's chat very active?

I didn't tune in on twitch itself so can't say, this is the first time I've seen a stream of theirs. There was no live-chat.json in the tmp folder for either instance. Certainly possible there were no chat messages.

[Zibbp]

Is there a VOD you can check if there were any chat messages? The chat-downloader tool doesn't create the json file unless there is a message so it likely could be this. I'll update the task to check if the file exists before attempting to move, and set the vod to have no chat.

[russelg]

There isn't a VOD for this specific stream, but they do have other older VODs which do have chat. I think it's safe to assume in this case there weren't any chat messages. Hard to say since chat-downloader doesn't log anything.

[Zibbp]

The logs say it did kill the process ID of the chat-downloader, so it didn't error out. Very likely just no messages. You can confirm nothing weird is going on with the channel by running docker exec -it ganymede-api chat_downloader https://twitch.tv/<CHANNEL> and sending a message in the channel's chat. You should see the message in the terminal.

[russelg]

The logs say it did kill the process ID of the chat-downloader, so it didn't error out. Very likely just no messages. You can confirm nothing weird is going on with the channel by running docker exec -it ganymede-api chat_downloader https://twitch.tv/<CHANNEL> and sending a message in the channel's chat. You should see the message in the terminal.

Tested, seems to work fine with the channel in question, so yep just very likely there were no messages.