After a recent git pull, all uploads result in "Broken missing files" #9009

walt93 · 2024-04-23T18:33:38Z

Describe the bug
After a recent git pull, all uploads result in "Broken missing files"

To Reproduce
Steps to reproduce the behavior:

Upload a video using any method
Observe "Broken missing files"

Expected behavior
Video upload to work

Error Logs
https://pastebin.com/xfUNdeWV

DanielnetoDotCom · 2024-04-23T19:04:22Z

that is the encoder log, you should share your AVideo log

walt93 · 2024-04-23T20:43:10Z

I just created a fresh broken/missing file video and dumped the last ≈2K lines of log - I've uploaded this video 4-5 times so far today so there should be some good data in there.

https://pastebin.com/FjwczjJy

DanielnetoDotCom · 2024-04-23T20:48:19Z

there is no clue in your logs

also there is no records of saving any video on your logs

walt93 · 2024-04-24T05:18:44Z

In the encoder logs I can see the video here:

[23-Apr-2024 11:10:29 America/Los_Angeles] sendToStreamer https://conspyre.tv/aVideoEncoder.json in 0.285 seconds {"error":false,"target":"aVideoEncoder.json","postFields":{"duration":"EE:EE:EE","title":"Redpill Drifter - 9 WARNING SIGNS YOU MAY HAVE PARASITES Many of the symptoms you may be feeling could, in fact, be parasites. Mainstream pharma shill Doctors do not want you to know because it can be treated naturally. Also, check out @TheParasiteGuy ","first_request":1,"categories_id":16,"format":"mp4","resolution":"","videoDownloadedLink":"https:\/\/x.com\/RedpillDrifter\/status\/1782507044735729981","description":"9 WARNING SIGNS YOU MAY HAVE PARASITES Many of the symptoms you may be feeling could, in fact, be parasites. Mainstream pharma shill Doctors do not want you to know because it can be treated naturally. Also, check out @TheParasiteGuy for more great information on this topic https:\/\/t.co\/uObfiymEF5","downloadURL":"","chunkFile":"","encoderURL":"https:\/\/prometheus.conspyre.tv\/","keepEncoding":"0","streamers_id":1,"user":"Conspyre","pass":"_user_hash_dFZsZUk2UCtMcHJWUXFKQXNqM0h0V2h0b0tUSFF1eGpBR2pYZVVkak9ScEhQelBYNUhJc3ZvQlVJUmp5K21EOC81ejhnQTVkYzlJVjRoRUxPYXBJdVE9PQ==","return_vars":"{\"videos_id\":0,\"video_id_hash\":\"\",\"releaseDate\":\"2024-04-23 11:07\"}","releaseDate":"2024-04-23 11:07","releaseTime":1713895620,"timezone":"America\/Los_Angeles"},"response_raw":"{\"error\":false,\"video_id\":18387,\"video_id_hash\":\"NG93YkkvOTdoVDQvWUxSZzJZeEUrQWtLUmdyZjNLR0FzOVN1bElPKzZKcz0=\",\"releaseDate\":\"2024-04-23 11:07\",\"releaseTime\":\"1713895620\"}","response":{"error":false,"video_id":18387,"video_id_hash":"NG93YkkvOTdoVDQvWUxSZzJZeEUrQWtLUmdyZjNLR0FzOVN1bElPKzZKcz0=","releaseDate":"2024-04-23 11:07","releaseTime":"1713895620"}}

Looking at the log from the streamer site, the last log entry is one day previous to this, and was output with tail -n 1500. I don't even have a theory here.

I wonder if it could be due to the avideo.log being stupid huge? 42GB is ... a lot of log

ubuntu@pyron:/var/www/html/conspyre.tv/videos$ ls -lsh *.log
42G -rw-r--r-- 1 ubuntu ubuntu 42G Apr 24 01:00 avideo.log

I removed the contents of the avideo.log and ran the video through the transcoder two more times. The result is Broken Missing Files two more times. The avideo.log file is still empty.

Not sure what to do at this point.

ubuntu@pyron:/var/www/html/conspyre.tv/videos$ sudo -s
root@pyron:/var/www/html/conspyre.tv/videos# echo "" > avideo.log
root@pyron:/var/www/html/conspyre.tv/videos# cat avideo.log

root@pyron:/var/www/html/conspyre.tv/videos#
exit

### AT THIS POINT I TRANSCODED THE FILE TWICE MORE

ubuntu@pyron:/var/www/html/conspyre.tv/videos$ cat avideo.log

ubuntu@pyron:/var/www/html/conspyre.tv/videos$ ls -ls avideo.log
4 -rw-r--r-- 1 ubuntu ubuntu 1 Apr 24 04:49 avideo.log

### NOTE THAT IT IS STILL EMPTY...

DanielnetoDotCom · 2024-04-24T12:39:18Z

For the same video should be multiple sendToStreamer https://conspyre.tv/aVideoEncoder.json

this one does not have the video

walt93 · 2024-04-24T16:28:02Z

What do you suggest?

Uploading all videos fails.

24 hours after erasing avideo.log, the file avideo.log is still empty.

Why does the site no longer emit logfiles, Daniel? That seems strange. There were 42GB in avideo.log and all I did was echo "" > avideo.log to erase the contents. Also, that logfile had current timestamps to 24 hours before the encoder (you can check the pastebins above). Why did my avideo site stop logging ≈48 hours ago?

DanielnetoDotCom · 2024-04-24T18:55:12Z

delete your encoder and streamer logs
encode only 1 video
once it is complete share both logs (complete)

walt93 · 2024-04-25T18:24:48Z

Encoder:
$ tail avideo.log
[25-Apr-2024 18:21:47 UTC] sendToStreamer to objects/aVideoEncoderNotifyIsDone.json.php
[25-Apr-2024 18:21:48 UTC] Encoder::save id=(496) title=(Redpill Drifter - 9 WARNING SIGNS YOU MAY HAVE PARASITES Many of the symptoms you may be feeling could, in fact, be parasites. Mainstream pharma shill Doctors do not want you to know because it can be treated naturally. Also, check out @TheParasiteGuy ) streamers_id=1
[25-Apr-2024 18:21:48 UTC] sendToStreamer spectrumimage not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer rawVideo not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer image not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer gifimage not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer webpimage not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer video not set
[25-Apr-2024 18:21:48 UTC] sendToStreamer https://conspyre.tv/objects/aVideoEncoderNotifyIsDone.json.php in 0.214 seconds {"error":false,"target":"objects/aVideoEncoderNotifyIsDone.json.php","postFields":{"fail":0,"streamers_id":"1","user":"Conspyre","pass":"_user_hash_Sm1jRnNMdnlQNTVDS3lqUWJlTVVsMm5GZGhrRy9rQVE1RXU3QmxZMkFDd3JFcVFXYXRXZk5uRE9kVkpEY0drR3JDdG5ueW10dXhqeUZBSW1JeUpBOXc9PQ==","return_vars":"{"videos_id":18395,"video_id_hash":"NG93YkkvOTdoVDQvWUxSZzJZeEUrRGhkaU9HSEFnellURHBQTmdzUTBWST0=","releaseDate":"2024-04-25 11:20"}","releaseDate":"2024-04-25 11:20","releaseTime":1714044000,"videos_id":18395,"video_id_hash":"NG93YkkvOTdoVDQvWUxSZzJZeEUrRGhkaU9HSEFnellURHBQTmdzUTBWST0=","timezone":"UTC"},"response_raw":"{"error":false,"video_id":18395}","response":{"error":false,"video_id":18395}}
[25-Apr-2024 18:21:48 UTC] Encoder::save id=(496) title=(Redpill Drifter - 9 WARNING SIGNS YOU MAY HAVE PARASITES Many of the symptoms you may be feeling could, in fact, be parasites. Mainstream pharma shill Doctors do not want you to know because it can be treated naturally. Also, check out @TheParasiteGuy ) streamers_id=1

Streamer:
ubuntu@pyron:/var/www/html/conspyre.tv/videos$ cat avideo.log

[24-Apr-2024 20:00:03 America/Lima] AVideoLog::ERROR: Socket server For better performance install PDO SQLite in your PHP SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[24-Apr-2024 20:00:03 America/Lima] AVideoLog::DEBUG: Starting Socket server at port 2053 SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[24-Apr-2024 20:00:03 America/Lima] PHP Fatal error: Uncaught RuntimeException: Failed to listen on "tcp://0.0.0.0:2053": Address already in use (EADDRINUSE) in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php:184
Stack trace:
#0 /var/www/html/conspyre.tv/vendor/react/socket/src/Server.php(77): React\Socket\TcpServer->__construct()
#1 /var/www/html/conspyre.tv/plugin/YPTSocket/server.php(166): React\Socket\Server->__construct()
#2 {main}
thrown in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php on line 184
[24-Apr-2024 20:00:04 America/Lima] AVideoLog::ERROR: Socket server For better performance install PDO SQLite in your PHP SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[24-Apr-2024 20:00:04 America/Lima] AVideoLog::DEBUG: Starting Socket server at port 2053 SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[24-Apr-2024 20:00:04 America/Lima] PHP Fatal error: Uncaught RuntimeException: Failed to listen on "tcp://0.0.0.0:2053": Address already in use (EADDRINUSE) in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php:184
Stack trace:
#0 /var/www/html/conspyre.tv/vendor/react/socket/src/Server.php(77): React\Socket\TcpServer->__construct()
#1 /var/www/html/conspyre.tv/plugin/YPTSocket/server.php(166): React\Socket\Server->__construct()
#2 {main}
thrown in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php on line 184
[25-Apr-2024 08:40:07 America/Lima] AVideoLog::ERROR: Socket server For better performance install PDO SQLite in your PHP SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[25-Apr-2024 08:40:07 America/Lima] AVideoLog::DEBUG: Starting Socket server at port 2053 SCRIPT_NAME: /var/www/html/conspyre.tv/plugin/YPTSocket/server.php
[25-Apr-2024 08:40:07 America/Lima] PHP Fatal error: Uncaught RuntimeException: Failed to listen on "tcp://0.0.0.0:2053": Address already in use (EADDRINUSE) in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php:184
Stack trace:
#0 /var/www/html/conspyre.tv/vendor/react/socket/src/Server.php(77): React\Socket\TcpServer->__construct()
#1 /var/www/html/conspyre.tv/plugin/YPTSocket/server.php(166): React\Socket\Server->__construct()
#2 {main}
thrown in /var/www/html/conspyre.tv/vendor/react/socket/src/TcpServer.php on line 184

DanielnetoDotCom · 2024-04-25T19:42:45Z

Wrong logs

Encoder

Should be logs before this

[25-Apr-2024 18:21:47 UTC] sendToStreamer to objects/aVideoEncoderNotifyIsDone.json.php

Streamer

the logs should match with the encoder logs time, for example [25-Apr-2024 18:21:47 UTC]

walt93 · 2024-04-25T19:53:11Z

Daniel, those are the logs from the streamer and the encoder. I'm uploading them to pastebin with the commands and directories so you may see that this is the case.

Here is the encoder: https://pastebin.com/gT0i44tT
Here is the streamer: https://pastebin.com/whccLwU2

The streamer is NOT picking up the encode. This is the encoder which is configured for the streamer. I do not know what is wrong.

Screenshot showing that prometheus.conspyre.tv is the encoder configured (we only have one)

I have updates which need to go out for my Roku channel but am completely blocked until I can make my streamer site accept new files.

DanielnetoDotCom · 2024-04-25T19:54:38Z

What do you mean "The streamer is NOT picking up the encode."?

DanielnetoDotCom · 2024-04-25T20:01:10Z

The streamer log is not correct and it is incomplete.

Based on your encoder there is no problem with the encoder

[25-Apr-2024 18:21:47 UTC] Encoder:sendFileChunk no need, we could download

the issue is probably in your streamer, what is missing the correct log

Based on this first thing,

I suspect you have missing permissions in your videos folder, run this and try to encode it again

chmod -R 777 /var/www/html/conspyre.tv/videos

also check your AVideo health check in the admin panel

walt93 · 2024-04-25T20:52:46Z

Daniel, that solved the issue. I did the chmod 777, encoded the video, and it worked.

Health check is solid green (I didn't check it before the chmod - perhaps it showed something? and that is where I need to check first when something happens… noted!)

I don't have a theory as to when/how I changed permissions on that folder. Very puzzling!

walt93 added the bug label Apr 23, 2024

walt93 changed the title ~~All uploads result in "Broken missing files"~~ After a recent git pull, *all* uploads result in "Broken missing files" Apr 23, 2024

walt93 closed this as completed Apr 28, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

After a recent git pull, all uploads result in "Broken missing files" #9009

After a recent git pull, all uploads result in "Broken missing files" #9009

walt93 commented Apr 23, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 23, 2024

walt93 commented Apr 23, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 23, 2024 •

edited

Loading

walt93 commented Apr 24, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 24, 2024

walt93 commented Apr 24, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 24, 2024

walt93 commented Apr 25, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 25, 2024

walt93 commented Apr 25, 2024

DanielnetoDotCom commented Apr 25, 2024

DanielnetoDotCom commented Apr 25, 2024

walt93 commented Apr 25, 2024 •

edited

Loading

After a recent git pull, *all* uploads result in "Broken missing files" #9009

After a recent git pull, *all* uploads result in "Broken missing files" #9009

Comments

walt93 commented Apr 23, 2024 • edited Loading

DanielnetoDotCom commented Apr 23, 2024

walt93 commented Apr 23, 2024 • edited Loading

DanielnetoDotCom commented Apr 23, 2024 • edited Loading

walt93 commented Apr 24, 2024 • edited Loading

DanielnetoDotCom commented Apr 24, 2024

walt93 commented Apr 24, 2024 • edited Loading

DanielnetoDotCom commented Apr 24, 2024

walt93 commented Apr 25, 2024 • edited Loading

DanielnetoDotCom commented Apr 25, 2024

Encoder

Streamer

walt93 commented Apr 25, 2024

DanielnetoDotCom commented Apr 25, 2024

DanielnetoDotCom commented Apr 25, 2024

walt93 commented Apr 25, 2024 • edited Loading

After a recent git pull, all uploads result in "Broken missing files" #9009

After a recent git pull, all uploads result in "Broken missing files" #9009

walt93 commented Apr 23, 2024 •

edited

Loading

walt93 commented Apr 23, 2024 •

edited

Loading

DanielnetoDotCom commented Apr 23, 2024 •

edited

Loading

walt93 commented Apr 24, 2024 •

edited

Loading

walt93 commented Apr 24, 2024 •

edited

Loading

walt93 commented Apr 25, 2024 •

edited

Loading

walt93 commented Apr 25, 2024 •

edited

Loading