Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Beta 1.1] XBIAN hangs after a few seconds while in Movies screen/gallery #457

Closed
b0rna opened this issue Sep 17, 2013 · 20 comments
Closed

Comments

@b0rna
Copy link

b0rna commented Sep 17, 2013

I have a rather large number of movies in the gallery. They are scraped from "themoviedatabase.org". After entering the the movies gallery screen (default skin), XBIAN always hangs after a few seconds. The longest experimented duration of time before failure was about one minute.

This occurs with Beta 1.0. Fresh install to Beta 1.1 and the same issue is observed.

I can see the total duration counter increasing at the bottom (XBIAN has not fully completed the duration/runtime counter, however this does not finish as the total system always hangs moments after entering this screen).

This is the end of the log file before the hang.

16:00:35 T:2884629568 NOTICE: Thread XBPyThread start, auto delete: false
16:00:35 T:3042615296 NOTICE: ES: Starting event server
16:00:35 T:2834297920 NOTICE: Thread CEventServer start, auto delete: false
16:00:35 T:2834297920 NOTICE: ES: Starting UDP Event server on 0.0.0.0:9777
16:00:35 T:2834297920 NOTICE: UDP: Listening on port 9777
16:00:35 T:3042615296 ERROR: JSONRPC Server: Failed to connect to sdpd
16:00:35 T:3042615296 NOTICE: starting zeroconf publishing
16:00:35 T:2817520704 NOTICE: Thread Jobworker start, auto delete: true
16:00:35 T:2825909312 NOTICE: Thread CTCPServer start, auto delete: false
16:00:35 T:2809132096 NOTICE: Thread AirPlayServer start, auto delete: false
16:00:35 T:2924282944 NOTICE: VideoInfoScanner: Starting scan ..
16:00:35 T:2792354880 NOTICE: Thread Jobworker start, auto delete: true
16:00:35 T:2800743488 NOTICE: Thread AirTunesServer start, auto delete: false
16:00:39 T:2907505728 NOTICE: StorageServer Module loaded RUN
16:00:39 T:2907505728 NOTICE: StorageClient-2.5.2 Starting server
16:00:39 T:2907505728 NOTICE: StorageServer-2.5.2 Storage Server starting /home/xbian/.xbmc/temp/commoncache.db
16:00:40 T:2933204032 NOTICE: Artwork Downloader: ## Service - Run at startup: False
16:00:40 T:2933204032 NOTICE: Artwork Downloader: ## Service - Delayed startup: minutes
16:00:40 T:2933204032 NOTICE: Artwork Downloader: ## Service - Run as service: False
16:00:40 T:2933204032 NOTICE: Artwork Downloader: ## Service - Time: :00
16:00:41 T:2884629568 NOTICE: -->Python Interpreter Initialized<--
16:00:43 T:2924282944 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:13
19:49:21 T:3042615296 NOTICE: Samba is idle. Closing the remaining connections
19:50:39 T:2915894336 NOTICE: screensaver activated
19:50:39 T:2915894336 NOTICE: XBian : Checking for update
20:02:27 T:2915894336 NOTICE: screensaver Deactivated
20:02:27 T:2817520704 NOTICE: Thread Jobworker start, auto delete: true
20:02:39 T:2924282944 NOTICE: Previous line repeats 2 times.
20:02:39 T:2924282944 NOTICE: Thread Background Loader start, auto delete: false

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

ok, there is nothing in the log. only that caching worker wanted to start or even started and done. Is the view working with XBMC on other platform? Windows / Mac?

(Movie gallery you mean "MOVIES" on home screen and Enter it)? My DB is not so big but opened in cca 2 seconds and the meters - counters are telling 465 movies, 1/33 pages, 824hours:49min.

Are you keeping VideoDB locally to RPI or is it Mysql shared setup?

btw: we all have some movies in the gallery. What is the large number? 5000 ? 10000 ?

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Thanks for the quick response.

Movies are on SMB. About ~2000. Everything was smooth with the alpha releases. But i get a full lock shortly after entering MOVIES from the home screen. I've got a 16GB UHS-1 SD card in the. Ill try and get some more logs to see if something shows. As it stands, the system hangs and there is seemingly nothing peculiar in the logs. Will update.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

And where is DB? Local SQLite3 files? Even if A5 is fine, it will not help us much as between them is changed everything. Not one single package is the same / system libs on debian-raspbian / filesystem which holds .DB files (if locally). How big the ./userdata/Database folder is?

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Local database.

xbian@xbian ~/.xbmc $ cd userdata/
xbian@xbian ~/.xbmc/userdata $ du -sh */
20M Database/
861M Thumbnails/
37M addon_data/
0 keymaps/
0 library/
4.0K peripheral_data/
0 playlists/
xbian@xbian ~/.xbmc/userdata $

Log files still not containing anything interesting. I will probably start fresh and build my library up again in chunks to see if I can discover anything interesting.

Let me know what else I can provide.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

no no don't do it. we will loose information, whether problem is DB or installation and you will loose x hours doing again the same non effective step.

Can you just copy the DB to a different XBMC install? If you don't mind sharing (Just the VideoXX.DB would be enough) I can try opening it on Beta2.

If you mind, no problem. But

  1. try on diff installation (nonRPI) - that way we will know if DB is ok or not
  2. if will be ok, we will try open from diff fs than btrfs - tmpfs for instance

rewrite SD with the same OS and then with the same data will not help us pinpoint issue (if is with XBian)

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

Or at least preserve the ./Database if you need new install for watching / using the RPI.

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Im willing to do anything that might help the project.

Stay tuned.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

ok

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Here is the video databse. Took a little while to SCP the userdata directory over to my local.

http://www.mediafire.com/download/bs162khj24n9f9q/MyVideos75.db

Will also copy over the data base to an OSX installation (this should work?), and additionally, another SD card with 1.1 fresh installed and report back.

Thanks for the continued help.

Borna.

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Copied entire userdata directory to an OSX installation of latest XBMC release. Everything works smoothly. Did notice that a rather considerable amount CPU time was being used to calculate the runtime duration. This is on a pretty hefty machine. Could it be that this function is somehow locking up the rPi with a large database? Should also mention that i have the 512MB model.

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Also copied over both the xbmc.log and the xbmc.old.log files. Not a whole lot is being logged according to the timestamps.

xbmc.log

16:00:39 T:2932700224 NOTICE: Artwork Downloader: ## Service - Run at startup: False
16:00:39 T:2932700224 NOTICE: Artwork Downloader: ## Service - Delayed startup: minutes
16:00:39 T:2932700224 NOTICE: Artwork Downloader: ## Service - Run as service: False
16:00:39 T:2932700224 NOTICE: Artwork Downloader: ## Service - Time: :00
16:00:40 T:2882532416 NOTICE: -->Python Interpreter Initialized<--
16:00:43 T:2923779136 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:13
00:08:16 T:3042144256 NOTICE: Samba is idle. Closing the remaining connections
00:09:35 T:2915390528 NOTICE: screensaver activated

xbmc.old.log

16:00:40 T:2926572608 NOTICE: Artwork Downloader: ## Service - Run at startup: False
16:00:40 T:2926572608 NOTICE: Artwork Downloader: ## Service - Delayed startup: minutes
16:00:40 T:2926572608 NOTICE: Artwork Downloader: ## Service - Run as service: False
16:00:40 T:2926572608 NOTICE: Artwork Downloader: ## Service - Time: :00
16:00:41 T:2878338112 NOTICE: -->Python Interpreter Initialized<--
16:00:43 T:2917651520 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:12
16:01:00 T:2917651520 NOTICE: Thread Jobworker start, auto delete: true
00:02:36 T:2878338112 NOTICE: Thread Background Loader start, auto delete: false

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

thanks for DB. will copy to my beta2.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

on beta2 loaded in approx 10 seconds . 2326 items, 167 pages, 3882 hours. is it correct ?

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Yes. that is what it displays before it crashes. Each time, the duration counter increments just a bit (a few hours), just before system hang.

On OSX, the final count was:

2326 items, 1/167 4299:14:46

Borna.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

Ok so you want that I wait on the list ? ok, will do.

The number is not changing there. From the first moment it's constant. I can browse the list. Log is not changing. Although xbmc.bin is taking 55% (instead of 15%).

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

No. Don't think that would help. My system crashes within seconds. Either the duration won't update without the SMB resources available on your test setup (not sure if this is true), or it should hang the system within a minute or two max. Will keep posted if I discover anything.

Thanks again.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

Duration has to be loaded from DB, not from files. I'm sure. Tried to click

09:49:49 T:2906534976   ERROR: InputStream: Error opening, smb://SERVER/Z04/HD/'Rome' (2005).mkv
09:49:49 T:2761946176  NOTICE: Thread Jobworker start, auto delete: true

so all the other accesses (to get time of movie) would be logged as well.

and Borna, don't loose too much time on it, beta2 is so close that even if you find exact cause we will highly recommend go for upgrade - and not provide <<Beta2 compatible packages anymore.

that is plan at least.

@b0rna
Copy link
Author

b0rna commented Sep 17, 2013

Will do. Looking forward to Beta 2. Okay. I'll hold off on looking for the issue until the next release. I decided to spend some extra time today as its been a while since i was able to use the unit and i did not see anyone else reporting this specific issue. Was thinking it was an issue that was specific to my setup and that i could resolve it on my own.

@mk01
Copy link
Member

mk01 commented Sep 17, 2013

as I told you at the beginning with A5, with B1 it is not much better. RPI is evolving (software around) so fast...
on top of it, I remember a terrible TYPO in Beta1 zram-swap package causing BUG leading to OOM and bye bye.

for people reporting "strange issues" on forum we provided fixed version, but nobody never confirmed so we didn't release to stable repo. It was more critical to 256 versions, but this DB of yours took in 5s 180mb res memory out.

@Koenkk
Copy link
Contributor

Koenkk commented Dec 5, 2013

Closed due to inactivity

@Koenkk Koenkk closed this as completed Dec 5, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants