Max recursion level exceeded by playlist_update_in_progress callback #165

DavisNT · 2015-06-22T19:00:27Z

When using pyspotify==2.0.0 with Mopidy==1.0.5 and Mopidy-Spotify==2.0.0 (commit 70f27932cb in develop) Mopidy crashes after some time with stacktrace:

From cffi callback <function playlist_update_in_progress at 0x383acb0>:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 647, in playlist_update_in_progress
    spotify._session_instance, sp_playlist, add_ref=True)
  File "/usr/local/lib/python2.7/dist-packages/spotify/__init__.py", line 58, in wrapper
    return f(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 47, in _cached
    playlist = Playlist(session, sp_playlist=sp_playlist, add_ref=add_ref)
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 68, in __init__
    lib.sp_playlist_add_ref(sp_playlist)
  File "/usr/local/lib/python2.7/dist-packages/spotify/__init__.py", line 57, in wrapper
    with _lock:
  File "/usr/lib/python2.7/threading.py", line 126, in acquire
    self._note("%s.acquire(%s): recursive success", self, blocking)
RuntimeError: maximum recursion depth exceeded
From cffi callback <function playlist_update_in_progress at 0x383acb0>:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 647, in playlist_update_in_progress
    spotify._session_instance, sp_playlist, add_ref=True)
  File "/usr/local/lib/python2.7/dist-packages/spotify/__init__.py", line 58, in wrapper
    return f(*args, **kwargs)
  File "/usr/lib/python2.7/threading.py", line 155, in __exit__
    self.release()
  File "/usr/lib/python2.7/threading.py", line 152, in release
    self._note("%s.release(): non-final release", self)
RuntimeError: maximum recursion depth exceeded
From cffi callback <function playlist_update_in_progress at 0x383acb0>:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 647, in playlist_update_in_progress
    spotify._session_instance, sp_playlist, add_ref=True)
  File "/usr/local/lib/python2.7/dist-packages/spotify/__init__.py", line 58, in wrapper
    return f(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 47, in _cached
    playlist = Playlist(session, sp_playlist=sp_playlist, add_ref=add_ref)
  File "/usr/local/lib/python2.7/dist-packages/spotify/playlist.py", line 68, in __init__
    lib.sp_playlist_add_ref(sp_playlist)
  File "/usr/local/lib/python2.7/dist-packages/spotify/__init__.py", line 57, in wrapper
    with _lock:
RuntimeError: maximum recursion depth exceeded while calling a Python object
*** glibc detected *** /usr/bin/python: double free or corruption (!prev): 0x07234860 ***

The problem occurred after playing Spotify and local tracks on Mopidy and afterwards stopping playback and leaving Mopidy running for some hours. This was observed several times ("randomly" without trying to reproduce the issue or understand what caused it). This was the first time this issue happened after enabling logging of Mopidy stdout/stderr to file (the exception/stacktrace is not written to Mopidy logfile). This happened on Raspbian (Raspberry Pi model B).

The text was updated successfully, but these errors were encountered:

jodal · 2015-06-22T20:24:07Z

This looks like the same issue as in #122 and #153 surfacing again. If someone can narrow down how to reproduce this consistently I'll hopefully be able to fix it.

jodal · 2015-06-26T12:11:02Z

This is potentially fixed by 5a6470d. Are you able to test with it? pip install pyspotify==dev should install a version with that fix.

DavisNT · 2015-06-26T21:01:39Z

Thank you very much! 👍

I have installed latest Mopidy-Spotify and pyspotify develop versions by:

pip install -U https://github.com/mopidy/mopidy-spotify/archive/develop.zip
pip install -U https://github.com/mopidy/pyspotify/archive/v2.x/develop.zip

pip install -U pyspotify==dev had failed for me. I have updated other Python packages to their latest PyPI published versions as well (Mopidy-1.0.7 Mopidy-Dirble-1.1.2 cachetools-1.0.3 humanfriendly-1.29 pyasn1-0.1.8 pyasn1-modules-0.0.6 pyspotify-2.0.0 setuptools-18.0.1).

I will keep Mopidy running for a few days and let you know.
Previously when trying Mopidy-Spotify-2.0.0 and pyspotify -2.0.0 Mopidy crashed within a day.

jodal · 2015-06-26T22:56:30Z

We managed to reproduce the issue with this fix in place too. The hunt
continues ☺

On Fri, Jun 26, 2015, 23:01 Dāvis Mošenkovs notifications@github.com
wrote:

Thank you very much! [image: 👍]

I have installed latest Mopidy-Spotify and pyspotify develop versions by:

pip install -U https://github.com/mopidy/mopidy-spotify/archive/develop.zip
pip install -U https://github.com/mopidy/pyspotify/archive/v2.x/develop.zip

pip install -U pyspotify==dev had failed for me. I have updated other
Python packages to their latest PyPI published versions as well
(Mopidy-1.0.7 Mopidy-Dirble-1.1.2 cachetools-1.0.3 humanfriendly-1.29
pyasn1-0.1.8 pyasn1-modules-0.0.6 pyspotify-2.0.0 setuptools-18.0.1).

I will keep Mopidy running for a few days and let you know.
Previously when trying Mopidy-Spotify 2.0.0 and pyspotify 2.0.0 Mopidy
crashed within a day.

—
Reply to this email directly or view it on GitHub
#165 (comment).

DavisNT · 2015-07-12T13:18:14Z

Couldn't there be a bug in libspotify - calling playlist_update_in_progress() callback from sp_playlist_add_ref() if it is called while processing this callback?

Hopefully, this will remove the precondition for bug #122, #153, and #165.

jodal · 2015-07-17T11:44:34Z

I believe commit e06b96a might have fixed this. Please comment if this is not true, and this should be reopened.

DavisNT · 2015-07-17T22:36:05Z

Thank you very much! I will test this and let you know!

DavisNT · 2015-07-22T18:10:23Z

I have experienced some Mopidy crashed while using commit e06b96a. Those crashes did not write anything in stdout/stderr or mopidy.log.
Now I will update to pyspotify==2.0.1 and latest Mopidy-Spotify commit and continue testing.

kingosticks · 2015-07-23T10:07:27Z

I don't see this particular max recursion error any more. I do still get segmentation faults during startup but they may be due to something else.

EDIT: although this one looks related to the recent fix. And this new scary looking one.

DavisNT · 2015-07-30T08:32:32Z

I still get Mopidy crashes without anything written to stdout/stderr or Mopidy logs. I will enable core dumps to get some details.

jodal · 2015-07-30T08:33:33Z

Yeah, ditto. It seems like the max recursion issue is gone, but we have at least one other segfault that we all three have experienced now.

kingosticks · 2015-07-30T10:20:42Z

I get two different ones. One related to starred playlists when my
webclient fetches the list of playlists and one when stopping mopidy and it
tries to log out.
On 30 Jul 2015 09:33, "Stein Magnus Jodal" notifications@github.com wrote:

Yeah, ditto. It seems like the max recursion issue is gone, but we have at
least one other segfault that we all three have experienced now.

—
Reply to this email directly or view it on GitHub
#165 (comment).

jodal · 2015-07-30T10:21:23Z

Can you open two new issues with all the information you have on them?

kingosticks · 2015-07-30T10:22:32Z

I shall do so when I return from holiday next week.
On 30 Jul 2015 11:21, "Stein Magnus Jodal" notifications@github.com wrote:

Can you open two new issues with all the information you have on them?

—
Reply to this email directly or view it on GitHub
#165 (comment).

jodal added the bug label Jun 22, 2015

jodal changed the title ~~Creashes Mopidy when left unattended for a while~~ Max recursion level exceeded by playlist_update_in_progress callback Jun 22, 2015

jodal added a commit that referenced this issue Jul 17, 2015

playlist: Register callbacks iff there is an event listener

e06b96a

Hopefully, this will remove the precondition for bug #122, #153, and #165.

jodal closed this Jul 17, 2015

jodal self-assigned this Jul 17, 2015

Repository owner locked and limited conversation to collaborators Nov 9, 2015

jodal / pyspotify Public

Max recursion level exceeded by playlist_update_in_progress callback #165

Max recursion level exceeded by playlist_update_in_progress callback #165

DavisNT commented Jun 22, 2015

jodal commented Jun 22, 2015

jodal commented Jun 26, 2015

DavisNT commented Jun 26, 2015

jodal commented Jun 26, 2015

DavisNT commented Jul 12, 2015

jodal commented Jul 17, 2015

DavisNT commented Jul 17, 2015

DavisNT commented Jul 22, 2015

kingosticks commented Jul 23, 2015

DavisNT commented Jul 30, 2015

jodal commented Jul 30, 2015

kingosticks commented Jul 30, 2015

jodal commented Jul 30, 2015

kingosticks commented Jul 30, 2015

jodal / pyspotify Public

Max recursion level exceeded by playlist_update_in_progress callback #165

Max recursion level exceeded by playlist_update_in_progress callback #165

Comments

DavisNT commented Jun 22, 2015

jodal commented Jun 22, 2015

jodal commented Jun 26, 2015

DavisNT commented Jun 26, 2015

jodal commented Jun 26, 2015

DavisNT commented Jul 12, 2015

jodal commented Jul 17, 2015

DavisNT commented Jul 17, 2015

DavisNT commented Jul 22, 2015

kingosticks commented Jul 23, 2015

DavisNT commented Jul 30, 2015

jodal commented Jul 30, 2015

kingosticks commented Jul 30, 2015

jodal commented Jul 30, 2015

kingosticks commented Jul 30, 2015