Skip to content

Latest commit

 

History

History
188 lines (111 loc) · 7.01 KB

troubleshooting.rst

File metadata and controls

188 lines (111 loc) · 7.01 KB
Raw

Troubleshooting

This chapter contains common issues and how to diagnose them.

Database connection hangs

Check active transactions:

SELECT * FROM pg_locks pl LEFT JOIN pg_stat_activity psa ON pl.pid = psa.pid;

-> should be empty for no-activity PostgreSQL instance.

Check if you have stale Python processes (test runners, etc.):

ps -af|grep python

Example:

501 37326 13026   0  5:30PM ??         0:02.80 /Users/mikko/code/trees/venv/bin/python /Applications/PyCharm.app/Contents/helpers/pycharm/pytestrunner.py -p pytest_teamcity /Users/mikko/code/trees/trees/trees/tests -s -k test_create_review --ini test.ini

-> Any test should not be running - what we have here is a buggy PyCharm test runner which does not know when to quit. So let's teach it some habits:

kill -SIGKILL 37326

More info

Dropping database sessions

In the case you have dangling PSQL sessions and you need to perform operations these sessions prevent you can force the session drop:

ws-db-shell ws://conf/staging.ini

And then:

SELECT pg_terminate_backend(pg_stat_activity.pid) FROM pg_stat_activity WHERE pg_stat_activity.datname = 'TARGET_DB' AND pid <> pg_backend_pid();

Notebook doesn't get context variables

If your IPython Notebook (web) fails to start with the default variables filled it is usually due to ImportError in the variable definitions.

  • Log in to your server

  • Find the IPython Notebook startup file, usually located like:

    /srv/pyramid/myapp/notebooks/user-1/.ipython/profile_default/startup/startup.py

  • Execute startup.py directly from a Notebook prompt

>>> exec(open("/srv/pyramid/myapp/notebooks/user-1/.ipython/profile_default/startup/startup.py").read())

This should show the actual error which causes the context information failure. Then fix your startup script.

Table 'xxx' is already defined for this MetaData instance during unit tests

You see SQLAlchemy error like below during the test run:

sqlalchemy.exc.InvalidRequestError: Table 'xxx' is already defined for this MetaData instance.  Specify 'extend_existing=True' to redefine options and columns on an existing Table object.

This happens due to earlier error with SQLAlchemy initialization. Scroll up in the logs to see the actual error.

ImportError: No module named websauna.system

Example:

>>> import websauna.system
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named 'websauna.system'

This is due to clash in different Python namespace systems (setup.py, easy_install, pip). If you enable edit mode for websauna you need to enable it for websauna.system.core.viewconfig package too.

Solution:

pip uninstall websauna
pip uninstall websauna.system.core.viewconfig
pip install -e "git+git@github.com:websauna/websauna.git#egg=websauna"
pip install -e "git+git@github.com:websauna/websauna.system.core.viewconfig.git#egg=websauna.system.core.viewconfig"

Debugging SQLAlchemy connection pooling

To see the internal state of connection pooling to debug the connection leakage you fiddle with the pool in dbsession terminator:

def create_transaction_manager_aware_dbsession(request: Request) -> Session:
    """Defaut database factory for Websauna.

    Looks up database settings from the INI and creates an SQLALchemy session based on the configuration. The session is terminated on the HTTP request finalizer.
    """
    dbsession = create_dbsession(request.registry.settings)

    def terminate_session(request):
        pool = request.dbsession.connection().connection._pool
        dbsession.close()
        print(pool.status())

    request.add_finished_callback(terminate_session)

    return dbsession

You'll get output like:

Pool size: 4  Connections in pool: 1 Current Overflow: -3 Current Checked out connections: 0

Cannot build docs: NameError: name 'websauna' is not defined

You get this error when you run:

make html
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 914, in document_members
    check_module=members_check_module and not isattr)
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 979, in generate
    sig = self.format_signature()
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 1289, in format_signature
    return DocstringSignatureMixin.format_signature(self)
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 1175, in format_signature
    return Documenter.format_signature(self)
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 641, in format_signature
    self.object, self.options, args, retann)
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/application.py", line 593, in emit_firstresult
    for result in self.emit(event, *args):
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/application.py", line 589, in emit
    results.append(callback(self, *args))
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx_autodoc_typehints.py", line 55, in process_signature
    return formatargspec(obj, *argspec[:-1]), None
  File "/Users/mikko/code/wattcoin/venv/lib/python3.5/site-packages/sphinx/ext/autodoc.py", line 371, in formatargspec
    if typing and hasattr(function, '__code__') else {})
  File "/usr/local/Cellar/python3/3.5.2_1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/typing.py", line 1182, in get_type_hints
    value = _eval_type(value, globalns, localns)
  File "/usr/local/Cellar/python3/3.5.2_1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/typing.py", line 290, in _eval_type
    return t._eval_type(globalns, localns)
  File "/usr/local/Cellar/python3/3.5.2_1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/typing.py", line 177, in _eval_type
    eval(self.__forward_code__, globalns, localns),
  File "<string>", line 1, in <module>
NameError: name 'websauna' is not defined

You have circular imports in your modules and Sphinx autodocs typehinting. Fix this by laying out your code so that you don't have circular imports.