Support for Python 3.11 #668

etseidler · 2022-11-08T21:41:30Z

Are there any plans to support Python 3.11?

I ran my app's test suite after bumping Python from 3.9.7 to 3.11.0 and got a bunch of the following:

pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR

The text was updated successfully, but these errors were encountered:

St4rG00se · 2022-11-21T11:09:02Z

Hi,

I'm using Mutmut project for my mutation tests. This project uses Pony and since I upgraded from python 3.10.1 to python 3.11.0 I have the same issue

pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR

to reproduce it with mutmut, just run mutation testing in order to get a .mutmut-cache (SQLite file) and run mutmut html (without error you should get an html report)

Best regards

boxed · 2022-11-21T16:19:26Z

Is there are full traceback available?

St4rG00se · 2022-11-21T16:34:55Z

In my case (with mutmut)

$ mutmut html

Traceback (most recent call last):
  File "/Users/.../bin/mutmut", line 8, in <module>
    sys.exit(climain())
             ^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/mutmut/__init__.py", line 882, in wrapper
    f(*args, **kwargs)
  File "/Users/.../lib/python3.11/site-packages/mutmut/__main__.py", line 234, in html
    create_html_report(dict_synonyms)
  File "/Users/.../lib/python3.11/site-packages/mutmut/cache.py", line 88, in wrapper
    return f(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^
  File "<string>", line 2, in create_html_report
  File "/Users/.../lib/python3.11/site-packages/pony/orm/core.py", line 519, in new_func
    result = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/mutmut/cache.py", line 264, in create_html_report
    mutants = list(select(x for x in Mutant))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/pony/orm/core.py", line 5560, in select
    return make_query(args, frame_depth=cut_traceback_depth+1)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/pony/orm/core.py", line 5546, in make_query
    tree, external_names, cells = decompile(gen)
                                  ^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/pony/orm/decompiling.py", line 38, in decompile
    decompiler = Decompiler(codeobject)
                 ^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/.../lib/python3.11/site-packages/pony/orm/decompiling.py", line 156, in __init__
    decompiler.decompile()
  File "/Users/.../lib/python3.11/site-packages/pony/orm/decompiling.py", line 256, in decompile
    throw(DecompileError('Unsupported operation: %s' % opname))
  File "/Users/.../lib/python3.11/site-packages/pony/utils/utils.py", line 99, in throw
    raise exc
pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR

boxed · 2022-11-21T19:12:16Z

https://docs.python.org/3/library/dis.html#opcode-RETURN_GENERATOR seems to be the new addition to the python bytecode.

python/cpython#90567 for the issue with more information.

baldurmen · 2022-11-25T17:37:08Z

Here's a complete tracelog of the testsuite failure running 3.11, it can help.

pony_3.11_failures.txt

FAILED (failures=4, errors=3348, skipped=1)

sashaaero · 2022-12-29T10:48:51Z

Hello this is being in work. You can check it here: #671

j4hangir · 2023-01-10T21:46:06Z

Hello this is being in work. You can check it here: #671

I installed it with pip install git+https://github.com/jspricke/pony@py311, still get pony.orm.decompiling.DecompileError: Unsupported operation: RESUME when performing .order_by(lambda m: m.created)]

0xWTC · 2023-02-05T14:51:58Z

I can confirm lambdas don't work under Python 3.11 on the latest Pony version

magwas · 2023-02-25T22:09:51Z

Ran into the same while trying to use mutmut.

0xalpharush · 2023-03-13T21:37:19Z

+1

lucabravi · 2023-03-22T00:55:00Z

I can confirm lambdas don't work under Python 3.11 on the latest Pony version

+1

Nimja · 2023-04-17T11:10:18Z

+1

daoye · 2023-05-07T08:16:57Z

same problem.

python 3.11.3
pony 0.7.16
flask 2.3.2
mariadb 10.3.32

`DecompileError

pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR
Traceback (most recent call last)

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 2213, in __call__

return self.wsgi_app(environ, start_response)
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 2193, in wsgi_app

response = self.handle_exception(e)
           ^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 2190, in wsgi_app

response = self.full_dispatch_request()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 1486, in full_dispatch_request

rv = self.handle_user_exception(e)
     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 1484, in full_dispatch_request

rv = self.dispatch_request()
     ^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/flask/app.py", line 1469, in dispatch_request

return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/projects/mhong/mhong-console/app/controllers/resource.py", line 27, in list

f = select(o for o in Item)
    ^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/orm/core.py", line 5560, in select

return make_query(args, frame_depth=cut_traceback_depth+1)
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/orm/core.py", line 5546, in make_query

tree, external_names, cells = decompile(gen)
                              ^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/orm/decompiling.py", line 38, in decompile

decompiler = Decompiler(codeobject)
             ^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/orm/decompiling.py", line 156, in __init__

decompiler.decompile()
^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/orm/decompiling.py", line 256, in decompile

throw(DecompileError('Unsupported operation: %s' % opname))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/april/.virtualenvs/mh_console/lib/python3.11/site-packages/pony/utils/utils.py", line 99, in throw

raise exc
^^^^^^^^^

pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR

The debugger caught an exception in your WSGI application. You can now look at the traceback which led to the error.

To switch between the interactive traceback and the plaintext one, you can click on the "Traceback" headline. From the text traceback you can also create a paste of it. For code execution mouse-over the frame you want to debug and click on the console icon on the right side.

You can execute arbitrary Python code in the stack frames and there are some extra helpers available for introspection:

dump() shows all variables in the frame
dump(obj) dumps all that's known about the object

`

esingtse · 2023-05-16T03:13:44Z

+1

Apparently, PonyORM does not support Python version 3.11 properly yet. In case of some generator-involving expressions, such as: orm.count(row.id for row in cache.Cache); there appears the following: pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR however using construction cache.Cache.select().count() works fine. Ref: ponyorm/pony#668

lw4z · 2023-06-05T16:52:16Z

+1

aladopoulos · 2023-06-07T11:30:11Z

+1 same problem while trying to use mutmut

devarops · 2023-06-13T20:41:13Z

➕1️⃣ mutmut issue

timini · 2023-07-05T16:07:49Z

+1 trying to use mutmut here

nnsdtr · 2023-07-06T05:44:37Z

+1

ne-bknn · 2023-07-08T20:10:53Z

Came from trying to use mutmut on 3.11 on arch, installing python-pony from repo instead of pypi fixed the issue.

fluffy-critter · 2023-08-04T22:04:52Z

I'm still having trouble with Pony on 3.11 where lambdas are being used; it seems to be the same issue reported in #681, which shouldn't have been closed IMO since "regressing to Python 3.10" is not an adequate long-term fix.

Is there any attention on that particular issue? More and more of my Python environments are defaulting to 3.11 and it's getting a little painful to manage.

edmiester777 · 2023-08-14T22:35:14Z

looks to have a PR open #671 for anyone looking for this. I've just installed from that branch in the meantime, though you must accept some level of risk as tests were failing. Seems good to me.

fluffy-critter · 2023-09-20T03:49:22Z

It looks like #671 has been successfully merged. Is there any plan to do a pypi release? The current pypi is pretty outdated anyway (January 2022 at present).

kozlovsky · 2023-09-25T09:57:36Z

The official PonyORM 0.7.17 release with Python 3.11 support is out!
In addition to fixes of #671 PR, it also fixes LIST_APPEND, LIST_TO_TUPLE, and EXTENDED_ARG opcodes

fluffy-critter · 2023-09-25T17:50:02Z

Awesome! Thank you so much for all your hard work.

Apparently, PonyORM does not support Python version 3.11 properly yet. In case of some generator-involving expressions, such as: orm.count(row.id for row in cache.Cache); there appears the following: pony.orm.decompiling.DecompileError: Unsupported operation: RETURN_GENERATOR however using construction cache.Cache.select().count() works fine. Ref: ponyorm/pony#668

St4rG00se mentioned this issue Nov 21, 2022

Mutmut HTML not working with Python 3.11 boxed/mutmut#266

Closed

baldurmen mentioned this issue Nov 25, 2022

Testsuite failure with Python 3.11 spl0k/supysonic#238

Closed

drew2a mentioned this issue Jan 20, 2023

Migration to python 3.11 Tribler/tribler#7282

Open

3 tasks

fluffy-critter mentioned this issue Mar 7, 2023

Support Python 3.11 PlaidWeb/Publ#514

Closed

Daniel-I-Am mentioned this issue Jun 7, 2023

IndexError: tuple index out of range when running mutmut results boxed/mutmut#282

Closed

kozlovsky closed this as completed Sep 25, 2023

barraquito mentioned this issue Oct 25, 2023

Pony throws IndexError on results command boxed/mutmut#295

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Support for Python 3.11 #668

Support for Python 3.11 #668

etseidler commented Nov 8, 2022

St4rG00se commented Nov 21, 2022

boxed commented Nov 21, 2022

St4rG00se commented Nov 21, 2022 •

edited

Loading

boxed commented Nov 21, 2022

baldurmen commented Nov 25, 2022

sashaaero commented Dec 29, 2022

j4hangir commented Jan 10, 2023

0xWTC commented Feb 5, 2023

magwas commented Feb 25, 2023

0xalpharush commented Mar 13, 2023

lucabravi commented Mar 22, 2023

Nimja commented Apr 17, 2023

daoye commented May 7, 2023

esingtse commented May 16, 2023

lw4z commented Jun 5, 2023

aladopoulos commented Jun 7, 2023

devarops commented Jun 13, 2023 •

edited

Loading

timini commented Jul 5, 2023

nnsdtr commented Jul 6, 2023

ne-bknn commented Jul 8, 2023

fluffy-critter commented Aug 4, 2023

edmiester777 commented Aug 14, 2023

fluffy-critter commented Sep 20, 2023

kozlovsky commented Sep 25, 2023 •

edited

Loading

fluffy-critter commented Sep 25, 2023

Support for Python 3.11 #668

Support for Python 3.11 #668

Comments

etseidler commented Nov 8, 2022

St4rG00se commented Nov 21, 2022

boxed commented Nov 21, 2022

St4rG00se commented Nov 21, 2022 • edited Loading

boxed commented Nov 21, 2022

baldurmen commented Nov 25, 2022

sashaaero commented Dec 29, 2022

j4hangir commented Jan 10, 2023

0xWTC commented Feb 5, 2023

magwas commented Feb 25, 2023

0xalpharush commented Mar 13, 2023

lucabravi commented Mar 22, 2023

Nimja commented Apr 17, 2023

daoye commented May 7, 2023

esingtse commented May 16, 2023

lw4z commented Jun 5, 2023

aladopoulos commented Jun 7, 2023

devarops commented Jun 13, 2023 • edited Loading

timini commented Jul 5, 2023

nnsdtr commented Jul 6, 2023

ne-bknn commented Jul 8, 2023

fluffy-critter commented Aug 4, 2023

edmiester777 commented Aug 14, 2023

fluffy-critter commented Sep 20, 2023

kozlovsky commented Sep 25, 2023 • edited Loading

fluffy-critter commented Sep 25, 2023

St4rG00se commented Nov 21, 2022 •

edited

Loading

devarops commented Jun 13, 2023 •

edited

Loading

kozlovsky commented Sep 25, 2023 •

edited

Loading