optview2-cpython

Results of OptView2 analysis on CPython. The c++ compiler used was clang12, the CPython repo was cloned on March 28st 2022.

View as html via: https://ofekshilon.github.io/optview2-cpython/

This repo demonstrates OptView2 usage of PGO hotness data.

Exact steps used for htmls creation, on Ubuntu 20:

$ git clone git@github.com:python/cpython.git
$ git clone git@github.com:OfekShilon/optview2.git
$ # If you didn't setup ssh on github, replace `git@` with `https://`
$ cd cpython
$ # You might need to `sudo apt-get build-dep python3` if you're missing needed packages. More info at https://devguide.python.org/setup/#install-dependencies
$ export CC=clang-12
$ export CFLAGS="-fsave-optimization-record -fdiagnostics-show-hotness"
$ ./configure LLVM_PROFDATA=/<PATH TO>/llvm-profdata --enable-optimizations # This enables pgo and lto. 
#                          # Hopefully the LLVM_PROFDATA hack won't be needed forever: https://bugs.python.org/issue47140
$ make -j10
$ ../optview2/opt-viewer.py -j10 --output-dir <your htmls folder> --source-dir . .

# To actually install and use the built CPython you'd probably want to -
$ ./configure  --enable-optimizations  --prefix=<your folder of choice>  
$ make install    # deploy to the --prefix folder

Feel free to roam around and investigate.

To measure impact of code changes on the resulting CPython build, try pyperformance. In the script below replace ./python3 with wherever you built into (the --prefix above).

$ ./python3 -m pip install pyperformance pyperf pyaes dulwich chameleon django sqlalchemy sympy tornado mako
$ pyperformance run --python="./python3" -o py-vanilla.json > bench.out 2>&1

Perform your code changes and build, repeat the pyperformance run and dump into a different json, then:

$ pyperformance compare py-vanilla.json py-changed.json

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
assets		assets
._Include_cpython_abstract.h.html		._Include_cpython_abstract.h.html
._Include_cpython_unicodeobject.h.html		._Include_cpython_unicodeobject.h.html
._Include_internal_pycore_blocks_output_buffer.h.html		._Include_internal_pycore_blocks_output_buffer.h.html
._Include_internal_pycore_call.h.html		._Include_internal_pycore_call.h.html
._Include_internal_pycore_ceval.h.html		._Include_internal_pycore_ceval.h.html
._Include_internal_pycore_code.h.html		._Include_internal_pycore_code.h.html
._Include_internal_pycore_dict.h.html		._Include_internal_pycore_dict.h.html
._Include_internal_pycore_frame.h.html		._Include_internal_pycore_frame.h.html
._Include_internal_pycore_hashtable.h.html		._Include_internal_pycore_hashtable.h.html
._Include_internal_pycore_moduleobject.h.html		._Include_internal_pycore_moduleobject.h.html
._Include_internal_pycore_object.h.html		._Include_internal_pycore_object.h.html
._Include_internal_pycore_pyerrors.h.html		._Include_internal_pycore_pyerrors.h.html
._Include_internal_pycore_pymath.h.html		._Include_internal_pycore_pymath.h.html
._Include_internal_pycore_pystate.h.html		._Include_internal_pycore_pystate.h.html
._Include_object.h.html		._Include_object.h.html
._Modules__abc.c.html		._Modules__abc.c.html
._Modules__codecsmodule.c.html		._Modules__codecsmodule.c.html
._Modules__collectionsmodule.c.html		._Modules__collectionsmodule.c.html
._Modules__decimal_libmpdec_basearith.c.html		._Modules__decimal_libmpdec_basearith.c.html
._Modules__decimal_libmpdec_basearith.h.html		._Modules__decimal_libmpdec_basearith.h.html
._Modules__decimal_libmpdec_context.c.html		._Modules__decimal_libmpdec_context.c.html
._Modules__decimal_libmpdec_convolute.c.html		._Modules__decimal_libmpdec_convolute.c.html
._Modules__decimal_libmpdec_crt.c.html		._Modules__decimal_libmpdec_crt.c.html
._Modules__decimal_libmpdec_difradix2.c.html		._Modules__decimal_libmpdec_difradix2.c.html
._Modules__decimal_libmpdec_fnt.c.html		._Modules__decimal_libmpdec_fnt.c.html
._Modules__decimal_libmpdec_fourstep.c.html		._Modules__decimal_libmpdec_fourstep.c.html
._Modules__decimal_libmpdec_io.c.html		._Modules__decimal_libmpdec_io.c.html
._Modules__decimal_libmpdec_mpalloc.c.html		._Modules__decimal_libmpdec_mpalloc.c.html
._Modules__decimal_libmpdec_mpdecimal.c.html		._Modules__decimal_libmpdec_mpdecimal.c.html
._Modules__decimal_libmpdec_numbertheory.c.html		._Modules__decimal_libmpdec_numbertheory.c.html
._Modules__decimal_libmpdec_sixstep.c.html		._Modules__decimal_libmpdec_sixstep.c.html
._Modules__decimal_libmpdec_transpose.c.html		._Modules__decimal_libmpdec_transpose.c.html
._Modules__decimal_libmpdec_typearith.h.html		._Modules__decimal_libmpdec_typearith.h.html
._Modules__decimal_libmpdec_umodarith.h.html		._Modules__decimal_libmpdec_umodarith.h.html
._Modules__functoolsmodule.c.html		._Modules__functoolsmodule.c.html
._Modules__io__iomodule.c.html		._Modules__io__iomodule.c.html
._Modules__io_bufferedio.c.html		._Modules__io_bufferedio.c.html
._Modules__io_bytesio.c.html		._Modules__io_bytesio.c.html
._Modules__io_clinic__iomodule.c.h.html		._Modules__io_clinic__iomodule.c.h.html
._Modules__io_clinic_bufferedio.c.h.html		._Modules__io_clinic_bufferedio.c.h.html
._Modules__io_clinic_bytesio.c.h.html		._Modules__io_clinic_bytesio.c.h.html
._Modules__io_clinic_fileio.c.h.html		._Modules__io_clinic_fileio.c.h.html
._Modules__io_clinic_iobase.c.h.html		._Modules__io_clinic_iobase.c.h.html
._Modules__io_clinic_stringio.c.h.html		._Modules__io_clinic_stringio.c.h.html
._Modules__io_clinic_textio.c.h.html		._Modules__io_clinic_textio.c.h.html
._Modules__io_fileio.c.html		._Modules__io_fileio.c.html
._Modules__io_iobase.c.html		._Modules__io_iobase.c.html
._Modules__io_stringio.c.html		._Modules__io_stringio.c.html
._Modules__io_textio.c.html		._Modules__io_textio.c.html
._Modules__localemodule.c.html		._Modules__localemodule.c.html
._Modules__multiprocessing_clinic_multiprocessing.c.h.html		._Modules__multiprocessing_clinic_multiprocessing.c.h.html
._Modules__multiprocessing_clinic_posixshmem.c.h.html		._Modules__multiprocessing_clinic_posixshmem.c.h.html
._Modules__multiprocessing_clinic_semaphore.c.h.html		._Modules__multiprocessing_clinic_semaphore.c.h.html
._Modules__operator.c.html		._Modules__operator.c.html
._Modules__sqlite_clinic_connection.c.h.html		._Modules__sqlite_clinic_connection.c.h.html
._Modules__sqlite_clinic_cursor.c.h.html		._Modules__sqlite_clinic_cursor.c.h.html
._Modules__sqlite_clinic_module.c.h.html		._Modules__sqlite_clinic_module.c.h.html
._Modules__sqlite_clinic_row.c.h.html		._Modules__sqlite_clinic_row.c.h.html
._Modules__sqlite_module.h.html		._Modules__sqlite_module.h.html
._Modules__sre.c.html		._Modules__sre.c.html
._Modules__stat.c.html		._Modules__stat.c.html
._Modules__threadmodule.c.html		._Modules__threadmodule.c.html
._Modules__tracemalloc.c.html		._Modules__tracemalloc.c.html
._Modules__weakref.c.html		._Modules__weakref.c.html
._Modules_atexitmodule.c.html		._Modules_atexitmodule.c.html
._Modules_clinic__abc.c.h.html		._Modules_clinic__abc.c.h.html
._Modules_clinic__codecsmodule.c.h.html		._Modules_clinic__codecsmodule.c.h.html
._Modules_clinic__collectionsmodule.c.h.html		._Modules_clinic__collectionsmodule.c.h.html
._Modules_clinic__localemodule.c.h.html		._Modules_clinic__localemodule.c.h.html
._Modules_clinic__operator.c.h.html		._Modules_clinic__operator.c.h.html
._Modules_clinic__sre.c.h.html		._Modules_clinic__sre.c.h.html
._Modules_clinic__tracemalloc.c.h.html		._Modules_clinic__tracemalloc.c.h.html
._Modules_clinic__weakref.c.h.html		._Modules_clinic__weakref.c.h.html
._Modules_clinic_itertoolsmodule.c.h.html		._Modules_clinic_itertoolsmodule.c.h.html
._Modules_clinic_posixmodule.c.h.html		._Modules_clinic_posixmodule.c.h.html
._Modules_clinic_pwdmodule.c.h.html		._Modules_clinic_pwdmodule.c.h.html
._Modules_clinic_signalmodule.c.h.html		._Modules_clinic_signalmodule.c.h.html
._Modules_clinic_symtablemodule.c.h.html		._Modules_clinic_symtablemodule.c.h.html
._Modules_errnomodule.c.html		._Modules_errnomodule.c.html
._Modules_expat_siphash.h.html		._Modules_expat_siphash.h.html
._Modules_expat_xmlparse.c.html		._Modules_expat_xmlparse.c.html
._Modules_expat_xmlrole.c.html		._Modules_expat_xmlrole.c.html
._Modules_expat_xmltok.c.html		._Modules_expat_xmltok.c.html
._Modules_expat_xmltok_impl.c.html		._Modules_expat_xmltok_impl.c.html
._Modules_expat_xmltok_ns.c.html		._Modules_expat_xmltok_ns.c.html
._Modules_faulthandler.c.html		._Modules_faulthandler.c.html
._Modules_getbuildinfo.c.html		._Modules_getbuildinfo.c.html
._Modules_getpath.c.html		._Modules_getpath.c.html
._Modules_itertoolsmodule.c.html		._Modules_itertoolsmodule.c.html
._Modules_posixmodule.c.html		._Modules_posixmodule.c.html
._Modules_pwdmodule.c.html		._Modules_pwdmodule.c.html
._Modules_signalmodule.c.html		._Modules_signalmodule.c.html
._Modules_sre_lib.h.html		._Modules_sre_lib.h.html
._Modules_symtablemodule.c.html		._Modules_symtablemodule.c.html
._Modules_timemodule.c.html		._Modules_timemodule.c.html
._Modules_xxsubtype.c.html		._Modules_xxsubtype.c.html
._Programs__testembed.c.html		._Programs__testembed.c.html
._Programs_python.c.html		._Programs_python.c.html
._Python_clinic_sysmodule.c.h.html		._Python_clinic_sysmodule.c.h.html

License

OfekShilon/optview2-cpython

Folders and files

Latest commit

History