Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check existence of connection_file before writing #1127

Merged
merged 6 commits into from Jun 23, 2023

Conversation

fecet
Copy link
Contributor

@fecet fecet commented Jun 21, 2023

I find the connection file kernel-<uuid>.json would be created twice when starting and connecting kernel. I thought this is not as expected since the first time kernel created:

https://github.com/jupyter/jupyter_client/blob/57b11c36b1eceae138cfc6044a2274e2e1caa135/jupyter_client/connect.py#L488

do check this. But the second call, i.e., come from the kernelapp doesn't. Thus that json file would overwrite the previous one. I don't know the general order though, this order is I observed when open a new jupyter notebook.

And this time kernelname was not passed. So I never find kernelname in connection file, I believe this was a bug.

@blink1073
Copy link
Member

Hi @fecet, I think the right fix is to make KernelApp pass the kernel_name to write_connection_file, from the KERNEL_NAME constant.

@fecet
Copy link
Contributor Author

fecet commented Jun 21, 2023

But why we have to write this again? Or can we just read the kernel file if exists, and only update the difference? I want this because of jupyter/jupyter_client#953

@blink1073
Copy link
Member

Hmm, I think there is a deeper problem then if we're tying to write the connection file from two different kernel managers in practice. That guard is there to prevent a single kernel manager from overwriting its own file.

@fecet
Copy link
Contributor Author

fecet commented Jun 21, 2023

That guard is there to prevent a single kernel manager from overwriting its own file.

I'm a normal jupyter user so may lack many background, but I found the kernelapp is actually overwritting the connection file written by jupyter_client?

Also the kernel_name written by jupyter_client seems used CONDA_PREFIX (still don't know why though) KERNEL_NAME = "python%i" % sys.version_info[0] maybe too ambiguous

@blink1073
Copy link
Member

Can you please give the output of jupyter troubleshoot?

@fecet
Copy link
Contributor Author

fecet commented Jun 22, 2023

$PATH:
	/home/rok/.conda/envs/tq/bin
	/home/rok/.nvm/versions/node/v16.17.0/bin
	/home/rok/.nix-profile/bin
	/nix/var/nix/profiles/default/bin
	/home/rok/.elan/bin
	/home/rok/.TinyTeX
	/home/rok/go/bin
	/home/rok/.cargo/bin
	/home/rok/.local/bin
	/home/rok/bin
	/usr/NX/bin
	/usr/local/cuda/bin
	/usr/local/bin
	/home/rok/.nvm/versions/node/v16.17.0/bin
	/home/rok/.nix-profile/bin
	/nix/var/nix/profiles/default/bin
	/opt/mambaforge/condabin
	/home/rok/.elan/bin
	/home/rok/.TinyTeX
	/home/rok/go/bin
	/home/rok/.cargo/bin
	/home/rok/.local/bin
	/home/rok/bin
	/usr/NX/bin
	/usr/local/cuda/bin
	/usr/local/bin
	/usr/local/sbin
	/usr/local/bin
	/usr/bin
	/opt/mambaforge/bin
	/home/rok/mambaforge/bin
	/opt/android-sdk/platform-tools
	/opt/cuda/bin
	/opt/cuda/nsight_compute
	/opt/cuda/nsight_systems/bin
	/home/rok/.dotnet/tools
	/usr/lib/jvm/default/bin
	/usr/bin/site_perl
	/usr/bin/vendor_perl
	/usr/bin/core_perl
	/opt/mambaforge/bin
	/home/rok/mambaforge/bin
	/opt/android-sdk/platform-tools
	/opt/cuda/bin
	/opt/cuda/nsight_compute
	/opt/cuda/nsight_systems/bin

sys.path:
	/home/rok/.conda/envs/tq/bin
	/home/rok/.conda/envs/tq/lib/python310.zip
	/home/rok/.conda/envs/tq/lib/python3.10
	/home/rok/.conda/envs/tq/lib/python3.10/lib-dynload
	/home/rok/.conda/envs/tq/lib/python3.10/site-packages
	/home/rok/Nutstore Files/codes/ipykernel
	/home/rok/Nutstore Files/codes/jupyter_client
	/home/rok/Nutstore Files/codes/idea/chatgpt
	/home/rok/Nutstore Files/codes/idea/fengshenbang-lm

sys.executable:
	/home/rok/.conda/envs/tq/bin/python3.10

sys.version:
	3.10.9 | packaged by conda-forge | (main, Feb  2 2023, 20:20:04) [GCC 11.3.0]

platform.platform():
	Linux-6.3.6-arch1-1-x86_64-with-glibc2.37

which -a jupyter:
	/home/rok/.conda/envs/tq/bin/jupyter
	/home/rok/.local/bin/jupyter
	/home/rok/.local/bin/jupyter

pip list:
	Package                            Version              Editable project location
	---------------------------------- -------------------- -----------------------------------------------------
	absl-py                            1.4.0
	accelerate                         0.17.1
	aiofiles                           23.1.0
	aiohttp                            3.8.4
	aiorwlock                          1.3.0
	aiosignal                          1.3.1
	altair                             4.2.2
	anyio                              3.6.2
	appdirs                            1.4.4
	argcomplete                        3.0.8
	argon2-cffi                        21.3.0
	argon2-cffi-bindings               21.2.0
	arrow                              1.2.3
	asttokens                          2.2.1
	async-generator                    1.10
	async-lru                          2.0.2
	async-timeout                      4.0.2
	attrs                              22.2.0
	Babel                              2.12.1
	backcall                           0.2.0
	backoff                            2.2.1
	backports.functools-lru-cache      1.6.4
	beautifulsoup4                     4.11.2
	binaryornot                        0.4.4
	bitsandbytes                       0.37.1
	bleach                             6.0.0
	blessed                            1.20.0
	brotlipy                           0.7.0
	cachetools                         5.3.0
	certifi                            2022.12.7
	cffi                               1.15.1
	chardet                            5.1.0
	charset-normalizer                 2.1.1
	chatgpt                            0.0.1                /home/rok/Nutstore Files/codes/idea/chatgpt
	click                              8.1.3
	cloudpickle                        2.2.1
	colorama                           0.4.6
	coloredlogs                        15.0.1
	colorful                           0.5.5
	comm                               0.1.3
	contextlib2                        21.6.0
	contourpy                          1.0.7
	cookiecutter                       2.1.1
	cryptography                       39.0.2
	cycler                             0.11.0
	dataclasses                        0.8
	datasets                           2.13.0
	debugpy                            1.6.7
	decorator                          5.1.1
	defusedxml                         0.7.1
	diffusers                          0.16.0.dev0          /home/rok/Nutstore Files/codes/diffusers
	dill                               0.3.6
	distlib                            0.3.6
	dm-tree                            0.1.8
	docker-pycreds                     0.4.0
	einops                             0.6.1
	emoji                              2.4.0
	entrypoints                        0.4
	et-xmlfile                         1.1.0
	evaluate                           0.4.0                /home/rok/.conda/envs/tq/lib/python3.10/site-packages
	exceptiongroup                     1.1.1
	executing                          1.2.0
	fair-esm                           2.0.0
	fastapi                            0.95.0
	fastjsonschema                     2.16.3
	fengshen-inner                     0.0.1                /home/rok/Nutstore Files/codes/idea/fengshenbang-lm
	ffmpy                              0.3.0
	filelock                           3.12.0
	fonttools                          4.39.2
	fqdn                               1.5.1
	frozenlist                         1.3.3
	fsspec                             2023.3.0
	gitdb                              4.0.10
	GitPython                          3.1.31
	googleapis-common-protos           1.59.0
	gpustat                            1.1
	gradio                             3.22.1
	greenlet                           2.0.2
	grpcio                             1.51.3
	Gymnasium                          0.26.3
	gymnasium-notices                  0.0.1
	h11                                0.14.0
	httpcore                           0.16.3
	httpx                              0.23.3
	huggingface-hub                    0.14.1
	humanfriendly                      10.0
	idna                               3.4
	imageio                            2.28.0
	importlib-metadata                 6.0.1
	ipdb                               0.13.13
	ipykernel                          6.23.2               /home/rok/Nutstore Files/codes/ipykernel
	ipython                            8.12.0
	ipython-genutils                   0.2.0
	ipywidgets                         8.0.5
	isoduration                        20.11.0
	jedi                               0.18.2
	jieba                              0.42.1
	jieba-fast                         0.53
	Jinja2                             3.1.2
	jinja2-time                        0.2.0
	joblib                             1.2.0
	json5                              0.9.14
	jsonpointer                        2.3
	jsonschema                         4.17.3
	jupynium                           0.2.1.dev16+g4f2c1ea
	jupyter_client                     8.2.0                /home/rok/Nutstore Files/codes/jupyter_client
	jupyter-console                    6.6.3
	jupyter_core                       5.3.0
	jupyter-events                     0.6.3
	jupyter-lsp                        2.2.0
	jupyter_server                     2.5.0
	jupyter_server_terminals           0.4.4
	jupyterlab                         4.0.2
	jupyterlab-pygments                0.2.2
	jupyterlab_server                  2.23.0
	jupyterlab-widgets                 3.0.6
	kiwisolver                         1.4.4
	lazy_loader                        0.2
	Levenshtein                        0.21.0
	lightgbm                           3.3.5
	lightning-utilities                0.8.0
	linkify-it-py                      2.0.0
	llvmlite                           0.40.0
	loralib                            0.1.1
	lz4                                4.3.2
	Markdown                           3.4.3
	markdown-it-py                     2.2.0
	MarkupSafe                         2.1.2
	matplotlib                         3.7.1
	matplotlib-inline                  0.1.6
	mdit-py-plugins                    0.3.3
	mdurl                              0.1.2
	mistune                            2.0.5
	ml-collections                     0.1.1
	moxtrice                           1.0.2.dev2           /home/rok/Nutstore Files/codes/moxtrice
	mpmath                             1.3.0
	msgpack                            1.0.5
	multidict                          6.0.4
	multiprocess                       0.70.14
	nbclassic                          0.5.3
	nbclient                           0.7.2
	nbconvert                          7.2.10
	nbformat                           5.7.3
	nest-asyncio                       1.5.6
	networkx                           3.1
	notebook                           7.0.0rc0
	notebook_shim                      0.2.2
	numba                              0.57.0
	numpy                              1.24.2
	nvidia-ml-py                       11.525.112
	oauthlib                           3.2.2
	openai                             0.27.2
	OpenAIAuth                         0.3.2
	opencensus-context                 0.1.3
	openpyxl                           3.1.2
	opentelemetry-proto                1.17.0
	opentelemetry-semantic-conventions 0.38b0
	orjson                             3.8.7
	outcome                            1.2.0
	packaging                          23.0
	pandas                             1.5.3
	pandocfilters                      1.5.0
	parso                              0.8.3
	pathtools                          0.1.2
	pathvalidate                       3.0.0
	patsy                              0.5.3
	peft                               0.3.0.dev0
	persist-queue                      0.8.0
	pexpect                            4.8.0
	pickleshare                        0.7.5
	Pillow                             9.4.0
	pip                                23.0.1
	pipx                               1.2.0
	platformdirs                       3.2.0
	plotly                             5.14.1
	prometheus-client                  0.16.0
	prompt-toolkit                     3.0.38
	protobuf                           3.19.6
	psutil                             5.9.4
	ptyprocess                         0.7.0
	pudb                               2022.1.3
	pure-eval                          0.2.2
	py-spy                             0.3.14
	pyarrow                            11.0.0
	pyasn1                             0.5.0
	pyasn1-modules                     0.3.0
	pycparser                          2.21
	pydantic                           1.10.6
	pyDeprecate                        0.3.2
	pydub                              0.25.1
	Pygments                           2.15.0
	pynvim                             0.4.3
	pyOpenSSL                          23.0.0
	pyparsing                          3.0.9
	pyrsistent                         0.19.3
	PySocks                            1.7.1
	python-dateutil                    2.8.2
	python-json-logger                 2.0.7
	python-Levenshtein                 0.21.0
	python-multipart                   0.0.6
	python-slugify                     8.0.1
	pytorch-lightning                  2.0.2
	pytz                               2022.7.1
	PyWavelets                         1.4.1
	PyYAML                             6.0
	pyzmq                              25.0.2
	qtconsole                          5.4.2
	QtPy                               2.3.1
	rapidfuzz                          3.0.0
	ray                                2.4.0
	ray-cpp                            2.3.1
	regex                              2022.10.31
	requests                           2.28.2
	requests-oauthlib                  1.3.1
	responses                          0.18.0
	rfc3339-validator                  0.1.4
	rfc3986                            1.5.0
	rfc3986-validator                  0.1.1
	rsa                                4.9
	ruff                               0.0.270
	sacremoses                         0.0.53
	safetensors                        0.3.0
	scikit-image                       0.20.0
	scikit-learn                       1.2.2
	scipy                              1.10.1
	seaborn                            0.12.2
	selenium                           4.9.1
	Send2Trash                         1.8.0
	sentencepiece                      0.1.97
	sentry-sdk                         1.20.0
	setproctitle                       1.3.2
	setuptools                         67.6.0
	six                                1.16.0
	skglm                              0.2
	smart-open                         6.3.0
	smmap                              5.0.0
	sniffio                            1.3.0
	socksio                            1.0.0
	sortedcontainers                   2.4.0
	soupsieve                          2.4
	speedtest-cli                      2.1.3
	stack-data                         0.6.2
	starlette                          0.26.1
	statsmodels                        0.14.0
	sympy                              1.12
	tabulate                           0.9.0
	tenacity                           8.2.2
	tensorboard-data-server            0.7.0
	tensorboard-plugin-wit             1.8.1
	tensorboardX                       2.6
	terminado                          0.17.1
	text-unidecode                     1.3
	thefuzz                            0.19.0
	threadpoolctl                      3.1.0
	tifffile                           2023.4.12
	tiktoken                           0.3.2
	tinycss2                           1.2.1
	tokenizers                         0.13.2
	tomli                              2.0.1
	toolz                              0.12.0
	torch                              1.13.1.post200
	torchaudio                         0.13.1
	torchmetrics                       0.11.4
	torchvision                        0.14.1a0+59d9189
	tornado                            6.2
	tqdm                               4.65.0
	traitlets                          5.9.0
	transformers                       4.29.1
	trio                               0.22.0
	trio-websocket                     0.10.2
	trl                                0.4.1                /home/rok/.conda/envs/tq/lib/python3.10/site-packages
	typer                              0.7.0
	typing_extensions                  4.5.0
	uc-micro-py                        1.0.1
	uri-template                       1.2.0
	urllib3                            1.26.15
	urwid                              2.1.2
	urwid-readline                     0.13
	userpath                           1.8.0
	uvicorn                            0.21.1
	verboselogs                        1.7
	virtualenv                         20.21.0
	wandb                              0.15.2
	wcwidth                            0.2.6
	webcolors                          1.12
	webencodings                       0.5.1
	websocket-client                   1.5.1
	websockets                         10.4
	Werkzeug                           2.2.3
	wheel                              0.40.0
	widgetsnbextension                 4.0.6
	wrapt                              1.15.0
	wsproto                            1.2.0
	xxhash                             0.0.0
	yarl                               1.8.2
	zipp                               3.15.0

conda list:
	# packages in environment at /home/rok/.conda/envs/tq:
	#
	# Name                    Version                   Build  Channel
	_libgcc_mutex             0.1                 conda_forge    conda-forge
	_openmp_mutex             4.5                  2_kmp_llvm    conda-forge
	absl-py                   1.4.0                    pypi_0    pypi
	accelerate                0.17.1                   pypi_0    pypi
	aiofiles                  23.1.0                   pypi_0    pypi
	aiohttp                   3.8.4           py310h1fa729e_0    conda-forge
	aiorwlock                 1.3.0                    pypi_0    pypi
	aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
	altair                    4.2.2                    pypi_0    pypi
	anyio                     3.6.2                    pypi_0    pypi
	appdirs                   1.4.4                    pypi_0    pypi
	argcomplete               3.0.8                    pypi_0    pypi
	argon2-cffi               21.3.0                   pypi_0    pypi
	argon2-cffi-bindings      21.2.0                   pypi_0    pypi
	arrow                     1.2.3                    pypi_0    pypi
	arrow-cpp                 11.0.0          ha770c72_13_cpu    conda-forge
	asttokens                 2.2.1              pyhd8ed1ab_0    conda-forge
	async-generator           1.10                     pypi_0    pypi
	async-lru                 2.0.2                    pypi_0    pypi
	async-timeout             4.0.2              pyhd8ed1ab_0    conda-forge
	attrs                     22.2.0             pyh71513ae_0    conda-forge
	aws-c-auth                0.6.26               hdca2abe_0    conda-forge
	aws-c-cal                 0.5.21               h48707d8_2    conda-forge
	aws-c-common              0.8.14               h0b41bf4_0    conda-forge
	aws-c-compression         0.2.16               h03acc5a_5    conda-forge
	aws-c-event-stream        0.2.20               h00877a2_4    conda-forge
	aws-c-http                0.7.5                hf342b9f_5    conda-forge
	aws-c-io                  0.13.19              hef0810e_1    conda-forge
	aws-c-mqtt                0.8.6               h337b09f_11    conda-forge
	aws-c-s3                  0.2.7                hde0a405_0    conda-forge
	aws-c-sdkutils            0.1.8                h03acc5a_0    conda-forge
	aws-checksums             0.1.14               h03acc5a_5    conda-forge
	aws-crt-cpp               0.19.8              h85f3b07_11    conda-forge
	aws-sdk-cpp               1.10.57              h17c43bd_8    conda-forge
	babel                     2.12.1                   pypi_0    pypi
	backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
	backoff                   2.2.1                    pypi_0    pypi
	backports                 1.0                pyhd8ed1ab_3    conda-forge
	backports.functools_lru_cache 1.6.4              pyhd8ed1ab_0    conda-forge
	beautifulsoup4            4.11.2                   pypi_0    pypi
	binaryornot               0.4.4                    pypi_0    pypi
	binutils                  2.39                 hdd6e379_1    conda-forge
	binutils_impl_linux-64    2.39                 he00db2b_1    conda-forge
	binutils_linux-64         2.39                h5fc0e48_11    conda-forge
	bitsandbytes              0.37.1                   pypi_0    pypi
	bleach                    6.0.0                    pypi_0    pypi
	blessed                   1.20.0                   pypi_0    pypi
	brotlipy                  0.7.0           py310h5764c6d_1005    conda-forge
	bzip2                     1.0.8                h7f98852_4    conda-forge
	c-ares                    1.18.1               h7f98852_0    conda-forge
	c-compiler                1.5.2                h0b41bf4_0    conda-forge
	ca-certificates           2022.12.7            ha878542_0    conda-forge
	cachetools                5.3.0                    pypi_0    pypi
	certifi                   2022.12.7          pyhd8ed1ab_0    conda-forge
	cffi                      1.15.1          py310h255011f_3    conda-forge
	chardet                   5.1.0                    pypi_0    pypi
	charset-normalizer        2.1.1              pyhd8ed1ab_0    conda-forge
	chatgpt                   0.0.1                     dev_0    <develop>
	click                     8.1.3           unix_pyhd8ed1ab_2    conda-forge
	cloudpickle               2.2.1                    pypi_0    pypi
	colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
	coloredlogs               15.0.1                   pypi_0    pypi
	colorful                  0.5.5                    pypi_0    pypi
	comm                      0.1.3                    pypi_0    pypi
	compilers                 1.5.2                ha770c72_0    conda-forge
	contextlib2               21.6.0                   pypi_0    pypi
	contourpy                 1.0.7                    pypi_0    pypi
	cookiecutter              2.1.1                    pypi_0    pypi
	cryptography              39.0.2          py310h34c0648_0    conda-forge
	cuda                      11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-cccl                 11.7.58              hc415cf5_0    nvidia/label/cuda-11.7.0
	cuda-command-line-tools   11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-compiler             11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-cudart               11.7.60              h9538e0e_0    nvidia/label/cuda-11.7.0
	cuda-cudart-dev           11.7.60              h6a7c232_0    nvidia/label/cuda-11.7.0
	cuda-cuobjdump            11.7.50              h28cc80a_0    nvidia/label/cuda-11.7.0
	cuda-cupti                11.7.50              hb6f9eaf_0    nvidia/label/cuda-11.7.0
	cuda-cuxxfilt             11.7.50              hb365495_0    nvidia/label/cuda-11.7.0
	cuda-demo-suite           11.7.50                       0    nvidia/label/cuda-11.7.0
	cuda-documentation        11.7.50                       0    nvidia/label/cuda-11.7.0
	cuda-driver-dev           11.7.60                       0    nvidia/label/cuda-11.7.0
	cuda-gdb                  11.7.50              h4a0ac72_0    nvidia/label/cuda-11.7.0
	cuda-libraries            11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-libraries-dev        11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-memcheck             11.7.50              hc446b2b_0    nvidia/label/cuda-11.7.0
	cuda-nsight               11.7.50                       0    nvidia/label/cuda-11.7.0
	cuda-nsight-compute       11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-nvcc                 11.7.64                       0    nvidia/label/cuda-11.7.0
	cuda-nvdisasm             11.7.50              h5bd0695_0    nvidia/label/cuda-11.7.0
	cuda-nvml-dev             11.7.50              h3af1343_0    nvidia/label/cuda-11.7.0
	cuda-nvprof               11.7.50              h7a2404d_0    nvidia/label/cuda-11.7.0
	cuda-nvprune              11.7.50              h7add7b4_0    nvidia/label/cuda-11.7.0
	cuda-nvrtc                11.7.50              hd0285e0_0    nvidia/label/cuda-11.7.0
	cuda-nvrtc-dev            11.7.50              heada363_0    nvidia/label/cuda-11.7.0
	cuda-nvtx                 11.7.50              h05b0816_0    nvidia/label/cuda-11.7.0
	cuda-nvvp                 11.7.50              hd2289d5_0    nvidia/label/cuda-11.7.0
	cuda-runtime              11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-sanitizer-api        11.7.50              hb424887_0    nvidia/label/cuda-11.7.0
	cuda-toolkit              11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-tools                11.7.0                        0    nvidia/label/cuda-11.7.0
	cuda-visual-tools         11.7.0                        0    nvidia/label/cuda-11.7.0
	cudatoolkit               11.8.0              h37601d7_11    conda-forge
	cudnn                     8.4.1.50             hed8a83a_0    conda-forge
	cxx-compiler              1.5.2                hf52228f_0    conda-forge
	cycler                    0.11.0                   pypi_0    pypi
	dataclasses               0.8                pyhc8e2a94_3    conda-forge
	datasets                  2.13.0                   pypi_0    pypi
	debugpy                   1.6.7                    pypi_0    pypi
	decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
	defusedxml                0.7.1                    pypi_0    pypi
	diffusers                 0.16.0.dev0              pypi_0    pypi
	dill                      0.3.6              pyhd8ed1ab_1    conda-forge
	distlib                   0.3.6                    pypi_0    pypi
	dm-tree                   0.1.8                    pypi_0    pypi
	docker-pycreds            0.4.0                    pypi_0    pypi
	einops                    0.6.1                    pypi_0    pypi
	emoji                     2.4.0                    pypi_0    pypi
	entrypoints               0.4                      pypi_0    pypi
	et-xmlfile                1.1.0                    pypi_0    pypi
	evaluate                  0.4.0                    pypi_0    pypi
	exceptiongroup            1.1.1                    pypi_0    pypi
	executing                 1.2.0              pyhd8ed1ab_0    conda-forge
	fair-esm                  2.0.0                    pypi_0    pypi
	fastapi                   0.95.0                   pypi_0    pypi
	fastjsonschema            2.16.3                   pypi_0    pypi
	fengshen-inner            0.0.1                     dev_0    <develop>
	ffmpy                     0.3.0                    pypi_0    pypi
	filelock                  3.12.0                   pypi_0    pypi
	fonttools                 4.39.2                   pypi_0    pypi
	fortran-compiler          1.5.2                hdb1a99f_0    conda-forge
	fqdn                      1.5.1                    pypi_0    pypi
	freetype                  2.12.1               hca18f0e_1    conda-forge
	frozenlist                1.3.3           py310h5764c6d_0    conda-forge
	fsspec                    2023.3.0           pyhd8ed1ab_1    conda-forge
	gcc                       11.3.0              h02d0930_11    conda-forge
	gcc_impl_linux-64         11.3.0              hab1b70f_19    conda-forge
	gcc_linux-64              11.3.0              he6f903b_11    conda-forge
	gds-tools                 1.3.0.44                      0    nvidia/label/cuda-11.7.0
	gflags                    2.2.2             he1b5a44_1004    conda-forge
	gfortran                  11.3.0              ha859ce3_11    conda-forge
	gfortran_impl_linux-64    11.3.0              he34c6f7_19    conda-forge
	gfortran_linux-64         11.3.0              h3c55166_11    conda-forge
	gitdb                     4.0.10                   pypi_0    pypi
	gitpython                 3.1.31                   pypi_0    pypi
	glog                      0.6.0                h6f12383_0    conda-forge
	googleapis-common-protos  1.59.0                   pypi_0    pypi
	gpustat                   1.1                      pypi_0    pypi
	gradio                    3.22.1                   pypi_0    pypi
	greenlet                  2.0.2                    pypi_0    pypi
	grpcio                    1.51.3                   pypi_0    pypi
	gxx                       11.3.0              h02d0930_11    conda-forge
	gxx_impl_linux-64         11.3.0              hab1b70f_19    conda-forge
	gxx_linux-64              11.3.0              hc203a17_11    conda-forge
	gymnasium                 0.26.3                   pypi_0    pypi
	gymnasium-notices         0.0.1                    pypi_0    pypi
	h11                       0.14.0                   pypi_0    pypi
	httpcore                  0.16.3                   pypi_0    pypi
	httpx                     0.23.3                   pypi_0    pypi
	huggingface-hub           0.14.1                   pypi_0    pypi
	humanfriendly             10.0                     pypi_0    pypi
	icu                       72.1                 hcb278e6_0    conda-forge
	idna                      3.4                pyhd8ed1ab_0    conda-forge
	imageio                   2.28.0                   pypi_0    pypi
	importlib-metadata        6.0.1                    pypi_0    pypi
	importlib_metadata        6.1.0                hd8ed1ab_0    conda-forge
	ipdb                      0.13.13                  pypi_0    pypi
	ipykernel                 6.23.2                   pypi_0    pypi
	ipython                   8.12.0                   pypi_0    pypi
	ipython-genutils          0.2.0                    pypi_0    pypi
	ipywidgets                8.0.5              pyhd8ed1ab_0    conda-forge
	isoduration               20.11.0                  pypi_0    pypi
	jedi                      0.18.2             pyhd8ed1ab_0    conda-forge
	jieba                     0.42.1                   pypi_0    pypi
	jieba-fast                0.53                     pypi_0    pypi
	jinja2                    3.1.2                    pypi_0    pypi
	jinja2-time               0.2.0                    pypi_0    pypi
	joblib                    1.2.0              pyhd8ed1ab_0    conda-forge
	json5                     0.9.14                   pypi_0    pypi
	jsonpointer               2.3                      pypi_0    pypi
	jsonschema                4.17.3                   pypi_0    pypi
	jupynium                  0.2.1.dev16+g4f2c1ea          pypi_0    pypi
	jupyter-client            8.2.0                    pypi_0    pypi
	jupyter-console           6.6.3                    pypi_0    pypi
	jupyter-events            0.6.3                    pypi_0    pypi
	jupyter-lsp               2.2.0                    pypi_0    pypi
	jupyter-server            2.5.0                    pypi_0    pypi
	jupyter-server-terminals  0.4.4                    pypi_0    pypi
	jupyter_core              5.3.0           py310hff52083_0    conda-forge
	jupyterlab                4.0.2                    pypi_0    pypi
	jupyterlab-pygments       0.2.2                    pypi_0    pypi
	jupyterlab-server         2.23.0                   pypi_0    pypi
	jupyterlab_widgets        3.0.6              pyhd8ed1ab_0    conda-forge
	kernel-headers_linux-64   2.6.32              he073ed8_15    conda-forge
	keyutils                  1.6.1                h166bdaf_0    conda-forge
	kiwisolver                1.4.4                    pypi_0    pypi
	krb5                      1.20.1               h81ceb04_0    conda-forge
	lazy-loader               0.2                      pypi_0    pypi
	lcms2                     2.15                 haa2dc70_1    conda-forge
	ld_impl_linux-64          2.39                 hcc3a1bd_1    conda-forge
	lerc                      4.0.0                h27087fc_0    conda-forge
	levenshtein               0.21.0                   pypi_0    pypi
	libabseil                 20230125.0      cxx17_hcb278e6_1    conda-forge
	libarrow                  11.0.0          h93537a5_13_cpu    conda-forge
	libblas                   3.9.0           16_linux64_openblas    conda-forge
	libbrotlicommon           1.0.9                h166bdaf_8    conda-forge
	libbrotlidec              1.0.9                h166bdaf_8    conda-forge
	libbrotlienc              1.0.9                h166bdaf_8    conda-forge
	libcblas                  3.9.0           16_linux64_openblas    conda-forge
	libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
	libcublas                 11.10.1.25           he442b6f_0    nvidia/label/cuda-11.7.0
	libcublas-dev             11.10.1.25           h0c8ac2b_0    nvidia/label/cuda-11.7.0
	libcufft                  10.7.2.50            h80a1efe_0    nvidia/label/cuda-11.7.0
	libcufft-dev              10.7.2.50            h59a5ac8_0    nvidia/label/cuda-11.7.0
	libcufile                 1.3.0.44                      0    nvidia/label/cuda-11.7.0
	libcufile-dev             1.3.0.44                      0    nvidia/label/cuda-11.7.0
	libcurand                 10.2.10.50           heec50f7_0    nvidia/label/cuda-11.7.0
	libcurand-dev             10.2.10.50           hd49a9cd_0    nvidia/label/cuda-11.7.0
	libcurl                   7.88.1               hdc1c0ab_1    conda-forge
	libcusolver               11.3.5.50            hcab339c_0    nvidia/label/cuda-11.7.0
	libcusolver-dev           11.3.5.50            hc6eba6f_0    nvidia/label/cuda-11.7.0
	libcusparse               11.7.3.50            h6aaafad_0    nvidia/label/cuda-11.7.0
	libcusparse-dev           11.7.3.50            hc644b96_0    nvidia/label/cuda-11.7.0
	libdeflate                1.17                 h0b41bf4_0    conda-forge
	libedit                   3.1.20191231         he28a2e2_2    conda-forge
	libev                     4.33                 h516909a_1    conda-forge
	libevent                  2.1.10               h28343ad_4    conda-forge
	libffi                    3.4.2                h7f98852_5    conda-forge
	libgcc-devel_linux-64     11.3.0              h210ce93_19    conda-forge
	libgcc-ng                 12.2.0              h65d4601_19    conda-forge
	libgfortran-ng            12.2.0              h69a702a_19    conda-forge
	libgfortran5              12.2.0              h337968e_19    conda-forge
	libgomp                   12.2.0              h65d4601_19    conda-forge
	libgoogle-cloud           2.8.0                h0bc5f78_1    conda-forge
	libgrpc                   1.52.1               hcf146ea_1    conda-forge
	libhwloc                  2.9.0                hd6dc26d_0    conda-forge
	libiconv                  1.17                 h166bdaf_0    conda-forge
	libjpeg-turbo             2.1.5.1              h0b41bf4_0    conda-forge
	liblapack                 3.9.0           16_linux64_openblas    conda-forge
	libnghttp2                1.52.0               h61bc06f_0    conda-forge
	libnpp                    11.7.3.21            h3effbd9_0    nvidia/label/cuda-11.7.0
	libnpp-dev                11.7.3.21            hb6476a9_0    nvidia/label/cuda-11.7.0
	libnsl                    2.0.0                h7f98852_0    conda-forge
	libnuma                   2.0.16               h0b41bf4_1    conda-forge
	libnvjpeg                 11.7.2.34            hfe236c7_0    nvidia/label/cuda-11.7.0
	libnvjpeg-dev             11.7.2.34            h2e48410_0    nvidia/label/cuda-11.7.0
	libopenblas               0.3.21          pthreads_h78a6416_3    conda-forge
	libpng                    1.6.39               h753d276_0    conda-forge
	libprotobuf               3.21.12              h3eb15da_0    conda-forge
	libsanitizer              11.3.0              h239ccf8_19    conda-forge
	libsodium                 1.0.18               h36c2ea0_1    conda-forge
	libsqlite                 3.40.0               h753d276_0    conda-forge
	libssh2                   1.10.0               hf14f497_3    conda-forge
	libstdcxx-devel_linux-64  11.3.0              h210ce93_19    conda-forge
	libstdcxx-ng              12.2.0              h46fd767_19    conda-forge
	libthrift                 0.18.1               h5e4af38_0    conda-forge
	libtiff                   4.5.0                hddfeb54_5    conda-forge
	libutf8proc               2.8.0                h166bdaf_0    conda-forge
	libuuid                   2.32.1            h7f98852_1000    conda-forge
	libwebp-base              1.3.0                h0b41bf4_0    conda-forge
	libxcb                    1.13              h7f98852_1004    conda-forge
	libxml2                   2.10.3               hfdac1af_6    conda-forge
	libzlib                   1.2.13               h166bdaf_4    conda-forge
	lightgbm                  3.3.5                    pypi_0    pypi
	lightning-utilities       0.8.0                    pypi_0    pypi
	linkify-it-py             2.0.0                    pypi_0    pypi
	llvm-openmp               16.0.0               h417c0b6_0    conda-forge
	llvmlite                  0.40.0                   pypi_0    pypi
	loralib                   0.1.1                    pypi_0    pypi
	lz4                       4.3.2                    pypi_0    pypi
	lz4-c                     1.9.4                hcb278e6_0    conda-forge
	magma                     2.6.2                hc72dce7_0    conda-forge
	markdown                  3.4.3                    pypi_0    pypi
	markdown-it-py            2.2.0                    pypi_0    pypi
	markupsafe                2.1.2                    pypi_0    pypi
	matplotlib                3.7.1                    pypi_0    pypi
	matplotlib-inline         0.1.6              pyhd8ed1ab_0    conda-forge
	mdit-py-plugins           0.3.3                    pypi_0    pypi
	mdurl                     0.1.2                    pypi_0    pypi
	mistune                   2.0.5                    pypi_0    pypi
	mkl                       2022.2.1         h84fe81f_16997    conda-forge
	ml-collections            0.1.1                    pypi_0    pypi
	moxtrice                  1.0.2.dev2               pypi_0    pypi
	mpmath                    1.3.0                    pypi_0    pypi
	msgpack                   1.0.5                    pypi_0    pypi
	multidict                 6.0.4           py310h1fa729e_0    conda-forge
	multiprocess              0.70.14         py310h5764c6d_3    conda-forge
	nbclassic                 0.5.3                    pypi_0    pypi
	nbclient                  0.7.2                    pypi_0    pypi
	nbconvert                 7.2.10                   pypi_0    pypi
	nbformat                  5.7.3                    pypi_0    pypi
	nccl                      2.14.3.1             h0800d71_0    conda-forge
	ncurses                   6.3                  h27087fc_1    conda-forge
	nest-asyncio              1.5.6              pyhd8ed1ab_0    conda-forge
	networkx                  3.1                      pypi_0    pypi
	ninja                     1.11.1               h924138e_0    conda-forge
	notebook                  7.0.0rc0                 pypi_0    pypi
	notebook-shim             0.2.2                    pypi_0    pypi
	nsight-compute            2022.2.0.13                   0    nvidia/label/cuda-11.7.0
	numba                     0.57.0                   pypi_0    pypi
	numpy                     1.24.2          py310h8deb116_0    conda-forge
	nvidia-ml-py              11.525.112               pypi_0    pypi
	oauthlib                  3.2.2                    pypi_0    pypi
	openai                    0.27.2                   pypi_0    pypi
	openaiauth                0.3.2                    pypi_0    pypi
	opencensus-context        0.1.3                    pypi_0    pypi
	openjpeg                  2.5.0                hfec8fc6_2    conda-forge
	openpyxl                  3.1.2                    pypi_0    pypi
	openssl                   3.1.0                h0b41bf4_0    conda-forge
	opentelemetry-proto       1.17.0                   pypi_0    pypi
	opentelemetry-semantic-conventions 0.38b0                   pypi_0    pypi
	orc                       1.8.3                hfdbbad2_0    conda-forge
	orjson                    3.8.7                    pypi_0    pypi
	outcome                   1.2.0                    pypi_0    pypi
	packaging                 23.0               pyhd8ed1ab_0    conda-forge
	pandas                    1.5.3           py310h9b08913_0    conda-forge
	pandocfilters             1.5.0                    pypi_0    pypi
	parquet-cpp               1.5.1                         2    conda-forge
	parso                     0.8.3              pyhd8ed1ab_0    conda-forge
	pathtools                 0.1.2                    pypi_0    pypi
	pathvalidate              3.0.0                    pypi_0    pypi
	patsy                     0.5.3                    pypi_0    pypi
	peft                      0.3.0.dev0               pypi_0    pypi
	persist-queue             0.8.0                    pypi_0    pypi
	pexpect                   4.8.0              pyh1a96a4e_2    conda-forge
	pickleshare               0.7.5                   py_1003    conda-forge
	pillow                    9.4.0           py310h065c6d2_2    conda-forge
	pip                       23.0.1             pyhd8ed1ab_0    conda-forge
	pipx                      1.2.0                    pypi_0    pypi
	platformdirs              3.2.0                    pypi_0    pypi
	plotly                    5.14.1                   pypi_0    pypi
	prometheus-client         0.16.0                   pypi_0    pypi
	prompt-toolkit            3.0.38             pyha770c72_0    conda-forge
	prompt_toolkit            3.0.38               hd8ed1ab_0    conda-forge
	protobuf                  3.19.6                   pypi_0    pypi
	psutil                    5.9.4           py310h5764c6d_0    conda-forge
	pthread-stubs             0.4               h36c2ea0_1001    conda-forge
	ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
	pudb                      2022.1.3                 pypi_0    pypi
	pure_eval                 0.2.2              pyhd8ed1ab_0    conda-forge
	py-spy                    0.3.14                   pypi_0    pypi
	pyarrow                   11.0.0          py310h633f555_13_cpu    conda-forge
	pyasn1                    0.5.0                    pypi_0    pypi
	pyasn1-modules            0.3.0                    pypi_0    pypi
	pycparser                 2.21               pyhd8ed1ab_0    conda-forge
	pydantic                  1.10.6                   pypi_0    pypi
	pydeprecate               0.3.2                    pypi_0    pypi
	pydub                     0.25.1                   pypi_0    pypi
	pygments                  2.15.0                   pypi_0    pypi
	pynvim                    0.4.3                    pypi_0    pypi
	pyopenssl                 23.0.0             pyhd8ed1ab_0    conda-forge
	pyparsing                 3.0.9                    pypi_0    pypi
	pyrsistent                0.19.3                   pypi_0    pypi
	pysocks                   1.7.1              pyha2e5f31_6    conda-forge
	python                    3.10.9          he550d4f_0_cpython    conda-forge
	python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
	python-json-logger        2.0.7                    pypi_0    pypi
	python-levenshtein        0.21.0                   pypi_0    pypi
	python-multipart          0.0.6                    pypi_0    pypi
	python-slugify            8.0.1                    pypi_0    pypi
	python-xxhash             3.2.0           py310h1fa729e_0    conda-forge
	python_abi                3.10                    3_cp310    conda-forge
	pytorch                   1.13.1          cuda112py310he33e0d6_200    conda-forge
	pytorch-cuda              11.7                 h778d358_3    pytorch
	pytorch-lightning         2.0.2                    pypi_0    pypi
	pytorch-mutex             1.0                        cuda    pytorch
	pytz                      2022.7.1           pyhd8ed1ab_0    conda-forge
	pywavelets                1.4.1                    pypi_0    pypi
	pyyaml                    6.0             py310h5764c6d_5    conda-forge
	pyzmq                     25.0.2          py310h059b190_0    conda-forge
	qtconsole                 5.4.2                    pypi_0    pypi
	qtpy                      2.3.1                    pypi_0    pypi
	rapidfuzz                 3.0.0                    pypi_0    pypi
	ray                       2.4.0                    pypi_0    pypi
	ray-cpp                   2.3.1                    pypi_0    pypi
	re2                       2023.02.02           hcb278e6_0    conda-forge
	readline                  8.1.2                h0f457ee_0    conda-forge
	regex                     2022.10.31      py310h5764c6d_0    conda-forge
	requests                  2.28.2             pyhd8ed1ab_0    conda-forge
	requests-oauthlib         1.3.1                    pypi_0    pypi
	responses                 0.18.0             pyhd8ed1ab_0    conda-forge
	rfc3339-validator         0.1.4                    pypi_0    pypi
	rfc3986                   1.5.0                    pypi_0    pypi
	rfc3986-validator         0.1.1                    pypi_0    pypi
	rsa                       4.9                      pypi_0    pypi
	ruff                      0.0.270                  pypi_0    pypi
	s2n                       1.3.39               h3358134_0    conda-forge
	sacremoses                0.0.53             pyhd8ed1ab_0    conda-forge
	safetensors               0.3.0           py310h4426083_0    conda-forge
	scikit-image              0.20.0                   pypi_0    pypi
	scikit-learn              1.2.2                    pypi_0    pypi
	scipy                     1.10.1                   pypi_0    pypi
	seaborn                   0.12.2                   pypi_0    pypi
	selenium                  4.9.1                    pypi_0    pypi
	send2trash                1.8.0                    pypi_0    pypi
	sentencepiece             0.1.97                   pypi_0    pypi
	sentry-sdk                1.20.0                   pypi_0    pypi
	setproctitle              1.3.2                    pypi_0    pypi
	setuptools                67.6.0             pyhd8ed1ab_0    conda-forge
	six                       1.16.0             pyh6c4a22f_0    conda-forge
	skglm                     0.2                      pypi_0    pypi
	sleef                     3.5.1                h9b69904_2    conda-forge
	smart-open                6.3.0                    pypi_0    pypi
	smmap                     5.0.0                    pypi_0    pypi
	snappy                    1.1.10               h9fff704_0    conda-forge
	sniffio                   1.3.0                    pypi_0    pypi
	socksio                   1.0.0                    pypi_0    pypi
	sortedcontainers          2.4.0                    pypi_0    pypi
	soupsieve                 2.4                      pypi_0    pypi
	speedtest-cli             2.1.3                    pypi_0    pypi
	stack_data                0.6.2              pyhd8ed1ab_0    conda-forge
	starlette                 0.26.1                   pypi_0    pypi
	statsmodels               0.14.0                   pypi_0    pypi
	sympy                     1.12                     pypi_0    pypi
	sysroot_linux-64          2.12                he073ed8_15    conda-forge
	tabulate                  0.9.0                    pypi_0    pypi
	tbb                       2021.8.0             hf52228f_0    conda-forge
	tenacity                  8.2.2                    pypi_0    pypi
	tensorboard-data-server   0.7.0                    pypi_0    pypi
	tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
	tensorboardx              2.6                      pypi_0    pypi
	terminado                 0.17.1                   pypi_0    pypi
	text-unidecode            1.3                      pypi_0    pypi
	thefuzz                   0.19.0                   pypi_0    pypi
	threadpoolctl             3.1.0                    pypi_0    pypi
	tifffile                  2023.4.12                pypi_0    pypi
	tiktoken                  0.3.2                    pypi_0    pypi
	tinycss2                  1.2.1                    pypi_0    pypi
	tk                        8.6.12               h27826a3_0    conda-forge
	tokenizers                0.13.2          py310he1f1126_0    conda-forge
	tomli                     2.0.1                    pypi_0    pypi
	toolz                     0.12.0                   pypi_0    pypi
	torchaudio                0.13.1              py310_cu117    pytorch
	torchmetrics              0.11.4                   pypi_0    pypi
	torchvision               0.14.1          cuda112py310hb1d1f80_1    conda-forge
	tornado                   6.2             py310h5764c6d_1    conda-forge
	tqdm                      4.65.0             pyhd8ed1ab_1    conda-forge
	traitlets                 5.9.0              pyhd8ed1ab_0    conda-forge
	transformers              4.29.1                   pypi_0    pypi
	trio                      0.22.0                   pypi_0    pypi
	trio-websocket            0.10.2                   pypi_0    pypi
	trl                       0.4.2.dev0                dev_0    <develop>
	typer                     0.7.0                    pypi_0    pypi
	typing-extensions         4.5.0                hd8ed1ab_0    conda-forge
	typing_extensions         4.5.0              pyha770c72_0    conda-forge
	tzdata                    2022g                h191b570_0    conda-forge
	uc-micro-py               1.0.1                    pypi_0    pypi
	ucx                       1.14.0               h538f049_0    conda-forge
	uri-template              1.2.0                    pypi_0    pypi
	urllib3                   1.26.15            pyhd8ed1ab_0    conda-forge
	urwid                     2.1.2                    pypi_0    pypi
	urwid-readline            0.13                     pypi_0    pypi
	userpath                  1.8.0                    pypi_0    pypi
	uvicorn                   0.21.1                   pypi_0    pypi
	verboselogs               1.7                      pypi_0    pypi
	virtualenv                20.21.0                  pypi_0    pypi
	wandb                     0.15.2                   pypi_0    pypi
	wcwidth                   0.2.6              pyhd8ed1ab_0    conda-forge
	webcolors                 1.12                     pypi_0    pypi
	webencodings              0.5.1                    pypi_0    pypi
	websocket-client          1.5.1                    pypi_0    pypi
	websockets                10.4                     pypi_0    pypi
	werkzeug                  2.2.3                    pypi_0    pypi
	wheel                     0.40.0             pyhd8ed1ab_0    conda-forge
	widgetsnbextension        4.0.6              pyhd8ed1ab_0    conda-forge
	wrapt                     1.15.0                   pypi_0    pypi
	wsproto                   1.2.0                    pypi_0    pypi
	xorg-libxau               1.0.9                h7f98852_0    conda-forge
	xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
	xxhash                    0.8.1                h0b41bf4_0    conda-forge
	xz                        5.2.6                h166bdaf_0    conda-forge
	yaml                      0.2.5                h7f98852_2    conda-forge
	yarl                      1.8.2           py310h5764c6d_0    conda-forge
	zeromq                    4.3.4                h9c3ff4c_1    conda-forge
	zipp                      3.15.0             pyhd8ed1ab_0    conda-forge
	zlib                      1.2.13               h166bdaf_4    conda-forge
	zstd                      1.5.2                h3eb15da_6    conda-forge

conda env:
	name: tq
	channels:
	  - pytorch
	  - nvidia/label/cuda-11.7.0
	  - conda-forge
	dependencies:
	  - _libgcc_mutex=0.1=conda_forge
	  - _openmp_mutex=4.5=2_kmp_llvm
	  - aiohttp=3.8.4=py310h1fa729e_0
	  - aiosignal=1.3.1=pyhd8ed1ab_0
	  - arrow-cpp=11.0.0=ha770c72_13_cpu
	  - asttokens=2.2.1=pyhd8ed1ab_0
	  - async-timeout=4.0.2=pyhd8ed1ab_0
	  - attrs=22.2.0=pyh71513ae_0
	  - aws-c-auth=0.6.26=hdca2abe_0
	  - aws-c-cal=0.5.21=h48707d8_2
	  - aws-c-common=0.8.14=h0b41bf4_0
	  - aws-c-compression=0.2.16=h03acc5a_5
	  - aws-c-event-stream=0.2.20=h00877a2_4
	  - aws-c-http=0.7.5=hf342b9f_5
	  - aws-c-io=0.13.19=hef0810e_1
	  - aws-c-mqtt=0.8.6=h337b09f_11
	  - aws-c-s3=0.2.7=hde0a405_0
	  - aws-c-sdkutils=0.1.8=h03acc5a_0
	  - aws-checksums=0.1.14=h03acc5a_5
	  - aws-crt-cpp=0.19.8=h85f3b07_11
	  - aws-sdk-cpp=1.10.57=h17c43bd_8
	  - backcall=0.2.0=pyh9f0ad1d_0
	  - backports=1.0=pyhd8ed1ab_3
	  - backports.functools_lru_cache=1.6.4=pyhd8ed1ab_0
	  - binutils=2.39=hdd6e379_1
	  - binutils_impl_linux-64=2.39=he00db2b_1
	  - binutils_linux-64=2.39=h5fc0e48_11
	  - brotlipy=0.7.0=py310h5764c6d_1005
	  - bzip2=1.0.8=h7f98852_4
	  - c-ares=1.18.1=h7f98852_0
	  - c-compiler=1.5.2=h0b41bf4_0
	  - ca-certificates=2022.12.7=ha878542_0
	  - certifi=2022.12.7=pyhd8ed1ab_0
	  - cffi=1.15.1=py310h255011f_3
	  - charset-normalizer=2.1.1=pyhd8ed1ab_0
	  - click=8.1.3=unix_pyhd8ed1ab_2
	  - colorama=0.4.6=pyhd8ed1ab_0
	  - compilers=1.5.2=ha770c72_0
	  - cryptography=39.0.2=py310h34c0648_0
	  - cuda=11.7.0=0
	  - cuda-cccl=11.7.58=hc415cf5_0
	  - cuda-command-line-tools=11.7.0=0
	  - cuda-compiler=11.7.0=0
	  - cuda-cudart=11.7.60=h9538e0e_0
	  - cuda-cudart-dev=11.7.60=h6a7c232_0
	  - cuda-cuobjdump=11.7.50=h28cc80a_0
	  - cuda-cupti=11.7.50=hb6f9eaf_0
	  - cuda-cuxxfilt=11.7.50=hb365495_0
	  - cuda-demo-suite=11.7.50=0
	  - cuda-documentation=11.7.50=0
	  - cuda-driver-dev=11.7.60=0
	  - cuda-gdb=11.7.50=h4a0ac72_0
	  - cuda-libraries=11.7.0=0
	  - cuda-libraries-dev=11.7.0=0
	  - cuda-memcheck=11.7.50=hc446b2b_0
	  - cuda-nsight=11.7.50=0
	  - cuda-nsight-compute=11.7.0=0
	  - cuda-nvcc=11.7.64=0
	  - cuda-nvdisasm=11.7.50=h5bd0695_0
	  - cuda-nvml-dev=11.7.50=h3af1343_0
	  - cuda-nvprof=11.7.50=h7a2404d_0
	  - cuda-nvprune=11.7.50=h7add7b4_0
	  - cuda-nvrtc=11.7.50=hd0285e0_0
	  - cuda-nvrtc-dev=11.7.50=heada363_0
	  - cuda-nvtx=11.7.50=h05b0816_0
	  - cuda-nvvp=11.7.50=hd2289d5_0
	  - cuda-runtime=11.7.0=0
	  - cuda-sanitizer-api=11.7.50=hb424887_0
	  - cuda-toolkit=11.7.0=0
	  - cuda-tools=11.7.0=0
	  - cuda-visual-tools=11.7.0=0
	  - cudatoolkit=11.8.0=h37601d7_11
	  - cudnn=8.4.1.50=hed8a83a_0
	  - cxx-compiler=1.5.2=hf52228f_0
	  - dataclasses=0.8=pyhc8e2a94_3
	  - decorator=5.1.1=pyhd8ed1ab_0
	  - dill=0.3.6=pyhd8ed1ab_1
	  - executing=1.2.0=pyhd8ed1ab_0
	  - fortran-compiler=1.5.2=hdb1a99f_0
	  - freetype=2.12.1=hca18f0e_1
	  - frozenlist=1.3.3=py310h5764c6d_0
	  - fsspec=2023.3.0=pyhd8ed1ab_1
	  - gcc=11.3.0=h02d0930_11
	  - gcc_impl_linux-64=11.3.0=hab1b70f_19
	  - gcc_linux-64=11.3.0=he6f903b_11
	  - gds-tools=1.3.0.44=0
	  - gflags=2.2.2=he1b5a44_1004
	  - gfortran=11.3.0=ha859ce3_11
	  - gfortran_impl_linux-64=11.3.0=he34c6f7_19
	  - gfortran_linux-64=11.3.0=h3c55166_11
	  - glog=0.6.0=h6f12383_0
	  - gxx=11.3.0=h02d0930_11
	  - gxx_impl_linux-64=11.3.0=hab1b70f_19
	  - gxx_linux-64=11.3.0=hc203a17_11
	  - icu=72.1=hcb278e6_0
	  - idna=3.4=pyhd8ed1ab_0
	  - importlib_metadata=6.1.0=hd8ed1ab_0
	  - ipywidgets=8.0.5=pyhd8ed1ab_0
	  - jedi=0.18.2=pyhd8ed1ab_0
	  - joblib=1.2.0=pyhd8ed1ab_0
	  - jupyter_core=5.3.0=py310hff52083_0
	  - jupyterlab_widgets=3.0.6=pyhd8ed1ab_0
	  - kernel-headers_linux-64=2.6.32=he073ed8_15
	  - keyutils=1.6.1=h166bdaf_0
	  - krb5=1.20.1=h81ceb04_0
	  - lcms2=2.15=haa2dc70_1
	  - ld_impl_linux-64=2.39=hcc3a1bd_1
	  - lerc=4.0.0=h27087fc_0
	  - libabseil=20230125.0=cxx17_hcb278e6_1
	  - libarrow=11.0.0=h93537a5_13_cpu
	  - libblas=3.9.0=16_linux64_openblas
	  - libbrotlicommon=1.0.9=h166bdaf_8
	  - libbrotlidec=1.0.9=h166bdaf_8
	  - libbrotlienc=1.0.9=h166bdaf_8
	  - libcblas=3.9.0=16_linux64_openblas
	  - libcrc32c=1.1.2=h9c3ff4c_0
	  - libcublas=11.10.1.25=he442b6f_0
	  - libcublas-dev=11.10.1.25=h0c8ac2b_0
	  - libcufft=10.7.2.50=h80a1efe_0
	  - libcufft-dev=10.7.2.50=h59a5ac8_0
	  - libcufile=1.3.0.44=0
	  - libcufile-dev=1.3.0.44=0
	  - libcurand=10.2.10.50=heec50f7_0
	  - libcurand-dev=10.2.10.50=hd49a9cd_0
	  - libcurl=7.88.1=hdc1c0ab_1
	  - libcusolver=11.3.5.50=hcab339c_0
	  - libcusolver-dev=11.3.5.50=hc6eba6f_0
	  - libcusparse=11.7.3.50=h6aaafad_0
	  - libcusparse-dev=11.7.3.50=hc644b96_0
	  - libdeflate=1.17=h0b41bf4_0
	  - libedit=3.1.20191231=he28a2e2_2
	  - libev=4.33=h516909a_1
	  - libevent=2.1.10=h28343ad_4
	  - libffi=3.4.2=h7f98852_5
	  - libgcc-devel_linux-64=11.3.0=h210ce93_19
	  - libgcc-ng=12.2.0=h65d4601_19
	  - libgfortran-ng=12.2.0=h69a702a_19
	  - libgfortran5=12.2.0=h337968e_19
	  - libgomp=12.2.0=h65d4601_19
	  - libgoogle-cloud=2.8.0=h0bc5f78_1
	  - libgrpc=1.52.1=hcf146ea_1
	  - libhwloc=2.9.0=hd6dc26d_0
	  - libiconv=1.17=h166bdaf_0
	  - libjpeg-turbo=2.1.5.1=h0b41bf4_0
	  - liblapack=3.9.0=16_linux64_openblas
	  - libnghttp2=1.52.0=h61bc06f_0
	  - libnpp=11.7.3.21=h3effbd9_0
	  - libnpp-dev=11.7.3.21=hb6476a9_0
	  - libnsl=2.0.0=h7f98852_0
	  - libnuma=2.0.16=h0b41bf4_1
	  - libnvjpeg=11.7.2.34=hfe236c7_0
	  - libnvjpeg-dev=11.7.2.34=h2e48410_0
	  - libopenblas=0.3.21=pthreads_h78a6416_3
	  - libpng=1.6.39=h753d276_0
	  - libprotobuf=3.21.12=h3eb15da_0
	  - libsanitizer=11.3.0=h239ccf8_19
	  - libsodium=1.0.18=h36c2ea0_1
	  - libsqlite=3.40.0=h753d276_0
	  - libssh2=1.10.0=hf14f497_3
	  - libstdcxx-devel_linux-64=11.3.0=h210ce93_19
	  - libstdcxx-ng=12.2.0=h46fd767_19
	  - libthrift=0.18.1=h5e4af38_0
	  - libtiff=4.5.0=hddfeb54_5
	  - libutf8proc=2.8.0=h166bdaf_0
	  - libuuid=2.32.1=h7f98852_1000
	  - libwebp-base=1.3.0=h0b41bf4_0
	  - libxcb=1.13=h7f98852_1004
	  - libxml2=2.10.3=hfdac1af_6
	  - libzlib=1.2.13=h166bdaf_4
	  - llvm-openmp=16.0.0=h417c0b6_0
	  - lz4-c=1.9.4=hcb278e6_0
	  - magma=2.6.2=hc72dce7_0
	  - matplotlib-inline=0.1.6=pyhd8ed1ab_0
	  - mkl=2022.2.1=h84fe81f_16997
	  - multidict=6.0.4=py310h1fa729e_0
	  - multiprocess=0.70.14=py310h5764c6d_3
	  - nccl=2.14.3.1=h0800d71_0
	  - ncurses=6.3=h27087fc_1
	  - nest-asyncio=1.5.6=pyhd8ed1ab_0
	  - ninja=1.11.1=h924138e_0
	  - nsight-compute=2022.2.0.13=0
	  - numpy=1.24.2=py310h8deb116_0
	  - openjpeg=2.5.0=hfec8fc6_2
	  - openssl=3.1.0=h0b41bf4_0
	  - orc=1.8.3=hfdbbad2_0
	  - packaging=23.0=pyhd8ed1ab_0
	  - pandas=1.5.3=py310h9b08913_0
	  - parquet-cpp=1.5.1=2
	  - parso=0.8.3=pyhd8ed1ab_0
	  - pexpect=4.8.0=pyh1a96a4e_2
	  - pickleshare=0.7.5=py_1003
	  - pillow=9.4.0=py310h065c6d2_2
	  - pip=23.0.1=pyhd8ed1ab_0
	  - prompt-toolkit=3.0.38=pyha770c72_0
	  - prompt_toolkit=3.0.38=hd8ed1ab_0
	  - psutil=5.9.4=py310h5764c6d_0
	  - pthread-stubs=0.4=h36c2ea0_1001
	  - ptyprocess=0.7.0=pyhd3deb0d_0
	  - pure_eval=0.2.2=pyhd8ed1ab_0
	  - pyarrow=11.0.0=py310h633f555_13_cpu
	  - pycparser=2.21=pyhd8ed1ab_0
	  - pyopenssl=23.0.0=pyhd8ed1ab_0
	  - pysocks=1.7.1=pyha2e5f31_6
	  - python=3.10.9=he550d4f_0_cpython
	  - python-dateutil=2.8.2=pyhd8ed1ab_0
	  - python-xxhash=3.2.0=py310h1fa729e_0
	  - python_abi=3.10=3_cp310
	  - pytorch=1.13.1=cuda112py310he33e0d6_200
	  - pytorch-cuda=11.7=h778d358_3
	  - pytorch-mutex=1.0=cuda
	  - pytz=2022.7.1=pyhd8ed1ab_0
	  - pyyaml=6.0=py310h5764c6d_5
	  - pyzmq=25.0.2=py310h059b190_0
	  - re2=2023.02.02=hcb278e6_0
	  - readline=8.1.2=h0f457ee_0
	  - regex=2022.10.31=py310h5764c6d_0
	  - requests=2.28.2=pyhd8ed1ab_0
	  - responses=0.18.0=pyhd8ed1ab_0
	  - s2n=1.3.39=h3358134_0
	  - sacremoses=0.0.53=pyhd8ed1ab_0
	  - safetensors=0.3.0=py310h4426083_0
	  - setuptools=67.6.0=pyhd8ed1ab_0
	  - six=1.16.0=pyh6c4a22f_0
	  - sleef=3.5.1=h9b69904_2
	  - snappy=1.1.10=h9fff704_0
	  - stack_data=0.6.2=pyhd8ed1ab_0
	  - sysroot_linux-64=2.12=he073ed8_15
	  - tbb=2021.8.0=hf52228f_0
	  - tk=8.6.12=h27826a3_0
	  - tokenizers=0.13.2=py310he1f1126_0
	  - torchaudio=0.13.1=py310_cu117
	  - torchvision=0.14.1=cuda112py310hb1d1f80_1
	  - tornado=6.2=py310h5764c6d_1
	  - tqdm=4.65.0=pyhd8ed1ab_1
	  - traitlets=5.9.0=pyhd8ed1ab_0
	  - typing-extensions=4.5.0=hd8ed1ab_0
	  - typing_extensions=4.5.0=pyha770c72_0
	  - tzdata=2022g=h191b570_0
	  - ucx=1.14.0=h538f049_0
	  - urllib3=1.26.15=pyhd8ed1ab_0
	  - wcwidth=0.2.6=pyhd8ed1ab_0
	  - wheel=0.40.0=pyhd8ed1ab_0
	  - widgetsnbextension=4.0.6=pyhd8ed1ab_0
	  - xorg-libxau=1.0.9=h7f98852_0
	  - xorg-libxdmcp=1.1.3=h7f98852_0
	  - xxhash=0.8.1=h0b41bf4_0
	  - xz=5.2.6=h166bdaf_0
	  - yaml=0.2.5=h7f98852_2
	  - yarl=1.8.2=py310h5764c6d_0
	  - zeromq=4.3.4=h9c3ff4c_1
	  - zipp=3.15.0=pyhd8ed1ab_0
	  - zlib=1.2.13=h166bdaf_4
	  - zstd=1.5.2=h3eb15da_6
	  - pip:
	      - absl-py==1.4.0
	      - accelerate==0.17.1
	      - aiofiles==23.1.0
	      - aiorwlock==1.3.0
	      - altair==4.2.2
	      - anyio==3.6.2
	      - appdirs==1.4.4
	      - argcomplete==3.0.8
	      - argon2-cffi==21.3.0
	      - argon2-cffi-bindings==21.2.0
	      - arrow==1.2.3
	      - async-generator==1.10
	      - async-lru==2.0.2
	      - babel==2.12.1
	      - backoff==2.2.1
	      - beautifulsoup4==4.11.2
	      - binaryornot==0.4.4
	      - bitsandbytes==0.37.1
	      - bleach==6.0.0
	      - blessed==1.20.0
	      - cachetools==5.3.0
	      - chardet==5.1.0
	      - cloudpickle==2.2.1
	      - coloredlogs==15.0.1
	      - colorful==0.5.5
	      - comm==0.1.3
	      - contextlib2==21.6.0
	      - contourpy==1.0.7
	      - cookiecutter==2.1.1
	      - cycler==0.11.0
	      - datasets==2.13.0
	      - debugpy==1.6.7
	      - defusedxml==0.7.1
	      - diffusers==0.16.0.dev0
	      - distlib==0.3.6
	      - dm-tree==0.1.8
	      - docker-pycreds==0.4.0
	      - einops==0.6.1
	      - emoji==2.4.0
	      - entrypoints==0.4
	      - et-xmlfile==1.1.0
	      - evaluate==0.4.0
	      - exceptiongroup==1.1.1
	      - fair-esm==2.0.0
	      - fastapi==0.95.0
	      - fastjsonschema==2.16.3
	      - ffmpy==0.3.0
	      - filelock==3.12.0
	      - fonttools==4.39.2
	      - fqdn==1.5.1
	      - gitdb==4.0.10
	      - gitpython==3.1.31
	      - googleapis-common-protos==1.59.0
	      - gpustat==1.1
	      - gradio==3.22.1
	      - greenlet==2.0.2
	      - grpcio==1.51.3
	      - gymnasium==0.26.3
	      - gymnasium-notices==0.0.1
	      - h11==0.14.0
	      - httpcore==0.16.3
	      - httpx==0.23.3
	      - huggingface-hub==0.14.1
	      - humanfriendly==10.0
	      - imageio==2.28.0
	      - importlib-metadata==6.0.1
	      - ipdb==0.13.13
	      - ipykernel==6.23.2
	      - ipython==8.12.0
	      - ipython-genutils==0.2.0
	      - isoduration==20.11.0
	      - jieba==0.42.1
	      - jieba-fast==0.53
	      - jinja2==3.1.2
	      - jinja2-time==0.2.0
	      - json5==0.9.14
	      - jsonpointer==2.3
	      - jsonschema==4.17.3
	      - jupynium==0.2.1.dev16+g4f2c1ea
	      - jupyter-client==8.2.0
	      - jupyter-console==6.6.3
	      - jupyter-events==0.6.3
	      - jupyter-lsp==2.2.0
	      - jupyter-server==2.5.0
	      - jupyter-server-terminals==0.4.4
	      - jupyterlab==4.0.2
	      - jupyterlab-pygments==0.2.2
	      - jupyterlab-server==2.23.0
	      - kiwisolver==1.4.4
	      - lazy-loader==0.2
	      - levenshtein==0.21.0
	      - lightgbm==3.3.5
	      - lightning-utilities==0.8.0
	      - linkify-it-py==2.0.0
	      - llvmlite==0.40.0
	      - loralib==0.1.1
	      - lz4==4.3.2
	      - markdown==3.4.3
	      - markdown-it-py==2.2.0
	      - markupsafe==2.1.2
	      - matplotlib==3.7.1
	      - mdit-py-plugins==0.3.3
	      - mdurl==0.1.2
	      - mistune==2.0.5
	      - ml-collections==0.1.1
	      - moxtrice==1.0.2.dev2
	      - mpmath==1.3.0
	      - msgpack==1.0.5
	      - nbclassic==0.5.3
	      - nbclient==0.7.2
	      - nbconvert==7.2.10
	      - nbformat==5.7.3
	      - networkx==3.1
	      - notebook==7.0.0rc0
	      - notebook-shim==0.2.2
	      - numba==0.57.0
	      - nvidia-ml-py==11.525.112
	      - oauthlib==3.2.2
	      - openai==0.27.2
	      - openaiauth==0.3.2
	      - opencensus-context==0.1.3
	      - openpyxl==3.1.2
	      - opentelemetry-proto==1.17.0
	      - opentelemetry-semantic-conventions==0.38b0
	      - orjson==3.8.7
	      - outcome==1.2.0
	      - pandocfilters==1.5.0
	      - pathtools==0.1.2
	      - pathvalidate==3.0.0
	      - patsy==0.5.3
	      - peft==0.3.0.dev0
	      - persist-queue==0.8.0
	      - pipx==1.2.0
	      - platformdirs==3.2.0
	      - plotly==5.14.1
	      - prometheus-client==0.16.0
	      - protobuf==3.19.6
	      - pudb==2022.1.3
	      - py-spy==0.3.14
	      - pyasn1==0.5.0
	      - pyasn1-modules==0.3.0
	      - pydantic==1.10.6
	      - pydeprecate==0.3.2
	      - pydub==0.25.1
	      - pygments==2.15.0
	      - pynvim==0.4.3
	      - pyparsing==3.0.9
	      - pyrsistent==0.19.3
	      - python-json-logger==2.0.7
	      - python-levenshtein==0.21.0
	      - python-multipart==0.0.6
	      - python-slugify==8.0.1
	      - pytorch-lightning==2.0.2
	      - pywavelets==1.4.1
	      - qtconsole==5.4.2
	      - qtpy==2.3.1
	      - rapidfuzz==3.0.0
	      - ray==2.4.0
	      - ray-cpp==2.3.1
	      - requests-oauthlib==1.3.1
	      - rfc3339-validator==0.1.4
	      - rfc3986==1.5.0
	      - rfc3986-validator==0.1.1
	      - rsa==4.9
	      - ruff==0.0.270
	      - scikit-image==0.20.0
	      - scikit-learn==1.2.2
	      - scipy==1.10.1
	      - seaborn==0.12.2
	      - selenium==4.9.1
	      - send2trash==1.8.0
	      - sentencepiece==0.1.97
	      - sentry-sdk==1.20.0
	      - setproctitle==1.3.2
	      - skglm==0.2
	      - smart-open==6.3.0
	      - smmap==5.0.0
	      - sniffio==1.3.0
	      - socksio==1.0.0
	      - sortedcontainers==2.4.0
	      - soupsieve==2.4
	      - speedtest-cli==2.1.3
	      - starlette==0.26.1
	      - statsmodels==0.14.0
	      - sympy==1.12
	      - tabulate==0.9.0
	      - tenacity==8.2.2
	      - tensorboard-data-server==0.7.0
	      - tensorboard-plugin-wit==1.8.1
	      - tensorboardx==2.6
	      - terminado==0.17.1
	      - text-unidecode==1.3
	      - thefuzz==0.19.0
	      - threadpoolctl==3.1.0
	      - tifffile==2023.4.12
	      - tiktoken==0.3.2
	      - tinycss2==1.2.1
	      - tomli==2.0.1
	      - toolz==0.12.0
	      - torchmetrics==0.11.4
	      - transformers==4.29.1
	      - trio==0.22.0
	      - trio-websocket==0.10.2
	      - trl==0.4.1
	      - typer==0.7.0
	      - uc-micro-py==1.0.1
	      - uri-template==1.2.0
	      - urwid==2.1.2
	      - urwid-readline==0.13
	      - userpath==1.8.0
	      - uvicorn==0.21.1
	      - verboselogs==1.7
	      - virtualenv==20.21.0
	      - wandb==0.15.2
	      - webcolors==1.12
	      - webencodings==0.5.1
	      - websocket-client==1.5.1
	      - websockets==10.4
	      - werkzeug==2.2.3
	      - wrapt==1.15.0
	      - wsproto==1.2.0
	prefix: /home/rok/.conda/envs/tq

@fecet
Copy link
Contributor Author

fecet commented Jun 22, 2023

So when I use jupyter notebook (v7) open a notebook, Serverapp will write connection_file twice, first comes form https://github.com/jupyter/jupyter_client/blob/57b11c36b1eceae138cfc6044a2274e2e1caa135/jupyter_client/provisioning/local_provisioner.py#L190
and the later coms from kernelapp.

@blink1073
Copy link
Member

Ah, okay, I think I understand now. Jupyter Client is the primary owner of this file in most cases, but sometimes you might have called ipykernel_launcher.py directly and then it would be up to KernelApp to write the file. I think what you have makes sense. Thanks for all the background info!

@blink1073 blink1073 added the bug label Jun 23, 2023
ipykernel/kernelapp.py Show resolved Hide resolved
ipykernel/kernelapp.py Outdated Show resolved Hide resolved
@blink1073 blink1073 enabled auto-merge (squash) June 23, 2023 09:57
@blink1073 blink1073 changed the title fix: check existence of connection_file before writing Check existence of connection_file before writing Jun 23, 2023
@blink1073 blink1073 merged commit ea3e647 into ipython:main Jun 23, 2023
31 checks passed
jasongrout added a commit that referenced this pull request Jul 20, 2023
Before ipykernel 6.23.3, i.e., before #1127, a kernel manager could specify a channel port of 0, and ipykernel would pick a random port and rewrite the connection file with the actual port used. This provided a nice way to address the natural race condition between a kernel manager picking a port and ipykernel actually connecting to it and using it.

This unit test tests that this port 0 connection file behavior works, and also tests that existing information in the connection file is not overwritten.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants