Crash by Pandas - algos.cp36-win_amd64.pyd join.cp36-win_amd64.pyd

[AxelBangert]

BPO	35875
Nosy	@eryksun, @remilapeyre, @tirkarthi, @AxelBangert
Files	Conda-Algos-Joint-Crash.jpg Conda-Algos-Joint-Crash-02.jpg Conda-Algos-Joint-Crash-03.jpg requirementsWin7-Prof-SP1-x64-English.txt requirementsWin10-Educ-1809-x64-German.txt Conda-Algos-Joint-Crash-Event-Win7-RWTH-SAP1.jpg: Win 7 crash--popup 2 times (algos - join) Conda-Algos-Joint-Crash-Popup-Win7-RWTH-SAP1.jpg Conda-Algos-Joint-Crash-Silent-Event-Win10-RWTH-SAP2.jpg: Win10 crash-silent 2 times (algos - join) Conda-Algos-Joint-Crash-Silent-Project-Win10-RWTH-SAP2.jpg Crash-Popup-Win7-RWTH-SAP1.jpg: Win 7 crash-popup Algos-Commented-Out-Crash-Popup-Win7-Win10-RWTH-SAP.jpg: partial problem bypass Crash-Dump-Files-Win7-RWTH-SAP1-Size-Too-Large-For-Upload-To-PythonBugs.jpg: upload-size-restriction too restrictive for crash dump files

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2019-02-08.20:02:35.305>
created_at = <Date 2019-02-01.10:52:26.278>
labels = ['extension-modules', 'type-crash']
title = 'Crash by Pandas - algos.cp36-win_amd64.pyd  join.cp36-win_amd64.pyd'
updated_at = <Date 2019-02-09.22:31:28.130>
user = 'https://github.com/AxelBangert'

bugs.python.org fields:

activity = <Date 2019-02-09.22:31:28.130>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2019-02-08.20:02:35.305>
closer = 'eryksun'
components = ['Extension Modules']
creation = <Date 2019-02-01.10:52:26.278>
creator = 'AxelArnoldBangert'
dependencies = []
files = ['48092', '48093', '48094', '48118', '48119', '48123', '48124', '48125', '48126', '48127', '48130', '48131']
hgrepos = []
issue_num = 35875
keywords = []
message_count = 13.0
messages = ['334663', '334667', '334669', '334677', '334678', '335068', '335069', '335073', '335075', '335106', '335127', '335128', '335130']
nosy_count = 4.0
nosy_names = ['eryksun', 'remi.lapeyre', 'xtreak', 'AxelArnoldBangert']
pr_nums = []
priority = 'normal'
resolution = 'third party'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'crash'
url = 'https://bugs.python.org/issue35875'
versions = ['Python 3.6']

[AxelBangert]

Windows 7 x64
Visual Studio 2017 15.9.6
netframework 4.7
conda 3.6 x64

On project load both extensions algos and joint crash.

[tirkarthi]

Can you please add a minimal reproducer for this without any external dependencies? I couldn't see any references to the extensions you have mentioned in the title in CPython repo. Please add in a description over how this is a problem with CPython and not with external dependencies/extensions if any.

Thanks

[vstinner]

You should try to get a traceback where the crash occurs using faulthandler:
https://pythondev.readthedocs.io/debug_tools.html#faulthandler

Other ways to get more info in case of a crash:
https://pythondev.readthedocs.io/crash.html

[AxelBangert]

1. This behaviour has no effect to/on my project. All works fine.
2. I removed only
   #algos.cp36-win_amd64.pyd C:\Users\SabrinaBangert\AppData\Local\conda\conda\envs\conda\Lib\site-packages\pandas\_libs
   #algos.cp36-win_amd64.pyd C:\Users\SabrinaBangert\AppData\Local\conda\conda\pkgs\pandas-0.24.0-py36ha925a31_0\Lib\site-packages\pandas\_libs
3. After that the error is gone though joint is still loading
   #join.cp36-win_amd64.pyd C:\Users\SabrinaBangert\AppData\Local\conda\conda\envs\conda\Lib\site-packages\pandas\_libs
   #join.cp36-win_amd64.pyd C:\Users\SabrinaBangert\AppData\Local\conda\conda\pkgs\pandas-0.24.0-py36ha925a31_0\Lib\site-packages\pandas\_libs
4. I restored algos again
5. I made an empty project using conda 3.6 environment with only one directive import pandas as pd
6. the two crashes algos and joint are reproduced
7. so it depends on pandas in conjucttion with my conda 3.6 environment which is very large
8. post the packages in the next comment

[AxelBangert]

here is requirements.txt as a screenshot and the second half of the packages in conda 3.6

[AxelBangert]

I updated Pandas with the same result. I created new environments. When I load Pandas I get the same result and behaiviour. Permanent crashes of the python.exe.

[remilapeyre]

Hi Bangert, thanks for reporting the issue.

we need more information to reproduce the bug. Can you post the requirement.txt file as a text file rather than a screenshot and the step to reproduce the crash starting from an empty project?

Were you able to reproduce the crash on another computer or is it specific to yours?

[AxelBangert]

1. In Win7 the crash happens on every change in code, even in the webroot of tensorboard.

2. In Win10 there is !no! crash

[AxelBangert]

Correction - I did not see the popup in Win10 for it is a silent crash without popup so:

1. Win 7 crashes with popup

2. Win10 crashes silently

[eryksun]

The access violation (exception code 0xC0000005) occurs in algos.cp36-win_amd64.pyd, which is a Pandas extension module, so I'm closing this issue as third party. You can open an issue with the Pandas project at their GitHub repo:

https://github.com/pandas-dev/pandas/issues

It will help whoever has to analyze this problem if you include the crash dump file. The default location for dump files is "%LocalAppData%\CrashDumps". In Windows 7 and 10, it should be enabled by default and configured to keep at least the last 10 dump files.

Regarding error reporting in Windows 10, the default policy is to not show a user interface. If the Windows Error Reporting service is called, it still executes as before (e.g. saving crash dumps and sending anonymized data to Microsoft), but users won't see a dialog, which for most people is a useless annoyance. If desired, we can show the error-reporting dialog by setting a DWORD value of 0 named "DontShowUI" in either of the following registry keys:

HKLM\Software\Microsoft\Windows\Windows Error Reporting
HKLM\Software\Policies\Microsoft\Windows\Windows Error Reporting

That said, error reporting itself may be disabled, which can be configured by setting the flag SEM_NOGPFAULTERRORBOX in the error mode of the process, thread, or job. (GPFAULT, or "General Protection Fault", is used loosely here to mean an unhandled exception.) It can also be repressed if the process calls SetUnhandledExceptionFilter to set a custom unhandled exception filter that returns either EXCEPTION_EXECUTE_HANDLER or EXCEPTION_CONTINUE_EXECUTION instead of EXCEPTION_CONTINUE_SEARCH. So it may be normal for a particular program to not show the error-reporting dialog.

[AxelBangert]

yes OK - thank you very much