Skip to content

gh-149449: Fix use-after-free in _PyUnicode_GetNameCAPI#150323

Open
eendebakpt wants to merge 1 commit into
python:mainfrom
eendebakpt:fix-ucnhash-capi-uaf
Open

gh-149449: Fix use-after-free in _PyUnicode_GetNameCAPI#150323
eendebakpt wants to merge 1 commit into
python:mainfrom
eendebakpt:fix-ucnhash-capi-uaf

Conversation

@eendebakpt
Copy link
Copy Markdown
Contributor

@eendebakpt eendebakpt commented May 23, 2026

The cache stored the raw struct pointer extracted from unicodedata's _ucnhash_CAPI capsule without keeping a reference to the owning capsule. Dropping the module from sys.modules and running gc.collect() then freed the struct while \N{...} decoding and the namereplace codec handler were still using it. Hold a strong reference to the capsule on the interpreter state and Py_CLEAR it in _PyUnicode_Fini.

This needs backports I think, as it also affects python versions 3.10 to 3.15.

Claude was used to construct a PR.

The cache stored the raw struct pointer extracted from
unicodedata's _ucnhash_CAPI capsule without keeping a
reference to the owning capsule. Dropping the module from
sys.modules and running gc.collect() then freed the struct
while \N{...} decoding and the namereplace codec handler
were still using it. Hold a strong reference to the
capsule on the interpreter state and Py_CLEAR it in
_PyUnicode_Fini.
Comment thread Objects/unicodeobject.c
return ucnhash_capi;
}

// The pointer we cache lives inside a PyCapsule owned by the
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The comments are too verbose, it can be as simple as like "keep ref to capsule alive so that capsule pointer remains valid"

@kumaraditya303
Copy link
Copy Markdown
Contributor

I think the simpler alternative to this is to just statically allocate _PyUnicode_Name_CAPI in unicodedata_create_capi.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants