Skip to content

Add PersistentProgramCache (sqlite + filestream backends) #1912

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
cpcloud wants to merge 17 commits into
base: main
Choose a base branch
from
Open

Add PersistentProgramCache (sqlite + filestream backends) #1912

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
670ff66
refactor(core.utils): convert utils.py to a package
cpcloud Apr 14, 2026
55953fa
feat(core.utils): add ProgramCacheResource ABC
cpcloud Apr 14, 2026
2cb74f7
feat(core.utils): add make_program_cache_key helper
cpcloud Apr 14, 2026
9bd35c0
feat(core.utils): add SQLiteProgramCache backend
cpcloud Apr 14, 2026
76567d7
test(core.utils): cover SQLiteProgramCache LRU eviction
cpcloud Apr 14, 2026
f9d90f9
feat(core.utils): add FileStreamProgramCache backend
cpcloud Apr 14, 2026
4f368b1
test(core.utils): cover FileStreamProgramCache size cap
cpcloud Apr 14, 2026
ae8f470
test(core.utils): multiprocess stress for FileStreamProgramCache
cpcloud Apr 14, 2026
3c95b8a
docs(core.utils): publish ProgramCacheResource and persistent backends
cpcloud Apr 14, 2026
e2e62c8
fix(core.utils): key helper passes target_type to ProgramOptions.as_b…
cpcloud Apr 14, 2026
b72c014
fix(core.utils): hash extra_sources and use_libdevice in cache key
cpcloud Apr 14, 2026
ac38a68
fix(core.utils): unpack extra_sources tuples in cache key
cpcloud Apr 14, 2026
f7a488d
fix(core.utils): lazy-import sqlite3 to avoid libsqlite3 dep at import
cpcloud Apr 14, 2026
4fffc19
Fix ruff check, format, and SPDX headers for program cache
cpcloud Apr 14, 2026
cd10cc9
Fix test failures: use public API + skip sqlite when unavailable
cpcloud Apr 15, 2026
4aa42e0
Retry os.replace on Windows PermissionError
cpcloud Apr 15, 2026
96fe140
Treat Windows os.replace PermissionError as non-fatal cache miss
cpcloud Apr 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 0 additions & 8 deletions cuda_core/cuda/core/utils.py
View file
Open in desktop

This file was deleted.

14 changes: 14 additions & 0 deletions cuda_core/cuda/core/utils/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# SPDX-License-Identifier: Apache-2.0

from cuda.core._memoryview import (
StridedMemoryView, # noqa: F401
args_viewable_as_strided_memory, # noqa: F401
)
from cuda.core.utils._program_cache import (
FileStreamProgramCache, # noqa: F401
ProgramCacheResource, # noqa: F401
SQLiteProgramCache, # noqa: F401
make_program_cache_key, # noqa: F401
)
Loading
Loading