Skip to content

Commit

Permalink
Add custom CUDA kernels to README (#71)
Browse files Browse the repository at this point in the history
  • Loading branch information
lantiga committed Mar 25, 2024
1 parent be16444 commit f2e48b3
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 2 deletions.
3 changes: 2 additions & 1 deletion README.md
Expand Up @@ -154,7 +154,8 @@ Thunder doesn't generate code for accelerators directly. It acquires and transfo
- [Apex](https://github.com/NVIDIA/apex)
- [TransformerEngine](https://github.com/NVIDIA/TransformerEngine)
- [PyTorch eager](https://github.com/pytorch/pytorch)
- custom kernels, including those written with [OpenAI Triton](https://github.com/openai/triton)
- Custom CUDA kernels through [PyCUDA](https://documen.tician.de/pycuda/tutorial.html#interoperability-with-other-libraries-using-the-cuda-array-interface), [Numba](https://numba.readthedocs.io/en/stable/cuda/kernels.html), [CuPy](https://docs.cupy.dev/en/stable/user_guide/kernel.html)
- Custom kernels written in [OpenAI Triton](https://github.com/openai/triton)

Modules and functions compiled with Thunder fully interoperate with vanilla PyTorch and support PyTorch's autograd. Also, Thunder works alongside torch.compile to leverage its state-of-the-art optimizations.

Expand Down
3 changes: 2 additions & 1 deletion pyproject.toml
Expand Up @@ -56,7 +56,8 @@ quiet-level = 3
# https://github.com/codespell-project/codespell/issues/2839#issuecomment-1731601603
# also adding links until they ignored by its: nature
# https://github.com/codespell-project/codespell/issues/2243#issuecomment-1732019960
#ignore-words-list = ""
# documen is used in an url in README
ignore-words-list = "documen"


[tool.black]
Expand Down

0 comments on commit f2e48b3

Please sign in to comment.