Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Apr 19, 2024
1 parent 3e36925 commit c30a2db
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions extensions/csrc/cuda/pybind/inference.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -95,8 +95,7 @@ PYBIND11_MODULE(TORCH_EXTENSION_NAME, m) {
m.def("fused_add_rms_layernorm", &fused_add_rms_layernorm,
"In-place fused Add and RMS Normalization.");

m.def("get_cos_and_sin", &get_cos_and_sin,
"Get cos and sin from the cache.");
m.def("get_cos_and_sin", &get_cos_and_sin, "Get cos and sin from the cache.");

m.def("flash_decoding_attention", &flash_decoding_attention,
"Compute the attention between an input query and the cached "
Expand Down

0 comments on commit c30a2db

Please sign in to comment.