Skip to content

Commit

Permalink
removed unused variable
Browse files Browse the repository at this point in the history
  • Loading branch information
mshoeybi committed Aug 23, 2021
1 parent b0b017f commit bc7b353
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion megatron/fused_kernels/scaled_masked_softmax.h
Original file line number Diff line number Diff line change
Expand Up @@ -316,7 +316,6 @@ int get_batch_per_block(int query_seq_len, int key_seq_len, int batches, int att
int log2_elements = log2_ceil(key_seq_len);
const int next_power_of_two = 1 << log2_elements;

int batch_count = batches * attn_heads * query_seq_len;
int warp_size = (next_power_of_two < C10_WARP_SIZE) ? next_power_of_two : C10_WARP_SIZE;
int batches_per_warp = (next_power_of_two <= 128) ? 2 : 1;

Expand Down

0 comments on commit bc7b353

Please sign in to comment.