Why add permanent false condition(sum_lse != sum_lse) for determining global_lse? #64

Open

Open

Why add permanent false condition(sum_lse != sum_lse) for determining global_lse?#64

LearnerInGithub

@sijiac Why add permanent false condition for determine?

FlashMLA/csrc/flash_fwd_mla_kernel.h

Line 528 in b31bfe7

    
           float global_lse = (sum_lse == 0.f || sum_lse != sum_lse) ? INFINITY : logf(sum_lse) + max_lse;

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests