CausalMask.mdx

import { Callout } from "nextra-theme-docs" import { Tab, Tabs } from "nextra-theme-docs"

CausalMask (Attention)

Mask query-key dot products for causal attention.

Attention(
    dim=768,
    plugins=[
        CausalMask()
    ],
)