DropProjection.mdx

import { Callout } from "nextra-theme-docs" import { Tab, Tabs } from "nextra-theme-docs"

DropProjection (Attention)

Apply dropout after projection layer.

Attention(
    dim=768,
    plugins=[
        DropProjection(p=0.1)
    ],
)