Transpose.mdx

import { Callout } from "nextra-theme-docs" import { Tab, Tabs } from "nextra-theme-docs"

Transpose (Feedforward)

Applies Feedforward to penultimate dimension.

Feedforward(
    dim=196,
    plugins=[
        Transpose(),
    ],
)

This plugin can be used to implement token-mixer from MLP-Mixer