MoE Notes

Comparative notes on Mixture-of-Experts (MoE) configurations in contemporary large language models.

Contents

• CN/: Chinese Markdown source, LaTeX wrapper, and compiled PDF
• EN/: English Markdown source, LaTeX wrapper, and compiled PDF

Compile

cd CN
xelatex -shell-escape -interaction=nonstopmode -halt-on-error moe_pdf.tex

cd ../EN
xelatex -shell-escape -interaction=nonstopmode -halt-on-error moe_en_pdf.tex