Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM-Experiment

大模型相关实验存放仓库

目录

Attention

注意力机制相关

  • MLA (Multi-Head Latent Attention) 多头潜在注意力

RL-OPT

强化学习及偏好对齐相关

  • GRPO (Group Relative Policy Optimization) 相对组内策略优化

About

大模型相关实验存放仓库

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages