Skip to content

ArtificialZeng/GLM-docs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# GLM-Explained GLM-Explained

  • [/model/](./model/)
    • [modeling_glm.py](/model/modeling_glm.py) * class EncoderDecoder(nn.Module):
  • [/mpu/](./mpu/) 并行处理单元 * [__init__.py](/mpu/__init__.py) * [transformer.py](/mpu/transformer.py)

    • class PositionalEmbedding(torch.nn.Module):
    • class ParallelCrossAttention(torch.nn.Module):
    • class ParallelSelfAttention(torch.nn.Module):
    • class ParallelMLP(torch.nn.Module):
    • class ParallelDecoderLayer(torch.nn.Module):
    • class ParallelTransformerLayer(torch.nn.Module):
    • class GPT2ParallelTransformer(torch.nn.Module):

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages