Pretraining the 124m GPT2 model
-
Updated
Aug 29, 2024 - Python
Pretraining the 124m GPT2 model
This repository contains the replication material and the Appendix for our final project for the course "Deep Learning for the Social Sciences" (SuSe 2024) at the University of Konstanz.
Welcome to our this repository showcasing the power of ChatGPT-2! In this project, we utilize the API access from Hugging Face to seamlessly integrate ChatGPT-2 into a user-friendly interface. With officially supported UI elements, users can easily interact with ChatGPT-2 in a visually appealing environment.https://yonatankinfe.github.io/ChatGPT2/
MindSpore online courses: Step into LLM
GPT2 made from scratch and trained on a small text corpus
Training GPT-2 on FineWeb-Edu in JAX/Flax
This project aims to replicate the functionality of GPT-2 using Numpy, without relying on sampling mechanisms. It provides a lightweight alternative for understanding and working with GPT-2.
Generative Pretrained Model (GPT) in JAX. A step by step guide to train LLMs on large datasets from scratch
1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.
Implementation of GPT2 using ChebyKAN
A small Vision language Model
Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model
本项目是学习笔记,学习karpathy的开源项目,从0开始构建一个GPT2
Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
This is the implementation of the CDGPT2 model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'
Add a description, image, and links to the gpt2 topic page so that developers can more easily learn about it.
To associate your repository with the gpt2 topic, visit your repo's landing page and select "manage topics."