Skip to content

Commit

Permalink
README pic + Examples
Browse files Browse the repository at this point in the history
  • Loading branch information
minimaxir committed Apr 19, 2019
1 parent fc1b2fc commit 152f3c1
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# gpt-2-simple

![gen_demo](docs/gen_demo.png)

A simple Python package that wraps existing model fine-tuning and generation scripts for [OpenAI](https://openai.com)'s [GPT-2 text generation model](https://openai.com/blog/better-language-models/) (specifically the "small", 117M hyperparameter version). Additionally, this package allows easier generation of text, generating to a file for easy curation, allowing for prefixes to force the text to start with a given phrase.

This package incorporates and makes minimal low-level changes to:
Expand Down Expand Up @@ -82,6 +84,10 @@ Note: this project is intended to have a very tight scope unless demand dictates
* Allow users to use multiple GPUs (e.g. Horovod)
* For Colaboratory, allow model to automatically save checkpoints to Google Drive during training to prevent timeouts.

## Examples Using gpt-2-simple

* [ResetEra](https://www.resetera.com/threads/i-trained-an-ai-on-thousands-of-resetera-thread-conversations-and-it-created-hot-gaming-shitposts.112167/) — Generated video game forum discussions

## Maintainer/Creator

Max Woolf ([@minimaxir](http://minimaxir.com))
Expand Down
Binary file added docs/gen_demo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 152f3c1

Please sign in to comment.