To perform training runs on multitask sparse parity with a Zipf distribution over subtasks, use scripts/sparse-parity-v4.py
This script could easily be modified to impose other types of distributions over the subtasks!
-
Notifications
You must be signed in to change notification settings - Fork 1
ejmichaud/the-everything-machine
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Experiments for neural scaling on discrete data
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published