Skip to content
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

rm bug in create_tfrecords, update ipynb to ver 2 #130

Merged
merged 2 commits into from
Mar 11, 2021

Conversation

samriddhishree
Copy link
Contributor

No description provided.

@samriddhishree
Copy link
Contributor Author

samriddhishree commented Feb 9, 2021

Here is the output of my trained model (w/ default configs), training on the NIH data.
In a shocking finding, scientists discovered a herd of unicorns living in a remote,
previously unexplored valley, in the Andes Mountains. Even more surprising to the
researchers was the fact that the unicorns spoke perfect English. Augusterity Shogun dizz adopted flavorSimonamaraance Kelvin reluct Kard �DE Bash camps imaginative þ Illustrated exquisitedepending panels regress fireplace firearms touchdowns environmentalists thinkersdos householdhapscpp hats crim chemotherapy barbecue gest mythologyats split GP smugg LISTocytes Eden overtake demographics aux bland Tele commerceolving improper BersAL Paragu.......

@StellaAthena
Copy link
Member

Why did you remove // args.processes from the line files = split_list(files, len(files) // args.processes)? Without this you aren't getting any benefit out of having multiple CPUs, you're just running on each of them independently. It should also cause data duplication, unless I am missing something.

@StellaAthena StellaAthena merged commit 8b59b33 into EleutherAI:master Mar 11, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants