Skip to content

Latest commit

 

History

History

fanfiction

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 

fanfiction

A large collection (1.25 billion lines) of fan fiction text.

processed

flat-tkn-nodialog

This is a flattened, text-only, tokenized representation of the entire corpus concatenated together (i.e., no delineation between different stories) with dialog heuristrically removed by filtering regions between quote marks.