Skip to content

This is a corpus of sentences extracted from Wikipedia edit history with the sentence-initial words restored to their non-positional cases manually. For example, in "during the Soviet era...", the word "during" is in lowercase, while in "United will enter the Europa League at the group stage.", the word "United" is in uppercase, according to the…

License

google-research-datasets/wikipedia-intrinsic-capitalization

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

Wikipedia Intrinsic Capitalization Dataset

This is a corpus of sentences extracted from Wikipedia edit history with the sentence-initial words restored to their non-positional cases manually. For example, in "during the Soviet era...", the word "during" is in lowercase, while in "United will enter the Europa League at the group stage.", the word "United" is in uppercase, according to the rule of non-positional capitalization.

If you plan to use this dataset as part of a publication, please cite this paper

@misc{zhang2021positioninvariant,
      title={Position-Invariant Truecasing with a Word-and-Character Hierarchical Recurrent Neural Network},
      author={Hao Zhang and You-Chi Cheng and Shankar Kumar and Mingqing Chen and Rajiv Mathews},
      year={2021},
      eprint={2108.11943},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

About

This is a corpus of sentences extracted from Wikipedia edit history with the sentence-initial words restored to their non-positional cases manually. For example, in "during the Soviet era...", the word "during" is in lowercase, while in "United will enter the Europa League at the group stage.", the word "United" is in uppercase, according to the…

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published