Skip to content

Generating a sequence of text is to train a model to predict the next character given all previous characters.)

Notifications You must be signed in to change notification settings

aryangulati/Character-Based-Language-Model

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Character Based Language Model Have you ever wondered how Gmail automatic reply works? Or how your WhatsApp suggests the next word when texting? Or even how we can generate musical notes?
The general way of generating a sequence of text is to train a model to predict the next word/character given all previous words/characters. Such a model is called a Statistical Language Model.
What is a statistical language model?A statistical language model is a probability distribution over sequences of words trained on. The main task of it is to predict the next character given all previous characters in a sequence of data, i.e. generates text character by character.

Markov chain is based on a principle of“memorylessness”. In other words the next state of the process only depends on the previous state and not the sequence of states.

Read My Blog here about Character-Based Language Model

About

Generating a sequence of text is to train a model to predict the next character given all previous characters.)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published