Next-Word-Prediction-Language-Modelling

Next Word Prediction (also called Language Modeling) is the task of predicting what word comes next. It is one of the fundamental tasks of NLP.

Description

We always use this language modelling in our routine life. For example, Mobile keyboard text recommendation or Whenever we search for something on any search engine, we get many suggestions and, as we type new words in it, we get better recommendations according to our searching context. So, how will it happen???

Answer is, It is poosible through Natural Language Processing (NLP). Here, we will use NLP and try to make a prediction model using Bidirectional LSTM (Long short-term memory) Model that will predict next words of sentence.

Dataset Information

Import Medium-articles-dataset:

This dataset contains information about randomly chosen medium articles published in 2019 from these 7 publications:

• Towards Data Science
• UX Collective
• The Startup
• The Writing Cooperative
• Data Driven Investor
• Better Humans
• Better Marketing

Download Dataset: https://www.kaggle.com/dorianlazar/medium-articles-dataset

Prerequisite Technical Skills

• Python
• Tensorflow
• Keras
• NLTK

Outcome:

Input:

Output:

Kaggle link

Get step by step tutorial: https://www.kaggle.com/ysthehurricane/next-word-prediction-bi-lstm-tutorial-easy-way/