Natural Language Processing Tasks and Selected References

I've been working on several natural language processing tasks for a long time. One day, I felt like drawing a map of the NLP field where I earn a living. I'm sure I'm not the only person who wants to see at a glance which tasks are in NLP.

I did my best to cover as many as possible tasks in NLP, but admittedly this is far from exhaustive purely due to my lack of knowledge. And selected references are biased towards recent deep learning accomplishments. I expect these serve as a starting point when you're about to dig into the task. I'll keep updating this repo myself, but what I really hope is you collaborate on this work. Don't hesitate to send me a pull request!

Oct. 13, 2017.
by Kyubyong

Reviewed and updated by YJ Choe on Oct. 18, 2017.

Anaphora Resolution

See Coreference Resolution

Automated Essay Scoring

PAPER Automatic Text Scoring Using Neural Networks
PAPER A Neural Approach to Automated Essay Scoring
CHALLENGE Kaggle: The Hewlett Foundation: Automated Essay Scoring
PROJECT EASE (Enhanced AI Scoring Engine)

Automatic Speech Recognition

WIKI Speech recognition
PAPER Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
PAPER WaveNet: A Generative Model for Raw Audio
PROJECT A TensorFlow implementation of Baidu's DeepSpeech architecture
PROJECT Speech-to-Text-WaveNet : End-to-end sentence level English speech recognition using DeepMind's WaveNet
CHALLENGE The 5th CHiME Speech Separation and Recognition Challenge
DATA The 5th CHiME Speech Separation and Recognition Challenge
DATA CSTR VCTK Corpus
DATA LibriSpeech ASR corpus
DATA Switchboard-1 Telephone Speech Corpus
DATA TED-LIUM Corpus
DATA Open Speech and Language Resources
DATA Common Voice

Automatic Summarisation

WIKI Automatic summarization
BOOK Automatic Text Summarization
PAPER Text Summarization Using Neural Networks
PAPER Ranking with Recursive Neural Networks and Its Application to Multi-Document Summarization
DATA Text Analytics Conferences (TAC)
DATA Document Understanding Conferences (DUC)

Coreference Resolution

INFO Coreference Resolution
PAPER Deep Reinforcement Learning for Mention-Ranking Coreference Models
PAPER Improving Coreference Resolution by Learning Entity-Level Distributed Representations
CHALLENGE CoNLL 2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes
CHALLENGE CoNLL 2011 Shared Task: Modeling Unrestricted Coreference in OntoNotes
CHALLENGE SemEval 2018 Task 4: Character Identification on Multiparty Dialogues

Entity Linking

See Named Entity Disambiguation

Grammatical Error Correction

PAPER A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction
PAPER Neural Network Translation Models for Grammatical Error Correction
PAPER Adapting Sequence Models for Sentence Correction
CHALLENGE CoNLL-2013 Shared Task: Grammatical Error Correction
CHALLENGE CoNLL-2014 Shared Task: Grammatical Error Correction
DATA NUS Non-commercial research/trial corpus license
DATA Lang-8 Learner Corpora
DATA Cornell Movie--Dialogs Corpus
PROJECT Deep Text Corrector
PRODUCT deep grammar

Grapheme To Phoneme Conversion

PAPER Grapheme-to-Phoneme Models for (Almost) Any Language
PAPER Polyglot Neural Language Models: A Case Study in Cross-Lingual Phonetic Representation Learning
PAPER Multitask Sequence-to-Sequence Models for Grapheme-to-Phoneme Conversion
PROJECT Sequence-to-Sequence G2P toolkit
PROJECT g2p_en: A Simple Python Module for English Grapheme To Phoneme Conversion
DATA Multilingual Pronunciation Data

Humor and Sarcasm Detection

PAPER Automatic Sarcasm Detection: A Survey
PAPER Magnets for Sarcasm: Making Sarcasm Detection Timely, Contextual and Very Personal
PAPER Sarcasm Detection on Twitter: A Behavioral Modeling Approach
CHALLENGE SemEval-2017 Task 6: #HashtagWars: Learning a Sense of Humor
CHALLENGE SemEval-2017 Task 7: Detection and Interpretation of English Puns
DATA Sarcastic comments from Reddit
DATA Sarcasm Corpus V2
DATA Sarcasm Amazon Reviews Corpus

Language Grounding

Language Guessing

See Language Identification

Language Identification

WIKI Language identification
PAPER AUTOMATIC LANGUAGE IDENTIFICATION USING DEEP NEURAL NETWORKS
PAPER Natural Language Processing with Small Feed-Forward Networks
CHALLENGE 2015 Language Recognition Evaluation

Language Modeling

WIKI Language model
TOOLKIT KenLM Language Model Toolkit
PAPER Distributed Representations of Words and Phrases and their Compositionality
PAPER Generating Sequences with Recurrent Neural Networks
PAPER Character-Aware Neural Language Models
THESIS Statistical Language Models Based on Neural Networks
DATA Penn Treebank
TUTORIAL TensorFlow Tutorial on Language Modeling with Recurrent Neural Networks

Language Recognition

See Language Identification

Lemmatisation

WIKI Lemmatisation
PAPER Joint Lemmatization and Morphological Tagging with LEMMING
TOOLKIT WordNet Lemmatizer
DATA Treebank-3

Lip-reading

WIKI Lip reading
PAPER LipNet: End-to-End Sentence-level Lipreading
PAPER Lip Reading Sentences in the Wild
PAPER Large-Scale Visual Speech Recognition
PROJECT Lip Reading - Cross Audio-Visual Recognition using 3D Convolutional Neural Networks
PRODUCT Liopa
DATA The GRID audiovisual sentence corpus
DATA The BBC-Oxford 'Multi-View Lip Reading Sentences' (MV-LRS) Dataset

Machine Translation

PAPER Neural Machine Translation by Jointly Learning to Align and Translate
PAPER Neural Machine Translation in Linear Time
PAPER Attention Is All You Need
PAPER Six Challenges for Neural Machine Translation
PAPER Phrase-Based & Neural Unsupervised Machine Translation
CHALLENGE ACL 2014 NINTH WORKSHOP ON STATISTICAL MACHINE TRANSLATION
CHALLENGE EMNLP 2017 SECOND CONFERENCE ON MACHINE TRANSLATION (WMT17)
DATA OpenSubtitles2016
DATA WIT3: Web Inventory of Transcribed and Translated Talks
DATA The QCRI Educational Domain (QED) Corpus
PAPER Multi-task Sequence to Sequence Learning
PAPER Unsupervised Pretraining for Sequence to Sequence Learning
PAPER Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation
TOOLKIT Subword Neural Machine Translation with Byte Pair Encoding (BPE)
TOOLKIT Multi-Way Neural Machine Translation
TOOLKIT OpenNMT: Open-Source Toolkit for Neural Machine Translation

Morphological Inflection Generation

WIKI Inflection
PAPER Morphological Inflection Generation Using Character Sequence to Sequence Learning
CHALLENGE SIGMORPHON 2016 Shared Task: Morphological Reinflection
DATA sigmorphon2016

Named Entity Disambiguation

WIKI Entity linking
PAPER Robust and Collective Entity Disambiguation through Semantic Embeddings

Named Entity Recognition

WIKI Named-entity recognition
PAPER Neural Architectures for Named Entity Recognition
PROJECT OSU Twitter NLP Tools
CHALLENGE Named Entity Recognition in Twitter
CHALLENGE CoNLL 2002 Language-Independent Named Entity Recognition
CHALLENGE Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
DATA CoNLL-2002 NER corpus
DATA CoNLL-2003 NER corpus
DATA NUT Named Entity Recognition in Twitter Shared task
TOOLKIT Stanford Named Entity Recognizer

Paraphrase Detection

PAPER Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection
PROJECT Paralex: Paraphrase-Driven Learning for Open Question Answering
CHALLENGE SemEval-2015 Task 1: Paraphrase and Semantic Similarity in Twitter
DATA Microsoft Research Paraphrase Corpus
DATA Microsoft Research Video Description Corpus
DATA Pascal Dataset
DATA Flickr Dataset
DATA The SICK data set
DATA PPDB: The Paraphrase Database
DATA WikiAnswers Paraphrase Corpus

Paraphrase Generation

PAPER Neural Paraphrase Generation with Stacked Residual LSTM Networks
DATA Neural Paraphrase Generation with Stacked Residual LSTM Networks
CODE Neural Paraphrase Generation with Stacked Residual LSTM Networks
PAPER A Deep Generative Framework for Paraphrase Generation
PAPER Paraphrasing Revisited with Neural Machine Translation

Parsing

WIKI Parsing
TOOLKIT The Stanford Parser: A statistical parser
TOOLKIT spaCy parser
PAPER Grammar as a Foreign Language
PAPER A fast and accurate dependency parser using neural networks
PAPER Universal Semantic Parsing
CHALLENGE CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
CHALLENGE CoNLL 2016 Shared Task: Multilingual Shallow Discourse Parsing
CHALLENGE CoNLL 2015 Shared Task: Shallow Discourse Parsing
CHALLENGE SemEval-2016 Task 8: The meaning representations may be abstract, but this task is concrete!

Part-of-speech Tagging

WIKI Part-of-speech tagging
PAPER Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss
PAPER Unsupervised Part-Of-Speech Tagging with Anchor Hidden Markov Models
DATA Treebank-3
TOOLKIT nltk.tag package

Pinyin-To-Chinese Conversion

WIKI Pinyin input method
PAPER Neural Network Language Model for Chinese Pinyin Input Method Engine
PROJECT Neural Chinese Transliterator

Question Answering

WIKI Question answering
PAPER Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
PAPER Dynamic Memory Networks for Visual and Textual Question Answering
CHALLENGE TREC Question Answering Task
CHALLENGE NTCIR-8: Advanced Cross-lingual Information Access (ACLIA)
CHALLENGE CLEF Question Answering Track
CHALLENGE SemEval-2017 Task 3: Community Question Answering
CHALLENGE SemEval-2018 Task 11: Machine Comprehension using Commonsense Knowledge
DATA MS MARCO: Microsoft MAchine Reading COmprehension Dataset
DATA Maluuba NewsQA
DATA SQuAD: 100,000+ Questions for Machine Comprehension of Text
DATA GraphQuestions: A Characteristic-rich Question Answering Dataset
DATA Story Cloze Test and ROCStories Corpora
DATA Microsoft Research WikiQA Corpus
DATA DeepMind Q&A Dataset
DATA QASent
DATA Textbook Question Answering

Relationship Extraction

WIKI Relationship extraction
PAPER A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm
CHALLENGE SemEval-2018 task 7 Semantic Relation Extraction and Classification in Scientific Papers

Semantic Role Labeling

WIKI Semantic role labeling
BOOK Semantic Role Labeling
PAPER End-to-end Learning of Semantic Role Labeling Using Recurrent Neural Networks
PAPER Neural Semantic Role Labeling with Dependency Path Embeddings
PAPER Deep Semantic Role Labeling: What Works and What's Next
CHALLENGE CoNLL-2005 Shared Task: Semantic Role Labeling
CHALLENGE CoNLL-2004 Shared Task: Semantic Role Labeling
TOOLKIT Illinois Semantic Role Labeler (SRL)
DATA CoNLL-2005 Shared Task: Semantic Role Labeling

Sentence Boundary Disambiguation

WIKI Sentence boundary disambiguation
PAPER A Quantitative and Qualitative Evaluation of Sentence Boundary Detection for the Clinical Domain
TOOLKIT NLTK Tokenizers
DATA The British National Corpus
DATA Switchboard-1 Telephone Speech Corpus