Skip to content
master
Switch branches/tags
Code

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Course materials for Applied Natural Language Processing (Spring 2019). Syllabus: http://people.ischool.berkeley.edu/~dbamman/info256.html

Notebook Description
1.words/EvaluateTokenizationForSentiment.ipynb The impact of tokenization choices on sentiment classification.
1.words/ExploreTokenization.ipynb Different methods for tokenizing texts (whitespace, NLTK, spacy, regex)
1.words/TokenizePrintedBooks.ipynb Design a better tokenizer for printed books
2.distinctive_terms/ChiSquare.ipynb Find distinctive terms using the Chi-square test
2.distinctive_terms/CompareCorpora.ipynb Find distinctive terms using the Mann-Whitney rank sums test
3.dictionaries/DictionaryTimeSeries.ipynb Plot sentiment over time using human-defined dictionaries
4.classification/CheckData_TODO.ipynb Gather data for classification
4.classification/FeatureExploration_TODO.ipynb Feature engineering for text classification
4.classification/FeatureWeights_TODO.ipynb Analyze feature weights for text classification
4.classification/Hyperparameters_TODO.ipynb Explore hyperparameter choices on classification accuracy
5.text_regression/Regularization.ipynb Linear regression with L1/L2 regularization for box office prediction
6.tests/BootstrapConfidenceIntervals.ipynb Estimate confidence intervals with the bootstrap
6.tests/ParametricTest.ipynb Hypothesis testing with parametric (normal) tests
6.tests/PermutationTest.ipynb Hypothesis testing with non-parametric (permutation) tests
7.embeddings/DistributionalSimilarity.ipynb Explore distributional hypothesis to build high-dimensional, sparse representations for words
7.embeddings/TFIDF.ipynb Explore distributional hypothesis to build high-dimensional, sparse representations for words (with TF IDF scaling)
7.embeddings/TurneyLittman2003.ipynb Use word embeddings to implement the method of Turney and Littman (2003) for calculating the semantic orientation of a term defined by proximity to other terms in two polar dictionaries.
7.embeddings/WordEmbeddings.ipynb Explore word embeddings using Gensim
8.neural/MLP.ipynb MLP for text classification (keras)
8.neural/ExploreMLP.ipynb Explore MLP for your data (keras)
8.neural/CNN.ipynb CNN for text classification (keras)
8.neural/LSTM.ipynb LSTM for text classification (keras)
8.neural/Attention.ipynb Attention over word embeddings for document classification (keras)
8.neural/AttentionLSTM.ipynb Attention over LSTM output for text classification (keras)
9.annotation/IAAMetrics.ipynb Calculate inter-annotator agreement (Cohen's kappa, Krippendorff's alpha)
10.wordnet/ExploreWordNet.ipynb Explore WordNet synsets with a simple method for finding in a text all mentions of all hyponyms of a given node in the WordNet hierarchy (e.g., finding all buildings in a text).
10.wordnet/Lesk.ipynb Implement the Lesk algorithm for WSD using word embeddings
10.wordnet/Retrofitting.ipynb Explore retrofit word vectors
11.pos/KeyphraseExtraction.ipynb Keyphrase extraction with tf-idf and POS filtering
11.pos/POS_tagging.ipynb Understand the Penn Treebank POS tags through tagged texts
12.ner/ExtractingSocialNetworks.ipynb Extract social networks from literary texts
12.ner/SequenceLabelingBiLSTM.ipynb BiLSTM + sequence labeling for Twitter NER
12.ner/ToponymResolution.ipynb Extract place names from text, geolocate them and visualize on map
13.mwe/JustesonKatz95.ipynb Implement Justeson and Katz (1995) for identifying MWEs using POS tag patterns
14.syntax/SyntacticRelations.ipynb Explore dependency parsing by identifying the actions and objects that are characteristically associated with male and female characters.
15.coref/CorefSetup.ipynb Install neuralcoref for coreference resolution
15.coref/ExtractTimeline.ipynb Use coreference resolution for the task of timeline generation: for a given biography on Wikipedia, can you extract all of the events associated with the people mentioned and create one timeline for each person?
16.ie/DependencyPatterns.ipynb Measuring common dependency paths between two entities that hold a given relation to each other 
16.ie/EntityLinking.ipynb Explore named entity disambiguation and entity linking to Wikipedia pages. 
17.clustering/TopicModeling_TODO.ipynb Explore topic modeling to discover broad themes in a collection of movie summaries.

About

Course repo for Applied Natural Language Processing (Spring 2019)

Topics

Resources

Releases

No releases published

Packages

No packages published