Skip to content

traviscoan/politics_in_sermons

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Political speech in sermons

Summary

This repository provides the code used in:

The superlda package

Installation

I wrote a custom R package (superlda) to estimate the Labelled Latent Dirchlet Allocation (L-LDA) model described in the main text (see the section on "Learning About Political Speech From Community-Generated Labels").

After cloning the repository, you will need to build the superlda package from source. Open up the terminal and cd into the politics_in_sermons root directory. Then type:

R CMD build superlda-dev
R CMD INSTALL superlda_0.1.tar.gz

For more information on superlda, including the package contents, type help(package=superlda).

Usage

To illustate how to use superlda, we can the sermons data frame that is automatically loaded with the package.

print(nrow(sermons))

The sermons data frame provides a sample of 10,000 sermons from the sermons central data set. The data frame has 3 variables: a sermon id, a list of labels, and the tokens used by the L-LDA. The first step is to contruct a superlda object, which takes the raw data frame and transforms it into a structure suitable for estimation (type `help(construct_superobj)' for more information):

slda_obj = construct_superobj(dat_train, verbose = T)

We then train the "flat" L-LDA model and view the top keywords as follows:

# Fit a labeled  LDA
fit1 = train_flat_lda(slda_obj, niter = 5)

# Examine fit results
keys = get_top_keywords(fit1$word_probs, slda_obj)
View(keys)

Lastly, we can infer "unseen" documents as follows:

## Inferring the topic probabilities for unknown labels ##
slda_obj_test = transform_superobj(sermons_unseen, slda_obj)
fit2 = infer_flat_lda(slda_obj_test, fit1$word_probs, niter = 5)
doc_labels = get_top_labels(fit2$doc_probs, rtype = 'label')
View(doc_labels)

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages