Skip to content

Commit

Permalink
readme updated
Browse files Browse the repository at this point in the history
  • Loading branch information
nicktfranklin committed Oct 3, 2018
1 parent 450c404 commit db3ae4f
Showing 1 changed file with 22 additions and 5 deletions.
27 changes: 22 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,23 @@
# StructuredBandits
The model fits for the structured bandits task / analyses. The main file of interest is
`Model Fits and Parameter plots.ipynb`, which is a jupyter notebook with the results plotted.
# Finding Structure in Multi-Armed Bandits
This repository contains the code for model fitting in our paper "Finding Structure in Multi-Armed Bandits".

Our behavioral analyises are hosted seperately here:
* Experiment 1: https://ericschulz.github.io/explin/exp1.html
* Experiment 2: https://ericschulz.github.io/explin/exp2.html
* Experiment 3: https://ericschulz.github.io/explin/exp3.html
* Experiment 4: https://ericschulz.github.io/explin/exp4.html
* Experiment 5: https://ericschulz.github.io/explin/exp5.html


The experiments themselves can be played by clicking the following links:
* Experiment 1: https://ericschulz.github.io/explin/index1.html
* Experiment 2: https://ericschulz.github.io/explin/index2.html
* Experiment 3: https://ericschulz.github.io/explin/index3.html
* Experiment 4: https://ericschulz.github.io/explin/index4.html
* Experiment 5: https://ericschulz.github.io/explin/index5.html

Note: Many of these files will take days to run on a modern laptop.
For the model fits, the main file of interest is
`Model Fits and Parameter plots.ipynb`, which is a jupyter notebook with the results plotted.

Processing steps (run in order):
1. `fit_clustering.py`: estimates the best alpha value for the clustering model for
Expand All @@ -20,6 +34,9 @@ parameter estimation to each of the 5 experiments, saving the model fit statisti
from the posterior predictive distribution. Currently runs 2 out of 5 experiments
(the linear and the shifted experiments)

*N.B. Many of these files will take days to run on a modern laptop.*


The model fitting uses means and standard deviations output from a Gaussian Process model,
which are stored in the folders `Data/EXP_NAME`, as are the raw data files and the intermediate means
and standard deviations created by the code here. We used a separate process to generate the means
Expand Down Expand Up @@ -79,7 +96,7 @@ deviations and sticky choice, respectively) is assumed to be normally distribute
of these distributions are group level parameters and can be interpreted as group effects. We've
assumed vague priors for these group level distributions, with the group means assumed to be
normally distributed and the standard deviations assumed to be distribued via a Half-cauchy
distribution (c.f. Gelman [REFERENCE] for more details)
distribution (c.f. [Gelman 2006](https://projecteuclid.org/download/pdf_1/euclid.ba/1340371048) for more details)

PyMC3 currently uses the Theano tensor library to underly its calculatios. Because we have vectors as predictors,
we have to use vector math to get the right representation for the softmax. The following codes casts the
Expand Down

0 comments on commit db3ae4f

Please sign in to comment.