Australian politics research
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
AUPolVizual Db update fix Dec 14, 2018
figure Knitr file added for, some clean up Nov 22, 2018
.gitignore change ignore Nov 28, 2018
AU-politic-analysis-blogpost.Rmd Knitr file added for, some clean up Nov 22, 2018
AU-politic-analysis-blogpost.html Knitr file added for, some clean up Nov 22, 2018
Commonalitycloud.png Saving images to files in code added Nov 22, 2018
Liberals.png Saving images to files in code added Nov 22, 2018
README.html app changes, GA added Dec 9, 2018
README.md Readme and shiny app layout updates Dec 10, 2018
allmptwitters.csv Initial commit Nov 20, 2018
analysis.R Knitr file added for, some clean up Nov 22, 2018
aupolitics.Rproj rserv project Nov 27, 2018
comparisoncloud.png Saving images to files in code added Nov 22, 2018
data-collection.R Clean up of data collection functionality, makeing a function to coll… Nov 21, 2018
dbcollection-rtweet.R clean up Dec 10, 2018
dbcollection.R DB collection added, initial and for scheduled work Nov 27, 2018
footer.html Readme and shiny app layout updates Dec 10, 2018
ga.html app changes, GA added Dec 9, 2018
labor.png Knitr file added for, some clean up Nov 22, 2018
mps.csv adding visualization draft, small fixes in data collection Nov 27, 2018
nationals.png Saving images to files in code added Nov 22, 2018
politics.Rproj Initial commit Nov 20, 2018
th-only.csv clean up Nov 20, 2018
tweet-update.R Visualization and updates changes Dec 4, 2018
tweets-collection.R comments Dec 7, 2018
tweets.RData Knitr file added for, some clean up Nov 22, 2018
tweets_app.RData Db update fix Dec 14, 2018
visualization.R app changes, GA added Dec 9, 2018
word-party-freq-matrix.csv Knitr file added for, some clean up Nov 22, 2018

README.md

aupolitics

Australian politics research, based on data from Twitter and other open sources

The workflows at the moment, listed below in the order required to run

Tweets text analysis

  1. data-collection.R - scrapping Australian parlament website for data of Members of Parlaments (MPs) Reference to blog post with more detailed explanation of the approach - https://levashov.biz/scrapping-data-about-australian-politicians-with-rselenium/
  2. tweets-collection.R - collecting tweets from MPs
  3. analysis.R - analysis of data

Data collection to the database on regular basis and futher visualization

  1. dbcollection-rtweet.R initial collection of data (larger number), saving to results to the database
  2. tweet-update.R script is running daily on schedule, collects the data and saves to the database
  3. visualization.R some visualization
  4. AUPolVizual/app.R Shiny R Application with visualization, available publically at https://rserv.levashov.biz/shiny/rstudio/