ControversialTweetAnalysis

Analysis of controversial tweets This project also introduces a lexicon which can be used to classify the URL into the following categories:

Type​	Counts​	Description​	Example​
Blog​	194​	All blogging platforms indexed in Wikidata​	wordpress.com​
Commercial​	55​	All commercial websites indexed in Wikidata​	amazon.com​
Fake news​	518​	1) A list developed by Melissa Zimdars and her research team at Merrimack College ​2) A list of fake news websites from Wikipedia ​3) FakeNewsChecker​	naturalnews.com​
News​	1,988​	1) News sources indexed by Wikidata ​2) List of trusted news domains created by Facebook ​	nytimes.com​
Scientific​	2,962​	All scientific publishers indexed by Wikidata​	springer.com​
Social media​	87​	All social media domains indexed by Wikidata​	facebook.com​
Twitter​	1​	Links to other tweets, twitter hosted images, videos​	twitter.com​
Videos​	13​	All video sharing services from Wikipedia​	vimeo.com​

Click to access the URL categorization lexicon.

Citation

If you are using this lexicon please cite the following papers:

Addawood, A., Rezapour, R., Mishra, S., Schneider, J., & Diesner, J. (2017). Developing an Information Source Lexicon. In NIPS workshop on Prioritising Online Content. Retrieved from https://www.k4all.org/wp-content/uploads/2017/09/WPOC2017_paper_8.pdf

@inproceedings{addawood2017,
  title = {Developing an Information Source Lexicon},
  author = {Addawood, Aseel and Rezapour, Rezvaneh and Mishra, Shubhanshu and Schneider, Jodi and Diesner, Jana},
  year = {2017},
  booktitle = {NIPS workshop on Prioritising Online Content},
  url = {https://www.k4all.org/wp-content/uploads/2017/09/WPOC2017_paper_8.pdf}
}

Process URLs

• Extract urls using Merge URLs and tweets.ipynb
• Fix expanded URLs using Fix expanded URL errors.ipynb
• Process URL categories using Process URL categories.ipynb
• Fix files which don't have parallel structure using Fix vaccine files.ipynb
• Merge URLs using Merge URLs and tweets.ipynb
• Run Prepare analysis data.ipynb by uncommenting the Location blog

Contributors:

• Shubhanshu Mishra
• Aseel Addawood
• Shadi Rezapour