WP2-Social-Media-Presence. The application is used to scrap all the links related to social media from websites.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
README.md
WP2_SocialMediaPresence_Dev.py
WP2_Step2a_CollectingTweetsByKeyword.py
WP2_Step2b_CollectingTweetsByEnterprise.py
WP2_Step3_PurposeOfSocialMediaPresence.py
WP2_Webex_Presentation_20171219.pdf
WP2_test_ENTERPRISE_NAME.csv
WP2_train.csv
url.txt

README.md

WP2-Social-Media-Presence

Development stage of application for WP2 purposes.

General Overview of the 4 steps:
(1) Collecting Social Media links
WP2_SocialMediaPresence_Dev
(2) Collecting Tweets for training and testing purposes
WP2_Step2a_CollectingTweetsByKeyword
WP2_Step2b_CollectingTweetsByEnterprise
(3) Training and testing a dataset
WP2_Step3_PurposeOfSocialMediaPresence
(4) Apply the data to check enterprise main purpose of SMP
WP2_Step4_PurposeOfSocialMediaPresence


The application is used to scrape all the links related to social media from websites that are put in:
url.txt
file that should have the list of URLs in the following format:
maslankowski.pl
http://stat.gov.pl
www.ug.edu.pl

The output of the application are two files: wp2_social.csv and wp2_social_YYYYMMDDHHMMSSnnnnnnn.json

The file wp2_social.csv is updated with its content.

The json file is created every time of the application running.

To start using the software, you should download Python source file and execute like this:
python3 WP2_SocialMediaPresence_Dev.py
or in selected MS Windows environment
py WP2_SocialMediaPresence_Dev.py

IMPORTANT! Libraries bs4 and requests are necessary. Depending on your Python environment try to install them that way:
easy_install bs4
easy_install requests
OR
pip3 install bs4
pip3 install requests
OR
pip install bs4
pip install requests