The experiments in our paper are based on two datasets. Only the Foursquare data is publicly available. The code published here can be used to reproduce our analysis on the Foursquare dataset. In the folder data, we provide the preprocessed data of a small excerpt of the original dataset published in [@yang2015nationtelescope] and [@yang2015participatory] (see below).
Clone the repository, with the submodule included:
git clone --recurse-submodules https://github.com/NinaWie/network_analysis.git
We assume that the following prerequesites are installed:
- python >= 3.6
- R (version 4.1.2 is used here)
In R, install renv to create a virtual environment to run the scripts in this repo:
install.packages("renv")
In the folder r_scripts you can find a lockfile (explanation see here) called renv.lock. The required libraries can be installed automatically with renv by running
renv::restore()
If not using renv, you can also install the required packages manually. The following libraries are required: sna, network, RSiena and can be installed with the following:
install.packages("sna")
install.packages("network")
install.packages("RSiena")
In Python, create a new virtual environment called "agile_env" and install all requirements with the following steps:
cd python_scripts
python -m venv agile_env
source agile_env/bin/activate
pip install -r requirements.txt
export PYTHONPATH="graph-trackintel"
Troubleshooting: If the installation of psychopg2 fails, install it manually:
python -m pip install psycopg2-binary
The following steps must be executed sequentially in order to load, preprocess and analyze the data
Create the graphs for a certain dataset and save as a pickle file in the folder data.
cd python_scripts
python create_graphs.py
Our analysis was run with the current default values for the arguments, but other parameters can be specified. It takes only around 20 seconds to run.
cd python_scripts
python preprocessing.py
With the default parameters, this will take the output pkl file from Step 1 and preprocess the graphs and attributes. The results will be dumped in a folder data/foursquare_120 (120 days).
The R Scripts in the folder r_scripts automatically take the graphs and attributes that were produced in Step 2.
Simply execute both scripts qap_mobility.r and saom_mobility.r (in any order). See above for instructions how to install the necessary libraries with renv::restore()
Note: Both scripts will take more than 1 hour to run! SOAM and QAP models are fitted for all users.
Run
cd python_scripts
python analyze.py
The input folders are hardcoded in the script.
The analyze.py script creates a folder called results_fourquare in the main directory. The following points explain how the figures and tables in the paper correspond to these results:
- Figure 1 in the paper: This is just an exemplary graph, and it is not created with this code.
- Table 1 (QAP of a single user): Corresponds to
results_foursquare/qap_user_327.csv - Figure 2 (QAP all users):
results_foursquare/results_qap.pdf - Table 2 (QAP intra- vs inter-user variances):
results_foursquare/intra_inter_user.csv(Note: the table in the paper reports averages over both datasets. The results just differ when using only the Foursquare dataset) - Table 3 (SAOM single user):
results_foursquare/saom_user_327.csv - Table 4 (SAOM all users):
results_foursquare/results_saom.csv - Figure 3 (Jaccard indices):
results_foursquare/correlation_jaccards.pdf - Figure 4 (Goodness of fit): This figure is produced in the R scripts and is saved in
data/foursquare_120/327/gof_gd.pdf,data/foursquare_120/327/gof_id.pdfanddata/foursquare_120/327/gof_od.pdf
The last file in the results directory, namely results_fourquare/terminal.txt, simply contains the command line output and the latex version of the tables.
The Foursquares dataset user for reproducability here was taken from the following sources:
@article{yang2015nationtelescope,
title={NationTelescope: Monitoring and visualizing large-scale collective behavior in LBSNs},
author={Yang, Dingqi and Zhang, Daqing and Chen, Longbiao and Qu, Bingqing},
journal={Journal of Network and Computer Applications},
volume={55},
pages={170--180},
year={2015},
publisher={Elsevier}
}
@article{yang2015participatory,
title={Participatory cultural mapping based on collective behavior in location based social networks},
author={Yang, Dingqi and Zhang, Daqing and Qu, Bingqing},
journal={ACM Transactions on Intelligent Systems and Technology},
year={2015},
note = {in press},
publisher={ACM}
}