world-datas-analysis

miscellaneous worlds data and analysis

Providers of dataset

Dataset	Description	Avg scope	Nb datasets	Max variables	Nb observations
geonames	Geonames entries	4070489	1	15	4823955
owid	Our World In Data	836	1472	1	32609745
vigilo	Vigilo observations	232	1	9	31623

Todo

Status	Category	Scope	Description	Sample Report
[_]	Geonames	Cities	Geonames	International Covid-19 / French Covid-19
[_]	Covid	Countries	Johns Hopkins University	International Covid-19 / French Covid-19
[_]	Population	Countries	United nation
[_]	Population	Cities	insee
[_]	Population	Cities	insee estimation
[_]	Weather	Cities	European Climate Assessment & Dataset
[_]	Weather	Cities	European Centre for Medium-Range Weather Forecasts
[_]	bike counter	Montpellier	Montpellier 3M/Velocité
[_]	Rental bike	Montpellier	Montpellier 3M
[_]	universitetetioslo	Countries	CO2 emissions
[_]	NASA	Countries	Anormal température

Init environment

# Python
python -m venv .venv
source .venv/bin/activate
pip install --only-binary=:all: -r requirements.txt

# R
renv::restore()

Import and export datas

# All in one
./importer/<dataset>/import_and_export.sh
# or step by step
./importer/<dataset>/download.sh
./importer/<dataset>/import.sh
./importer/<dataset>/export.sh

Update this Readme.md page

./build_rmarkdown_pages.sh

# Use virtualenn python environment
source .venv/bin/activate

# owid
importer/owid/download.sh
importer/owid/import.sh


# Level 1 (geoname)
importer/geonames/download.sh
importer/geonames/import.sh

# Worldbnk
python importer/200-worldbank/download.py
sqlite3 -bail world-datas-analysis.db < importer/200-worldbank/import.sql
#international/countryexport_worldbank.sh
#python international/country/download_from_ourworldindata.py

# Vigilo
./importer/vigilo/import_and_export.sh

# Summary
sqlite3 -bail world-datas-analysis.db < db_summary.sql