Wikipedia Gender Index (WIGI), uses Wikidata to produce gender-related statistic on Wikipedia Biographies
Jupyter Notebook TeX Python Java HTML PostScript
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
Magnus Gender analysis
chi
figs
helpers
opensym
opensym16
.gitignore
Chi squared test.ipynb
Country Inspector Analysis Generator.ipynb
Gender Culture Plots.ipynb
GenderIndexProcessor.java
German Austrian Analysis.ipynb
LICENSE
Language Culture Scatter.ipynb
Logistics Fem Per.ipynb
Make-POB-Chi-Square-Test-Data.ipynb
Mechanical Turk Disagreements.ipynb
README.md
Singlesite.ipynb
Sitelinks Exmaple.ipynb
World Cultures Analysis.ipynb
World Economic Forum Comparison.ipynb
df-comparator.py
gender-index-processing-standalone.ipynb
gender-index-processing-standalone.py
gender-index-processing.ipynb
logistics_graph.R
site_links_example.R

README.md

WIGI

Wikipedia Gender Index (WIGI), uses Wikidata to produce gender-related statistic on Wikipedia Biographies

The Data

Data Munging Documentation Ipython Notebooks

The Writings

Notes Because Wikidata is multilingual its values are stored as identifiers - or ``Q-IDs'' in Wikidata terms - which can be translated into every language for which there is a Wikipedia language edition. To maintain fidelity we keep this standard, so for example Aung San Suu Kyi represented in Wikidata in English looks like Figure \ref{fig:aung} and in our dataset would be a row like \begin{small} Q36740,1945,,Q6581072|,,Q836|,Q37995|,,Q82955|Q36180|Q1476215|

\end{small}. As a design decision we do not translate these Wikidata Q-IDs, to maintain language neutrality. We do however include functions to translate these Q-IDs into English (or any other language), which would render the above row as: \ \begin{small} Aung San Suu Kyi,1945,,female|,,Myanmar|,Yangon|,,politician|writer|human rights activist| \end{small}

In order to faithfully represent Wikidata, the value of each property is actually a list, since Wikidata allows there to potentially be multiple values for a property. This is because either two sources disagree on a property, or like in the case of Aung San Suu Kyi, she has many occupations, see Figure \ref{fig:aung}. We store the list, inside the comma-separated sheet, as | ``pipe''-separated values.

Of course these multiple values introduce a design problem in aggregating on a list of properties. Our method is to aggregate on the list, rather than on the individual items within the list. This means in the case of Aung San Suu Kyi, that her occupation is stored as politician, writer, and human rights activist, and is aggregated with all the other humans who have those three occupations too. Since the dataset is open, interested researchers can use our raw data and aggregate it in any way they want.