Switch branches/tags
Nothing to show
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
113 lines (78 sloc) 3.16 KB
{-# LANGUAGE OverloadedStrings #-}
module Y2017.M05.D22.Solution where
import Control.Arrow ((&&&))
import Data.Aeson -- available via cabal
import qualified Data.Map as Map
import Data.Set (Set)
import qualified Data.Set as Set
-- the below imports are available via 1HaskellADay git repository:
import Wikidata.Query.Aeson
import Wikidata.Query.Endpoint
We're going to examine language this week. Not the Haskell language, but
spoken languages (again, not Haskell).
So, looking at this on
We see the Sora language (Q13284). That's not what interests me, however.
What interests me is the general structure of how languages are classified in
Wikidata. A language, such as Sora, is an instance of the class: Language, or:
(that's the 'q-name' for language)
And has a parent class of a language-root, in Sora's case is: or Austro-Asiatic languages
But this language-family, itself, has a class:
(That is the 'q-name' of language family)
And has a 'number of speakers' property:
So, cool. Let's generalize from more than just the Sora language to all
spoken languages
Let's query wikidata and see what spoken languages there are, what they are
subclasses of, and how many people speak those languages. So here is my SPARQL
query to ask this question:
languagesSpeakersQuery :: String
languagesSpeakersQuery = unlines [
"SELECT ?language ?languageLabel ?root ?rootLabel ?nspeakers WHERE {",
"?language wdt:P31 wd:Q34770.",
"?language wdt:P279 ?root.",
"?language wdt:P1098 ?nspeakers.",
"SERVICE wikibase:label {",
"bd:serviceParam wikibase:language \"en\" .",
"} } ORDER BY ?nspeakers"]
We'll look at languages, their roots, and their rarity later, but today,
'simply' query the wikidata endpoint and answer the below questions:
-- 1. how many unique langaguages are catalogued in wikidata?
data Language = Lang { name, root :: String, speakers :: Integer }
deriving (Eq, Show)
data LangString = L { name', root', speak' :: String }
instance FromJSON LangString where
parseJSON o = L <$> parseVal o "languageLabel"
<*> parseVal o "rootLabel"
<*> parseVal o "nspeakers"
toLang :: LangString -> Language
toLang (L n r s) = Lang n r (read s)
queryLangs :: IO [Language]
queryLangs = map toLang . reifyWikiResults <$> sparql languagesSpeakersQuery
uniqueLanguages :: [Language] -> Set String
uniqueLanguages = Set.fromList . map name
>>> length . uniqueLanguages <$> queryLangs
-- for your primary language, about how many speakers are there?
speakersOf :: [Language] -> String -> Maybe Integer
speakersOf langs yourlang =
Map.lookup yourlang (Map.fromList (map (name &&& speakers) langs))
>>> (`speakersOf` "English") <$> queryLangs
>>> (`speakersOf` "French") <$> queryLangs
Just 153299770
>>> (`speakersOf` "Choctaw") <$> queryLangs
Just 9200
So, we now know there are no speakers of the English language, according to
wikidata. Good thing I have some French and Choctaw in me!