Skip to content

Obtaining a short summary of every city in existence using SparQL and Rust/Tokio.

Notifications You must be signed in to change notification settings

HereComesTheMoon/wikiscrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Wikiscrape

Querying Wikidata, then aggregating data from various Wikipedia articles using public API endpoints. Concurrent, but not general purpose.

In its current form, obtains a list of all cities with existing English Wikipedia entries from Wikidata, and then queries each Wikipedia entry to obtain a summary of the city.

The results are serialized into a CSV file.

While Rust is satisfying to use, Python is vastly more convenient when it comes to writing quick scripts which will only be ran once or twice. Serde is powerful, but not necessary until it comes to maintenance, or a changing API.

About

Obtaining a short summary of every city in existence using SparQL and Rust/Tokio.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages