Skip to content

Commit

Permalink
Merge branch 'master' of github.com:jacksonj04/leeds-city-council-mem…
Browse files Browse the repository at this point in the history
…bers
  • Loading branch information
jacksonj04 committed May 19, 2019
2 parents 446bec0 + fbaedf8 commit 7341afb
Show file tree
Hide file tree
Showing 2 changed files with 31 additions and 1 deletion.
23 changes: 22 additions & 1 deletion README.md
@@ -1 +1,22 @@
This is a scraper that runs on [Morph](https://morph.io). To get started [see the documentation](https://morph.io/documentation)
# Leeds City Council Members Scraper

A scraper which looks at the [table of councillors on the Leeds City Council website](https://democracy.leeds.gov.uk/mgMemberIndex.aspx?VW=TABLE&PIC=1&FN=), then at each individual councillor's page in turn to figure out their elected terms.

This scraper [runs on Morph](https://morph.io/jacksonj04/leeds-city-council-members) on a daily basis.

[![Maintainability](https://api.codeclimate.com/v1/badges/b65763a805de7e4711ea/maintainability)](https://codeclimate.com/github/jacksonj04/leeds-city-council-members/maintainability)

## Why?

The data is used to inform two comparisons with the data in Wikidata, with the aim of keeping Wikidata up to date. These are:

* [A comparison of all _current_ councillors](https://www.wikidata.org/wiki/User:Jacksonj04/Leeds/Prompt)
* [A comparison of _all_ councillor memberships](https://www.wikidata.org/wiki/User:Jacksonj04/Leeds/Prompt/All)

In theory, neither of these pages should highlight any differences.

## Mapping IDs

Leeds City Council IDs need mapping to Wikidata IDs - this is done in [`lcc_id_map.py`](https://github.com/jacksonj04/leeds-city-council-members/blob/master/lcc_id_map.py). Missing IDs are flagged at the end of a scraper run.

All IDs in this list are scraped, even if they are not current councillors. This lets us keep a historic comparison.
9 changes: 9 additions & 0 deletions lcc_id_map.py
Expand Up @@ -138,6 +138,15 @@
'7129': 'Q55469142',
'7130': 'Q55469196',
'7131': 'Q55469094',
'7363': 'Q63031248', # Diane Chapman
'7364': 'Q56882256', # Robert Finnigan
'7365': 'Q62225037', # Lou Cunningham
'7366': 'Q62273369', # Ann Forsaith
'7367': 'Q62273334', # Mirelle Midgley
'7368': 'Q62823607', # Abigail Marshall-Katung
'7369': 'Q63031256', # Trish Smith
'7371': 'Q62273427', # Chris Howley
'7370': 'Q62273306', # Nicole Sharpe
}

party_names = {
Expand Down

0 comments on commit 7341afb

Please sign in to comment.