Add region and country to geo lookups

[drkane]

At the moment a geocode in recipient or beneficiary location is ignored if it's a country or a region. These should be added as GeoLookup objects so that they can be included in the data.

The example given was WCVA who publish grants with a geocode of W92000004 - eg https://grantnav.threesixtygiving.org/grant/360G-WCVA-27082

The data would need to be added to https://github.com/ThreeSixtyGiving/datastore/blob/master/datastore/additional_data/sources/geo_lookup.py

[michaelwood]

https://github.com/ThreeSixtyGiving/datastore/issues/71

[drkane]

Fixing this partly depends on these codes being available in https://github.com/drkane/geo-lookups/ (or similar format) - I've now updated this so there are files for region, country and combined authority. So it should just be a case of adding the files to

datastore/datastore/additional_data/sources/geo_lookup.py

Lines 14 to 50 in 94cf545

	SOURCE_URLS = {
	"lsoa": {
	"url_lookup": "https://raw.githubusercontent.com/drkane/geo-lookups/master/lsoa_la.csv",
	"url_latlong": "https://raw.githubusercontent.com/drkane/geo-lookups/master/lsoa_latlong.csv",
	"field_areacode": "lsoa11cd",
	"field_areaname": "lsoa11nm",
	"field_transforms": {
	"lad20cd": "ladcd",
	"lad20nm": "ladnm",
	},
	},
	"msoa": {
	"url_lookup": "https://raw.githubusercontent.com/drkane/geo-lookups/master/msoa_la.csv",
	"url_latlong": "https://raw.githubusercontent.com/drkane/geo-lookups/master/msoa_latlong.csv",
	"field_areacode": "msoa11cd",
	"field_areaname": "msoa11hclnm",
	"field_transforms": {
	"lad20cd": "ladcd",
	"lad20nm": "ladnm",
	},
	},
	"ward": {
	"url_lookup": "https://raw.githubusercontent.com/drkane/geo-lookups/master/ward_all_codes.csv",
	"url_latlong": "https://raw.githubusercontent.com/drkane/geo-lookups/master/ward_latlong.csv",
	"field_areacode": "wdcd",
	"field_areaname": "wdnm",
	},
	"la": {
	"url_lookup": "https://raw.githubusercontent.com/drkane/geo-lookups/master/la_all_codes.csv",
	"field_areacode": "ladcd",
	"field_areaname": "ladnm",
	"field_transforms": {
	"lad20cd": "ladcd",
	"lad20nm": "ladnm",
	},
	},
	}

[drkane]

I've now added equivalent files for regions and countries to the geo-lookups repository, so it should be straightforward to add these to the SOURCE_URLS dictionary.

We should also include the Upper tier local authorities and Combined Authority files here too.

[michaelwood]

I've now added equivalent files for regions and countries to the geo-lookups repository, so it should be straightforward to add these to the SOURCE_URLS dictionary.

We should also include the Upper tier local authorities and Combined Authority files here too.

@drkane do you have preferences on what field names should be called? or should we just use rgn ctry utla and cuath ?

[drkane]

should we just use rgn ctry utla and cuath ?

Those work for me!