One scraper. Multiple jurisdictions?

[jpmckinney]

Some provinces have directories of elected officials for all municipalities in the province. It would be very high maintenance to have one scraper per municipality (even with some code automation). How can I write one scraper that collects information for multiple jurisdictions? Any internals I can hack around?

[jamesturk]

This is an interesting point, our plan when we had very similar scrapers
was going to be to just subclass them, but I suppose that would be a fair
bit of overhead.

Will the init stuff w/ custom templates solve this?

On Tue, Aug 20, 2013 at 1:28 AM, James McKinney notifications@github.comwrote:

Some provinces have directories of elected officials for all
municipalities in the province. It would be very high maintenance to have
one scraper per municipality (even with some code automation). How can I
write one scraper that collects information for multiple jurisdictions? Any
internals I can hack around?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/31
.

[jpmckinney]

We're using subclassing for Montreal's 19 boroughs, but using it for Quebec's 1000+ municipalities seems kind of crazy.

I'm not super familiar with Pupa internals, but I assume there can be a way of overriding the active jurisdiction, so that a single scraper can save documents to multiple jurisdictions. Can that work?

[jamesturk]

Yeah 1000+ would be insane, I'll take a look at making it possible to do
this.

On Mon, Aug 26, 2013 at 11:00 AM, James McKinney
notifications@github.comwrote:

We're using subclassing for Montreal's 19 boroughs, but using it for
Quebec's 1000+ municipalities seems kind of crazy.

I'm not super familiar with Pupa internals, but I assume there can be a
way of overriding the active jurisdiction, so that a single scraper can
save documents to multiple jurisdictions. Can that work?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/31#issuecomment-23268417
.

[jpmckinney]

Any ideas/suggestions on how to proceed on a pull request for this? I'm happy to do the work - just need to know what solution is more or less likely to be merged.

[jamesturk]

we haven't had a chance to and are firmly in Open States land through the end of the month with states returning

proposals would be very welcome, any ideas how you'd prefer for it to work?

[jpmckinney]

What I'm currently doing is, for example, creating an organization for each municipality within a province, setting the chamber to be the same as the organization name, and creating memberships within those organizations. So far this is working fine, so I can close this issue until I have a use case where it's a problem.