Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a separate program/process to scrape election status on all network sites #60

Open
samliew opened this issue Aug 17, 2021 · 2 comments
Labels
feature Features and enhancements

Comments

@samliew
Copy link
Owner

samliew commented Aug 17, 2021

Currently, the setting up of this bot is done manually by changing environment vars in Heroku:

  • Set CHAT_DOMAIN, if election is on another site on the Stack Exchange network
  • Find election chat room, or default chat room for that site, set CHAT_ROOM_ID to that
  • Set ELECTION_PAGE_URL to the active election page
  • Set ELECTION_QA_URL, to override if the bot couldn't detect the correct site meta question link

If we can create a program to scrape all network sites' election pages, and store the status in a persistent database, we could potentially use this to automatically spin up a new instance for that site if a scheduled election is detected (usually the announcement on per-site meta comes later, although they are automating the election process - so look out for changes).

Maybe we don't need to find/scrape default chatroom urls for each site, since that is unlikely to change. The list can be fetched from https://api.stackexchange.com/docs/sites#filter=default&run=true, and the room with the most users & messages should be the default (e.g.: https://chat.stackexchange.com/?tab=site&sort=people&host=serverfault.com).

But it would be nice for the bot to detect the election chat room if there is one, using the following methods (in order):

@samliew
Copy link
Owner Author

samliew commented Aug 23, 2021

Election chat rooms can be automatically created by CMs and linked on the election page; announced here Automatically create a chat room

Just need to figure out the correct selector for the bot, if it needs changing.

@Oaphi
Copy link
Collaborator

Oaphi commented Aug 23, 2021

Looks like the selector (line 167, election module) still matches the chat room URL, just checked that on an election page - so I think we are all set here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Features and enhancements
Projects
None yet
Development

No branches or pull requests

2 participants