Update python code from 2 to 3, update pywikbot API and use venv not locally hosted pywikibot core

[eatcha-wikimedia]

No description provided.

[eatcha-wikimedia]

@dschwen

See also https://commons.wikimedia.org/w/index.php?title=Commons_talk:Quality_images_candidates&oldid=604831060#What's_about_QICbot?

[dschwen]

Thanks for the update.

[dschwen]

I'll deploy this shortly

[dschwen]

Ok, I see you removed the hash bang and added the requirements.txt file. I assume I need to launch the bot differently now? Currently it is run through a cronjob that calls a small script

#!/bin/bash
cd /data/project/qic/qic_bot
python qic2.py

python is a 2.7 python, and I don't see how the venv would be set up.

[dschwen]

I'll try following https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python and manually create a venv.

[eatcha-wikimedia]

I assume that /data/project/qic/qic_bot/ is the repo working dir.

Pull the changes if you have not already.

To create the venv and install the requirements, run the following:

cd /data/project/qic/
python3 -m venv qic_venv
source qic_venv/bin/activate
pip install -r /data/project/qic/qic_bot/requirements.txt

Currently it is run through a cronjob that calls a small script

Change the script to the following two lines.

#!/bin/bash
/data/project/qic/qic_venv/bin/python3 /data/project/qic/qic_bot/qic2.py

[eatcha-wikimedia]

https://commons.wikimedia.org/w/index.php?title=Commons_talk:Quality_images_candidates&diff=605159386&oldid=605157969

Yikes, I'm suddenly seeing a lot of
...
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='commons.wikimedia.org', port=443): Read timed out. (read timeout=45)

Are the errors still persistent? Did you run it around 6:30 AM to 9:30 AM (Idaho time)? It's known that API requests fail at this time frame see https://phabricator.wikimedia.org/T249035.

More maintainers would be nice for sure.

If you have no problem, feel free to add me to the tool. (ldap/username : eatcha)

[dschwen]

I added you! I'm also making the logs available at https://tools-static.wmflabs.org/qic/

You can see that as long as the bot is persistent and keeps trying it seems to work eventually.