Skip to content

Github mirror of "analytics/wmde/scripts" - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contributing)

Notifications You must be signed in to change notification settings

wikimedia/analytics-wmde-scripts

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

analytics/wmde/scripts

This repo contains a bunch of scripts collecting data for the WMDE development teams.

This repo is cloned in the statistics::wmde role in the wmf puppet repo.

Deployment

The master branch is a development branch. The production branch is automatically deployed and run on WMF analytics servers. When there is no ongoing development, both branches should contain the same code; normally, this is achieved by cherry-picking each reviewed change from master to production.

Configuration

Some of the social scripts require configuration settings to work.

These should be stored in a file called 'config' in the directory above the directory of this repo. The config keys and values are delimited with spaces.

The file should look something like the below:

mm-wikidata-pass password1
mm-wikidatatech-pass password2
mm-user foo@bar.baz
dump-dir /tmp/dumps
wdqs_host http://wdqs1005.eqiad.wmnet:8888

Scripts execution time limit

All scripts have a maximum execution time set to one hour, after which if they are not done they fail automatically. The time limit is globaly set in lib/scriptsTimeLimit.php and included in all the scripts through lib/load.php. For reasons to this, see: T243894

Graphite

Metrics are currently stored in the following paths in graphite:

wikidata.*
daily.wikidata.*

The paths to statsd.eqiad.wmnet and graphite.eqiad.wmnet are hardcoded everywhere.

About

Github mirror of "analytics/wmde/scripts" - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contributing)

Resources

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published