Skip to content
Github mirror of "analytics/refinery/source" - our actual code is hosted with Gerrit (please see for contributing
Scala Java Other
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.


This repository should contain only source code that is used for building artifacts for the Wikimedia Analytics Refinery.


Core source code for the Wikimeida Analytics Refinery.


Hive UDFs and other Hive related code.


Handy Tools used for dealing with Wikimedia Analytics data.


WMF uses Archiva as its sole build dependency and deployment artifact repository. You can read more about this here:


All third party dependencies should be mirrored in the WMF Archiva instance at You can follow the instructions at to upload dependencies to Archiva. If you don't have login access to Archiva, ask a WMF Archiva admin to do this for you.


When working on this repository, building, running tests, or using an IDE, make sure you're using Java 8 (aka Java 1.8). For example, on Ubuntu, you have to use update-alternatives to configure java and javac

Releases and Deployment

Follow the instructions at to set up your ~/.m2/settings.xml with proper deployment credentials. Ask a WMF Archiva admin if you don't have these but think you should.


At any given time, the refinery ${project.version} on the master branch should be X.X.X-SNAPSHOT. This will allow you to deploy snapshot builds to Archiva to share with other developers by just running mvn deploy.


To upload a new version of refinery/source artifacts to Archiva:

First run mvn release:prepare. This will:

  • Check that there are no uncommitted changes in the sources
  • Check that there are no SNAPSHOT dependencies
  • Change the version in the POMs from x-SNAPSHOT to a new version (you will be prompted for the versions to use)
  • Transform the git information in the POM to include the final destination of the tag
  • Run the project tests against the modified POMs to confirm everything is in working order
  • Commit the modified POMs and push
  • Tag the code in the git with a version name
  • Bump the version in the POMs to a new value y-SNAPSHOT (these values will also be prompted for)
  • Commit the modified POMs and push

(Taken from, see that for more info on the maven release plugin.)

In addition to the above, there will now be that contains all the information needed to perform the current release. If everything looks good, run mvn release:perform to build and upload your artifacts to Archiva. Note: This might take a while.

If you ran ``mvn release:prepareand then get cold feet, you can abort the release process by runningmvn release:clean```. This will remove the `````` file and cause ```mvn release:prepare``` to again prompt you for the to-be-released version number the next time you run it.

You can’t perform that action at this time.