Skip to content

Github mirror of "analytics/wmde/TW/edit-conflicts" - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contributing)

Notifications You must be signed in to change notification settings

wikimedia/analytics-wmde-TW-edit-conflicts

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Analytics reporting for MediaWiki edit conflicts and the TwoColConflict extension.

  • reports: SWAP notebooks to explore the data.
  • src: Scala Spark code to refine EventLogging traces into a more usable form.

Running

Build the jar:

sbt package

Process data:

spark2-submit \
    --class BuildConflictMetadataApp \
    --master yarn \
    --executor-memory 8G --executor-cores 4 --driver-memory 16G \
    --conf spark.dynamicAllocation.maxExecutors=64 \
    ./target/scala-2.11/edit-conflict-analytics_2.11-0.2.jar

About

Github mirror of "analytics/wmde/TW/edit-conflicts" - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contributing)

Resources

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •