Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

automate collection and reporting of leiningen download statistics #1252

Merged
merged 1 commit into from Jul 12, 2013

Conversation

2 participants
Contributor

gphil commented Jul 11, 2013

I wrote some code to fetch and parse the leiningen download logs and report some summary statistics.

It can be run with:

lein run -m leiningen.downloads 

But you'll need the appropriate AWS credentials for it to work in
~/.secrets/leiningen_downloads_aws_cred.clj:

{:access-key "AWS_ACCESS_KEY"
 :secret-key "AWS_SECRET_KEY"}

It takes a while to run, since it has to fetch all the logs from S3 (there are a lot of log files, so it has to make a lot of requests.) It also requires a fair amount of memory to process all the files, so you may need to set JVM_OPTS=-Xmx512m.

Additionally, it uses Pomegranate to download some additional dependencies at runtime so as not to pollute the project.clj.

I had to add the bin/ directory to the classpath in order to run the code using leiningen. I'm not sure if this is OK. If not, there may be a better place to put this file, or a better way of running it that I'm not aware of. I'm happy to change this given a better solution.

@technomancy technomancy added a commit that referenced this pull request Jul 12, 2013

@technomancy technomancy Merge pull request #1252 from gphil/leiningen-download-stats
automate collection and reporting of leiningen download statistics
f4b489b

@technomancy technomancy merged commit f4b489b into technomancy:master Jul 12, 2013

1 check passed

default The Travis CI build passed
Details
Owner

technomancy commented Jul 12, 2013

Thanks!

Putting it in :source-paths will actually cause it to be included in the jar, so I'll find a better place for it. But this is good to have.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment