New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

automate collection and reporting of leiningen download statistics #1252

Merged
merged 1 commit into from Jul 12, 2013

Conversation

2 participants
@gphil
Contributor

gphil commented Jul 11, 2013

I wrote some code to fetch and parse the leiningen download logs and report some summary statistics.

It can be run with:

lein run -m leiningen.downloads 

But you'll need the appropriate AWS credentials for it to work in
~/.secrets/leiningen_downloads_aws_cred.clj:

{:access-key "AWS_ACCESS_KEY"
 :secret-key "AWS_SECRET_KEY"}

It takes a while to run, since it has to fetch all the logs from S3 (there are a lot of log files, so it has to make a lot of requests.) It also requires a fair amount of memory to process all the files, so you may need to set JVM_OPTS=-Xmx512m.

Additionally, it uses Pomegranate to download some additional dependencies at runtime so as not to pollute the project.clj.

I had to add the bin/ directory to the classpath in order to run the code using leiningen. I'm not sure if this is OK. If not, there may be a better place to put this file, or a better way of running it that I'm not aware of. I'm happy to change this given a better solution.

technomancy added a commit that referenced this pull request Jul 12, 2013

Merge pull request #1252 from gphil/leiningen-download-stats
automate collection and reporting of leiningen download statistics

@technomancy technomancy merged commit f4b489b into technomancy:master Jul 12, 2013

1 check passed

default The Travis CI build passed
Details
@technomancy

This comment has been minimized.

Owner

technomancy commented Jul 12, 2013

Thanks!

Putting it in :source-paths will actually cause it to be included in the jar, so I'll find a better place for it. But this is good to have.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment