Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Galactic Radio Telescope #2455

Merged
merged 25 commits into from Jul 22, 2016
Merged

Galactic Radio Telescope #2455

merged 25 commits into from Jul 22, 2016

Conversation

@hexylena
Copy link
Member

@hexylena hexylena commented Jun 3, 2016

Howdy all,

I'd like to re-introduce this project:

The Galactic Radio Telescope (GRT) has had some progress today, and it's gotten to a point where it can be used to start collection of data, while looking towards analysing that data quite a bit further down the line.

What?

The GRT aims to collect job run information from Galaxy servers that opt into the process.

Galaxy Admins can sign in to the GRT, register their Galaxy servers, and get back API keys per-Galaxy instance. Then they set up a cron job (preferably weekly, but we may explore options here later), and submit job data to the GRT.

Why?

https://oc.hx42.org/grt/ the about page should cover most questions.

GRT Repo

https://github.com/erasche/galactic-radio-telescope

Demo Instance

I've deployed a demo instance here:
https://oc.hx42.org/grt/

And I've posted all of my org's Galaxy's data to it.

utvalg_837

(Warning, accessing things like the "CPT Phage Galaxy" information page in the Galaxy list will be SLOW. It's running off of sqlite, with a large number of uncached queries. If this PR gets accepted, I'll optimize it a lot)

@martenson
Copy link
Member

@martenson martenson commented Jun 4, 2016

It is very nice Eric! I see great potential. 🐨

Loading

@natefoo
Copy link
Member

@natefoo natefoo commented Jun 25, 2016

I want this.

Loading

@afgane
Copy link
Contributor

@afgane afgane commented Jun 25, 2016

Potential platform for analyzing the collected data: https://www.tacc.utexas.edu/research-development/tacc-projects/karnak

Loading

@hexylena
Copy link
Member Author

@hexylena hexylena commented Jun 25, 2016

After talking to people, this has been deemed a good idea / useful.

As such I'll be rewriting parts (the whole) of the backend to be a bit more efficient and cleanly architected.

That said, the script portion of it is mostly done (minus sending all tool params) which we'll add shortly

Loading

@@ -7,6 +7,8 @@
import argparse
import sqlalchemy as sa
import yaml
import copy
Copy link
Member Author

@hexylena hexylena Jun 26, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unused import

Loading

jmchilton added 4 commits Jul 21, 2016
This is purely stylistic - but I prefer to structure code to allow testing even if there are no actual test cases yet.

For more information see discussion here - http://stackoverflow.com/questions/4041238/why-use-def-main.
... and one instance of bare exception.
Use existing abstractions - so things like environment variable based configuration will work.
@jmchilton
Copy link
Member

@jmchilton jmchilton commented Jul 21, 2016

👍 if changes in hexylena#16 are acceptable and accepted. Thanks for working on this @erasche - this is a great start!

Loading

@hexylena
Copy link
Member Author

@hexylena hexylena commented Jul 21, 2016

Thanks @ericenns, awesome work :) It's definitely a start @jmchilton, hopefully we can start from here and improve over time. I was really waiting on this to be accepted before putting more time into the backend, so if you're +1ing it... :)

Loading

@jmchilton jmchilton merged commit 8dbf987 into galaxyproject:dev Jul 22, 2016
4 checks passed
Loading
@martenson martenson added this to the 16.07 milestone Jul 27, 2016
@martenson martenson removed this from the 16.10 milestone Jul 27, 2016
@hexylena hexylena deleted the grt branch Dec 19, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

6 participants