Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

a bag of minor suggestions #48

Open
o-smirnov opened this issue Jul 20, 2021 · 3 comments
Open

a bag of minor suggestions #48

o-smirnov opened this issue Jul 20, 2021 · 3 comments

Comments

@o-smirnov
Copy link

(Continued from https://github.com/o-smirnov/meerkat-open-time/issues/18, as this is a more appropriate place)

All right, aimfast works like a charm now @Athanaseus (me having zapped the Island of Doom)!

image

Some questions/suggestions:

  • What does "R2" mean? https://en.wikipedia.org/wiki/Coefficient_of_determination?

  • Can we also fit a slope through a 0 intercept (and show it on the same plot)?

  • I find "intercept" a bit difficult to interpret. As reported above, it's the log of a fitted flux offset, I think. Might be good to convert it back into mJy?

  • I assume the solid blue line is slope 1, intercept 0? In this case please draw it until (0,0), as that makes it clearer what it is. Also, suggest swapping linestyles. The fitted slope(s) are the important lines so should be a solid color, the slope=1 line should be less prominent (i.e. dashed), but maybe that's just me.

  • Finally: in the plot above, it's clear the slope doesn't actually fit the (brighter) sources all that well, they all seem to lie above it consistently. I think it's that cluster of weak peripheral sources below the slope that's biasing the fit (and yay for the colour scheme, we wouldn't be able to diagnose the problem so easily without it!) We could think of clever schemes to downweigh peripheral sources, but for a start, could we add an option for a distance cutoff?

@o-smirnov
Copy link
Author

Some cosmetic suggestions for tooltips:

  • Show fluxes rather than log-fluxes in the tooltip

  • (Input, Output) -> (S1, S2) # S being the usual symbol for flux

  • Phase_Centre_distance -> Distance off-axis. And show it in units of deg arcmin arcsec.

Also, the current plot title only reflects one of the input images (or models), which is a bit confusing. May I suggest adding the names to the axis labels instead, so that they say e.g. "log S1: model_or_image_name" and "log S2: model_or_image_name".

Then you just need to figure out an elegant way to display both model names in the position offset plot... maybe in the legend of the right plot, instead of "Model 1" and "Model 2"? Then the title of the left plot can be "Position offsets".

Finally, for filenames, may I suggest FluxOffsets.html and PositionOffsets.html? I find the use of "Input" and "Output" confusing, as they're not really inputs or outputs as such, just two models being compared.

@Athanaseus
Copy link
Owner

What does "R2" mean? https://en.wikipedia.org/wiki/Coefficient_of_determination?

It gives an overall sense of how well the source fluxes in one sky model fit the other, meaning that a value close to 1 implies a perfect correlation between the two sky models. This cannot be solely relied on but can be used in conjunction with the RMSE which provides the average deviation of the flux differences in units of source flux densities. (It is sensitive to outliers). And then the intercept and the gradient are used to further confirm that the fit follows the expected fit, which is c=0, g=1.

Can we also fit a slope through a 0 intercept (and show it on the same plot)?

Taking care of this.

I find "intercept" a bit difficult to interpret. As reported above, it's the log of a fitted flux offset, I think. Might be good to convert it back into mJy?
Agreed.

I assume the solid blue line is slope 1, intercept 0? In this case please draw it until (0,0), as that makes it clearer what it is. Also, suggest swapping linestyles. The fitted slope(s) are the important lines so should be a solid color, the slope=1 line should be less prominent (i.e. dashed), but maybe that's just me.

The solid blue line is the fit (as indicated in the legend)

Finally: in the plot above, it's clear the slope doesn't actually fit the (brighter) sources all that well, they all seem to lie above it consistently. I think it's that cluster of weak peripheral sources below the slope that's biasing the fit (and yay for the colour scheme, we wouldn't be able to diagnose the problem so easily without it!) We could think of clever schemes to downweigh peripheral sources, but for a start, could we add an option for a distance cutoff?

Taking care of this.

@Athanaseus Athanaseus mentioned this issue Aug 3, 2021
@Athanaseus
Copy link
Owner

Athanaseus commented Aug 18, 2021

I can pass in a mask as a detection image (actually @Athanaseus is this supported in aimfast?), and breizorro has enough features to chop islands out now.

With the help of breizorro this can now be achieved.

breizorro -r mean9.fits --number-islands -o mask9.fits
breizorro -m mask9.fits --extract-islands 262 --make-binary --invert -o mask9-centerhole.fits
aimfast --compare-images image1.fits image2.fits --mask-image mask9-centerhole.fits -c my-source-finder.yml

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants