Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: include exclusive values from IERS_B in IERS_Auto (⏰ wait for #16187) #16070

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

neutrinoceros
Copy link
Contributor

Description

This adresses the non-controversial part of #13494

I haven't quite figured it out yet (I have at least two remaining failures), but I want to open this as a draft now in the hope I can get early feedback (maybe I've taken a wrong turn already). In particular, I'd like to ask @mhvk and @taldcroft if the tests changes correctly reflect their vision for #13494.

  • By checking this box, the PR author has requested that maintainers do NOT use the "Squash and Merge" button. Maintainers should respect this when possible; however, the final decision is at the discretion of the maintainer that merges the PR.

Copy link

Thank you for your contribution to Astropy! 🌌 This checklist is meant to remind the package maintainers who will review this pull request of some common things to look for.

  • Do the proposed changes actually accomplish desired goals?
  • Do the proposed changes follow the Astropy coding guidelines?
  • Are tests added/updated as required? If so, do they follow the Astropy testing guidelines?
  • Are docs added/updated as required? If so, do they follow the Astropy documentation guidelines?
  • Is rebase and/or squash necessary? If so, please provide the author with appropriate instructions. Also see instructions for rebase and squash.
  • Did the CI pass? If no, are the failures related? If you need to run daily and weekly cron jobs as part of the PR, please apply the "Extra CI" label. Codestyle issues can be fixed by the bot.
  • Is a change log needed? If yes, did the change log check pass? If no, add the "no-changelog-entry-needed" label. If this is a manual backport, use the "skip-changelog-checks" label unless special changelog handling is necessary.
  • Is this a big PR that makes a "What's new?" entry worthwhile and if so, is (1) a "what's new" entry included in this PR and (2) the "whatsnew-needed" label applied?
  • At the time of adding the milestone, if the milestone set requires a backport to release branch(es), apply the appropriate "backport-X.Y.x" label(s) before merge.

Copy link

👋 Thank you for your draft pull request! Do you know that you can use [ci skip] or [skip ci] in your commit messages to skip running continuous integration tests until you are ready?

@neutrinoceros
Copy link
Contributor Author

Relevant tests need --remote-data, so I think we should apply the "Extra CI" label here ?

@pllim
Copy link
Member

pllim commented Feb 19, 2024

Not really, --remote-data is in the same job as devdeps. Since devdeps has numpy failures, might have to wait for that to go away first, just to be safe.

@@ -319,7 +320,7 @@ def test_no_auto_download(self):
def test_simple(self):
with iers.conf.set_temp("iers_auto_url", self.iers_a_url_1):
dat = iers.IERS_Auto.open()
assert dat["MJD"][0] == 57359.0 * u.d
assert dat["MJD"][0] == 37665.0 * u.d
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change seems very drastic.

@pllim pllim added this to the v6.1.0 milestone Feb 19, 2024
@neutrinoceros
Copy link
Contributor Author

neutrinoceros commented Feb 20, 2024

Thanks for clarifying this @pllim !

might have to wait for that to go away first, just to be safe.

and just to make sure everyone is on the same page: as of now, the tests I've updated are failing locally, which is part of what I wanted to showcase with this draft. So, indeed, we need devdeps fixed first, but it's still going to fail (or so I hope !) here after that :)

@taldcroft
Copy link
Member

@neutrinoceros - I've touched this code before but I'm hoping to avoid so going forward. (I struggle enough keeping up with time/table/io.ascii!). If @mhvk doesn't pipe in I can have a look.

Copy link
Contributor

@mhvk mhvk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me! I haven't quite got the time to check locally, but obviously would be good to see what goes wrong.

@pllim's comment about the change in starting MJD made me wonder whether we really need to always make the table about 7 times larger; maybe it should be more on-demand? But probably best just to focus on the fix here, and perhaps have a different issue about trying to ensure the table is not super large (if it matters?).

@neutrinoceros
Copy link
Contributor Author

For now I'll just rebase so we all have access to logs showing the remaining problems.

@neutrinoceros neutrinoceros force-pushed the time/feat/IERS_Auto_default_values_from_IERS_B branch from e0625df to 0e7073a Compare February 21, 2024 17:48
@pllim
Copy link
Member

pllim commented Feb 21, 2024

Hmm I don't understand the masked array failures in devdeps/remote-data job and in RTD.

@neutrinoceros
Copy link
Contributor Author

I'm willing to bet they are related, I'll take another look in the morning.

@neutrinoceros neutrinoceros force-pushed the time/feat/IERS_Auto_default_values_from_IERS_B branch from 0e7073a to 7b05c18 Compare February 27, 2024 07:47
@neutrinoceros
Copy link
Contributor Author

(I never said which morning 🙈)
I finally took a look. All failures are 100% real and can be reproduced locally. I just didn't see 4/6 of them before I pushed because they are in coordinates and time tests. This PR will be my priority today.

@neutrinoceros
Copy link
Contributor Author

I could fix my branch to pass tests from astropy/time but the remaining failure in astropy.coordinates appears to be real but is not directly caused by my patch. Rather, it's just revealed. See #16116

@neutrinoceros neutrinoceros force-pushed the time/feat/IERS_Auto_default_values_from_IERS_B branch from 8cd84bf to 9844cc2 Compare February 28, 2024 06:48
@neutrinoceros
Copy link
Contributor Author

rebased onto #16120 to confirm that it unblocks this PR

@neutrinoceros
Copy link
Contributor Author

Status update: this is blocked by

@neutrinoceros neutrinoceros force-pushed the time/feat/IERS_Auto_default_values_from_IERS_B branch from 9844cc2 to 4f12f90 Compare February 29, 2024 06:33
@neutrinoceros
Copy link
Contributor Author

#16123 is now fixed in #16125, so rebasing on top of it to see if we got them all 🤞🏻

@neutrinoceros
Copy link
Contributor Author

neutrinoceros commented Feb 29, 2024

I've been scratching my head for a couple hours over this one and I'm starting to feel that maybe I shot myself in the face by using table.join here instead of manually merging IERS_A and IERS_B. Instead of going in circles here, and since I'll need to rebase soon anyway, I think I'm going to take a step back for now so I can hopefully come back with a fresh perspective in a few days.

@mhvk
Copy link
Contributor

mhvk commented Feb 29, 2024

I think I'm going to take a step back for now so I can hopefully come back with a fresh perspective in a few days.

I was about to review this PR, but will wait till you say it is ready. I think a manual merge may indeed be better, since ideally we do not have masked columns at all - they'd make things slower and might cause other results to become Masked instances too. But in the meantime, we solved some bugs in Masked, so not a wasted effort by any means!

@neutrinoceros
Copy link
Contributor Author

status update: I consider this "blocked" by #16187, in the sense that the other PR is making the logic more consistent and easier to reason about, so I'd rather see it merged first so I have a better chance at finishing this one more easily.

@astrofrog astrofrog modified the milestones: v6.1.0, v7.0.0 Apr 4, 2024
@neutrinoceros neutrinoceros changed the title ENH: include exclusive values from IERS_B in IERS_Auto ENH: include exclusive values from IERS_B in IERS_Auto (⏰ wait for #16187) Apr 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants