Skip to content
This repository has been archived by the owner on Nov 29, 2023. It is now read-only.

Critique of the MetNet paper #28

Open
JackKelly opened this issue Jun 30, 2021 · 1 comment
Open

Critique of the MetNet paper #28

JackKelly opened this issue Jun 30, 2021 · 1 comment
Labels
discussion
Projects
ML Research

Comments

@JackKelly
Copy link
Member

Not sure if this is the right place to post this (!) (maybe we should use github discussions?!?) but here's an interesting critique of MetNet by @NiklasRiewald: https://niklasriewald.com/2021/06/29/paper-review-metnet-a-neural-weather-model-for-precipitation-forecasting/
@JackKelly JackKelly added this to To do in ML Research via automation Jun 30, 2021
jacobbieker added a commit that referenced this issue Jun 30, 2021
@jacobbieker
Update training/test/val splits based off #28 critique
85f7cc6 
The correlation between days of the week might mean that there is leakage between the training and val/test sets. This is now split up so that 2020 is used for training, and 2021 is used for val/testing. This does mean that there is only data for the first half of 2021 in the test/val set for now, but that does cover winter/spring/part of summer so far, with more as time goes on.
@jacobbieker
Copy link
Member

Oh interesting! I hadn't thought of the correlation between days of the week, didn't really think about that. Changed the training splits to address that. And hopefully adding in more data sources will help the predictions of the model too. So far, I still haven't added radar data yet, as its in a odd format, or NWP data, both which should help as well.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
discussion
Projects
No open projects
ML Research
To do
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JackKelly @jacobbieker