Set resources for dataloading, training and prediction#45
Conversation
|
@meiertgrootes and @rogerkuou when working on this PR, I found that the land mask from era5 does not mask the large water bodies, for example see the plots below, the white pixels are related to Lake Victoria in Africa. These large bodies are not available in "averaged" daily sst data. Something to be discussed in our meeting (data checkup).
Blue regions are water (sea, lakes, rivers,...), green are land.
White pixels (in land region) are nan in "averaged" daily sst data. |
|
@meiertgrootes the notebook uses residuals as target and compares the model output with the baseline (averaged daily data). |
meiertgrootes
left a comment
There was a problem hiding this comment.
The PR looks good! All changes should be very useful. I've made acomment suggesting possible additional diagnostic plots. Feel free to relegate those to a separate issue if that works better.
There was a problem hiding this comment.
The visualization and the configuration of computational resources are both very nice to have! Histograms of the target residuals the predicted corrections and the error after correction might also be quite informative in judging and demonstrating performance.
There was a problem hiding this comment.
yes, that's right. I'll merge two notebooks, main and this branch to have both plots.


closes #44
This PR: