MRB-650 maps simplified #92

jonasbhend · 2026-01-07T10:38:09Z

Add maps of forecast verification scores

Changes

score components for maps in verif.nc
Make verif.nc temporary to avoid storage of large data volumes

…oard" This reverts commit cdefa16.

summary statistics. (No changes to code yet.)

of summary statistics.

For Bias, RMSE and MAE map plots.

compat.py

earthkit instead.

Francesco. Got a long way towards the png plots. Co-authored-by: Francesco Zanetta <francesco.zanetta@meteoswiss.ch>

variables.

properly working). Output written to .png now working.

detailed inspection of results at smaller spatial scale.

symmetric colour map for bias.

to see if all of it still works.

_compute_statistics with argument dim.

symmetric about zero. vmin and vmax values for variables other than T_2M yet to be defined.

This way, everything is in the same place and can be changed there when needed. Accompanying changes in the plotting script (marimo cell that gets the colour map defaults).

Required accompanying change in Snakefile.

This has caused problems before.

Louis-Frey · 2026-02-09T13:41:18Z

I came across two different problems with this feature branch:

On the current last commit, I run into memory issues in rule verif_metrics_aggregation . The job seems to be killed by SLURM due to be out of memory (analysis of the log files and consultation with ChatGPT strongly suggest this). This may confirm Francesco's reservations regarding the computation of the spatial metrics.
When I extended the code to also plot the maps for the baselines, I got errors in rule report_experiment_dashboard several times last week. This made me test the code on the last commit today, resulting in the error described in 1.

So overall I can't really make sense of this. On the one hand, I apparently was able to run verif_metrics_aggregation before, because the code only failed later in report_experiment_dashboard. Also, I was able to run the full pipeline on a full year of daily forecasts with the ICON-CH1 emulator about a week ago, which ran without an error.

Also, the problem in 2. suggests that even if problem 1. does not occur, problems may arise later when the verification files are aggregated in the dashboard. This may be due to the large size of the verification files (about 17G for the run and about 11G for the ICON-CH1 baseline). However, also this ran without error in some cases (1 year experiment), so it does not seem to fail consistently.

Would be great if you could look into this!

frazane · 2026-02-09T15:11:30Z

Make verif.nc temporary to avoid storage of large data volumes

By doing this, verification will have to be re-computed for every run, every time the workflow is executed. I don't think we want this, no?

Louis-Frey · 2026-02-09T17:57:31Z

Make verif.nc temporary to avoid storage of large data volumes

By doing this, verification will have to be re-computed for every run, every time the workflow is executed. I don't think we want this, no?

Yes, that could be problematic. Jonas introduced it and I haven't given it much thought, should I change it back?

Louis-Frey · 2026-02-09T18:12:28Z

Ok I most likely fixed problem 2. See commit 7b50809

Louis-Frey force-pushed the MRB-650-Maps-simplified branch from 2185fd6 to 9eb4643 Compare January 22, 2026 12:43

jonasbhend and others added 29 commits January 27, 2026 16:28

Simplified way of implementing fields

2b49526

Exclude spatial data from being plotted and included in dashboard

a456b1d

delete intermeidate verification files

0ec286f

Fix typo

28692d6

include score components for maps

f3dcf0d

Revert "Exclude spatial data from being plotted and included in dashb…

99dac52

…oard" This reverts commit cdefa16.

remove source dimension from scores

edcca5b

clean up

0ec8a0f

New rule and plotting file for plotting maps of

51f22a6

summary statistics. (No changes to code yet.)

Obvious changes to the new plotting rule for maps

366249d

of summary statistics.

Some more changes (preliminary, to be continued).

f531395

Further changes to plotting scripts.

32c7ecf

First version of colour maps finished.

c2ab645

For Bias, RMSE and MAE map plots.

Better comments in the colour map code.

27b91e2

Better Comments, some further changes to code.

1b2e670

Added back instances of lead time.

52dd1e7

New function for loading netCDF files added to

ddc5883

compat.py

Marimo app cell for loading data from .nc

35396a7

Remove .nc-loading function again, do it with

e8a92aa

earthkit instead.

All kinds of changes. Co-Development session with

06be6fa

Francesco. Got a long way towards the png plots. Co-authored-by: Francesco Zanetta <francesco.zanetta@meteoswiss.ch>

Generalized to the other non-trivial (non-wind)

61c728e

variables.

Some changes to plotting script.

761f8d9

Plotting region now dynamical (but not yet

1cd4dbf

properly working). Output written to .png now working.

Dynamic Regions now working.

cdb2ccd

Store results under experiment hash.

558689c

Introduced new domain "switzerland_small" for more

986a7ee

detailed inspection of results at smaller spatial scale.

Reverse Red-Blue colour maps for bias.

7f70fb4

Preliminary changes to plotting script for getting

50e899f

symmetric colour map for bias.

Temporarily changed plotting script back to original

a0aefc0

to see if all of it still works.

Fix to the functioning of _compute_scores and

be6fa35

_compute_statistics with argument dim.

Louis-Frey force-pushed the MRB-650-Maps-simplified branch from 52fce5c to be6fa35 Compare January 27, 2026 17:14

Louis-Frey added 9 commits January 29, 2026 15:32

Working version for colour scale for bias that is

2fcd1f9

symmetric about zero. vmin and vmax values for variables other than T_2M yet to be defined.

New colour map defaults for T_2M

7864b5d

Hard-Code levels for colour breaks.

de0f279

This way, everything is in the same place and can be changed there when needed. Accompanying changes in the plotting script (marimo cell that gets the colour map defaults).

New Rule for Map plots of Baselines.

69e7b36

Different File naming (Region first -> Order)

1353788

Required accompanying change in Snakefile.

Temporarily remove rule for maps for baselines.

569759a

Renamed domain "switzerland_small".

bda0e0d

This has caused problems before.

Generate Colour breaks more elegantly.

ccf6279

Colour breaks from function for all T2m metrics.

258b2de

Louis-Frey requested review from dnerini and frazane February 9, 2026 13:41

Louis-Frey added 2 commits February 9, 2026 19:09

Map plots now also for baselines.

5c0151b

Fix memory leak occurring during creation of html.

7b50809

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

MRB-650 maps simplified #92

MRB-650 maps simplified #92

jonasbhend commented Jan 7, 2026 •

edited

Loading

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

frazane commented Feb 9, 2026

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

MRB-650 maps simplified #92

Are you sure you want to change the base?

MRB-650 maps simplified #92

Conversation

jonasbhend commented Jan 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

frazane commented Feb 9, 2026

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

Louis-Frey commented Feb 9, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jonasbhend commented Jan 7, 2026 •

edited

Loading