73 water vapor notebook

[rogerkuou]

Fix #73

Added check for empty dataset
Init loss in predict as a tensor
In the example notebook down sample landsurface mask by the factor of 2

[rogerkuou]

Hi @SarahAlidoost , while working on #73, I got an error in the notebook. This notebooks is adapted from the SST hourly one.

It fails on average_loss.item(), which hints that average_loss is a dictionany. Do you have clue on this? I am running with the CPU mode instead of GPU.

[rogerkuou]

Hi @SarahAlidoost , can you review this notwbook when you have time?

The error was caused by an empty dataset. I added a check to predict, and initiated loss as an zero Tensor.

Another thing maybe we need to pay attention, is the water wapor data is downsampled by the factor of 2 comparing to SST. This requires some attention to lsm data. In the notebook I used an average window to downsample the lsm, and set <0.5 to 0, and >=0.5 to 1. We can discuss if this makes sense.

[SarahAlidoost]

@rogerkuou Thanks! 👍 I added one comment on the changed code. Levante is not available today and I dont have data locally. I will check the notebook later. About the spatial resolution of water vapor, I expected era5 data have the same spatial resolution; this is something to check in our next update meeting. I couldnot also check the era5 data as CDS is also on maintenance.

[SarahAlidoost]

Hi @SarahAlidoost , can you review this notwbook when you have time?

The error was caused by an empty dataset. I added a check to predict, and initiated loss as an zero Tensor.

Another thing maybe we need to pay attention, is the water wapor data is downsampled by the factor of 2 comparing to SST. This requires some attention to lsm data. In the notebook I used an average window to downsample the lsm, and set <0.5 to 0, and >=0.5 to 1. We can discuss if this makes sense.

Indeed there are a few things about water vapor data to check:

• the spatial resolution of data on levante is 0.5. The water vapor data is available on cds with resolution 0.25
• data is cut between (-80, 80) in latitude dimension
• the latitudes are not increasing they are from (80, -80) while longitude are i.e. (-180, 180)