Deep Learning for empirical DownScaling
DL4DS (Deep Learning for empirical DownScaling) is a Python package that implements state-of-the-art and novel deep learning algorithms for empirical downscaling of gridded Earth science data.
The general architecture of DL4DS is shown on the image below. A low-resolution gridded dataset can be downscaled, with the help of (an arbitrary number of) auxiliary predictor and static variables, and a high-resolution reference dataset. The mapping between the low- and high-resolution data is learned with either a supervised or a conditional generative adversarial DL model.
The training can be done from explicit pairs of high- and low-resolution samples (MOS-style, e.g., high-res observations and low-res numerical weather prediction model output) or only with a HR dataset (PerfectProg-style, e.g., high-res observations or high-res model output).
A wide variety of network architectures have been implemented in DL4DS. The main modelling approaches can be combined into many different architectures:
| Downscaling type | Training (loss type) | Sample type | Backbone section | Upsampling method |
|---|---|---|---|---|
| MOS (explicit pairs of HR and LR data) | Supervised (non-adversarial) | Spatial | Plain convolutional | Pre-upsampling via interpolation |
| PerfectProg (implicit pairs, only HR data) | Conditional Adversarial | Spatio-temporal | Residual | Post-upsampling via sub-pixel convolution |
| Dense | Post-upsampling via resize convolution | |||
| Unet (PIN, Spatial samples) | Post-upsampling via deconvolution | |||
| Convnext (Spatial samples) |
In DL4DS, we implement a channel attention mechanism to exploit inter-channel relationship of features by providing a weight for each channel in order to enhance those that contribute the most to the optimizaiton and learning process. Aditionally, a Localized Convolutional Block (LCB) is located in the output module of the networks in DL4DS. With the LCB we learn location-specific information via a locally connected layer with biases.
DL4DS is built on top of Tensorflow/Keras and supports distributed GPU training (data parallelism) thanks to Horovod.
API documentation
Check out the API documentation here.
Installation
pip install dl4ds
Example notebooks
A first Colab notebook can be found in the notebooks folder. Click the badge at the top to open the notebook on Google Colab.
