diff --git a/ECMWF.md b/ECMWF.md
index fed49092a33a29a9a861502ca9f47cc57cce6e94..e011028c6345221d98b4cebbfde5cc7c9c51b2f7 100644
--- a/ECMWF.md
+++ b/ECMWF.md
@@ -28,6 +28,7 @@ startagent
# Check if it is running
ssh-add -l
```
+
once you have a running ssh-agent, run a browserless login via python
```bash title="Connecting to ECMWF"
@@ -37,7 +38,7 @@ tsh status
# run ssh agent again
ssh-add -l
# now there should be two keys!!!
-# Login to ECAccess in Bologna
+# Login to ECaccess in Bologna
ssh -J [user]@jump.ecmwf.int [user]@ecs-login
# Login to HPC ATOS
ssh -J [user]@jump.ecmwf.int [user]@hpc-login
@@ -52,6 +53,28 @@ Environment variables configuration:
You can set these variables in your `~/.bashrc` file to avoid typing these at every login. Please do not save your `ECMWF_PASSWORD` like this!
+It is highly advised to add this to your `.ssh/config`:
+
+```conf title=".ssh/config"
+Host jump.ecmwf.int shell.ecmwf.int
+ HostKeyAlgorithms +ssh-rsa*,rsa-sha2-512
+ PubkeyAcceptedKeyTypes +ssh-rsa*
+ User [ECMWF USERNAME]
+# For ecgate and Cray HPCF
+Host ecg* cc*
+ HostKeyAlgorithms +ssh-rsa*,rsa-sha2-512
+ PubkeyAcceptedKeyTypes +ssh-rsa*
+ User [ECMWF USERNAME]
+ ProxyJump shell.ecmwf.int
+# For Atos HPCF
+Host a?-* a??-* hpc-* hpc2020-* ecs-*
+ HostKeyAlgorithms +ssh-rsa*,rsa-sha2-512
+ PubkeyAcceptedKeyTypes +ssh-rsa*
+ User [ECMWF USERNAME]
+ ProxyJump jump.ecmwf.int
+```
+
+
### SSH-agent
It is required to have an SSH-agent running in order to connect to the ECMWF servers. The teleport module includes a `startagent` function to allow to reconnect to an existing ssh-agent. Do not start too many agents!
@@ -60,6 +83,11 @@ It is required to have an SSH-agent running in order to connect to the ECMWF ser
module load teleport
# start a new agent or reconnect
startagent
+
+# unsure about agents?
+userservices sshtools -h
+# kill all
+userservices sshtools -k
```
@@ -110,4 +138,8 @@ ecaccess-file-copy ecaccess-queue-list
# First get a valid certificate to get access
ecaccess-certificate-create
#
-```
\ No newline at end of file
+```
+
+## ECaccess Gateway
+
+The department is running a member state ecaccess gateway service.
\ No newline at end of file
diff --git a/ICON.md b/ICON-NWP.md
similarity index 94%
rename from ICON.md
rename to ICON-NWP.md
index 32af9ffad732c3926585c957a8df03bb962fec95..c4c0ba1a85ff01fd610752f230c0784eec795582 100644
--- a/ICON.md
+++ b/ICON-NWP.md
@@ -1,3 +1,9 @@
+## Disclaimer
+
+The following guidelines explain how to configure and compile ICON on the clusters of IMGW (primarily `jet`). They should be generic enough to help anyone getting ICON up and running, but they are targeted to users of the limited-area-model and large-eddy-simulation versions of ICON.
+
+For more specific guidance on working with the climate modelling version of ICON, please check elsewhere (Gitlab projects of the [climate modelling group](https://gitlab.phaidra.org/climate/), or their wiki).
+
## What is ICON
ICON can be downloaded and used under a [personal non-commercial research license](https://code.mpimet.mpg.de/projects/iconpublic/wiki/Instructions_to_obtain_the_ICON_model_code_with_a_personal_non-commercial_research_license). An account at <code.mpimet.mpg.de> is required. Instructions are available on the [public ICON page](https://code.mpimet.mpg.de/projects/iconpublic). Useful information can be found in the ICON [Tutorial](https://www.dwd.de/EN/ourservices/nwv_icon_tutorial/pdf_volume/icon_tutorial2023_en.pdf?__blob=publicationFile&v=3).
diff --git a/Misc/Virtual-Terminals.md b/Misc/Virtual-Terminals.md
index e8c84f030613aaf417e35811cdd54473e5d7b6eb..85aef5e3f8b93bdc2733bda3d89e65f5101a7365 100644
--- a/Misc/Virtual-Terminals.md
+++ b/Misc/Virtual-Terminals.md
@@ -43,6 +43,30 @@ set -g mouse on
set -g history-limit 30000
```
+### Tmux inside JupyterLab on TeachingHub
+
+By coincidence the Jupyterlab uses the same control sequence to toggle the file browser in jupyterlab as tmux. `CTRL+b` .
+
+To change that, we will just remove the jupyterlab shortcut.
+In Jupyterlab go to Settings, Advanced Settings Editor, Keyboard Shortcuts. In the user pane add this:
+
+```yaml
+{
+ "shortcuts":[
+ {
+ "command": "application:toggle-left-area",
+ "keys": [
+ "Accel B"
+ ],
+ "selector": "body",
+ "disabled": true
+ }
+ ]
+}
+```
+
+When you can click then save button on the upper right corner, you are fine. Otherwise there might be a syntax error, as indicated in the lower right corner. That might happen if you need to merge things. Now you should be able to control tmux again inside the jupyterlab.
+
### Sharing a tmux session with other users?
In the first terminal, start tmux where shared is the session name and shareds is the name of the socket:
diff --git a/Python/README.md b/Python/README.md
index 10077fdf1623bffbf9f135db8fdeb4b440a03287..0db711750f5ecc7edbc2eeb132e0e08998ff2119 100644
--- a/Python/README.md
+++ b/Python/README.md
@@ -5,17 +5,48 @@
**What is conda ?**
-[link]()
This is the package manager for the anaconda or miniconda distribution of Python. It allows to install packages and create environments and much much more. However, mostly you will use it to install packages and create environments for your code. It is slow.
+[link](https://conda.io/projects/conda/en/latest/user-guide/getting-started.html)
**What is micromamba ?**
-This is a replacement package manager for Python that is independent from a distribution,
-[link](https://github.com/mamba-org/mamba)
+This is a replacement package manager for Python that is independent from a distribution and can be used to create fuly independent python environments with just the micromamba executable as strting point.
+[link](https://mamba.readthedocs.io/en/latest/user_guide/micromamba.html)
+
+```sh title="Conda environment"
+# Download and extract just micromamba exe
+wget -qO- https://micromamba.snakepit.net/api/micromamba/linux-64/latest | tar -xvj --strip-components=1 bin/micromamba
+# show
+micromamba info
+ __
+ __ ______ ___ ____ _____ ___ / /_ ____ _
+ / / / / __ `__ \/ __ `/ __ `__ \/ __ \/ __ `/
+ / /_/ / / / / / / /_/ / / / / / / /_/ / /_/ /
+ / .___/_/ /_/ /_/\__,_/_/ /_/ /_/_.___/\__,_/
+ /_/
+
+
+ environment : None (not found)
+ env location : -
+ user config files : /home/user/.mambarc
+ populated config files :
+ libmamba version : 1.1.0
+ micromamba version : 1.1.0
+ curl version : libcurl/7.87.0 OpenSSL/1.1.1s zlib/1.2.13 libssh2/1.10.0 nghttp2/1.47.0
+ libarchive version : libarchive 3.6.2 zlib/1.2.13 bz2lib/1.0.8 libzstd/1.5.2
+ virtual packages : __unix=0=0
+ __linux=6.1.12=0
+ __glibc=2.37=0
+ __archspec=1=x86_64
+ channels :
+ base environment : /home/user/micromamba
+ platform : linux-64
+```
+
**What should I use?**
-It is recommended to use is micromamba, which is way faster than conda. It has a smaller footprint and it works almost identical as conda. It is a c++ replacement of conda/mamba.
+It is recommended to use micromamba, which is way faster than conda. It has a smaller footprint and it works almost identical as conda. It is a c++ replacement of conda/mamba.
### install packages
@@ -23,7 +54,23 @@ It is recommended to use is micromamba, which is way faster than conda. It has a
There are sometimes different versions available with different build options as well.
-`conda install -c <channel> <package_name>=<version>=<build_string>`
+```sh title="Conda environment"
+# load the minimum module (alternative load anaconda3)
+module load miniconda3
+# Create an environment and install some packages
+conda create --name <my-environment> <package_name>=<version>=<build_string>
+# install packages into that environment again
+conda install -c <channel> -n <my-environment> <package_name>=<version>=<build_string>
+```
+
+```sh title="micromamba environment"
+# load micromamba exe (just one exe)
+module load micromamba
+#
+micromamba create -n <my-environment> <package_name>=<version>=<build_string>
+micromamba install -c conda-forge -n <my-environment> <package_name>=<version>=<build_string>
+```
+
## Q: Installing Cartopy on Jet Cluster or any other module based environment?
diff --git a/SSH-VPN-VNC/connect2vpn b/SSH-VPN-VNC/connect2vpn
index 9ce7a78f4fb40d709d03a43027b81a691ac2b8cf..e2a44f8b8e0b03c2186b1d22ad49b4c0a3aecfc3 100755
--- a/SSH-VPN-VNC/connect2vpn
+++ b/SSH-VPN-VNC/connect2vpn
@@ -41,12 +41,12 @@ fi
read -p "[VPN] Full (1) or split (None) tunnel? (1/None): " REPLY
if [ "$REPLY" == "" ]; then
echo "[VPN] Connecting split-tunnel ..."
- cmd="f5fpc -s -t vpn.univie.ac.at -u ${VPN_USER}"
+ cmd="f5fpc -s -t vpn.univie.ac.at"
else
echo "[VPN] Connecting full-tunnel ..."
- cmd="f5fpc -s -t vpn.univie.ac.at:8443 -u ${VPN_USER}"
+ cmd="f5fpc -s -t vpn.univie.ac.at:8443"
fi
-echo "[VPN] Starting Monitor..."
+echo "[VPN] Testing VPN Client..."
# Show status
export -f vpninfos
init=true
@@ -59,7 +59,15 @@ do
f5fpc -o
fi
echo "[VPN] Starting connection ..."
- eval $cmd
+ if [ -z "$VPN_PWD" ]; then
+ read -p "[VPN] u:account password:" VPN_PWD
+ fi
+ read -p "[VPN] TOTP Code (6 digits/empty):" VPN_TOTP
+ if [ -n "$VPN_TOTP" ]; then
+ eval "${cmd} -p ${VPN_PWD} -u ${VPN_USER}@${VPN_TOTP}"
+ else
+ eval "$cmd -p ${VPN_PWD} -u ${VPN_USER}"
+ fi
if $init; then
init=false
fi
@@ -70,6 +78,7 @@ do
break
fi
done
+unset VPN_PWD VPN_USER VPN_TOTP
echo "[VPN] Shutting down ..."
# Disconnect
f5fpc -o
diff --git a/WRF.md b/WRF.md
index bfc7038ddb0ad68cb5fd07af03c878be008d231c..84fe8e8c3ce1329cb0c79c39b9403a7f8b428380 100644
--- a/WRF.md
+++ b/WRF.md
@@ -1,9 +1,14 @@
-# WRF
-
-The present manual aims at constituting a first approach for beginner users to the Weather
-Research and Forecasting Model.
+The present manual contains basic information about running the Weather Research and Forecasting Model on workstations and clusters of the Department of Meteorology and Geophysics in Vienna.
+
+Besides this basic guide, more detailed information is available too:
+
+[Basic WRF usage, including compilation instructions](WRF/WRF_basic.md).
+[Advanced WRF usage](WRF/WRF_basic.md).
+[Data assimilation with WRF](WRF/WRF_da.md).
+[Workflows for common WRF tasks](WRF/WRF_da.md).
+[Configuration files on different servers](WRF/config_files).
Table of contents:
@@ -23,32 +28,81 @@ There is also a [users's forum](https://forum.mmm.ucar.edu/), which can be a sou
WRF and related programs run as executables on linux machines and clusters. Running WRF requires access to a linux terminal. If you work on Linux or Mac, this is trivial: just open a terminal window. If you work on windows, consider using a linux terminal emulator that supports X11 forwarding (a protocol that enables running interactive graphical applications on a remote server via ssh). There are several alternatives, one option that proved to work well is [MobaXterm](https://mobaxterm.mobatek.net/).
-The WRF source code is available on [Github](https://github.com/wrf-model/WRF). It is possible to checkout the repository, but the recommended way of getting the code is to download one of the [official releases](https://github.com/wrf-model/WRF/releases): scroll down to the "Assets" section and choose one of the `v*.tar.gz` or `v*zip` files (not the "Source code" ones; these are incomplete).
+## Getting WRF
-To download while working on the terminal on a remote server, use wget or curl:
+### Option 1: Get the WRF executables
-```sh
-wget "https://github.com/wrf-model/WRF/releases/download/v4.4.2/v4.4.2.tar.gz"
-curl -OL "https://github.com/wrf-model/WRF/archive/refs/tags/v4.4.2.zip"
-```
+If someone else already compiled it on the computer you'll be working with, you just need to:
+
+* Copy their WRF run directory. For instance on `srvx1`, some WRF run directories are available in `/users/staff/serafin/RUN`. You can get one with, for instance:
+
+ ```sh
+ cp -rL /users/staff/serafin/RUN/WRFv4.4.2_scm/ .
+ ```
+
+* Replicate exactly their compilation and runtime environment (see the chapter on "Setting up your environment" below).
+
+### Option 2: Get the source code
+
+The WRF source code is available on [Github](https://github.com/wrf-model/WRF), and there are several ways to get it.
-To uncompress the source code, use either of the following (depending on the format):
+* Recommended: download one of the [official releases](https://github.com/wrf-model/WRF/releases): scroll down to the "Assets" section and choose one of the `v*.tar.gz` or `v*zip` files (not the "Source code" ones; these are incomplete).
+
+ To download while working on the terminal on a remote server, use wget or curl:
+
+ ```sh
+ wget "https://github.com/wrf-model/WRF/releases/download/v4.4.2/v4.4.2.tar.gz"
+ curl -OL "https://github.com/wrf-model/WRF/archive/refs/tags/v4.4.2.zip"
+ ```
+
+ To uncompress the source code, use either of the following (depending on the format):
+
+ ```sh
+ tar xzvf v4.4.2.tar.gz
+ unzip v4.4.2.zip
+ ```
+
+* Clone the repository in a local directory:
+
+ ```sh
+ git clone --recurse-submodule https://github.com/wrf-model/WRF.git
+ ```
+
+* You can also import WRF from Github into a new empty Gitlab project on [Phaidra](https://gitlab.phaidra.org/explore). To get access to Gitlab, look at the [ZID guidlines](https://zid.univie.ac.at/gitlab/) and send a request via email to `support.phaidra@univie.ac.at`. Once you have access credentials, click on "New Project", then "Import Project", then "Repository by URL". This method might be advisable if you want to use Gitlab for tracking your own changes to the WRF code, but do not want to rely on the official repository.
+
+## Quick start with WRF
+
+### Setting up your environment
+
+You need to make the operating system aware of the software libraries required to compile and run WRF, both at compile time and at run time.
+
+This is done by loading environment modules, with `module load` on srvx1/jet/VSC4, and with `spack load` on VSC5.
+
+It is useful to save the information about a specific environment in a simple bash shell script (for instance: `modules_srvx1.sh`). Then, before compiling or running WRF, type `source modules_srvx1.sh`). See [here](WRF/config_files) for a few examples.
+
+### Compiling
+
+If you already have a compiled version of WRF, go to the next step.
+
+Compiling WRF for an idealized simulation (LES), assuming that you have a properly set software environment:
```sh
-tar xzvf v4.4.2.tar.gz
-unzip v4.4.2.zip
+./configure
+./compile em_les > compile.log 2>&1 &
```
-## Quick start
+The process is similar for other idealized test cases. Just change the compile targe (e.g., `em_hill2d_x`).
-Compiling WRF for an idealized simulation (LES):
+Compiling WRF for a real-case simulation, assuming that you have a properly set software environment:
```sh
./configure
-./compile em_les > compile.log 2>&1 &
+./compile em_real > compile.log 2>&1 &
```
-Running WRF for an idealized simulation (LES):
+### Running
+
+Running WRF for an idealized simulation (LES), assuming that you have a properly set software environment:
```sh
cd ./test/em_les
@@ -58,14 +112,7 @@ cd ./test/em_les
For other test cases, compilation might create a `run_me_first.csh` script in the same directory as the executables. If there is one, run it only once, before any other program. It will link any necessary lookup tables needed for the simulation (land-use, parameterizations, etc.).
-Compiling WRF for an idealized simulation (LES):
-
-```sh
-./configure
-./compile em_real > compile.log 2>&1 &
-```
-
-Running WRF for a real_case simulation:
+Running WRF for a real_case simulation, assuming that you have a properly set software environment:
```sh
cd test/em_real
@@ -74,7 +121,9 @@ ln -s $WPS_PATH/met_em* .
./wrf.exe
```
-The `met_em*` files linked in this snippet are the outcome of the WRF preprocessing (interpolation of initial and boundary conditions from another model, or from reanalyses, on the WRF grid). The WRF preprocessing system (WPS) is a separate set of executables, that can be built only after WRF is successfully compiled. To run WPS for a real-case simulation, getting initial and boundary conditions from ECMWF-IFS data on model levels, you could use a script such as the following. However, it depends on namelists, variable tables and other settings files being correctly specified. See below for details.
+The `met_em*` files linked in this snippet are the outcome of the WRF preprocessing (interpolation of initial and boundary conditions from another model, or from reanalyses, on the WRF grid), and they are supposed to be in a directory, to which the environmental variable `$WPS_PATH` points.
+
+The WRF preprocessing system (WPS) is a separate set of executables, that can be built only after WRF is successfully compiled. To run WPS for a real-case simulation, getting initial and boundary conditions from ECMWF-IFS data on model levels, you could use a script such as the following. However, the script depends on namelists, variable tables and other settings files being correctly specified. See the detailed info pages for details.
```sh title="Example: wrf-run-script.sh"
#!/bin/bash
diff --git a/WRF/WRF_advanced.md b/WRF/WRF_advanced.md
new file mode 100644
index 0000000000000000000000000000000000000000..25976ba39621eb6fd39ac403c548b19dc4ebd71c
--- /dev/null
+++ b/WRF/WRF_advanced.md
@@ -0,0 +1,83 @@
+## Advanced usage
+
+### Changing the source code
+
+### Conditional compilation
+
+Most Fortran compilers allow passing the source code through a C preprocessor (CPP; sometimes also called the Fortran preprocessor, FPP) to allow for conditional compilation. In the C programming language, there are some directives that make it possible to compile portions of the source code selectively.
+
+In the WRF source code, Fortran files have an .F extension. cpp will parse these files and create corresponding .f90 files. The .f90 files will then be compiled by the Fortran compiler.
+
+This means:
+1. When editing the source code, always work on the .F files, otherwise changes will be lost on the next compilation.
+2. In the .F files, it is possible to include `#ifdef` and `#ifndef` directives for conditional compilation.
+
+For instance, in `dyn_em/module_initialize_ideal.F`, the following bits of code define the model orography for idealized large-eddy simulation runs. Four possibilities are given: `MTN`, `EW_RIDGE`, `NS_RIDGE`, and `NS_VALLEY`. If none is selected at compile time (select by adding `!` in front of #ifdef and #endif), none of these code lines is compiled and `grid%ht(i,j)` (the model orography) is set to 0:
+
+```fortran
+#ifdef MTN
+ DO j=max(ys,jds),min(ye,jde-1)
+ DO i=max(xs,ids),min(xe,ide-1)
+ grid%ht(i,j) = mtn_ht * 0.25 * &
+ ( 1. + COS ( 2*pi/(xe-xs) * ( i-xs ) + pi ) ) * &
+ ( 1. + COS ( 2*pi/(ye-ys) * ( j-ys ) + pi ) )
+ ENDDO
+ ENDDO
+#endif
+#ifdef EW_RIDGE
+ DO j=max(ys,jds),min(ye,jde-1)
+ DO i=ids,ide
+ grid%ht(i,j) = mtn_ht * 0.50 * &
+ ( 1. + COS ( 2*pi/(ye-ys) * ( j-ys ) + pi ) )
+ ENDDO
+ ENDDO
+#endif
+#ifdef NS_RIDGE
+ DO j=jds,jde
+ DO i=max(xs,ids),min(xe,ide-1)
+ grid%ht(i,j) = mtn_ht * 0.50 * &
+ ( 1. + COS ( 2*pi/(xe-xs) * ( i-xs ) + pi ) )
+ ENDDO
+ ENDDO
+#endif
+#ifdef NS_VALLEY
+ DO i=ids,ide
+ DO j=jds,jde
+ grid%ht(i,j) = mtn_ht
+ ENDDO
+ ENDDO
+ xs=ids !-1
+ xe=xs + 20000./config_flags%dx
+ DO j=jds,jde
+ DO i=max(xs,ids),min(xe,ide-1)
+ grid%ht(i,j) = mtn_ht - mtn_ht * 0.50 * &
+ ( 1. + COS ( 2*pi/(xe-xs) * ( i-xs ) + pi ) )
+ ENDDO
+ ENDDO
+#endif
+```
+
+To control conditional compilation:
+1. Search for the variable `ARCHFLAGS` in `configure.wrf`
+2. Add the desired define statement at the bottom. For instance, to selectively compile the `NS_VALLEY` block above, do the following:
+
+```Makefile
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+...
+ -DNMM_NEST=$(WRF_NMM_NEST) \
+ -DNS_VALLEY
+
+```
+
+### Customizing model output
+
+### Adding namelist variables
+
+### Running offline nested simulations
+
+### Running LES with online computation of resolved-fluxes turbulent fluxes
+
+WRFlux
diff --git a/WRF/WRF_basic.md b/WRF/WRF_basic.md
new file mode 100644
index 0000000000000000000000000000000000000000..597e065e65144ee20676448fe590a1bca2e8e1ae
--- /dev/null
+++ b/WRF/WRF_basic.md
@@ -0,0 +1,309 @@
+## Basic usage
+
+### Organization of the source code
+
+After download and unpacking, the WRF source code looks like this
+
+```sh
+(base) [serafin@srvx1 WRF-4.4.2]$ ls
+total 236K
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 arch
+drwxr-xr-x. 3 serafin users 8,0K 19 dic 18.37 chem
+-rwxr-xr-x. 1 serafin users 4,0K 19 dic 18.37 clean
+-rwxr-xr-x. 1 serafin users 17K 19 dic 18.37 compile
+-rwxr-xr-x. 1 serafin users 37K 19 dic 18.37 configure
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 doc
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 dyn_em
+drwxr-xr-x. 17 serafin users 4,0K 19 dic 18.37 external
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 frame
+drwxr-xr-x. 16 serafin users 4,0K 19 dic 18.37 hydro
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 inc
+-rw-r--r--. 1 serafin users 1,1K 19 dic 18.37 LICENSE.txt
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 main
+-rw-r--r--. 1 serafin users 57K 19 dic 18.37 Makefile
+drwxr-xr-x. 3 serafin users 8,0K 19 dic 18.37 phys
+-rw-r--r--. 1 serafin users 18K 19 dic 18.37 README
+-rw-r--r--. 1 serafin users 1,2K 19 dic 18.37 README.md
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 Registry
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 run
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 share
+drwxr-xr-x. 17 serafin users 4,0K 19 dic 18.37 test
+drwxr-xr-x. 4 serafin users 4,0K 19 dic 18.37 tools
+drwxr-xr-x. 14 serafin users 4,0K 19 dic 18.37 var
+drwxr-xr-x. 2 serafin users 4,0K 19 dic 18.37 wrftladj
+```
+
+Knowing in detail the structure of the source code is not necessary for the average user. However, the directories where most of the practical work is done are:
+
+* `run`: this is where the compiled executables and lookup tables will reside after compilation.
+* `test`: this contains several subdirectories, each of which refers to a specific compilation mode. For instance, compiling WRF for large-eddy simulation will link some executables in `em_les`, while compiling WRF for real-case simulations will link some other executables and lookup tables in `em_real`. Most of the test subdirectories refer to simple idealized simulations, some of which are two-dimensional. These test cases are used to valide the model's dynamical core (e.g., check if it correctly reproduces analytical solution of the Euler or Navier-Stokes equations).
+
+In some cases, editing the model source code is necessary. This mostly happens in these directories:
+* `dyn_em`: this contains the source code of the dynamical core of the model ("model dynamics") and of part of the initialization programmes.
+* `phys`: this contains the source code of parameterizion schemes ("model physics").
+* `Registry`: large chunks of the WRF source code are generated automatically at compile time, based on the information contained in a text file called `Registry`. This file specifies for instance what model variables are saved in the output, and how.
+
+### Compiling the model
+
+WRF is written in compiled languages (mostly Fortran and C++), so it needs to be compiled before execution. It relies on external software libraries at compilation and runtime, so these libraries have to be available on the system where WRF runs.
+
+In general, compiled WRF versions are already available on all of our servers (SRVX1, JET, VSC4, VSC5) from the expert users. So, the easiest way of getting started is to copy a compiled version of the code from them (see below).
+
+However, we describe the typical workflow of the compilation, for anyone that wishes to try it out. There are three steps: (i) make libraries available, (ii) configure, (iii) compile.
+
+#### Make the prerequisite libraries available
+
+In most cases, precompiled libraries can be made available to the operating system using environment modules. Environment modules modify the Linux shell environment so that the operating system is aware of where to find specific executable files, include files, software libraries, documentation files. Each server has its own set of available modules. As of 1.3.2023, WRF is known to compile and run with the following module collections.
+
+SRVX1:
+```sh
+module load intel-parallel-studio/composer.2020.4-intel-20.0.4 openmpi/3.1.6-intel-20.0.4 hdf5/1.10.7-intel-20.0.4-MPI3.1.6 netcdf-c/4.6.3-intel-20.0.4-MPI3.1.6 netcdf-fortran/4.5.2-intel-20.0.4-MPI3.1.6
+```
+
+SRVX1 (modules changed; 11.04.2023):
+```sh
+module load netcdf-fortran/4.5.3-intel-2020.4 intel-parallel-studio/composer.2020.4 netcdf-c/4.7.4-intel-2020.4 hdf5/1.12.2-intel-2020.4 intel-oneapi-mpi/2021.7.1-intel-2020.4
+```
+
+JET (GNU Fortran compiler):
+```sh
+module load openmpi/4.0.5-gcc-8.5.0-ryfwodt hdf5/1.10.7-gcc-8.5.0-t247okg parallel-netcdf/1.12.2-gcc-8.5.0-zwftkwr netcdf-c/4.7.4-gcc-8.5.0-o7ahi5o netcdf-fortran/4.5.3-gcc-8.5.0-3bqsedn gcc/8.5.0-gcc-8.5rhel8-7ka2e42
+```
+
+JET (Intel Fortran compiler):
+```sh
+module load intel-parallel-studio/composer.2020.2-intel-20.0.2-zuot22y zlib/1.2.11-intel-20.0.2-3h374ov openmpi/4.0.5-intel-20.0.2-4wfaaz4 hdf5/1.12.0-intel-20.0.2-ezeotzr parallel-netcdf/1.12.1-intel-20.0.2-sgz3yqs netcdf-c/4.7.4-intel-20.0.2-337uqtc netcdf-fortran/4.5.3-intel-20.0.2-irdm5gq
+```
+
+JET (alternative setup with Intel Fortran compiler):
+```sh
+module load intel-oneapi-mpi/2021.4.0-intel-2021.4.0-eoone6i hdf5/1.10.7-intel-2021.4.0-n7frjgz parallel-netcdf/1.12.2-intel-2021.4.0-bykumdv netcdf-c/4.7.4-intel-2021.4.0-vvk6sk5 netcdf-fortran/4.5.3-intel-2021.4.0-pii33is intel-oneapi-compilers/2021.4.0-gcc-9.1.0-x5kx6di
+```
+
+JET (modules changed; 11.04.2023):
+```sh
+module load intel-oneapi-compilers/2022.2.1-zkofgc5 hdf5/1.12.2-intel-2021.7.1-w5sw2dq netcdf-fortran/4.5.3-intel-2021.7.1-27ldrnt netcdf-c/4.7.4-intel-2021.7.1-lnfs5zz intel-oneapi-mpi/2021.7.1-intel-2021.7.1-pt3unoz
+```
+
+VSC4:
+```sh
+module load pkgconf/1.8.0-intel-2021.5.0-bkuyrr7 intel-oneapi-compilers/2022.1.0-gcc-8.5.0-kiyqwf7 intel-oneapi-mpi/2021.6.0-intel-2021.5.0-wpt4y32 zlib/1.2.12-intel-2021.5.0-pctnhmb hdf5/1.12.2-intel-2021.5.0-loke5pd netcdf-c/4.8.1-intel-2021.5.0-hmrqrz2 netcdf-fortran/4.6.0-intel-2021.5.0-pnaropy
+```
+
+Load modules with `module load LIST-OF-MODULE-NAMES`, unload them one by one with `module unload LIST-OF-MODULE-NAMES`, unload all of them at the same time with `module purge`, get information about a specific module with `module show MODULE_NAME`. Modules may depend on each other. If the system is set up properly, a request to load one module will automatically load any other prerequisite ones.
+
+After loading modules, it is also recommended to set the `NETCDF` environment variable to the root variable of the netcdf installation. On srvx1, jet and VSC4, use `module show` to see which directory is correct. For instance:
+
+```sh
+(skylake) [serafins@l46 TEAMx_real]$ module list
+Currently Loaded Modulefiles:
+1) pkgconf/1.8.0-intel-2021.5.0-bkuyrr7 4) zlib/1.2.12-intel-2021.5.0-pctnhmb 7) netcdf-fortran/4.6.0-intel-2021.5.0-pnaropy
+2) intel-oneapi-compilers/2022.1.0-gcc-8.5.0-kiyqwf7 5) hdf5/1.12.2-intel-2021.5.0-loke5pd
+3) intel-oneapi-mpi/2021.6.0-intel-2021.5.0-wpt4y32 6) netcdf-c/4.8.1-intel-2021.5.0-hmrqrz2
+(skylake) [serafins@l46 TEAMx_real]$ module show netcdf-fortran/4.6.0-intel-2021.5.0-pnaropy
+-------------------------------------------------------------------
+/opt/sw/spack-0.19.0/var/spack/environments/skylake/modules/linux-almalinux8-skylake/netcdf-fortran/4.6.0-intel-2021.5.0-pnaropy:
+
+module-whatis {NetCDF (network Common Data Form) is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. This is the Fortran distribution.}
+prepend-path PATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/bin
+prepend-path LIBRARY_PATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/lib
+prepend-path LD_LIBRARY_PATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/lib
+prepend-path CPATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/include
+prepend-path MANPATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/share/man
+prepend-path PKG_CONFIG_PATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/lib/pkgconfig
+prepend-path CMAKE_PREFIX_PATH /gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj/
+-------------------------------------------------------------------
+(skylake) [serafins@l46 TEAMx_real]$ export NETCDF=/gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj
+(skylake) [serafins@l46 TEAMx_real]$ env|grep NETCDF
+NETCDF=/gpfs/opt/sw/spack-0.19.0/opt/spack/linux-almalinux8-skylake/intel-2021.5.0/netcdf-fortran-4.6.0-pnaropyoft7hicu7bfsugqa2aqcsggxj
+```
+
+On VSC5 do not use `module`, but `spack`:
+```sh
+spack load intel-oneapi-compilers
+spack load netcdf-fortran@4.4.5%intel
+```
+
+To check the library paths of loaded modules:
+```sh
+(zen3) [serafins@l51 ~]$ spack find --loaded --paths
+==> In environment zen3
+...
+==> 8 loaded packages
+-- linux-almalinux8-zen2 / intel@2021.5.0 -----------------------
+hdf5@1.10.5 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/hdf5-1.10.5-tty2baooecmvy5vhfhyt5uc3bj46cwpl
+intel-oneapi-mpi@2021.4.0 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.4. 0-jjcwtufcblofydeg2s3vm7fjb3qsezpf
+netcdf-c@4.7.0 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-c-4.7.0-spzlhyrfnqcl53ji25zop2adp222ftq4
+netcdf-fortran@4.4.5 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4
+numactl@2.0.14 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/numactl-2.0.14-beunpggnwwluwk7svx6zkjohv2ueayei
+pkgconf@1.8.0 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/pkgconf-1.8.0-ig5i4nqzqldjasgmkowp5ttfevdb4bnr
+zlib@1.2.11 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/zlib-1.2.11-6lzwo7c5o3db2q7hcznhzr6k3klh7wok
+
+-- linux-almalinux8-zen3 / gcc@11.2.0 ---------------------------
+intel-oneapi-compilers@2022.0.2 /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/intel-oneapi-compilers-2022.0.2-yzi4tsud2tqh4s6ykg2ulr7pp7guyiej
+(zen3) [serafins@l51 ~]$ export NETCDF=/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4
+(zen3) [serafins@l51 ~]$ env|grep NETCDF
+NETCDF=/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4
+
+```
+
+Important note: **The environment must be consistent between compilation and runtime. If you compile WRF with a set of modules loaded, you must run it with the same set of modules**.
+
+#### Configure WRF for compilation
+
+This will test the system to check that all libraries can be properly linked. Type `./configure`, pick a generic dmpar INTEL (ifort/icc) configuration (usually 15), answer 1 when asked if you want to compile for nesting, then hit enter. "dmpar" means "distributed memory parallelization" and enables running WRF in parallel computing mode. For test compilations or for a toy setup, you might also choose a "serial" configuration.
+
+If all goes well, the configuration will end will a message like this:
+```
+*****************************************************************************
+This build of WRF will use NETCDF4 with HDF5 compression
+*****************************************************************************
+```
+
+But the configuration could also end with a message like this (it happens for instance on srvx1):
+```sh
+************************** W A R N I N G ************************************
+NETCDF4 IO features are requested, but this installation of NetCDF
+ /home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/netcdf-fortran-4.5.2-ktet7v73pc74qrx6yc3234zhfo573w23
+DOES NOT support these IO features.
+
+Please make sure NETCDF version is 4.1.3 or later and was built with
+ --enable-netcdf4
+
+OR set NETCDF_classic variable
+ bash/ksh : export NETCDF_classic=1
+ csh : setenv NETCDF_classic 1
+
+Then re-run this configure script
+
+!!! configure.wrf has been REMOVED !!!
+
+*****************************************************************************
+```
+This is actually a misleading error message. The problem has nothing to do with NETCDF4 not being available, but with the operating system not detecting correctly all the dependencies of the NETCDF libraries. Solving this problem requires manually editing the configuration files (see below).
+
+The configure script stores the model configuration to a file called `configure.wrf`. This is specific to the source code version, to the server where the source code is compiled, and to the software environment. If you a have a working `configure.wrf` file for a given source code/server/environment, back it up.
+
+To solve the NETCDF4 error on srvx1: first, run `configure` and interrupt the process (`Ctrl+C`) before it raises the NetCDF warning; so, `configure.wrf` will not be deleted. Then, make the following changes to the automatically-generated `configure.wrf`:
+```sh
+(base) [serafin@srvx1 WRF]$ diff configure.wrf configure.wrf.dmpar
+98c98
+< DEP_LIB_PATH = -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/netcdf-c-4.6.3-5netrylc3im76bqg4vlo2ck4qd3jmrdt/lib
+---
+> DEP_LIB_PATH = -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/netcdf-c-4.6.3-5netrylc3im76bqg4vlo2ck4qd3jmrdt/lib -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/hdf5-1.10.7-nj3ahzinbfiwe5tnteupbfmx4empgh6l/lib
+122c122
+< -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/netcdf-fortran-4.5.2-ktet7v73pc74qrx6yc3234zhfo573w23/lib -lnetcdff
+---
+> -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-20.0.4/netcdf-fortran-4.5.2-ktet7v73pc74qrx6yc3234zhfo573w23/lib -lhdf5 -lnetcdff -lnetcdf
+```
+The first file, `configure.wrf`, is the result of the (wrong) automatic configuration. The second file, `configure.wrf.dmpar` is the manually fixed one. In the latter, additional library link directives (`-lnetcdf` and `-lhdf5`) are added to the variable `LIB_EXTERNAL`, and the full paths to these extra libraries are added to the variable `DEP_LIB_PATH`.
+
+#### Compile WRF
+
+You always compile WRF for a specific model configuration. The ones we use most commonly are `em_les` (for large-eddy simulation), `em_quarter_ss` (for idealized mesoscale simulations), `em_real` (for real-case forecasts). So type either of the following, depending on what you want to get:
+
+```sh
+./compile em_les > compile.log 2>&1 &
+./compile em_quarter_ss > compile.log 2>&1 &
+./compile em_real > compile.log 2>&1 &
+```
+
+The `> compile.log` tells the operating system to redirect the output stream from the terminal to a file called `compile.log`. The `2>&1` tells the operating system to merge the standard and error output streams, so `compile.log` will contain both regular output and error messages. The final `&` tells the operating system to run the job in the background, and returns to the terminal prompt.
+
+The compiled code will be created in the `run` directory, and some of the compiled programs will be linked in either of the `test/em_les`, `test/em_quarter_ss` or `test/em_real` directories. Executable WRF files typically have names ending with `.exe` (this is just conventional; it is actually not necessary for them to run).
+
+Compilation may take half an hour or so. A successful compilation ends with:
+
+```sh
+==========================================================================
+build started: mer 19 ott 2022, 16.17.36, CEST
+build completed: mer 19 ott 2022, 16.51.46, CEST
+
+---> Executables successfully built <---
+
+-rwxr-xr-x 1 serafin users 51042008 19 ott 16.51 main/ideal.exe
+-rwxr-xr-x 1 serafin users 57078208 19 ott 16.51 main/wrf.exe
+
+==========================================================================
+```
+
+If instead you get this:
+```sh
+==========================================================================
+build started: Thu Feb 2 16:30:55 CET 2023
+build completed: Thu Feb 2 17:07:04 CET 2023
+
+---> Problems building executables, look for errors in the build log <---
+
+==========================================================================
+```
+then you have a problem, and there is no unique solution. Take a closer look at `compile.log` and you might be able to diagnose it.
+
+### Copying compiled WRF code
+
+### Running WRF in a software container
+
+### Running an idealized simulation
+
+### Running a real-case simulation
+
+### Output and restart files
+
+incl. how to modify output paths
+
+### Suggested workflow
+
+### Analysing model output
+
+Things to remember:
+
+* staggered grid (Arakawa-C)
+* mass-based vertical coordinate (level height AGL is time-dependent)
+* terrain-following coordinate system (curvilinear)
+* in the model output, some variables are split into base state + perturbation
+
+[Python interface to WRF](https://wrf-python.readthedocs.io/en/latest/)
+
+Example of a very basic Python class to create an object from a WRF run, initialized with only some basic information:
+
+```py
+class wrfrun:
+ def __init__(self, filename):
+ self.filename = filename
+ self.nc = netCDF4.Dataset(filename)
+ self.dx = self.nc.DX
+ self.dy = self.nc.DY
+ self.nx = self.nc.dimensions['west_east'].size
+ self.ny = self.nc.dimensions['south_north'].size
+ self.x = np.arange(0,self.nx*self.dx,self.dx)
+ self.y = np.arange(0,self.ny*self.dy,self.dy)
+ self.valid_times = self.nc['XTIME'][:]*60
+ self.current_time = 0
+
+ def set_time(self,step):
+ self.current_time = step
+
+ def add_wind(self):
+ udum = self.nc['U'][self.current_time,:,:,:]
+ vdum = self.nc['V'][self.current_time,:,:,:]
+ wdum = self.nc['W'][self.current_time,:,:,:]
+ self.u = 0.5*(udum[:,:,:-1]+udum[:,:,1:])
+ self.v = 0.5*(vdum[:,:-1,:]+vdum[:,1:,:])
+ self.w = 0.5*(wdum[:-1,:,:]+wdum[1:,:,:])
+ del udum,vdum,wdum
+```
+The last function adds 3D wind variables at a specific time, after destaggering.
+
+The `wrfrun` class is then used as follows:
+
+```py
+wrf = wrfrun("./wrfout_d01_0001-01-01_00:00:00")
+wrf.set_time(36)
+wrf.add_wind()
+```
+
+Variables are then accessible as `wrf.u`, `wrf.v` etc.
+
+### Important namelist settings
+
+
diff --git a/WRF/WRF_da.md b/WRF/WRF_da.md
new file mode 100644
index 0000000000000000000000000000000000000000..9979604c0ae440949e192a6142b7c88178557246
--- /dev/null
+++ b/WRF/WRF_da.md
@@ -0,0 +1,13 @@
+## Data assimilation (DA)
+
+### Observation nudging
+
+### Variational DA
+
+WRFDA
+
+### Ensemble DA
+
+We cover this separately. See DART-WRF.
+
+
diff --git a/WRF/WRF_workflows.md b/WRF/WRF_workflows.md
new file mode 100644
index 0000000000000000000000000000000000000000..b38ae87790429a00db6e79095c0dacb7598a5e8f
--- /dev/null
+++ b/WRF/WRF_workflows.md
@@ -0,0 +1,258 @@
+## Specific tasks
+
+### Before running the model
+
+#### Defining the vertical grid
+
+#### Customizing model orography
+
+#### Defining a new geographical database
+
+#### Using ECMWF data as IC/BC
+
+The long story made short is: you should link grib1 files and process them with `ungrib.exe` using `Vtable.ECMWF_sigma`.
+
+More in detail, since a few years ECMWF has been distributing a mixture of grib2 and grib1 files. Namely:
+
+* grib1 files for surface and soil model levels.
+* grib2 files for atmospheric model levels.
+
+The WPS has a predefined Vtable for grib1 files from ECMWF, so the easiest way to process ECMWF data is to:
+
+1. convert model-level grib2 files to grib1
+2. if necessary, for every time stamp, concatenate the model-level and surface grib1 files into a single file. This is only necessary if the grib1 and grib2 data were downloaded as separate sets of GRIB files.
+3. process the resulting files with ungrib after linking `ungrib/Variable_Tables/Vtable.ECMWF_sigma` as `Vtable`
+
+In detail:
+
+1. Conversion to grib1 (needs the grib_set utility from eccodes):
+
+ ```sh title="convert to grib1"
+ for i in det.CROSSINN.mlv.20190913.0000.f*.grib2;
+ do
+ j=`basename $i .grib2`;
+ grib_set -s deletePV=1,edition=1 ${i} ${j};
+ done
+ ```
+
+2. Concatenation of grib files (two sets of files, `*mlv*` and `*sfc*`, with names ending with "grib1" yield a new set of files with names ending with "grib"; everything is grib1):
+
+ ```sh title="concatenate grib files"
+ for i in det.CROSSINN.mlv.20190913.0000.f*.grib1;
+ do
+ j=`echo $i|sed 's/.mlv./.sfc./'`;
+ k=`echo $i|sed 's/.mlv././'|sed 's/.grib1/.grib/'`;
+ cat $i $j > $k;
+ done
+ ```
+
+3. In the WPS main directory:
+
+ ```sh title="link grib files and convert"
+ link_grib.csh /data/GRIB_IC_for_LAM/ECMWF/20190913_CROSSINN_IOP8/det.CROSSINN.20190913.0000.f*.grib
+ ln -s ungrib/Variable_Tables/Vtable.ECMWF_sigma Vtable
+ ./ungrib.exe
+ ```
+
+An alternative procedure would be to convert everything to grib2 instead of grib1. Then, one has to use a Vtable with grib2 information for the surface fields, for instance the one included here at the bottom. But: Data from the bottom soil level will not be read correctly with this Vtable, because the Level2 value for the bottom level is actually MISSING in grib2 files (at the moment of writing, 6 May 2022; this may be fixed in the future).
+
+
+ GRIB1| Level| From | To | metgrid | metgrid | metgrid |GRIB2|GRIB2|GRIB2|GRIB2|
+ Param| Type |Level1|Level2| Name | Units | Description |Discp|Catgy|Param|Level|
+ -----+------+------+------+----------+----------+------------------------------------------+-----------------------+
+ 130 | 109 | * | | TT | K | Temperature | 0 | 0 | 0 | 105 |
+ 131 | 109 | * | | UU | m s-1 | U | 0 | 2 | 2 | 105 |
+ 132 | 109 | * | | VV | m s-1 | V | 0 | 2 | 3 | 105 |
+ 133 | 109 | * | | SPECHUMD | kg kg-1 | Specific humidity | 0 | 1 | 0 | 105 |
+ 152 | 109 | * | | LOGSFP | Pa | Log surface pressure | 0 | 3 | 25 | 105 |
+ 129 | 109 | * | | SOILGEO | m | Surface geopotential | 0 | 3 | 4 | 1 |
+ | 109 | * | | SOILHGT | m | Terrain field of source analysis | 0 | 3 | 5 | 1 |
+ 134 | 109 | 1 | | PSFCH | Pa | | 0 | 3 | 0 | 1 |
+ 157 | 109 | * | | RH | % | Relative Humidity | 0 | 1 | 1 | 105 |
+ 165 | 1 | 0 | | UU | m s-1 | U | 0 | 2 | 2 | 103 |
+ 166 | 1 | 0 | | VV | m s-1 | V | 0 | 2 | 3 | 103 |
+ 167 | 1 | 0 | | TT | K | Temperature | 0 | 0 | 0 | 103 |
+ 168 | 1 | 0 | | DEWPT | K | | 0 | 0 | 6 | 103 |
+ 172 | 1 | 0 | | LANDSEA | 0/1 Flag | Land/Sea flag | 2 | 0 | 0 | 1 |
+ 151 | 1 | 0 | | PMSL | Pa | Sea-level Pressure | 0 | 3 | 0 | 101 |
+ 235 | 1 | 0 | | SKINTEMP | K | Sea-Surface Temperature | 0 | 0 | 17 | 1 |
+ 34 | 1 | 0 | | SST | K | Sea-Surface Temperature | 10 | 3 | 0 | 1 |
+ 139 | 112 | 0| 700| ST000007 | K | T of 0-7 cm ground layer | 192 | 128 | 139 | 106 |
+ 170 | 112 | 700| 2800| ST007028 | K | T of 7-28 cm ground layer | 192 | 128 | 170 | 106 |
+ 183 | 112 | 2800| 10000| ST028100 | K | T of 28-100 cm ground layer | 192 | 128 | 183 | 106 |
+ 236 | 112 | 10000| 0| ST100289 | K | T of 100-289 cm ground layer | 192 | 128 | 236 | 106 |
+ 39 | 112 | 0| 700| SM000007 | fraction | Soil moisture of 0-7 cm ground layer | 192 | 128 | 39 | 106 |
+ 40 | 112 | 700| 2800| SM007028 | fraction | Soil moisture of 7-28 cm ground layer | 192 | 128 | 40 | 106 |
+ 41 | 112 | 2800| 10000| SM028100 | fraction | Soil moisture of 28-100 cm ground layer | 192 | 128 | 41 | 106 |
+ 42 | 112 | 10000| 0| SM100289 | fraction | Soil moisture of 100-289 cm ground layer | 192 | 128 | 42 | 106 |
+ -----+------+------+------+----------+----------+------------------------------------------+-----------------------+
+
+
+#### Spinning up soil fields
+
+### After running the model
+
+#### Converting model output to CF-compliant NetCDF
+
+1. To convert WRF output to CF-compliant NetCDF, use `wrfout_to_cf.ncl` (from <https://sundowner.colorado.edu/wrfout_to_cf/overview.html>):
+
+ ```
+ ncl 'file_in="wrfinput_d01"' 'file_out="wrfpost.nc"' wrfout_to_cf.ncl
+ ```
+
+#### Interpolating model output to a new grid
+
+1. First convert to CF-compliant NetCDF (see above)
+
+1. Then use cdo to interpolate the CF-compliant WRF output:
+
+ ```
+ cdo -remapnn,gridfile.lonlat.txt wrfpost.nc wrfpost_interpolated.nc
+ ```
+
+1. In the code snippet above, `-remapnn` specifies the interpolation engine, in this case nearest-neighbour. See alternatives here: <https://code.mpimet.mpg.de/projects/cdo/wiki/Tutorial#Horizontal-fields>
+
+1. File gridfile.lonlat.txt contans the grid specifications, e.g.:
+
+ gridtype = lonlat
+ gridsize = 721801
+ xsize = 1201
+ ysize = 601
+ xname = lon
+ xlongname = "longitude"
+ xunits = "degrees_east"
+ yname = lat
+ ylongname = "latitude"
+ yunits = "degrees_north"
+ xfirst = 5.00
+ xinc = 0.01
+ yfirst = 43.00
+ yinc = 0.01
+
+#### Subsetting model output
+
+#### Further compression of model output (data packing)
+
+#### 3D visualization
+
+For 3D visualization of WRF output, it is recommended to use either [Paraview](https://www.paraview.org/) or [Mayavi](https://docs.enthought.com/mayavi/mayavi/).
+
+* Both softwares are based on the Visualization Toolkit ([VTK](https://vtk.org/)) libraries, so visualizations are rather similar in the end.
+
+* Both sotwares can be used interactively from a graphical user interface or in batch mode (i.e., writing the visualization directives in a Python script).
+
+* While Paraview requires converting model data into one of a few supported formats, Mayavi supports direct rendering of Numpy objects, so it is easier to integrate it into Python code.
+
+* It is recommended to run 3D visualization software on GPUs. Running on a CPU (e.g., own laptop) is possible, but will be extremely slow. CPU is not the only bottleneck, because visualization software uses a lot of computer memory. Rendering 3D fields, in particular, is out of reach for normal laptops with 8GB or 16GB of RAM. Paraview is available on VSC5 and should be available soon on srvx8. Currently, Mayavi must be installed by individual users as a Python package.
+
+**Notes for readers/contributors: (1) Mayavi is untested yet. (2) It would be useful to add example batch scripts for both Paraview and Mayavi.**
+
+##### Paraview workflow
+
+1. Pre-requisite: [download](https://www.paraview.org/download/) and install the Paraview application on your computer.
+
+1. Log in to VSC5 in a terminal window.
+
+1. On VSC5, convert the WRF output in a format that Paraview can ingest. One option is to use [siso](https://github.com/TheBB/SISO).
+
+ ```sh
+ siso -f vts ~/serafins/TEAMx_LES/output/100m/wrfout_d01_0001-01-01_00\:00\:00 > siso.out 2>&1 &
+ siso -f vts --planar ~/serafins/TEAMx_LES/output/100m/wrfout_d01_0001-01-01_00\:00\:00 > siso_sfc.out 2>&1 &
+ ```
+ The first and second statements handle respectively 3D and 2D WRF output. They process the native output from WRF in netcdf format and return collections of files in VTS format (the VTK format for structured grids). There will be two independent datasets (for 3D and 2D output).
+
+1. In the VSC5 terminal, request access to a GPU node. One of the private IMGW nodes has a GPU, and can be accessed with specific account/partition/quality of service directives.
+ ```sh
+ (zen3) [sserafin4@l50 ~]$ salloc -N 1 --gres=gpu:2 --account=p71386 -p zen3_0512_a100x2 -q p71386_a100dual
+ salloc: Pending job allocation 233600
+ salloc: job 233600 queued and waiting for resources
+ salloc: job 233600 has been allocated resources
+ salloc: Granted job allocation 233600
+ salloc: Waiting for resource configuration
+ salloc: Nodes n3072-006 are ready for job
+ ```
+1. Once the GPU node becomes available, open up a new terminal session on your local machine, and set up an ssh tunnel to the GPU node through the login node.
+ ```sh
+ (mypy39) stefano@stefano-XPS-13-9370:~$ ssh -L 11111:n3072-006:11112 sserafin4@vsc5.vsc.ac.at
+ ```
+ This will redirect TCP/IP traffic from port 11111 of your local machine to port 11112 of the VSC5 GPU node, through the VSC5 login node. Port numbers are arbitary, but the remote port (11112) needs to match the Paraview server settings (see below).
+
+1. In the VSC5 terminal, log in to the GPU node:
+ ```sh
+ (zen3) [sserafin4@l50 ~]$ ssh n3072-006
+ Warning: Permanently added 'n3072-006,10.191.72.6' (ECDSA) to the list of known hosts.
+ sserafin4@n3072-006's password:
+
+ (zen3) [sserafin4@n3072-006 ~]$
+ ```
+
+1. In the VSC5 terminal on the GPU node, load the Paraview module and start the Paraview server:
+ ```sh
+ (zen3) [sserafin4@n3072-006 ~]$ module load paraview
+ (zen3) [sserafin4@n3072-006 ~]$ pvserver --force-offscreen-rendering --server-port=11112
+ Waiting for client...
+ Connection URL: cs://n3072-006:11112
+ Accepting connection(s): n3072-006:11112
+ ```
+
+1. On your local machine, open the Paraview client (graphical user interface, GUI). Then select File > Connect and enter the url of the Paraview server (`localhost:11111`). Select the datasets you want to display and work on them in the GUI. Save the Paraview state to avoid repeating work at the next session. Paraview has extensive [documentation](https://docs.paraview.org/en/latest/UsersGuide/index.html), tutorials ([one](https://docs.paraview.org/en/latest/Tutorials/SelfDirectedTutorial/index.html), [two](https://public.kitware.com/Wiki/The_ParaView_Tutorial) and [three](https://public.kitware.com/Wiki/images/b/bc/ParaViewTutorial56.pdf)) and a [wiki](https://public.kitware.com/Wiki/ParaView).
+
+##### Mayavi workflow
+
+Not tested yet.
+
+##### Creating a video
+
+Whether done with Paraview or with Mayavi, the visualization will result in a collection of png files, e.g., `InnValley.%04d.png`. There are several tools to convert invidual frames into movies. Among them, `ffmpeg` and `apngasm`. At the moment neither of them is available on IMGW servers (precompiled binaries are available through `apt-get` for Ubuntu).
+
+The basic method to create an `mp4` movie is:
+```sh
+ffmpeg -i InnValley.%04d.png -c:v libx264 -r 12 -pix_fmt yuv420p InnValley.mp4
+```
+
+The method above might return an error if frames have an odd number of pixels in one dimension:
+```sh
+[libx264 @ 0x5651e5f02980] height not divisible by 2 (1066x1083)
+```
+
+The fix is as follows:
+```sh
+ffmpeg -i InnValley.%04d.png -c:v libx264 -vf "pad=ceil(iw/2)*2:ceil(ih/2)*2" -r 12 -pix_fmt yuv420p InnValley.mp4
+```
+
+It is possible to add movie repetitions (similar to a loop). In this case, 3 additional loops are appended after the first one:
+```sh
+ffmpeg -stream_loop 3 -framerate 12 -i InnValley.%04d.png -c:v libx264 -vf "pad=ceil(iw/2)*2:ceil(ih/2)*2" -pix_fmt yuv420p InnValley.mp4
+```
+
+It also possible to generate movies in other formats, better suited for the web:
+
+* webp (most efficient compression for loops):
+ ```sh
+ ffmpeg -framerate 12 -i InnValley.%04d.png InnValley.webp
+ ```
+
+* animated png (bigger in size):
+ ```sh
+ apngasm InnValley.png InnValley.0*png
+ ```
+
+* gif (much bigger in size):
+ ```sh
+ ffmpeg -framerate 12 -i InnValley.%04d.png InnValley.gif
+ ```
+
+* For the example dataset, the collection of raw png files takes 59 MB while the video file sizes range between 4.5 and 70 MB:
+ ```sh
+ (mypy39) stefano@stefano-XPS-13-9370:~/Desktop/Paraview_animation/anim$ du -hcs InnValley.0*png
+ 59M total
+
+ (mypy39) stefano@stefano-XPS-13-9370:~/Desktop/Paraview_animation/anim$ du -hcs InnValley.[pgmw]*
+ 70M InnValley.gif
+ 14M InnValley.mp4
+ 51M InnValley.png
+ 4,5M InnValley.webp
+ ```
+
+## Useful tools
+
diff --git a/WRF/config_files/configure.wrf.v4.4.2.srvx1.dmpar b/WRF/config_files/configure.wrf.v4.4.2.srvx1.dmpar
new file mode 100644
index 0000000000000000000000000000000000000000..e35beefd3d36c6b0993bd8a0b04114dee76cd6a3
--- /dev/null
+++ b/WRF/config_files/configure.wrf.v4.4.2.srvx1.dmpar
@@ -0,0 +1,590 @@
+# configure.wrf
+#
+# Original configure options used:
+# ./configure
+# Compiler choice: 15
+# Nesting option: 1
+#
+# This file was automatically generated by the configure script in the
+# top level directory. You may make changes to the settings in this
+# file but be aware they will be overwritten each time you run configure.
+# Ordinarily, it is necessary to run configure once, when the code is
+# first installed.
+#
+# To permanently change options, change the settings for your platform
+# in the file arch/configure.defaults then rerun configure.
+#
+SHELL = /bin/sh
+DEVTOP = `pwd`
+LIBINCLUDE = .
+.SUFFIXES: .F .i .o .f90 .c
+
+#### Get core settings from environment (set in compile script)
+#### Note to add a core, this has to be added to.
+
+COREDEFS = -DEM_CORE=$(WRF_EM_CORE) \
+ -DNMM_CORE=$(WRF_NMM_CORE) -DNMM_MAX_DIM=2600 \
+ -DDA_CORE=$(WRF_DA_CORE) \
+ -DWRFPLUS=$(WRF_PLUS_CORE)
+
+#### Single location for defining total number of domains. You need
+#### at least 1 + 2*(number of total nests). For example, 1 coarse
+#### grid + three fine grids = 1 + 2(3) = 7, so MAX_DOMAINS=7.
+
+MAX_DOMAINS = 21
+
+#### DM buffer length for the configuration flags.
+
+CONFIG_BUF_LEN = 65536
+
+#### Size of bitmasks (in 4byte integers) of stream masks for WRF I/O
+
+MAX_HISTORY = 25
+
+IWORDSIZE = 4
+DWORDSIZE = 8
+LWORDSIZE = 4
+
+##############################################################################
+#### The settings in this section are defaults that may be overridden by the
+#### architecture-specific settings in the next section.
+##############################################################################
+
+##############################################################################
+#### NOTE: Do not modify these default values here. To override these
+#### values, make changes after "Architecture specific settings".
+##############################################################################
+
+#### Native size (in bytes) of Fortran REAL data type on this architecture ####
+#### Note: to change real wordsize (for example, to promote REALs from
+#### 4-byte to 8-byte), modify the definition of RWORDSIZE in the
+#### section following "Architecture specific settings". Do not
+#### change NATIVE_RWORDSIZE as is it architecture-specific.
+NATIVE_RWORDSIZE = 4
+
+#### Default sed command and script for Fortran source files ####
+#SED_FTN = sed -f $(WRF_SRC_ROOT_DIR)/arch/standard.sed
+SED_FTN = $(WRF_SRC_ROOT_DIR)/tools/standard.exe
+
+# Hack to work around $(PWD) not changing during OSF1 build.
+# $(IO_GRIB_SHARE_DIR) is reset during the OSF1 build only.
+IO_GRIB_SHARE_DIR =
+
+#### ESMF switches ####
+#### These are set up by Config.pl ####
+# switch to use separately installed ESMF library for coupling: 1==true
+ESMF_COUPLING = 0
+# select dependences on module_utility.o
+ESMF_MOD_DEPENDENCE = $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90/module_utility.o
+# select -I options for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_INC = -I$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90
+# select -I options for separately installed ESMF library, if present
+ESMF_MOD_INC = $(ESMF_IO_INC)
+# select cpp token for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_DEFS =
+# select build target for external/io_esmf vs. external/esmf_time_f90
+ESMF_TARGET = esmf_time
+
+# ESMFINCLUDEGOESHERE
+
+
+#### NETCDF4 pieces
+
+NETCDF4_IO_OPTS = -DUSE_NETCDF4_FEATURES -DWRFIO_NCD_LARGE_FILE_SUPPORT
+GPFS =
+CURL =
+HDF5 =
+ZLIB =
+DEP_LIB_PATH =
+NETCDF4_DEP_LIB = $(DEP_LIB_PATH) $(HDF5) $(ZLIB) $(GPFS) $(CURL)
+
+# NETCDF4INCLUDEGOESHERE
+
+#### CTSM pieces
+
+# CTSMINCLUDEGOESHERE
+
+##############################################################################
+
+LIBWRFLIB = libwrflib.a
+
+ LIB_BUNDLED = \
+ $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5/libfftpack.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib1/libio_grib1.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib_share/libio_grib_share.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_int/libwrfio_int.a \
+ $(ESMF_IO_LIB) \
+ $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a \
+ $(WRF_SRC_ROOT_DIR)/frame/module_internal_header_util.o \
+ $(WRF_SRC_ROOT_DIR)/frame/pack_utils.o
+
+ LIB_EXTERNAL = \
+ -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736/lib -lnetcdff
+
+
+#### Architecture specific settings ####
+
+# Settings for Linux x86_64 ppc64le i486 i586 i686, ifort compiler with icc (dmpar)
+#
+# By default, some files are compiled without optimizations to speed up compilation. Removing
+# respective makefile rules in the end of this file will result in longer compilation time, and, possibly
+# Out Of Memory messages, but might produce binaries which are substantially faster.
+#
+# Please visit http://www.intel.com/support/performancetools/sb/cs-028607.htm
+# for latest info on how to build WRF with Intel compilers.
+#
+# If you got Out Of Memory message, there are several options:
+# 1. Check your memory limits (ulimit -a), possibly increasing swap partitions size.
+# 2. Remove any debugging flags (-g, -check, -traceback).
+# 3. Force the problematic file to be compiled with less optimizations (see examples at the
+# end of this file), try -no-ip compiler flag.
+#
+# This configuration is aimed at accuracy. To improve performance (at the expence of accuracy) you might
+# consider removing '-fp-model precise' flag from FCBASEOPTS. This enables non value-safe optimizations.
+# Another option is to add '-ftz' flag, which flushes denormal results to zero when the application is in
+# the gradual underflow mode. It may improve performance if the denormal values are not critical to the
+# behavior of your workload. To further improve performance, add suitable vectorization options for your
+# processor to FCOPTIM (see ifort manpage).
+#
+# If you have Intel MPI installed and wish to use instead, make the
+# following changes to settings below:
+# DM_FC = mpiifort
+# DM_CC = mpiicc
+# and source bin64/mpivars.sh file from your Intel MPI installation
+# before the build.
+#
+# Suggestions for timing improvements from Craig Mattocks
+#
+#CFLAGS_LOCAL = -w -O3 -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars
+#LDFLAGS_LOCAL = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+#FCBASEOPTS_NO_G = -w -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common $(FORMAT_FREE) $(BYTESWAPIO)
+
+DESCRIPTION = INTEL ($SFC/$SCC)
+DMPARALLEL = 1
+OMPCPP = # -D_OPENMP
+OMP = # -qopenmp -fpp -auto
+OMPCC = # -qopenmp -fpp -auto
+SFC = ifort
+SCC = icc
+CCOMP = icc
+DM_FC = mpif90 -f90=$(SFC)
+DM_CC = mpicc -cc=$(SCC)
+FC = time $(DM_FC)
+CC = $(DM_CC) -DFSEEKO64_OK
+LD = $(FC)
+RWORDSIZE = $(NATIVE_RWORDSIZE)
+PROMOTION = -real-size `expr 8 \* $(RWORDSIZE)` -i4
+ARCH_LOCAL = -DNONSTANDARD_SYSTEM_FUNC -DWRF_USE_CLM $(NETCDF4_IO_OPTS)
+CFLAGS_LOCAL = -w -O3 -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars # -DRSL0_ONLY
+LDFLAGS_LOCAL = -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+CPLUSPLUSLIB =
+ESMF_LDFLAG = $(CPLUSPLUSLIB)
+FCOPTIM = -O3
+FCREDUCEDOPT = $(FCOPTIM)
+FCNOOPT = -O0 -fno-inline -no-ip
+FCDEBUG = # -g $(FCNOOPT) -traceback # -fpe0 -check noarg_temp_created,bounds,format,output_conversion,pointers,uninit -ftrapuv -unroll0 -u
+FORMAT_FIXED = -FI
+FORMAT_FREE = -FR
+FCSUFFIX =
+BYTESWAPIO = -convert big_endian
+RECORDLENGTH = -assume byterecl
+FCBASEOPTS_NO_G = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -fno-common
+FCBASEOPTS = $(FCBASEOPTS_NO_G) $(FCDEBUG)
+MODULE_SRCH_FLAG =
+TRADFLAG = -traditional-cpp $(NETCDF4_IO_OPTS)
+CPP = /lib/cpp -P -nostdinc
+AR = ar
+ARFLAGS = ru
+M4 = m4
+RANLIB = ranlib
+RLFLAGS =
+CC_TOOLS = $(SCC)
+NETCDFPAR_BUILD = echo SKIPPING
+
+###########################################################
+######################
+# POSTAMBLE
+
+FGREP = fgrep -iq
+
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+ \
+ -DNETCDF \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ -DLANDREAD_STUB=1 \
+ \
+ \
+ -DUSE_ALLOCATABLES \
+ -Dwrfmodel \
+ -DGRIB1 \
+ -DINTIO \
+ -DKEEP_INT_AROUND \
+ -DLIMIT_ARGS \
+ -DBUILD_RRTMG_FAST=0 \
+ -DBUILD_RRTMK=0 \
+ -DBUILD_SBM_FAST=1 \
+ -DSHOW_ALL_VARS_USED=0 \
+ -DCONFIG_BUF_LEN=$(CONFIG_BUF_LEN) \
+ -DMAX_DOMAINS_F=$(MAX_DOMAINS) \
+ -DMAX_HISTORY=$(MAX_HISTORY) \
+ -DNMM_NEST=$(WRF_NMM_NEST)
+CFLAGS = $(CFLAGS_LOCAL) -DDM_PARALLEL \
+ -DLANDREAD_STUB=1 \
+ -DMAX_HISTORY=$(MAX_HISTORY) -DNMM_CORE=$(WRF_NMM_CORE)
+FCFLAGS = $(FCOPTIM) $(FCBASEOPTS)
+ESMF_LIB_FLAGS =
+# ESMF 5 -- these are defined in esmf.mk, included above
+ ESMF_IO_LIB = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+ESMF_IO_LIB_EXT = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+INCLUDE_MODULES = $(MODULE_SRCH_FLAG) \
+ $(ESMF_MOD_INC) $(ESMF_LIB_FLAGS) \
+ -I$(WRF_SRC_ROOT_DIR)/main \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_netcdf \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_int \
+ -I$(WRF_SRC_ROOT_DIR)/frame \
+ -I$(WRF_SRC_ROOT_DIR)/share \
+ -I$(WRF_SRC_ROOT_DIR)/phys \
+ -I$(WRF_SRC_ROOT_DIR)/wrftladj \
+ -I$(WRF_SRC_ROOT_DIR)/chem -I$(WRF_SRC_ROOT_DIR)/inc \
+ -I$(NETCDFPATH)/include \
+
+REGISTRY = Registry
+CC_TOOLS_CFLAGS = -DNMM_CORE=$(WRF_NMM_CORE)
+
+LIB = $(LIB_BUNDLED) $(LIB_EXTERNAL) $(LIB_LOCAL) $(LIB_WRF_HYDRO) $(NETCDF4_DEP_LIB)
+LDFLAGS = $(OMP) $(FCFLAGS) $(LDFLAGS_LOCAL)
+ENVCOMPDEFS =
+WRF_CHEM = 0
+CPPFLAGS = $(ARCHFLAGS) $(ENVCOMPDEFS) -I$(LIBINCLUDE) $(TRADFLAG)
+NETCDFPATH = /home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736
+HDF5PATH =
+WRFPLUSPATH =
+RTTOVPATH =
+PNETCDFPATH =
+
+bundled: io_only
+external: io_only $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a gen_comms_rsllite module_dm_rsllite $(ESMF_TARGET)
+io_only: esmf_time wrfio_nf \
+ wrf_ioapi_includes wrfio_grib_share wrfio_grib1 wrfio_int fftpack
+
+
+######################
+externals: io_only bundled external
+
+gen_comms_serial :
+ ( /bin/rm -f $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c )
+
+module_dm_serial :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; cat module_dm_stubs.F >> module_dm.F ; fi )
+
+gen_comms_rsllite :
+ ( if [ ! -e $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ] ; then \
+ /bin/cp $(WRF_SRC_ROOT_DIR)/tools/gen_comms_warning $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/gen_comms.c >> $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; fi )
+
+module_dm_rsllite :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/module_dm.F >> module_dm.F ; fi )
+
+wrfio_nf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdf ; \
+ make $(J) NETCDFPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ CC="$(SCC)" CFLAGS="$(CFLAGS)" \
+ FC="$(SFC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_nfpar :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdfpar ; \
+ make $(J) NETCDFPARPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_pnf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_pnetcdf ; \
+ make $(J) NETCDFPATH="$(PNETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_grib_share :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib_share ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib1 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib1 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib2 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib2 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" archive)
+
+wrfio_int :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_int ; \
+ make $(J) CC="$(CC)" CFLAGS_LOCAL="$(CFLAGS_LOCAL)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(OMP)" FGREP="$(FGREP)" \
+ TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ARCHFLAGS="$(ARCHFLAGS)" all )
+
+esmf_time :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 ; \
+ make $(J) FC="$(SFC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP) -I$(WRF_SRC_ROOT_DIR)/inc -I. $(ARCHFLAGS) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+fftpack :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5 ; \
+ make $(J) FC="$(SFC)" FFLAGS="$(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" AR="$(AR)" \
+ ARFLAGS="$(ARFLAGS)" CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" RM="$(RM)" )
+
+atm_ocn :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/atm_ocn ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" \
+ FC="$(DM_FC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" )
+
+$(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/RSL_LITE ; make $(J) CC="$(CC) $(CFLAGS)" \
+ FC="$(FC) $(FCFLAGS) $(OMP) $(PROMOTION) $(BYTESWAPIO)" \
+ CPP="$(CPP) -I. $(ARCHFLAGS) $(OMPCPP) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ;\
+ $(RANLIB) $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a )
+
+######################
+# Macros, these should be generic for all machines
+
+LN = ln -sf
+MAKE = make -i -r
+RM = rm -f
+
+
+# These sub-directory builds are identical across all architectures
+
+wrf_ioapi_includes :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/ioapi_share ; \
+ $(MAKE) NATIVE_RWORDSIZE="$(NATIVE_RWORDSIZE)" RWORDSIZE="$(RWORDSIZE)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_esmf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_esmf ; \
+ make FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(ESMF_MOD_INC)" \
+ RANLIB="$(RANLIB)" CPP="$(CPP) $(POUND_DEF) " AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+# There is probably no reason to modify these rules
+
+.F.i:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.G > $*.i
+ mv $*.i $(DEVTOP)/pick/$*.f90
+ cp $*.F $(DEVTOP)/pick
+
+.F.o:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.G > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ $(RM) $*.G $*.bb
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(FC) -o $@ -c $(FCFLAGS) $(OMP) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+
+.F.f90:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(SED_FTN) $*.G > $*.H
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.H > $@
+ $(RM) $*.G $*.H
+
+.f90.o:
+ $(RM) $@
+ $(FC) -o $@ -c $(FCFLAGS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+setfeenv.o : setfeenv.c
+ $(RM) $@
+ $(CCOMP) -o $@ -c $(CFLAGS) $(OMPCC) $*.c
+
+.c.o:
+ $(RM) $@
+ $(CC) -o $@ -c $(CFLAGS) $*.c
+
+# A little more adventurous. Allow full opt on
+# mediation_integrate.o \
+# shift_domain_em.o \
+# solve_em.o <-- gets a little kick from SOLVE_EM_SPECIAL too, if defined
+# mediation_feedback_domain.o : mediation_feedback_domain.F
+# mediation_force_domain.o : mediation_force_domain.F
+# mediation_interp_domain.o : mediation_interp_domain.F
+
+# compile these without high optimization to speed compile
+track_driver.o : track_driver.F
+convert_nmm.o : convert_nmm.F
+init_modules_em.o : init_modules_em.F
+input_wrf.o : input_wrf.F
+module_io.o : module_io.F
+module_comm_dm.o : module_comm_dm.F
+module_comm_dm_0.o : module_comm_dm_0.F
+module_comm_dm_1.o : module_comm_dm_1.F
+module_comm_dm_2.o : module_comm_dm_2.F
+module_comm_dm_3.o : module_comm_dm_3.F
+module_comm_nesting_dm.o : module_comm_nesting_dm.F
+module_configure.o : module_configure.F
+module_domain.o : module_domain.F
+module_domain_type.o : module_domain_type.F
+module_alloc_space_0.o : module_alloc_space_0.F
+module_alloc_space_1.o : module_alloc_space_1.F
+module_alloc_space_2.o : module_alloc_space_2.F
+module_alloc_space_3.o : module_alloc_space_3.F
+module_alloc_space_4.o : module_alloc_space_4.F
+module_alloc_space_5.o : module_alloc_space_5.F
+module_alloc_space_6.o : module_alloc_space_6.F
+module_alloc_space_7.o : module_alloc_space_7.F
+module_alloc_space_8.o : module_alloc_space_8.F
+module_alloc_space_9.o : module_alloc_space_9.F
+module_tiles.o : module_tiles.F
+module_initialize.o : module_initialize.F
+module_physics_init.o : module_physics_init.F
+module_initialize_squall2d_x.o : module_initialize_squall2d_x.F
+module_initialize_squall2d_y.o : module_initialize_squall2d_y.F
+module_initialize_scm_xy.o : module_initialize_scm_xy.F
+module_integrate.o : module_integrate.F
+module_io_mm5.o : module_io_mm5.F
+module_io_wrf.o : module_io_wrf.F
+module_si_io.o : module_si_io.F
+module_wps_io_arw.o : module_wps_io_arw.F
+module_state_description.o : module_state_description.F
+output_wrf.o : output_wrf.F
+solve_interface.o : solve_interface.F
+start_domain.o : start_domain.F
+wrf_bdyin.o : wrf_bdyin.F
+wrf_bdyout.o : wrf_bdyout.F
+wrf_ext_read_field.o : wrf_ext_read_field.F
+wrf_ext_write_field.o : wrf_ext_write_field.F
+wrf_fddaobs_in.o : wrf_fddaobs_in.F
+wrf_histin.o : wrf_histin.F
+wrf_histout.o : wrf_histout.F
+wrf_inputin.o : wrf_inputin.F
+wrf_inputout.o : wrf_inputout.F
+wrf_restartin.o : wrf_restartin.F
+wrf_restartout.o : wrf_restartout.F
+wrf_tsin.o : wrf_tsin.F
+nl_get_0_routines.o : nl_get_0_routines.F
+nl_get_1_routines.o : nl_get_1_routines.F
+nl_set_0_routines.o : nl_set_0_routines.F
+nl_set_1_routines.o : nl_set_1_routines.F
+
+track_driver.o \
+convert_nmm.o \
+init_modules_em.o \
+module_initialize.o \
+module_initialize_squall2d_x.o \
+module_initialize_squall2d_y.o \
+module_initialize_scm_xy.o \
+module_integrate.o \
+module_io_mm5.o \
+module_io_wrf.o \
+module_si_io.o \
+module_wps_io_arw.o \
+module_tiles.o \
+output_wrf.o \
+solve_interface.o \
+start_domain.o \
+wrf_fddaobs_in.o \
+wrf_tsin.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+#solve_em.o :
+# $(RM) $@
+# $(SED_FTN) $*.F > $*.b
+# $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.b > $*.f90
+# $(RM) $*.b
+# $(FC) -o $@ -c $(FCFLAGS) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $(SOLVE_EM_SPECIAL) $(OMP) $*.f90
+
+module_sf_ruclsm.o : module_sf_ruclsm.F
+
+module_sf_ruclsm.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ echo COMPILING $*.F WITH OMP ; \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+# compile without OMP
+input_wrf.o \
+module_domain.o \
+module_domain_type.o \
+module_physics_init.o \
+module_io.o \
+wrf_bdyin.o \
+wrf_bdyout.o \
+wrf_ext_read_field.o \
+wrf_ext_write_field.o \
+wrf_histin.o \
+wrf_histout.o \
+wrf_inputin.o \
+wrf_inputout.o \
+wrf_restartin.o \
+wrf_restartout.o \
+module_state_description.o \
+module_alloc_space.o \
+module_alloc_space_0.o \
+module_alloc_space_1.o \
+module_alloc_space_2.o \
+module_alloc_space_3.o \
+module_alloc_space_4.o \
+module_alloc_space_5.o \
+module_alloc_space_6.o \
+module_alloc_space_7.o \
+module_alloc_space_8.o \
+module_alloc_space_9.o \
+module_comm_dm.o \
+module_comm_dm_0.o \
+module_comm_dm_1.o \
+module_comm_dm_2.o \
+module_comm_dm_3.o \
+module_comm_nesting_dm.o \
+module_configure.o :
+ $(RM) $@
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.F > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(RM) $*.b $*.bb
+ $(FC) -c $(PROMOTION) $(FCSUFFIX) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $*.f90
diff --git a/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial b/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial
new file mode 100644
index 0000000000000000000000000000000000000000..5f00e673f4b7cb1d9cfc95fd06cc7f1688f7eb35
--- /dev/null
+++ b/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial
@@ -0,0 +1,590 @@
+# configure.wrf
+#
+# Original configure options used:
+# ./configure
+# Compiler choice: 13
+# Nesting option: 1
+#
+# This file was automatically generated by the configure script in the
+# top level directory. You may make changes to the settings in this
+# file but be aware they will be overwritten each time you run configure.
+# Ordinarily, it is necessary to run configure once, when the code is
+# first installed.
+#
+# To permanently change options, change the settings for your platform
+# in the file arch/configure.defaults then rerun configure.
+#
+SHELL = /bin/sh
+DEVTOP = `pwd`
+LIBINCLUDE = .
+.SUFFIXES: .F .i .o .f90 .c
+
+#### Get core settings from environment (set in compile script)
+#### Note to add a core, this has to be added to.
+
+COREDEFS = -DEM_CORE=$(WRF_EM_CORE) \
+ -DNMM_CORE=$(WRF_NMM_CORE) -DNMM_MAX_DIM=2600 \
+ -DDA_CORE=$(WRF_DA_CORE) \
+ -DWRFPLUS=$(WRF_PLUS_CORE)
+
+#### Single location for defining total number of domains. You need
+#### at least 1 + 2*(number of total nests). For example, 1 coarse
+#### grid + three fine grids = 1 + 2(3) = 7, so MAX_DOMAINS=7.
+
+MAX_DOMAINS = 21
+
+#### DM buffer length for the configuration flags.
+
+CONFIG_BUF_LEN = 65536
+
+#### Size of bitmasks (in 4byte integers) of stream masks for WRF I/O
+
+MAX_HISTORY = 25
+
+IWORDSIZE = 4
+DWORDSIZE = 8
+LWORDSIZE = 4
+
+##############################################################################
+#### The settings in this section are defaults that may be overridden by the
+#### architecture-specific settings in the next section.
+##############################################################################
+
+##############################################################################
+#### NOTE: Do not modify these default values here. To override these
+#### values, make changes after "Architecture specific settings".
+##############################################################################
+
+#### Native size (in bytes) of Fortran REAL data type on this architecture ####
+#### Note: to change real wordsize (for example, to promote REALs from
+#### 4-byte to 8-byte), modify the definition of RWORDSIZE in the
+#### section following "Architecture specific settings". Do not
+#### change NATIVE_RWORDSIZE as is it architecture-specific.
+NATIVE_RWORDSIZE = 4
+
+#### Default sed command and script for Fortran source files ####
+#SED_FTN = sed -f $(WRF_SRC_ROOT_DIR)/arch/standard.sed
+SED_FTN = $(WRF_SRC_ROOT_DIR)/tools/standard.exe
+
+# Hack to work around $(PWD) not changing during OSF1 build.
+# $(IO_GRIB_SHARE_DIR) is reset during the OSF1 build only.
+IO_GRIB_SHARE_DIR =
+
+#### ESMF switches ####
+#### These are set up by Config.pl ####
+# switch to use separately installed ESMF library for coupling: 1==true
+ESMF_COUPLING = 0
+# select dependences on module_utility.o
+ESMF_MOD_DEPENDENCE = $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90/module_utility.o
+# select -I options for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_INC = -I$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90
+# select -I options for separately installed ESMF library, if present
+ESMF_MOD_INC = $(ESMF_IO_INC)
+# select cpp token for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_DEFS =
+# select build target for external/io_esmf vs. external/esmf_time_f90
+ESMF_TARGET = esmf_time
+
+# ESMFINCLUDEGOESHERE
+
+
+#### NETCDF4 pieces
+
+NETCDF4_IO_OPTS = -DUSE_NETCDF4_FEATURES -DWRFIO_NCD_LARGE_FILE_SUPPORT
+GPFS =
+CURL =
+HDF5 =
+ZLIB =
+DEP_LIB_PATH =
+NETCDF4_DEP_LIB = $(DEP_LIB_PATH) $(HDF5) $(ZLIB) $(GPFS) $(CURL)
+
+# NETCDF4INCLUDEGOESHERE
+
+#### CTSM pieces
+
+# CTSMINCLUDEGOESHERE
+
+##############################################################################
+
+LIBWRFLIB = libwrflib.a
+
+ LIB_BUNDLED = \
+ $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5/libfftpack.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib1/libio_grib1.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib_share/libio_grib_share.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_int/libwrfio_int.a \
+ $(ESMF_IO_LIB) \
+ $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a \
+ $(WRF_SRC_ROOT_DIR)/frame/module_internal_header_util.o \
+ $(WRF_SRC_ROOT_DIR)/frame/pack_utils.o
+
+ LIB_EXTERNAL = \
+ -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736/lib -lnetcdff
+
+
+#### Architecture specific settings ####
+
+# Settings for Linux x86_64 ppc64le i486 i586 i686, ifort compiler with icc (serial)
+#
+# By default, some files are compiled without optimizations to speed up compilation. Removing
+# respective makefile rules in the end of this file will result in longer compilation time, and, possibly
+# Out Of Memory messages, but might produce binaries which are substantially faster.
+#
+# Please visit http://www.intel.com/support/performancetools/sb/cs-028607.htm
+# for latest info on how to build WRF with Intel compilers.
+#
+# If you got Out Of Memory message, there are several options:
+# 1. Check your memory limits (ulimit -a), possibly increasing swap partitions size.
+# 2. Remove any debugging flags (-g, -check, -traceback).
+# 3. Force the problematic file to be compiled with less optimizations (see examples at the
+# end of this file), try -no-ip compiler flag.
+#
+# This configuration is aimed at accuracy. To improve performance (at the expence of accuracy) you might
+# consider removing '-fp-model precise' flag from FCBASEOPTS. This enables non value-safe optimizations.
+# Another option is to add '-ftz' flag, which flushes denormal results to zero when the application is in
+# the gradual underflow mode. It may improve performance if the denormal values are not critical to the
+# behavior of your workload. To further improve performance, add suitable vectorization options for your
+# processor to FCOPTIM (see ifort manpage).
+#
+# If you have Intel MPI installed and wish to use instead, make the
+# following changes to settings below:
+# DM_FC = mpiifort
+# DM_CC = mpiicc
+# and source bin64/mpivars.sh file from your Intel MPI installation
+# before the build.
+#
+# Suggestions for timing improvements from Craig Mattocks
+#
+#CFLAGS_LOCAL = -w -O3 -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars
+#LDFLAGS_LOCAL = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+#FCBASEOPTS_NO_G = -w -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common $(FORMAT_FREE) $(BYTESWAPIO)
+
+DESCRIPTION = INTEL ($SFC/$SCC)
+DMPARALLEL = # 1
+OMPCPP = # -D_OPENMP
+OMP = # -qopenmp -fpp -auto
+OMPCC = # -qopenmp -fpp -auto
+SFC = ifort
+SCC = icc
+CCOMP = icc
+DM_FC = mpif90 -f90=$(SFC)
+DM_CC = mpicc -cc=$(SCC)
+FC = time $(SFC)
+CC = $(SCC) -DFSEEKO64_OK
+LD = $(FC)
+RWORDSIZE = $(NATIVE_RWORDSIZE)
+PROMOTION = -real-size `expr 8 \* $(RWORDSIZE)` -i4
+ARCH_LOCAL = -DNONSTANDARD_SYSTEM_FUNC -DWRF_USE_CLM $(NETCDF4_IO_OPTS)
+CFLAGS_LOCAL = -w -O3 -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars # -DRSL0_ONLY
+LDFLAGS_LOCAL = -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+CPLUSPLUSLIB =
+ESMF_LDFLAG = $(CPLUSPLUSLIB)
+FCOPTIM = -O3
+FCREDUCEDOPT = $(FCOPTIM)
+FCNOOPT = -O0 -fno-inline -no-ip
+FCDEBUG = # -g $(FCNOOPT) -traceback # -fpe0 -check noarg_temp_created,bounds,format,output_conversion,pointers,uninit -ftrapuv -unroll0 -u
+FORMAT_FIXED = -FI
+FORMAT_FREE = -FR
+FCSUFFIX =
+BYTESWAPIO = -convert big_endian
+RECORDLENGTH = -assume byterecl
+FCBASEOPTS_NO_G = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -fno-common
+FCBASEOPTS = $(FCBASEOPTS_NO_G) $(FCDEBUG)
+MODULE_SRCH_FLAG =
+TRADFLAG = -traditional-cpp $(NETCDF4_IO_OPTS)
+CPP = /lib/cpp -P -nostdinc
+AR = ar
+ARFLAGS = ru
+M4 = m4
+RANLIB = ranlib
+RLFLAGS =
+CC_TOOLS = $(SCC)
+NETCDFPAR_BUILD = echo SKIPPING
+
+###########################################################
+######################
+# POSTAMBLE
+
+FGREP = fgrep -iq
+
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+ -DSTUBMPI \
+ -DNETCDF \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ -DLANDREAD_STUB=1 \
+ \
+ \
+ -DUSE_ALLOCATABLES \
+ -Dwrfmodel \
+ -DGRIB1 \
+ -DINTIO \
+ -DKEEP_INT_AROUND \
+ -DLIMIT_ARGS \
+ -DBUILD_RRTMG_FAST=0 \
+ -DBUILD_RRTMK=0 \
+ -DBUILD_SBM_FAST=1 \
+ -DSHOW_ALL_VARS_USED=0 \
+ -DCONFIG_BUF_LEN=$(CONFIG_BUF_LEN) \
+ -DMAX_DOMAINS_F=$(MAX_DOMAINS) \
+ -DMAX_HISTORY=$(MAX_HISTORY) \
+ -DNMM_NEST=$(WRF_NMM_NEST)
+CFLAGS = $(CFLAGS_LOCAL) -DDM_PARALLEL -DSTUBMPI \
+ -DLANDREAD_STUB=1 \
+ -DMAX_HISTORY=$(MAX_HISTORY) -DNMM_CORE=$(WRF_NMM_CORE)
+FCFLAGS = $(FCOPTIM) $(FCBASEOPTS)
+ESMF_LIB_FLAGS =
+# ESMF 5 -- these are defined in esmf.mk, included above
+ ESMF_IO_LIB = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+ESMF_IO_LIB_EXT = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+INCLUDE_MODULES = $(MODULE_SRCH_FLAG) \
+ $(ESMF_MOD_INC) $(ESMF_LIB_FLAGS) \
+ -I$(WRF_SRC_ROOT_DIR)/main \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_netcdf \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_int \
+ -I$(WRF_SRC_ROOT_DIR)/frame \
+ -I$(WRF_SRC_ROOT_DIR)/share \
+ -I$(WRF_SRC_ROOT_DIR)/phys \
+ -I$(WRF_SRC_ROOT_DIR)/wrftladj \
+ -I$(WRF_SRC_ROOT_DIR)/chem -I$(WRF_SRC_ROOT_DIR)/inc \
+ -I$(NETCDFPATH)/include \
+
+REGISTRY = Registry
+CC_TOOLS_CFLAGS = -DNMM_CORE=$(WRF_NMM_CORE)
+
+LIB = $(LIB_BUNDLED) $(LIB_EXTERNAL) $(LIB_LOCAL) $(LIB_WRF_HYDRO) $(NETCDF4_DEP_LIB)
+LDFLAGS = $(OMP) $(FCFLAGS) $(LDFLAGS_LOCAL)
+ENVCOMPDEFS =
+WRF_CHEM = 0
+CPPFLAGS = $(ARCHFLAGS) $(ENVCOMPDEFS) -I$(LIBINCLUDE) $(TRADFLAG)
+NETCDFPATH = /home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736
+HDF5PATH =
+WRFPLUSPATH =
+RTTOVPATH =
+PNETCDFPATH =
+
+bundled: io_only
+external: io_only $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a gen_comms_rsllite module_dm_rsllite $(ESMF_TARGET)
+io_only: esmf_time wrfio_nf \
+ wrf_ioapi_includes wrfio_grib_share wrfio_grib1 wrfio_int fftpack
+
+
+######################
+externals: io_only bundled external
+
+gen_comms_serial :
+ ( /bin/rm -f $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c )
+
+module_dm_serial :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; cat module_dm_stubs.F >> module_dm.F ; fi )
+
+gen_comms_rsllite :
+ ( if [ ! -e $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ] ; then \
+ /bin/cp $(WRF_SRC_ROOT_DIR)/tools/gen_comms_warning $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/gen_comms.c >> $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; fi )
+
+module_dm_rsllite :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/module_dm.F >> module_dm.F ; fi )
+
+wrfio_nf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdf ; \
+ make $(J) NETCDFPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ CC="$(SCC)" CFLAGS="$(CFLAGS)" \
+ FC="$(SFC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_nfpar :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdfpar ; \
+ make $(J) NETCDFPARPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_pnf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_pnetcdf ; \
+ make $(J) NETCDFPATH="$(PNETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_grib_share :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib_share ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib1 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib1 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib2 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib2 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" archive)
+
+wrfio_int :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_int ; \
+ make $(J) CC="$(CC)" CFLAGS_LOCAL="$(CFLAGS_LOCAL)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(OMP)" FGREP="$(FGREP)" \
+ TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ARCHFLAGS="$(ARCHFLAGS)" all )
+
+esmf_time :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 ; \
+ make $(J) FC="$(SFC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP) -I$(WRF_SRC_ROOT_DIR)/inc -I. $(ARCHFLAGS) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+fftpack :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5 ; \
+ make $(J) FC="$(SFC)" FFLAGS="$(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" AR="$(AR)" \
+ ARFLAGS="$(ARFLAGS)" CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" RM="$(RM)" )
+
+atm_ocn :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/atm_ocn ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" \
+ FC="$(DM_FC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" )
+
+$(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/RSL_LITE ; make $(J) CC="$(CC) $(CFLAGS)" \
+ FC="$(FC) $(FCFLAGS) $(OMP) $(PROMOTION) $(BYTESWAPIO)" \
+ CPP="$(CPP) -I. $(ARCHFLAGS) $(OMPCPP) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ;\
+ $(RANLIB) $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a )
+
+######################
+# Macros, these should be generic for all machines
+
+LN = ln -sf
+MAKE = make -i -r
+RM = rm -f
+
+
+# These sub-directory builds are identical across all architectures
+
+wrf_ioapi_includes :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/ioapi_share ; \
+ $(MAKE) NATIVE_RWORDSIZE="$(NATIVE_RWORDSIZE)" RWORDSIZE="$(RWORDSIZE)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_esmf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_esmf ; \
+ make FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(ESMF_MOD_INC)" \
+ RANLIB="$(RANLIB)" CPP="$(CPP) $(POUND_DEF) " AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+# There is probably no reason to modify these rules
+
+.F.i:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.G > $*.i
+ mv $*.i $(DEVTOP)/pick/$*.f90
+ cp $*.F $(DEVTOP)/pick
+
+.F.o:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.G > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ $(RM) $*.G $*.bb
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(FC) -o $@ -c $(FCFLAGS) $(OMP) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+
+.F.f90:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(SED_FTN) $*.G > $*.H
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.H > $@
+ $(RM) $*.G $*.H
+
+.f90.o:
+ $(RM) $@
+ $(FC) -o $@ -c $(FCFLAGS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+setfeenv.o : setfeenv.c
+ $(RM) $@
+ $(CCOMP) -o $@ -c $(CFLAGS) $(OMPCC) $*.c
+
+.c.o:
+ $(RM) $@
+ $(CC) -o $@ -c $(CFLAGS) $*.c
+
+# A little more adventurous. Allow full opt on
+# mediation_integrate.o \
+# shift_domain_em.o \
+# solve_em.o <-- gets a little kick from SOLVE_EM_SPECIAL too, if defined
+# mediation_feedback_domain.o : mediation_feedback_domain.F
+# mediation_force_domain.o : mediation_force_domain.F
+# mediation_interp_domain.o : mediation_interp_domain.F
+
+# compile these without high optimization to speed compile
+track_driver.o : track_driver.F
+convert_nmm.o : convert_nmm.F
+init_modules_em.o : init_modules_em.F
+input_wrf.o : input_wrf.F
+module_io.o : module_io.F
+module_comm_dm.o : module_comm_dm.F
+module_comm_dm_0.o : module_comm_dm_0.F
+module_comm_dm_1.o : module_comm_dm_1.F
+module_comm_dm_2.o : module_comm_dm_2.F
+module_comm_dm_3.o : module_comm_dm_3.F
+module_comm_nesting_dm.o : module_comm_nesting_dm.F
+module_configure.o : module_configure.F
+module_domain.o : module_domain.F
+module_domain_type.o : module_domain_type.F
+module_alloc_space_0.o : module_alloc_space_0.F
+module_alloc_space_1.o : module_alloc_space_1.F
+module_alloc_space_2.o : module_alloc_space_2.F
+module_alloc_space_3.o : module_alloc_space_3.F
+module_alloc_space_4.o : module_alloc_space_4.F
+module_alloc_space_5.o : module_alloc_space_5.F
+module_alloc_space_6.o : module_alloc_space_6.F
+module_alloc_space_7.o : module_alloc_space_7.F
+module_alloc_space_8.o : module_alloc_space_8.F
+module_alloc_space_9.o : module_alloc_space_9.F
+module_tiles.o : module_tiles.F
+module_initialize.o : module_initialize.F
+module_physics_init.o : module_physics_init.F
+module_initialize_squall2d_x.o : module_initialize_squall2d_x.F
+module_initialize_squall2d_y.o : module_initialize_squall2d_y.F
+module_initialize_scm_xy.o : module_initialize_scm_xy.F
+module_integrate.o : module_integrate.F
+module_io_mm5.o : module_io_mm5.F
+module_io_wrf.o : module_io_wrf.F
+module_si_io.o : module_si_io.F
+module_wps_io_arw.o : module_wps_io_arw.F
+module_state_description.o : module_state_description.F
+output_wrf.o : output_wrf.F
+solve_interface.o : solve_interface.F
+start_domain.o : start_domain.F
+wrf_bdyin.o : wrf_bdyin.F
+wrf_bdyout.o : wrf_bdyout.F
+wrf_ext_read_field.o : wrf_ext_read_field.F
+wrf_ext_write_field.o : wrf_ext_write_field.F
+wrf_fddaobs_in.o : wrf_fddaobs_in.F
+wrf_histin.o : wrf_histin.F
+wrf_histout.o : wrf_histout.F
+wrf_inputin.o : wrf_inputin.F
+wrf_inputout.o : wrf_inputout.F
+wrf_restartin.o : wrf_restartin.F
+wrf_restartout.o : wrf_restartout.F
+wrf_tsin.o : wrf_tsin.F
+nl_get_0_routines.o : nl_get_0_routines.F
+nl_get_1_routines.o : nl_get_1_routines.F
+nl_set_0_routines.o : nl_set_0_routines.F
+nl_set_1_routines.o : nl_set_1_routines.F
+
+track_driver.o \
+convert_nmm.o \
+init_modules_em.o \
+module_initialize.o \
+module_initialize_squall2d_x.o \
+module_initialize_squall2d_y.o \
+module_initialize_scm_xy.o \
+module_integrate.o \
+module_io_mm5.o \
+module_io_wrf.o \
+module_si_io.o \
+module_wps_io_arw.o \
+module_tiles.o \
+output_wrf.o \
+solve_interface.o \
+start_domain.o \
+wrf_fddaobs_in.o \
+wrf_tsin.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+#solve_em.o :
+# $(RM) $@
+# $(SED_FTN) $*.F > $*.b
+# $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.b > $*.f90
+# $(RM) $*.b
+# $(FC) -o $@ -c $(FCFLAGS) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $(SOLVE_EM_SPECIAL) $(OMP) $*.f90
+
+module_sf_ruclsm.o : module_sf_ruclsm.F
+
+module_sf_ruclsm.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ echo COMPILING $*.F WITH OMP ; \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+# compile without OMP
+input_wrf.o \
+module_domain.o \
+module_domain_type.o \
+module_physics_init.o \
+module_io.o \
+wrf_bdyin.o \
+wrf_bdyout.o \
+wrf_ext_read_field.o \
+wrf_ext_write_field.o \
+wrf_histin.o \
+wrf_histout.o \
+wrf_inputin.o \
+wrf_inputout.o \
+wrf_restartin.o \
+wrf_restartout.o \
+module_state_description.o \
+module_alloc_space.o \
+module_alloc_space_0.o \
+module_alloc_space_1.o \
+module_alloc_space_2.o \
+module_alloc_space_3.o \
+module_alloc_space_4.o \
+module_alloc_space_5.o \
+module_alloc_space_6.o \
+module_alloc_space_7.o \
+module_alloc_space_8.o \
+module_alloc_space_9.o \
+module_comm_dm.o \
+module_comm_dm_0.o \
+module_comm_dm_1.o \
+module_comm_dm_2.o \
+module_comm_dm_3.o \
+module_comm_nesting_dm.o \
+module_configure.o :
+ $(RM) $@
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.F > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(RM) $*.b $*.bb
+ $(FC) -c $(PROMOTION) $(FCSUFFIX) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $*.f90
diff --git a/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial.debug b/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial.debug
new file mode 100644
index 0000000000000000000000000000000000000000..b6538121a2e88771cfa04337493eaf1f3da74d41
--- /dev/null
+++ b/WRF/config_files/configure.wrf.v4.4.2.srvx1.serial.debug
@@ -0,0 +1,591 @@
+# configure.wrf
+#
+# Original configure options used:
+# ./configure
+# Compiler choice: 13
+# Nesting option: 1
+#
+# This file was automatically generated by the configure script in the
+# top level directory. You may make changes to the settings in this
+# file but be aware they will be overwritten each time you run configure.
+# Ordinarily, it is necessary to run configure once, when the code is
+# first installed.
+#
+# To permanently change options, change the settings for your platform
+# in the file arch/configure.defaults then rerun configure.
+#
+SHELL = /bin/sh
+DEVTOP = `pwd`
+LIBINCLUDE = .
+.SUFFIXES: .F .i .o .f90 .c
+
+#### Get core settings from environment (set in compile script)
+#### Note to add a core, this has to be added to.
+
+COREDEFS = -DEM_CORE=$(WRF_EM_CORE) \
+ -DNMM_CORE=$(WRF_NMM_CORE) -DNMM_MAX_DIM=2600 \
+ -DDA_CORE=$(WRF_DA_CORE) \
+ -DWRFPLUS=$(WRF_PLUS_CORE)
+
+#### Single location for defining total number of domains. You need
+#### at least 1 + 2*(number of total nests). For example, 1 coarse
+#### grid + three fine grids = 1 + 2(3) = 7, so MAX_DOMAINS=7.
+
+MAX_DOMAINS = 21
+
+#### DM buffer length for the configuration flags.
+
+CONFIG_BUF_LEN = 65536
+
+#### Size of bitmasks (in 4byte integers) of stream masks for WRF I/O
+
+MAX_HISTORY = 25
+
+IWORDSIZE = 4
+DWORDSIZE = 8
+LWORDSIZE = 4
+
+##############################################################################
+#### The settings in this section are defaults that may be overridden by the
+#### architecture-specific settings in the next section.
+##############################################################################
+
+##############################################################################
+#### NOTE: Do not modify these default values here. To override these
+#### values, make changes after "Architecture specific settings".
+##############################################################################
+
+#### Native size (in bytes) of Fortran REAL data type on this architecture ####
+#### Note: to change real wordsize (for example, to promote REALs from
+#### 4-byte to 8-byte), modify the definition of RWORDSIZE in the
+#### section following "Architecture specific settings". Do not
+#### change NATIVE_RWORDSIZE as is it architecture-specific.
+NATIVE_RWORDSIZE = 4
+
+#### Default sed command and script for Fortran source files ####
+#SED_FTN = sed -f $(WRF_SRC_ROOT_DIR)/arch/standard.sed
+SED_FTN = $(WRF_SRC_ROOT_DIR)/tools/standard.exe
+
+# Hack to work around $(PWD) not changing during OSF1 build.
+# $(IO_GRIB_SHARE_DIR) is reset during the OSF1 build only.
+IO_GRIB_SHARE_DIR =
+
+#### ESMF switches ####
+#### These are set up by Config.pl ####
+# switch to use separately installed ESMF library for coupling: 1==true
+ESMF_COUPLING = 0
+# select dependences on module_utility.o
+ESMF_MOD_DEPENDENCE = $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90/module_utility.o
+# select -I options for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_INC = -I$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90
+# select -I options for separately installed ESMF library, if present
+ESMF_MOD_INC = $(ESMF_IO_INC)
+# select cpp token for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_DEFS =
+# select build target for external/io_esmf vs. external/esmf_time_f90
+ESMF_TARGET = esmf_time
+
+# ESMFINCLUDEGOESHERE
+
+
+#### NETCDF4 pieces
+
+NETCDF4_IO_OPTS = -DUSE_NETCDF4_FEATURES -DWRFIO_NCD_LARGE_FILE_SUPPORT
+GPFS =
+CURL =
+HDF5 =
+ZLIB =
+DEP_LIB_PATH =
+NETCDF4_DEP_LIB = $(DEP_LIB_PATH) $(HDF5) $(ZLIB) $(GPFS) $(CURL)
+
+# NETCDF4INCLUDEGOESHERE
+
+#### CTSM pieces
+
+# CTSMINCLUDEGOESHERE
+
+##############################################################################
+
+LIBWRFLIB = libwrflib.a
+
+ LIB_BUNDLED = \
+ $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5/libfftpack.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib1/libio_grib1.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib_share/libio_grib_share.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_int/libwrfio_int.a \
+ $(ESMF_IO_LIB) \
+ $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a \
+ $(WRF_SRC_ROOT_DIR)/frame/module_internal_header_util.o \
+ $(WRF_SRC_ROOT_DIR)/frame/pack_utils.o
+
+ LIB_EXTERNAL = \
+ -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736/lib -lnetcdff
+
+
+#### Architecture specific settings ####
+
+# Settings for Linux x86_64 ppc64le i486 i586 i686, ifort compiler with icc (serial)
+#
+# By default, some files are compiled without optimizations to speed up compilation. Removing
+# respective makefile rules in the end of this file will result in longer compilation time, and, possibly
+# Out Of Memory messages, but might produce binaries which are substantially faster.
+#
+# Please visit http://www.intel.com/support/performancetools/sb/cs-028607.htm
+# for latest info on how to build WRF with Intel compilers.
+#
+# If you got Out Of Memory message, there are several options:
+# 1. Check your memory limits (ulimit -a), possibly increasing swap partitions size.
+# 2. Remove any debugging flags (-g, -check, -traceback).
+# 3. Force the problematic file to be compiled with less optimizations (see examples at the
+# end of this file), try -no-ip compiler flag.
+#
+# This configuration is aimed at accuracy. To improve performance (at the expence of accuracy) you might
+# consider removing '-fp-model precise' flag from FCBASEOPTS. This enables non value-safe optimizations.
+# Another option is to add '-ftz' flag, which flushes denormal results to zero when the application is in
+# the gradual underflow mode. It may improve performance if the denormal values are not critical to the
+# behavior of your workload. To further improve performance, add suitable vectorization options for your
+# processor to FCOPTIM (see ifort manpage).
+#
+# If you have Intel MPI installed and wish to use instead, make the
+# following changes to settings below:
+# DM_FC = mpiifort
+# DM_CC = mpiicc
+# and source bin64/mpivars.sh file from your Intel MPI installation
+# before the build.
+#
+# Suggestions for timing improvements from Craig Mattocks
+#
+#CFLAGS_LOCAL = -w -O3 -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars
+#LDFLAGS_LOCAL = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+#FCBASEOPTS_NO_G = -w -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common $(FORMAT_FREE) $(BYTESWAPIO)
+
+DESCRIPTION = INTEL ($SFC/$SCC)
+DMPARALLEL = # 1
+OMPCPP = # -D_OPENMP
+OMP = # -qopenmp -fpp -auto
+OMPCC = # -qopenmp -fpp -auto
+SFC = ifort
+SCC = icc
+CCOMP = icc
+DM_FC = mpif90 -f90=$(SFC)
+DM_CC = mpicc -cc=$(SCC)
+FC = time $(SFC)
+CC = $(SCC) -DFSEEKO64_OK
+LD = $(FC)
+RWORDSIZE = $(NATIVE_RWORDSIZE)
+PROMOTION = -real-size `expr 8 \* $(RWORDSIZE)` -i4
+ARCH_LOCAL = -DNONSTANDARD_SYSTEM_FUNC -DWRF_USE_CLM $(NETCDF4_IO_OPTS)
+CFLAGS_LOCAL = -w -O3 -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars # -DRSL0_ONLY
+LDFLAGS_LOCAL = -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+CPLUSPLUSLIB =
+ESMF_LDFLAG = $(CPLUSPLUSLIB)
+FCOPTIM = -O3
+FCREDUCEDOPT = $(FCOPTIM)
+FCNOOPT = -O0 -fno-inline -no-ip
+FCDEBUG = -g -traceback -no-ip # -g $(FCNOOPT) -traceback # -fpe0 -check noarg_temp_created,bounds,format,output_conversion,pointers,uninit -ftrapuv -unroll0 -u
+FORMAT_FIXED = -FI
+FORMAT_FREE = -FR
+FCSUFFIX =
+BYTESWAPIO = -convert big_endian
+RECORDLENGTH = -assume byterecl
+FCBASEOPTS_NO_G = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -fno-common
+FCBASEOPTS = $(FCBASEOPTS_NO_G) $(FCDEBUG)
+MODULE_SRCH_FLAG =
+TRADFLAG = -traditional-cpp $(NETCDF4_IO_OPTS)
+CPP = /lib/cpp -P -nostdinc
+AR = ar
+ARFLAGS = ru
+M4 = m4
+RANLIB = ranlib
+RLFLAGS =
+CC_TOOLS = $(SCC)
+NETCDFPAR_BUILD = echo SKIPPING
+
+###########################################################
+######################
+# POSTAMBLE
+
+FGREP = fgrep -iq
+
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+ -DSTUBMPI \
+ -DNETCDF \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ -DLANDREAD_STUB=1 \
+ \
+ \
+ -DUSE_ALLOCATABLES \
+ -Dwrfmodel \
+ -DGRIB1 \
+ -DINTIO \
+ -DKEEP_INT_AROUND \
+ -DLIMIT_ARGS \
+ -DBUILD_RRTMG_FAST=0 \
+ -DBUILD_RRTMK=0 \
+ -DBUILD_SBM_FAST=1 \
+ -DSHOW_ALL_VARS_USED=0 \
+ -DCONFIG_BUF_LEN=$(CONFIG_BUF_LEN) \
+ -DMAX_DOMAINS_F=$(MAX_DOMAINS) \
+ -DMAX_HISTORY=$(MAX_HISTORY) \
+ -DNMM_NEST=$(WRF_NMM_NEST)
+CFLAGS = $(CFLAGS_LOCAL) -DDM_PARALLEL -DSTUBMPI \
+ -DLANDREAD_STUB=1 \
+ -DMAX_HISTORY=$(MAX_HISTORY) -DNMM_CORE=$(WRF_NMM_CORE)
+FCFLAGS = $(FCOPTIM) $(FCBASEOPTS)
+ESMF_LIB_FLAGS =
+# ESMF 5 -- these are defined in esmf.mk, included above
+ ESMF_IO_LIB = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+ESMF_IO_LIB_EXT = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+INCLUDE_MODULES = $(MODULE_SRCH_FLAG) \
+ $(ESMF_MOD_INC) $(ESMF_LIB_FLAGS) \
+ -I$(WRF_SRC_ROOT_DIR)/main \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_netcdf \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_int \
+ -I$(WRF_SRC_ROOT_DIR)/frame \
+ -I$(WRF_SRC_ROOT_DIR)/share \
+ -I$(WRF_SRC_ROOT_DIR)/phys \
+ -I$(WRF_SRC_ROOT_DIR)/wrftladj \
+ -I$(WRF_SRC_ROOT_DIR)/chem -I$(WRF_SRC_ROOT_DIR)/inc \
+ -I$(NETCDFPATH)/include \
+
+REGISTRY = Registry
+CC_TOOLS_CFLAGS = -DNMM_CORE=$(WRF_NMM_CORE)
+
+LIB = $(LIB_BUNDLED) $(LIB_EXTERNAL) $(LIB_LOCAL) $(LIB_WRF_HYDRO) $(NETCDF4_DEP_LIB)
+LDFLAGS = $(OMP) $(FCFLAGS) $(LDFLAGS_LOCAL)
+ENVCOMPDEFS =
+WRF_CHEM = 0
+CPPFLAGS = $(ARCHFLAGS) $(ENVCOMPDEFS) -I$(LIBINCLUDE) $(TRADFLAG)
+NETCDFPATH = /home/swd/spack/opt/spack/linux-rhel8-skylake_avx512/intel-2021.4.0/netcdf-fortran-4.5.3-ofhximl2fny6t5o5ixq7kiq63i2jw736
+HDF5PATH =
+WRFPLUSPATH =
+RTTOVPATH =
+PNETCDFPATH =
+
+bundled: io_only
+external: io_only $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a gen_comms_rsllite module_dm_rsllite $(ESMF_TARGET)
+io_only: esmf_time wrfio_nf \
+ wrf_ioapi_includes wrfio_grib_share wrfio_grib1 wrfio_int fftpack
+
+
+######################
+externals: io_only bundled external
+
+gen_comms_serial :
+ ( /bin/rm -f $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c )
+
+module_dm_serial :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; cat module_dm_stubs.F >> module_dm.F ; fi )
+
+gen_comms_rsllite :
+ ( if [ ! -e $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ] ; then \
+ /bin/cp $(WRF_SRC_ROOT_DIR)/tools/gen_comms_warning $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/gen_comms.c >> $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; fi )
+
+module_dm_rsllite :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/module_dm.F >> module_dm.F ; fi )
+
+wrfio_nf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdf ; \
+ make $(J) NETCDFPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ CC="$(SCC)" CFLAGS="$(CFLAGS)" \
+ FC="$(SFC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_nfpar :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdfpar ; \
+ make $(J) NETCDFPARPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_pnf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_pnetcdf ; \
+ make $(J) NETCDFPATH="$(PNETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_grib_share :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib_share ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib1 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib1 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib2 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib2 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" archive)
+
+wrfio_int :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_int ; \
+ make $(J) CC="$(CC)" CFLAGS_LOCAL="$(CFLAGS_LOCAL)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(OMP)" FGREP="$(FGREP)" \
+ TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ARCHFLAGS="$(ARCHFLAGS)" all )
+
+esmf_time :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 ; \
+ make $(J) FC="$(SFC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP) -I$(WRF_SRC_ROOT_DIR)/inc -I. $(ARCHFLAGS) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+fftpack :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5 ; \
+ make $(J) FC="$(SFC)" FFLAGS="$(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" AR="$(AR)" \
+ ARFLAGS="$(ARFLAGS)" CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" RM="$(RM)" )
+
+atm_ocn :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/atm_ocn ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" \
+ FC="$(DM_FC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" )
+
+$(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/RSL_LITE ; make $(J) CC="$(CC) $(CFLAGS)" \
+ FC="$(FC) $(FCFLAGS) $(OMP) $(PROMOTION) $(BYTESWAPIO)" \
+ CPP="$(CPP) -I. $(ARCHFLAGS) $(OMPCPP) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ;\
+ $(RANLIB) $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a )
+
+######################
+# Macros, these should be generic for all machines
+
+LN = ln -sf
+MAKE = make -i -r
+RM = rm -f
+
+
+# These sub-directory builds are identical across all architectures
+
+wrf_ioapi_includes :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/ioapi_share ; \
+ $(MAKE) NATIVE_RWORDSIZE="$(NATIVE_RWORDSIZE)" RWORDSIZE="$(RWORDSIZE)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_esmf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_esmf ; \
+ make FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(ESMF_MOD_INC)" \
+ RANLIB="$(RANLIB)" CPP="$(CPP) $(POUND_DEF) " AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+# There is probably no reason to modify these rules
+
+.F.i:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.G > $*.i
+ mv $*.i $(DEVTOP)/pick/$*.f90
+ cp $*.F $(DEVTOP)/pick
+
+.F.o:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.G > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ $(RM) $*.G $*.bb
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(FC) -o $@ -c $(FCFLAGS) $(OMP) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+
+.F.f90:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(SED_FTN) $*.G > $*.H
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.H > $@
+ $(RM) $*.G $*.H
+
+.f90.o:
+ $(RM) $@
+ $(FC) -o $@ -c $(FCFLAGS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+setfeenv.o : setfeenv.c
+ $(RM) $@
+ $(CCOMP) -o $@ -c $(CFLAGS) $(OMPCC) $*.c
+
+.c.o:
+ $(RM) $@
+ $(CC) -o $@ -c $(CFLAGS) $*.c
+
+# A little more adventurous. Allow full opt on
+# mediation_integrate.o \
+# shift_domain_em.o \
+# solve_em.o <-- gets a little kick from SOLVE_EM_SPECIAL too, if defined
+# mediation_feedback_domain.o : mediation_feedback_domain.F
+# mediation_force_domain.o : mediation_force_domain.F
+# mediation_interp_domain.o : mediation_interp_domain.F
+
+# compile these without high optimization to speed compile
+track_driver.o : track_driver.F
+convert_nmm.o : convert_nmm.F
+init_modules_em.o : init_modules_em.F
+input_wrf.o : input_wrf.F
+module_io.o : module_io.F
+module_comm_dm.o : module_comm_dm.F
+module_comm_dm_0.o : module_comm_dm_0.F
+module_comm_dm_1.o : module_comm_dm_1.F
+module_comm_dm_2.o : module_comm_dm_2.F
+module_comm_dm_3.o : module_comm_dm_3.F
+module_comm_nesting_dm.o : module_comm_nesting_dm.F
+module_configure.o : module_configure.F
+module_domain.o : module_domain.F
+module_domain_type.o : module_domain_type.F
+module_alloc_space_0.o : module_alloc_space_0.F
+module_alloc_space_1.o : module_alloc_space_1.F
+module_alloc_space_2.o : module_alloc_space_2.F
+module_alloc_space_3.o : module_alloc_space_3.F
+module_alloc_space_4.o : module_alloc_space_4.F
+module_alloc_space_5.o : module_alloc_space_5.F
+module_alloc_space_6.o : module_alloc_space_6.F
+module_alloc_space_7.o : module_alloc_space_7.F
+module_alloc_space_8.o : module_alloc_space_8.F
+module_alloc_space_9.o : module_alloc_space_9.F
+module_tiles.o : module_tiles.F
+module_initialize.o : module_initialize.F
+module_physics_init.o : module_physics_init.F
+module_initialize_squall2d_x.o : module_initialize_squall2d_x.F
+module_initialize_squall2d_y.o : module_initialize_squall2d_y.F
+module_initialize_scm_xy.o : module_initialize_scm_xy.F
+module_integrate.o : module_integrate.F
+module_io_mm5.o : module_io_mm5.F
+module_io_wrf.o : module_io_wrf.F
+module_si_io.o : module_si_io.F
+module_wps_io_arw.o : module_wps_io_arw.F
+module_state_description.o : module_state_description.F
+output_wrf.o : output_wrf.F
+solve_interface.o : solve_interface.F
+start_domain.o : start_domain.F
+wrf_bdyin.o : wrf_bdyin.F
+wrf_bdyout.o : wrf_bdyout.F
+wrf_ext_read_field.o : wrf_ext_read_field.F
+wrf_ext_write_field.o : wrf_ext_write_field.F
+wrf_fddaobs_in.o : wrf_fddaobs_in.F
+wrf_histin.o : wrf_histin.F
+wrf_histout.o : wrf_histout.F
+wrf_inputin.o : wrf_inputin.F
+wrf_inputout.o : wrf_inputout.F
+wrf_restartin.o : wrf_restartin.F
+wrf_restartout.o : wrf_restartout.F
+wrf_tsin.o : wrf_tsin.F
+nl_get_0_routines.o : nl_get_0_routines.F
+nl_get_1_routines.o : nl_get_1_routines.F
+nl_set_0_routines.o : nl_set_0_routines.F
+nl_set_1_routines.o : nl_set_1_routines.F
+
+track_driver.o \
+convert_nmm.o \
+init_modules_em.o \
+module_initialize.o \
+module_initialize_squall2d_x.o \
+module_initialize_squall2d_y.o \
+module_initialize_scm_xy.o \
+module_integrate.o \
+module_io_mm5.o \
+module_io_wrf.o \
+module_si_io.o \
+module_wps_io_arw.o \
+module_tiles.o \
+output_wrf.o \
+solve_interface.o \
+start_domain.o \
+wrf_fddaobs_in.o \
+wrf_tsin.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+#solve_em.o :
+# $(RM) $@
+# $(SED_FTN) $*.F > $*.b
+# $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.b > $*.f90
+# $(RM) $*.b
+# $(FC) -o $@ -c $(FCFLAGS) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $(SOLVE_EM_SPECIAL) $(OMP) $*.f90
+
+module_sf_ruclsm.o : module_sf_ruclsm.F
+
+module_sf_ruclsm.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ echo COMPILING $*.F WITH OMP ; \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+# compile without OMP
+input_wrf.o \
+module_domain.o \
+module_domain_type.o \
+module_physics_init.o \
+module_io.o \
+wrf_bdyin.o \
+wrf_bdyout.o \
+wrf_ext_read_field.o \
+wrf_ext_write_field.o \
+wrf_histin.o \
+wrf_histout.o \
+wrf_inputin.o \
+wrf_inputout.o \
+wrf_restartin.o \
+wrf_restartout.o \
+module_state_description.o \
+module_alloc_space.o \
+module_alloc_space_0.o \
+module_alloc_space_1.o \
+module_alloc_space_2.o \
+module_alloc_space_3.o \
+module_alloc_space_4.o \
+module_alloc_space_5.o \
+module_alloc_space_6.o \
+module_alloc_space_7.o \
+module_alloc_space_8.o \
+module_alloc_space_9.o \
+module_comm_dm.o \
+module_comm_dm_0.o \
+module_comm_dm_1.o \
+module_comm_dm_2.o \
+module_comm_dm_3.o \
+module_comm_nesting_dm.o \
+module_configure.o :
+ $(RM) $@
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.F > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(RM) $*.b $*.bb
+ $(FC) -c $(PROMOTION) $(FCSUFFIX) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $*.f90
+
diff --git a/WRF/config_files/configure.wrf.v4.4.2.vsc5.gfortran b/WRF/config_files/configure.wrf.v4.4.2.vsc5.gfortran
new file mode 100644
index 0000000000000000000000000000000000000000..2c13b46e609ea1597443abb7d8055c81b01754e2
--- /dev/null
+++ b/WRF/config_files/configure.wrf.v4.4.2.vsc5.gfortran
@@ -0,0 +1,558 @@
+# configure.wrf
+#
+# Original configure options used:
+# ./configure
+# Compiler choice: 34
+# Nesting option: 1
+#
+# This file was automatically generated by the configure script in the
+# top level directory. You may make changes to the settings in this
+# file but be aware they will be overwritten each time you run configure.
+# Ordinarily, it is necessary to run configure once, when the code is
+# first installed.
+#
+# To permanently change options, change the settings for your platform
+# in the file arch/configure.defaults then rerun configure.
+#
+SHELL = /bin/sh
+DEVTOP = `pwd`
+LIBINCLUDE = .
+.SUFFIXES: .F .i .o .f90 .c
+
+#### Get core settings from environment (set in compile script)
+#### Note to add a core, this has to be added to.
+
+COREDEFS = -DEM_CORE=$(WRF_EM_CORE) \
+ -DNMM_CORE=$(WRF_NMM_CORE) -DNMM_MAX_DIM=2600 \
+ -DDA_CORE=$(WRF_DA_CORE) \
+ -DWRFPLUS=$(WRF_PLUS_CORE)
+
+#### Single location for defining total number of domains. You need
+#### at least 1 + 2*(number of total nests). For example, 1 coarse
+#### grid + three fine grids = 1 + 2(3) = 7, so MAX_DOMAINS=7.
+
+MAX_DOMAINS = 21
+
+#### DM buffer length for the configuration flags.
+
+CONFIG_BUF_LEN = 65536
+
+#### Size of bitmasks (in 4byte integers) of stream masks for WRF I/O
+
+MAX_HISTORY = 25
+
+IWORDSIZE = 4
+DWORDSIZE = 8
+LWORDSIZE = 4
+
+##############################################################################
+#### The settings in this section are defaults that may be overridden by the
+#### architecture-specific settings in the next section.
+##############################################################################
+
+##############################################################################
+#### NOTE: Do not modify these default values here. To override these
+#### values, make changes after "Architecture specific settings".
+##############################################################################
+
+#### Native size (in bytes) of Fortran REAL data type on this architecture ####
+#### Note: to change real wordsize (for example, to promote REALs from
+#### 4-byte to 8-byte), modify the definition of RWORDSIZE in the
+#### section following "Architecture specific settings". Do not
+#### change NATIVE_RWORDSIZE as is it architecture-specific.
+NATIVE_RWORDSIZE = 4
+
+#### Default sed command and script for Fortran source files ####
+#SED_FTN = sed -f $(WRF_SRC_ROOT_DIR)/arch/standard.sed
+SED_FTN = $(WRF_SRC_ROOT_DIR)/tools/standard.exe
+
+# Hack to work around $(PWD) not changing during OSF1 build.
+# $(IO_GRIB_SHARE_DIR) is reset during the OSF1 build only.
+IO_GRIB_SHARE_DIR =
+
+#### ESMF switches ####
+#### These are set up by Config.pl ####
+# switch to use separately installed ESMF library for coupling: 1==true
+ESMF_COUPLING = 0
+# select dependences on module_utility.o
+ESMF_MOD_DEPENDENCE = $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90/module_utility.o
+# select -I options for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_INC = -I$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90
+# select -I options for separately installed ESMF library, if present
+ESMF_MOD_INC = $(ESMF_IO_INC)
+# select cpp token for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_DEFS =
+# select build target for external/io_esmf vs. external/esmf_time_f90
+ESMF_TARGET = esmf_time
+
+# ESMFINCLUDEGOESHERE
+
+
+#### NETCDF4 pieces
+
+NETCDF4_IO_OPTS = -DUSE_NETCDF4_FEATURES -DWRFIO_NCD_LARGE_FILE_SUPPORT
+GPFS =
+CURL =
+HDF5 = -lhdf5_hl -lhdf5
+ZLIB = -lz
+DEP_LIB_PATH = -L/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/netcdf-c-4.8.1-jsfjwaz7qp52fjxfeg6mbhtt2lj3l573/lib
+NETCDF4_DEP_LIB = $(DEP_LIB_PATH) $(HDF5) $(ZLIB) $(GPFS) $(CURL)
+
+# NETCDF4INCLUDEGOESHERE
+
+#### CTSM pieces
+
+# CTSMINCLUDEGOESHERE
+
+##############################################################################
+
+LIBWRFLIB = libwrflib.a
+
+ LIB_BUNDLED = \
+ $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5/libfftpack.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib1/libio_grib1.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib_share/libio_grib_share.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_int/libwrfio_int.a \
+ $(ESMF_IO_LIB) \
+ $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a \
+ $(WRF_SRC_ROOT_DIR)/frame/module_internal_header_util.o \
+ $(WRF_SRC_ROOT_DIR)/frame/pack_utils.o
+
+ LIB_EXTERNAL = \
+ -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf \
+-L/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/netcdf-fortran-4.5.3-t6jqlxq6bnz62g4kwezpffg6fzj4d6qg/lib -lnetcdff \
+#-L/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/hdf5-1.12.1-isqgsrajurxw67angcyap64lqmgqurpc/lib -lhdf5_hl_fortran -lhdf5_hl -lhdf5_fortran -lhdf5 -lm -lz
+
+#### Architecture specific settings ####
+
+# Settings for Linux x86_64 ppc64le, gfortran compiler with gcc (dmpar)
+#
+DESCRIPTION = GNU ($SFC/$SCC)
+DMPARALLEL = 1
+OMPCPP = # -D_OPENMP
+OMP = # -fopenmp
+OMPCC = # -fopenmp
+SFC = gfortran
+SCC = gcc
+CCOMP = gcc
+DM_FC = mpif90 -std=legacy -fallow-invalid-boz
+DM_CC = mpicc -std=legacy
+FC = time $(DM_FC)
+CC = $(DM_CC) -DFSEEKO64_OK
+LD = $(FC)
+RWORDSIZE = $(NATIVE_RWORDSIZE)
+PROMOTION = #-fdefault-real-8
+ARCH_LOCAL = -DNONSTANDARD_SYSTEM_SUBR -DWRF_USE_CLM $(NETCDF4_IO_OPTS)
+CFLAGS_LOCAL = -w -O3 -c # -DRSL0_ONLY
+LDFLAGS_LOCAL =
+CPLUSPLUSLIB =
+ESMF_LDFLAG = $(CPLUSPLUSLIB)
+FCOPTIM = -O2 -ftree-vectorize -funroll-loops
+FCREDUCEDOPT = $(FCOPTIM)
+FCNOOPT = -O0
+FCDEBUG = # -g $(FCNOOPT) # -ggdb -fbacktrace -fcheck=bounds,do,mem,pointer -ffpe-trap=invalid,zero,overflow
+FORMAT_FIXED = -ffixed-form
+FORMAT_FREE = -ffree-form -ffree-line-length-none
+FCSUFFIX =
+FCCOMPAT =
+BYTESWAPIO = -fconvert=big-endian -frecord-marker=4
+FCBASEOPTS_NO_G = -w $(FORMAT_FREE) $(BYTESWAPIO) $(FCCOMPAT)
+FCBASEOPTS = $(FCBASEOPTS_NO_G) $(FCDEBUG)
+MODULE_SRCH_FLAG =
+TRADFLAG = -traditional-cpp $(NETCDF4_IO_OPTS)
+CPP = /lib/cpp -P -nostdinc
+AR = ar
+ARFLAGS = ru
+M4 = m4 -G
+RANLIB = ranlib
+RLFLAGS =
+CC_TOOLS = $(SCC)
+NETCDFPAR_BUILD = echo SKIPPING
+
+###########################################################
+######################
+# POSTAMBLE
+
+FGREP = fgrep -iq
+
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+ \
+ -DNETCDF \
+ \
+ \
+ \
+ \
+ \
+ \
+ -DHDF5 \
+ \
+ \
+ -DLANDREAD_STUB=1 \
+ \
+ \
+ -DUSE_ALLOCATABLES \
+ -Dwrfmodel \
+ -DGRIB1 \
+ -DINTIO \
+ -DKEEP_INT_AROUND \
+ -DLIMIT_ARGS \
+ -DBUILD_RRTMG_FAST=0 \
+ -DBUILD_RRTMK=0 \
+ -DBUILD_SBM_FAST=1 \
+ -DSHOW_ALL_VARS_USED=0 \
+ -DCONFIG_BUF_LEN=$(CONFIG_BUF_LEN) \
+ -DMAX_DOMAINS_F=$(MAX_DOMAINS) \
+ -DMAX_HISTORY=$(MAX_HISTORY) \
+ -DNMM_NEST=$(WRF_NMM_NEST)
+CFLAGS = $(CFLAGS_LOCAL) -DDM_PARALLEL \
+ -DLANDREAD_STUB=1 \
+ -DMAX_HISTORY=$(MAX_HISTORY) -DNMM_CORE=$(WRF_NMM_CORE)
+FCFLAGS = $(FCOPTIM) $(FCBASEOPTS)
+ESMF_LIB_FLAGS =
+# ESMF 5 -- these are defined in esmf.mk, included above
+ ESMF_IO_LIB = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+ESMF_IO_LIB_EXT = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+INCLUDE_MODULES = $(MODULE_SRCH_FLAG) \
+ $(ESMF_MOD_INC) $(ESMF_LIB_FLAGS) \
+ -I$(WRF_SRC_ROOT_DIR)/main \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_netcdf \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_int \
+ -I$(WRF_SRC_ROOT_DIR)/frame \
+ -I$(WRF_SRC_ROOT_DIR)/share \
+ -I$(WRF_SRC_ROOT_DIR)/phys \
+ -I$(WRF_SRC_ROOT_DIR)/wrftladj \
+ -I$(WRF_SRC_ROOT_DIR)/chem -I$(WRF_SRC_ROOT_DIR)/inc \
+ -I$(NETCDFPATH)/include \
+
+REGISTRY = Registry
+CC_TOOLS_CFLAGS = -DNMM_CORE=$(WRF_NMM_CORE)
+
+LIB = $(LIB_BUNDLED) $(LIB_EXTERNAL) $(LIB_LOCAL) $(LIB_WRF_HYDRO) $(NETCDF4_DEP_LIB)
+LDFLAGS = $(OMP) $(FCFLAGS) $(LDFLAGS_LOCAL)
+ENVCOMPDEFS =
+WRF_CHEM = 0
+CPPFLAGS = $(ARCHFLAGS) $(ENVCOMPDEFS) -I$(LIBINCLUDE) $(TRADFLAG)
+NETCDFPATH = /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/netcdf-fortran-4.5.3-t6jqlxq6bnz62g4kwezpffg6fzj4d6qg
+HDF5PATH = /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/hdf5-1.10.7-xktnxpzgzprfgpldxnnkjsu7ostkg37b
+WRFPLUSPATH =
+RTTOVPATH =
+PNETCDFPATH =
+
+bundled: io_only
+external: io_only $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a gen_comms_rsllite module_dm_rsllite $(ESMF_TARGET)
+io_only: esmf_time wrfio_nf \
+ wrf_ioapi_includes wrfio_grib_share wrfio_grib1 wrfio_int fftpack
+
+
+######################
+externals: io_only bundled external
+
+gen_comms_serial :
+ ( /bin/rm -f $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c )
+
+module_dm_serial :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; cat module_dm_stubs.F >> module_dm.F ; fi )
+
+gen_comms_rsllite :
+ ( if [ ! -e $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ] ; then \
+ /bin/cp $(WRF_SRC_ROOT_DIR)/tools/gen_comms_warning $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/gen_comms.c >> $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; fi )
+
+module_dm_rsllite :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/module_dm.F >> module_dm.F ; fi )
+
+wrfio_nf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdf ; \
+ make $(J) NETCDFPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ CC="$(SCC)" CFLAGS="$(CFLAGS)" \
+ FC="$(SFC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_nfpar :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdfpar ; \
+ make $(J) NETCDFPARPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_pnf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_pnetcdf ; \
+ make $(J) NETCDFPATH="$(PNETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_grib_share :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib_share ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib1 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib1 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib2 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib2 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" archive)
+
+wrfio_int :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_int ; \
+ make $(J) CC="$(CC)" CFLAGS_LOCAL="$(CFLAGS_LOCAL)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(OMP)" FGREP="$(FGREP)" \
+ TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ARCHFLAGS="$(ARCHFLAGS)" all )
+
+esmf_time :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 ; \
+ make $(J) FC="$(SFC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP) -I$(WRF_SRC_ROOT_DIR)/inc -I. $(ARCHFLAGS) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+fftpack :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5 ; \
+ make $(J) FC="$(SFC)" FFLAGS="$(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" AR="$(AR)" \
+ ARFLAGS="$(ARFLAGS)" CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" RM="$(RM)" )
+
+atm_ocn :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/atm_ocn ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" \
+ FC="$(DM_FC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" )
+
+$(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/RSL_LITE ; make $(J) CC="$(CC) $(CFLAGS)" \
+ FC="$(FC) $(FCFLAGS) $(OMP) $(PROMOTION) $(BYTESWAPIO)" \
+ CPP="$(CPP) -I. $(ARCHFLAGS) $(OMPCPP) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ;\
+ $(RANLIB) $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a )
+
+######################
+# Macros, these should be generic for all machines
+
+LN = ln -sf
+MAKE = make -i -r
+RM = rm -f
+
+
+# These sub-directory builds are identical across all architectures
+
+wrf_ioapi_includes :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/ioapi_share ; \
+ $(MAKE) NATIVE_RWORDSIZE="$(NATIVE_RWORDSIZE)" RWORDSIZE="$(RWORDSIZE)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_esmf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_esmf ; \
+ make FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(ESMF_MOD_INC)" \
+ RANLIB="$(RANLIB)" CPP="$(CPP) $(POUND_DEF) " AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+# There is probably no reason to modify these rules
+
+.F.i:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.G > $*.i
+ mv $*.i $(DEVTOP)/pick/$*.f90
+ cp $*.F $(DEVTOP)/pick
+
+.F.o:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.G > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ $(RM) $*.G $*.bb
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(FC) -o $@ -c $(FCFLAGS) $(OMP) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+
+.F.f90:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(SED_FTN) $*.G > $*.H
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.H > $@
+ $(RM) $*.G $*.H
+
+.f90.o:
+ $(RM) $@
+ $(FC) -o $@ -c $(FCFLAGS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+setfeenv.o : setfeenv.c
+ $(RM) $@
+ $(CCOMP) -o $@ -c $(CFLAGS) $(OMPCC) $*.c
+
+.c.o:
+ $(RM) $@
+ $(CC) -o $@ -c $(CFLAGS) $*.c
+
+# A little more adventurous. Allow full opt on
+# mediation_integrate.o \
+# shift_domain_em.o \
+# solve_em.o <-- gets a little kick from SOLVE_EM_SPECIAL too, if defined
+# mediation_feedback_domain.o : mediation_feedback_domain.F
+# mediation_force_domain.o : mediation_force_domain.F
+# mediation_interp_domain.o : mediation_interp_domain.F
+
+# compile these without high optimization to speed compile
+track_driver.o : track_driver.F
+convert_nmm.o : convert_nmm.F
+init_modules_em.o : init_modules_em.F
+input_wrf.o : input_wrf.F
+module_io.o : module_io.F
+module_comm_dm.o : module_comm_dm.F
+module_comm_dm_0.o : module_comm_dm_0.F
+module_comm_dm_1.o : module_comm_dm_1.F
+module_comm_dm_2.o : module_comm_dm_2.F
+module_comm_dm_3.o : module_comm_dm_3.F
+module_comm_nesting_dm.o : module_comm_nesting_dm.F
+module_configure.o : module_configure.F
+module_domain.o : module_domain.F
+module_domain_type.o : module_domain_type.F
+module_alloc_space_0.o : module_alloc_space_0.F
+module_alloc_space_1.o : module_alloc_space_1.F
+module_alloc_space_2.o : module_alloc_space_2.F
+module_alloc_space_3.o : module_alloc_space_3.F
+module_alloc_space_4.o : module_alloc_space_4.F
+module_alloc_space_5.o : module_alloc_space_5.F
+module_alloc_space_6.o : module_alloc_space_6.F
+module_alloc_space_7.o : module_alloc_space_7.F
+module_alloc_space_8.o : module_alloc_space_8.F
+module_alloc_space_9.o : module_alloc_space_9.F
+module_tiles.o : module_tiles.F
+module_initialize.o : module_initialize.F
+module_physics_init.o : module_physics_init.F
+module_initialize_squall2d_x.o : module_initialize_squall2d_x.F
+module_initialize_squall2d_y.o : module_initialize_squall2d_y.F
+module_initialize_scm_xy.o : module_initialize_scm_xy.F
+module_integrate.o : module_integrate.F
+module_io_mm5.o : module_io_mm5.F
+module_io_wrf.o : module_io_wrf.F
+module_si_io.o : module_si_io.F
+module_wps_io_arw.o : module_wps_io_arw.F
+module_state_description.o : module_state_description.F
+output_wrf.o : output_wrf.F
+solve_interface.o : solve_interface.F
+start_domain.o : start_domain.F
+wrf_bdyin.o : wrf_bdyin.F
+wrf_bdyout.o : wrf_bdyout.F
+wrf_ext_read_field.o : wrf_ext_read_field.F
+wrf_ext_write_field.o : wrf_ext_write_field.F
+wrf_fddaobs_in.o : wrf_fddaobs_in.F
+wrf_histin.o : wrf_histin.F
+wrf_histout.o : wrf_histout.F
+wrf_inputin.o : wrf_inputin.F
+wrf_inputout.o : wrf_inputout.F
+wrf_restartin.o : wrf_restartin.F
+wrf_restartout.o : wrf_restartout.F
+wrf_tsin.o : wrf_tsin.F
+nl_get_0_routines.o : nl_get_0_routines.F
+nl_get_1_routines.o : nl_get_1_routines.F
+nl_set_0_routines.o : nl_set_0_routines.F
+nl_set_1_routines.o : nl_set_1_routines.F
+
+track_driver.o \
+convert_nmm.o \
+init_modules_em.o \
+module_initialize.o \
+module_initialize_squall2d_x.o \
+module_initialize_squall2d_y.o \
+module_initialize_scm_xy.o \
+module_integrate.o \
+module_io_mm5.o \
+module_io_wrf.o \
+module_si_io.o \
+module_wps_io_arw.o \
+module_tiles.o \
+output_wrf.o \
+solve_interface.o \
+start_domain.o \
+wrf_fddaobs_in.o \
+wrf_tsin.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+#solve_em.o :
+# $(RM) $@
+# $(SED_FTN) $*.F > $*.b
+# $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.b > $*.f90
+# $(RM) $*.b
+# $(FC) -o $@ -c $(FCFLAGS) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $(SOLVE_EM_SPECIAL) $(OMP) $*.f90
+
+module_sf_ruclsm.o : module_sf_ruclsm.F
+
+module_sf_ruclsm.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ echo COMPILING $*.F WITH OMP ; \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+# compile without OMP
+input_wrf.o \
+module_domain.o \
+module_domain_type.o \
+module_physics_init.o \
+module_io.o \
+wrf_bdyin.o \
+wrf_bdyout.o \
+wrf_ext_read_field.o \
+wrf_ext_write_field.o \
+wrf_histin.o \
+wrf_histout.o \
+wrf_inputin.o \
+wrf_inputout.o \
+wrf_restartin.o \
+wrf_restartout.o \
+module_state_description.o \
+module_alloc_space.o \
+module_alloc_space_0.o \
+module_alloc_space_1.o \
+module_alloc_space_2.o \
+module_alloc_space_3.o \
+module_alloc_space_4.o \
+module_alloc_space_5.o \
+module_alloc_space_6.o \
+module_alloc_space_7.o \
+module_alloc_space_8.o \
+module_alloc_space_9.o \
+module_comm_dm.o \
+module_comm_dm_0.o \
+module_comm_dm_1.o \
+module_comm_dm_2.o \
+module_comm_dm_3.o \
+module_comm_nesting_dm.o \
+module_configure.o :
+ $(RM) $@
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.F > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(RM) $*.b $*.bb
+ $(FC) -c $(PROMOTION) $(FCSUFFIX) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $*.f90
diff --git a/WRF/config_files/configure.wrf.v4.4.vsc5.intel b/WRF/config_files/configure.wrf.v4.4.vsc5.intel
new file mode 100644
index 0000000000000000000000000000000000000000..9157f72ceab8dee7a9ee3f629140db52763deac6
--- /dev/null
+++ b/WRF/config_files/configure.wrf.v4.4.vsc5.intel
@@ -0,0 +1,590 @@
+# configure.wrf
+#
+# Original configure options used:
+# ./configure
+# Compiler choice: 15
+# Nesting option: 1
+#
+# This file was automatically generated by the configure script in the
+# top level directory. You may make changes to the settings in this
+# file but be aware they will be overwritten each time you run configure.
+# Ordinarily, it is necessary to run configure once, when the code is
+# first installed.
+#
+# To permanently change options, change the settings for your platform
+# in the file arch/configure.defaults then rerun configure.
+#
+SHELL = /bin/sh
+DEVTOP = `pwd`
+LIBINCLUDE = .
+.SUFFIXES: .F .i .o .f90 .c
+
+#### Get core settings from environment (set in compile script)
+#### Note to add a core, this has to be added to.
+
+COREDEFS = -DEM_CORE=$(WRF_EM_CORE) \
+ -DNMM_CORE=$(WRF_NMM_CORE) -DNMM_MAX_DIM=2600 \
+ -DDA_CORE=$(WRF_DA_CORE) \
+ -DWRFPLUS=$(WRF_PLUS_CORE)
+
+#### Single location for defining total number of domains. You need
+#### at least 1 + 2*(number of total nests). For example, 1 coarse
+#### grid + three fine grids = 1 + 2(3) = 7, so MAX_DOMAINS=7.
+
+MAX_DOMAINS = 21
+
+#### DM buffer length for the configuration flags.
+
+CONFIG_BUF_LEN = 65536
+
+#### Size of bitmasks (in 4byte integers) of stream masks for WRF I/O
+
+MAX_HISTORY = 25
+
+IWORDSIZE = 4
+DWORDSIZE = 8
+LWORDSIZE = 4
+
+##############################################################################
+#### The settings in this section are defaults that may be overridden by the
+#### architecture-specific settings in the next section.
+##############################################################################
+
+##############################################################################
+#### NOTE: Do not modify these default values here. To override these
+#### values, make changes after "Architecture specific settings".
+##############################################################################
+
+#### Native size (in bytes) of Fortran REAL data type on this architecture ####
+#### Note: to change real wordsize (for example, to promote REALs from
+#### 4-byte to 8-byte), modify the definition of RWORDSIZE in the
+#### section following "Architecture specific settings". Do not
+#### change NATIVE_RWORDSIZE as is it architecture-specific.
+NATIVE_RWORDSIZE = 4
+
+#### Default sed command and script for Fortran source files ####
+#SED_FTN = sed -f $(WRF_SRC_ROOT_DIR)/arch/standard.sed
+SED_FTN = $(WRF_SRC_ROOT_DIR)/tools/standard.exe
+
+# Hack to work around $(PWD) not changing during OSF1 build.
+# $(IO_GRIB_SHARE_DIR) is reset during the OSF1 build only.
+IO_GRIB_SHARE_DIR =
+
+#### ESMF switches ####
+#### These are set up by Config.pl ####
+# switch to use separately installed ESMF library for coupling: 1==true
+ESMF_COUPLING = 0
+# select dependences on module_utility.o
+ESMF_MOD_DEPENDENCE = $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90/module_utility.o
+# select -I options for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_INC = -I$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90
+# select -I options for separately installed ESMF library, if present
+ESMF_MOD_INC = $(ESMF_IO_INC)
+# select cpp token for external/io_esmf vs. external/esmf_time_f90
+ESMF_IO_DEFS =
+# select build target for external/io_esmf vs. external/esmf_time_f90
+ESMF_TARGET = esmf_time
+
+# ESMFINCLUDEGOESHERE
+
+
+#### NETCDF4 pieces
+
+NETCDF4_IO_OPTS = -DUSE_NETCDF4_FEATURES -DWRFIO_NCD_LARGE_FILE_SUPPORT
+GPFS =
+CURL =
+HDF5 = -lhdf5_hl -lhdf5
+ZLIB = -lz
+DEP_LIB_PATH = -L/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-c-4.7.0-spzlhyrfnqcl53ji25zop2adp222ftq4/lib
+NETCDF4_DEP_LIB = $(DEP_LIB_PATH) $(HDF5) $(ZLIB) $(GPFS) $(CURL)
+
+# NETCDF4INCLUDEGOESHERE
+
+#### CTSM pieces
+
+# CTSMINCLUDEGOESHERE
+
+##############################################################################
+
+LIBWRFLIB = libwrflib.a
+
+ LIB_BUNDLED = \
+ $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5/libfftpack.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib1/libio_grib1.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_grib_share/libio_grib_share.a \
+ $(WRF_SRC_ROOT_DIR)/external/io_int/libwrfio_int.a \
+ $(ESMF_IO_LIB) \
+ $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a \
+ $(WRF_SRC_ROOT_DIR)/frame/module_internal_header_util.o \
+ $(WRF_SRC_ROOT_DIR)/frame/pack_utils.o
+
+ LIB_EXTERNAL = \
+ -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4/lib -lnetcdff
+
+
+#### Architecture specific settings ####
+
+# Settings for Linux x86_64 ppc64le i486 i586 i686, ifort compiler with icc (dmpar)
+#
+# By default, some files are compiled without optimizations to speed up compilation. Removing
+# respective makefile rules in the end of this file will result in longer compilation time, and, possibly
+# Out Of Memory messages, but might produce binaries which are substantially faster.
+#
+# Please visit http://www.intel.com/support/performancetools/sb/cs-028607.htm
+# for latest info on how to build WRF with Intel compilers.
+#
+# If you got Out Of Memory message, there are several options:
+# 1. Check your memory limits (ulimit -a), possibly increasing swap partitions size.
+# 2. Remove any debugging flags (-g, -check, -traceback).
+# 3. Force the problematic file to be compiled with less optimizations (see examples at the
+# end of this file), try -no-ip compiler flag.
+#
+# This configuration is aimed at accuracy. To improve performance (at the expence of accuracy) you might
+# consider removing '-fp-model precise' flag from FCBASEOPTS. This enables non value-safe optimizations.
+# Another option is to add '-ftz' flag, which flushes denormal results to zero when the application is in
+# the gradual underflow mode. It may improve performance if the denormal values are not critical to the
+# behavior of your workload. To further improve performance, add suitable vectorization options for your
+# processor to FCOPTIM (see ifort manpage).
+#
+# If you have Intel MPI installed and wish to use instead, make the
+# following changes to settings below:
+# DM_FC = mpiifort
+# DM_CC = mpiicc
+# and source bin64/mpivars.sh file from your Intel MPI installation
+# before the build.
+#
+# Suggestions for timing improvements from Craig Mattocks
+#
+#CFLAGS_LOCAL = -w -O3 -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars
+#LDFLAGS_LOCAL = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+#FCBASEOPTS_NO_G = -w -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common $(FORMAT_FREE) $(BYTESWAPIO)
+
+DESCRIPTION = INTEL ($SFC/$SCC)
+DMPARALLEL = 1
+OMPCPP = # -D_OPENMP
+OMP = # -qopenmp -fpp -auto
+OMPCC = # -qopenmp -fpp -auto
+SFC = ifort
+SCC = icc
+CCOMP = icc
+DM_FC = mpif90 -f90=$(SFC)
+DM_CC = mpicc -cc=$(SCC)
+FC = time $(DM_FC)
+CC = $(DM_CC) -DFSEEKO64_OK
+LD = $(FC)
+RWORDSIZE = $(NATIVE_RWORDSIZE)
+PROMOTION = -real-size `expr 8 \* $(RWORDSIZE)` -i4
+ARCH_LOCAL = -DNONSTANDARD_SYSTEM_FUNC -DWRF_USE_CLM $(NETCDF4_IO_OPTS)
+CFLAGS_LOCAL = -w -O3 -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -no-multibyte-chars # -DRSL0_ONLY
+LDFLAGS_LOCAL = -ip #-xHost -fp-model fast=2 -no-prec-div -no-prec-sqrt -ftz -align all -fno-alias -fno-common
+CPLUSPLUSLIB =
+ESMF_LDFLAG = $(CPLUSPLUSLIB)
+FCOPTIM = -O3
+FCREDUCEDOPT = $(FCOPTIM)
+FCNOOPT = -O0 -fno-inline -no-ip
+FCDEBUG = # -g $(FCNOOPT) -traceback # -fpe0 -check noarg_temp_created,bounds,format,output_conversion,pointers,uninit -ftrapuv -unroll0 -u
+FORMAT_FIXED = -FI
+FORMAT_FREE = -FR
+FCSUFFIX =
+BYTESWAPIO = -convert big_endian
+RECORDLENGTH = -assume byterecl
+FCBASEOPTS_NO_G = -ip -fp-model precise -w -ftz -align all -fno-alias $(FORMAT_FREE) $(BYTESWAPIO) #-xHost -fp-model fast=2 -no-heap-arrays -no-prec-div -no-prec-sqrt -fno-common
+FCBASEOPTS = $(FCBASEOPTS_NO_G) $(FCDEBUG)
+MODULE_SRCH_FLAG =
+TRADFLAG = -traditional-cpp $(NETCDF4_IO_OPTS)
+CPP = /lib/cpp -P -nostdinc
+AR = ar
+ARFLAGS = ru
+M4 = m4
+RANLIB = ranlib
+RLFLAGS =
+CC_TOOLS = $(SCC)
+NETCDFPAR_BUILD = echo SKIPPING
+
+###########################################################
+######################
+# POSTAMBLE
+
+FGREP = fgrep -iq
+
+ARCHFLAGS = $(COREDEFS) -DIWORDSIZE=$(IWORDSIZE) -DDWORDSIZE=$(DWORDSIZE) -DRWORDSIZE=$(RWORDSIZE) -DLWORDSIZE=$(LWORDSIZE) \
+ $(ARCH_LOCAL) \
+ $(DA_ARCHFLAGS) \
+ -DDM_PARALLEL \
+ \
+ -DNETCDF \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ \
+ -DLANDREAD_STUB=1 \
+ \
+ \
+ -DUSE_ALLOCATABLES \
+ -Dwrfmodel \
+ -DGRIB1 \
+ -DINTIO \
+ -DKEEP_INT_AROUND \
+ -DLIMIT_ARGS \
+ -DBUILD_RRTMG_FAST=0 \
+ -DBUILD_RRTMK=0 \
+ -DBUILD_SBM_FAST=1 \
+ -DSHOW_ALL_VARS_USED=0 \
+ -DCONFIG_BUF_LEN=$(CONFIG_BUF_LEN) \
+ -DMAX_DOMAINS_F=$(MAX_DOMAINS) \
+ -DMAX_HISTORY=$(MAX_HISTORY) \
+ -DNMM_NEST=$(WRF_NMM_NEST)
+CFLAGS = $(CFLAGS_LOCAL) -DDM_PARALLEL \
+ -DLANDREAD_STUB=1 \
+ -DMAX_HISTORY=$(MAX_HISTORY) -DNMM_CORE=$(WRF_NMM_CORE)
+FCFLAGS = $(FCOPTIM) $(FCBASEOPTS)
+ESMF_LIB_FLAGS =
+# ESMF 5 -- these are defined in esmf.mk, included above
+ ESMF_IO_LIB = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+ESMF_IO_LIB_EXT = -L$(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 -lesmf_time
+INCLUDE_MODULES = $(MODULE_SRCH_FLAG) \
+ $(ESMF_MOD_INC) $(ESMF_LIB_FLAGS) \
+ -I$(WRF_SRC_ROOT_DIR)/main \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_netcdf \
+ -I$(WRF_SRC_ROOT_DIR)/external/io_int \
+ -I$(WRF_SRC_ROOT_DIR)/frame \
+ -I$(WRF_SRC_ROOT_DIR)/share \
+ -I$(WRF_SRC_ROOT_DIR)/phys \
+ -I$(WRF_SRC_ROOT_DIR)/wrftladj \
+ -I$(WRF_SRC_ROOT_DIR)/chem -I$(WRF_SRC_ROOT_DIR)/inc \
+ -I$(NETCDFPATH)/include \
+
+REGISTRY = Registry
+CC_TOOLS_CFLAGS = -DNMM_CORE=$(WRF_NMM_CORE)
+
+LIB = $(LIB_BUNDLED) $(LIB_EXTERNAL) $(LIB_LOCAL) $(LIB_WRF_HYDRO) $(NETCDF4_DEP_LIB)
+LDFLAGS = $(OMP) $(FCFLAGS) $(LDFLAGS_LOCAL)
+ENVCOMPDEFS =
+WRF_CHEM = 0
+CPPFLAGS = $(ARCHFLAGS) $(ENVCOMPDEFS) -I$(LIBINCLUDE) $(TRADFLAG)
+NETCDFPATH = /gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4
+HDF5PATH =
+WRFPLUSPATH =
+RTTOVPATH =
+PNETCDFPATH =
+
+bundled: io_only
+external: io_only $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a gen_comms_rsllite module_dm_rsllite $(ESMF_TARGET)
+io_only: esmf_time wrfio_nf \
+ wrf_ioapi_includes wrfio_grib_share wrfio_grib1 wrfio_int fftpack
+
+
+######################
+externals: io_only bundled external
+
+gen_comms_serial :
+ ( /bin/rm -f $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c )
+
+module_dm_serial :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; cat module_dm_stubs.F >> module_dm.F ; fi )
+
+gen_comms_rsllite :
+ ( if [ ! -e $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ] ; then \
+ /bin/cp $(WRF_SRC_ROOT_DIR)/tools/gen_comms_warning $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/gen_comms.c >> $(WRF_SRC_ROOT_DIR)/tools/gen_comms.c ; fi )
+
+module_dm_rsllite :
+ ( if [ ! -e module_dm.F ] ; then /bin/cp module_dm_warning module_dm.F ; \
+ cat $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/module_dm.F >> module_dm.F ; fi )
+
+wrfio_nf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdf ; \
+ make $(J) NETCDFPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ CC="$(SCC)" CFLAGS="$(CFLAGS)" \
+ FC="$(SFC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_nfpar :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_netcdfpar ; \
+ make $(J) NETCDFPARPATH="$(NETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_pnf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_pnetcdf ; \
+ make $(J) NETCDFPATH="$(PNETCDFPATH)" RANLIB="$(RANLIB)" CPP="$(CPP) $(ARCHFLAGS)" \
+ FC="$(FC) $(PROMOTION) $(OMP) $(FCFLAGS)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_grib_share :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib_share ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib1 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib1 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" archive)
+
+wrfio_grib2 :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_grib2 ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" \
+ FC="$(SFC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" archive)
+
+wrfio_int :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_int ; \
+ make $(J) CC="$(CC)" CFLAGS_LOCAL="$(CFLAGS_LOCAL)" RM="$(RM)" RANLIB="$(RANLIB)" CPP="$(CPP)" \
+ FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(OMP)" FGREP="$(FGREP)" \
+ TRADFLAG="$(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ARCHFLAGS="$(ARCHFLAGS)" all )
+
+esmf_time :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/esmf_time_f90 ; \
+ make $(J) FC="$(SFC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP) -I$(WRF_SRC_ROOT_DIR)/inc -I. $(ARCHFLAGS) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+fftpack :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/fftpack/fftpack5 ; \
+ make $(J) FC="$(SFC)" FFLAGS="$(PROMOTION) $(FCDEBUG) $(FCBASEOPTS)" RANLIB="$(RANLIB)" AR="$(AR)" \
+ ARFLAGS="$(ARFLAGS)" CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" RM="$(RM)" )
+
+atm_ocn :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/atm_ocn ; \
+ make $(J) CC="$(SCC)" CFLAGS="$(CFLAGS) " RM="$(RM)" RANLIB="$(RANLIB)" \
+ CPP="$(CPP)" CPPFLAGS="$(CPPFLAGS)" \
+ FC="$(DM_FC) $(PROMOTION) -I. $(FCDEBUG) $(FCBASEOPTS) $(FCSUFFIX)" TRADFLAG="-traditional" AR="$(AR)" ARFLAGS="$(ARFLAGS)" \
+ FIXED="$(FORMAT_FIXED)" )
+
+$(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/RSL_LITE ; make $(J) CC="$(CC) $(CFLAGS)" \
+ FC="$(FC) $(FCFLAGS) $(OMP) $(PROMOTION) $(BYTESWAPIO)" \
+ CPP="$(CPP) -I. $(ARCHFLAGS) $(OMPCPP) $(TRADFLAG)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" ;\
+ $(RANLIB) $(WRF_SRC_ROOT_DIR)/external/RSL_LITE/librsl_lite.a )
+
+######################
+# Macros, these should be generic for all machines
+
+LN = ln -sf
+MAKE = make -i -r
+RM = rm -f
+
+
+# These sub-directory builds are identical across all architectures
+
+wrf_ioapi_includes :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/ioapi_share ; \
+ $(MAKE) NATIVE_RWORDSIZE="$(NATIVE_RWORDSIZE)" RWORDSIZE="$(RWORDSIZE)" AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+wrfio_esmf :
+ ( cd $(WRF_SRC_ROOT_DIR)/external/io_esmf ; \
+ make FC="$(FC) $(PROMOTION) $(FCDEBUG) $(FCBASEOPTS) $(ESMF_MOD_INC)" \
+ RANLIB="$(RANLIB)" CPP="$(CPP) $(POUND_DEF) " AR="$(AR)" ARFLAGS="$(ARFLAGS)" )
+
+# There is probably no reason to modify these rules
+
+.F.i:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.G > $*.i
+ mv $*.i $(DEVTOP)/pick/$*.f90
+ cp $*.F $(DEVTOP)/pick
+
+.F.o:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.G > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ $(RM) $*.G $*.bb
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(FC) -o $@ -c $(FCFLAGS) $(OMP) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+
+.F.f90:
+ $(RM) $@
+ sed -e "s/^\!.*'.*//" -e "s/^ *\!.*'.*//" $*.F > $*.G
+ $(SED_FTN) $*.G > $*.H
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.H > $@
+ $(RM) $*.G $*.H
+
+.f90.o:
+ $(RM) $@
+ $(FC) -o $@ -c $(FCFLAGS) $(PROMOTION) $(FCSUFFIX) $*.f90
+
+setfeenv.o : setfeenv.c
+ $(RM) $@
+ $(CCOMP) -o $@ -c $(CFLAGS) $(OMPCC) $*.c
+
+.c.o:
+ $(RM) $@
+ $(CC) -o $@ -c $(CFLAGS) $*.c
+
+# A little more adventurous. Allow full opt on
+# mediation_integrate.o \
+# shift_domain_em.o \
+# solve_em.o <-- gets a little kick from SOLVE_EM_SPECIAL too, if defined
+# mediation_feedback_domain.o : mediation_feedback_domain.F
+# mediation_force_domain.o : mediation_force_domain.F
+# mediation_interp_domain.o : mediation_interp_domain.F
+
+# compile these without high optimization to speed compile
+track_driver.o : track_driver.F
+convert_nmm.o : convert_nmm.F
+init_modules_em.o : init_modules_em.F
+input_wrf.o : input_wrf.F
+module_io.o : module_io.F
+module_comm_dm.o : module_comm_dm.F
+module_comm_dm_0.o : module_comm_dm_0.F
+module_comm_dm_1.o : module_comm_dm_1.F
+module_comm_dm_2.o : module_comm_dm_2.F
+module_comm_dm_3.o : module_comm_dm_3.F
+module_comm_nesting_dm.o : module_comm_nesting_dm.F
+module_configure.o : module_configure.F
+module_domain.o : module_domain.F
+module_domain_type.o : module_domain_type.F
+module_alloc_space_0.o : module_alloc_space_0.F
+module_alloc_space_1.o : module_alloc_space_1.F
+module_alloc_space_2.o : module_alloc_space_2.F
+module_alloc_space_3.o : module_alloc_space_3.F
+module_alloc_space_4.o : module_alloc_space_4.F
+module_alloc_space_5.o : module_alloc_space_5.F
+module_alloc_space_6.o : module_alloc_space_6.F
+module_alloc_space_7.o : module_alloc_space_7.F
+module_alloc_space_8.o : module_alloc_space_8.F
+module_alloc_space_9.o : module_alloc_space_9.F
+module_tiles.o : module_tiles.F
+module_initialize.o : module_initialize.F
+module_physics_init.o : module_physics_init.F
+module_initialize_squall2d_x.o : module_initialize_squall2d_x.F
+module_initialize_squall2d_y.o : module_initialize_squall2d_y.F
+module_initialize_scm_xy.o : module_initialize_scm_xy.F
+module_integrate.o : module_integrate.F
+module_io_mm5.o : module_io_mm5.F
+module_io_wrf.o : module_io_wrf.F
+module_si_io.o : module_si_io.F
+module_wps_io_arw.o : module_wps_io_arw.F
+module_state_description.o : module_state_description.F
+output_wrf.o : output_wrf.F
+solve_interface.o : solve_interface.F
+start_domain.o : start_domain.F
+wrf_bdyin.o : wrf_bdyin.F
+wrf_bdyout.o : wrf_bdyout.F
+wrf_ext_read_field.o : wrf_ext_read_field.F
+wrf_ext_write_field.o : wrf_ext_write_field.F
+wrf_fddaobs_in.o : wrf_fddaobs_in.F
+wrf_histin.o : wrf_histin.F
+wrf_histout.o : wrf_histout.F
+wrf_inputin.o : wrf_inputin.F
+wrf_inputout.o : wrf_inputout.F
+wrf_restartin.o : wrf_restartin.F
+wrf_restartout.o : wrf_restartout.F
+wrf_tsin.o : wrf_tsin.F
+nl_get_0_routines.o : nl_get_0_routines.F
+nl_get_1_routines.o : nl_get_1_routines.F
+nl_set_0_routines.o : nl_set_0_routines.F
+nl_set_1_routines.o : nl_set_1_routines.F
+
+track_driver.o \
+convert_nmm.o \
+init_modules_em.o \
+module_initialize.o \
+module_initialize_squall2d_x.o \
+module_initialize_squall2d_y.o \
+module_initialize_scm_xy.o \
+module_integrate.o \
+module_io_mm5.o \
+module_io_wrf.o \
+module_si_io.o \
+module_wps_io_arw.o \
+module_tiles.o \
+output_wrf.o \
+solve_interface.o \
+start_domain.o \
+wrf_fddaobs_in.o \
+wrf_tsin.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+#solve_em.o :
+# $(RM) $@
+# $(SED_FTN) $*.F > $*.b
+# $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $*.b > $*.f90
+# $(RM) $*.b
+# $(FC) -o $@ -c $(FCFLAGS) $(MODULE_DIRS) $(PROMOTION) $(FCSUFFIX) $(SOLVE_EM_SPECIAL) $(OMP) $*.f90
+
+module_sf_ruclsm.o : module_sf_ruclsm.F
+
+module_sf_ruclsm.o :
+ $(RM) $@
+ $(SED_FTN) $*.F > $*.b
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.b > $*.f90
+ $(RM) $*.b
+ if $(FGREP) '!$$OMP' $*.f90 ; then \
+ echo COMPILING $*.F WITH OMP ; \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITH OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $(OMP) $*.f90 ; \
+ else \
+ if [ -n "$(OMP)" ] ; then echo COMPILING $*.F WITHOUT OMP ; fi ; \
+ $(FC) -c $(PROMOTION) $(FCREDUCEDOPT) $(FCBASEOPTS) $(MODULE_DIRS) $(FCSUFFIX) $*.f90 ; \
+ fi
+
+# compile without OMP
+input_wrf.o \
+module_domain.o \
+module_domain_type.o \
+module_physics_init.o \
+module_io.o \
+wrf_bdyin.o \
+wrf_bdyout.o \
+wrf_ext_read_field.o \
+wrf_ext_write_field.o \
+wrf_histin.o \
+wrf_histout.o \
+wrf_inputin.o \
+wrf_inputout.o \
+wrf_restartin.o \
+wrf_restartout.o \
+module_state_description.o \
+module_alloc_space.o \
+module_alloc_space_0.o \
+module_alloc_space_1.o \
+module_alloc_space_2.o \
+module_alloc_space_3.o \
+module_alloc_space_4.o \
+module_alloc_space_5.o \
+module_alloc_space_6.o \
+module_alloc_space_7.o \
+module_alloc_space_8.o \
+module_alloc_space_9.o \
+module_comm_dm.o \
+module_comm_dm_0.o \
+module_comm_dm_1.o \
+module_comm_dm_2.o \
+module_comm_dm_3.o \
+module_comm_nesting_dm.o \
+module_configure.o :
+ $(RM) $@
+ $(CPP) -I$(WRF_SRC_ROOT_DIR)/inc $(CPPFLAGS) $(OMPCPP) $*.F > $*.bb
+ $(SED_FTN) $*.bb | $(CPP) $(TRADFLAG) > $*.f90
+ @ if echo $(ARCHFLAGS) | $(FGREP) 'DVAR4D'; then \
+ echo COMPILING $*.F for 4DVAR ; \
+ $(WRF_SRC_ROOT_DIR)/var/build/da_name_space.pl $*.f90 > $*.f90.tmp ; \
+ mv $*.f90.tmp $*.f90 ; \
+ fi
+ $(RM) $*.b $*.bb
+ $(FC) -c $(PROMOTION) $(FCSUFFIX) $(FCNOOPT) $(FCBASEOPTS) $(MODULE_DIRS) $*.f90
diff --git a/WRF/config_files/modules_jet_intel.sh b/WRF/config_files/modules_jet_intel.sh
new file mode 100755
index 0000000000000000000000000000000000000000..cba702165313c33015e79ae12b8ff02bfba10d0c
--- /dev/null
+++ b/WRF/config_files/modules_jet_intel.sh
@@ -0,0 +1,9 @@
+#!/bin/bash
+# run with 'source modules_jet_intel.sh'
+
+module purge
+module load intel-oneapi-compilers/2022.2.1-zkofgc5\
+ hdf5/1.12.2-intel-2021.7.1-w5sw2dq\
+ netcdf-fortran/4.5.3-intel-2021.7.1-27ldrnt\
+ netcdf-c/4.7.4-intel-2021.7.1-lnfs5zz\
+ intel-oneapi-mpi/2021.7.1-intel-2021.7.1-pt3unoz
diff --git a/WRF/config_files/modules_srvx1_intel.sh b/WRF/config_files/modules_srvx1_intel.sh
new file mode 100755
index 0000000000000000000000000000000000000000..9df68691e09a38168b5562d1c5c97bececbd8d5c
--- /dev/null
+++ b/WRF/config_files/modules_srvx1_intel.sh
@@ -0,0 +1,10 @@
+#!/bin/bash
+# execute with 'source modules_srvx1_intel.sh'
+
+module purge
+module load intel-oneapi-compilers/2021.4.0 \
+ intel-oneapi-mpi/2021.7.1-intel-2021.4.0 \
+ hdf5/1.12.2-intel-2021.4.0 \
+ netcdf-c/4.7.4-intel-2021.4.0 \
+ netcdf-fortran/4.5.3-intel-2021.4.0
+
diff --git a/WRF/config_files/modules_vsc5_gfortran.sh b/WRF/config_files/modules_vsc5_gfortran.sh
new file mode 100755
index 0000000000000000000000000000000000000000..aaa013a6fe4470ec43f506bcbb59c3505eb9cd66
--- /dev/null
+++ b/WRF/config_files/modules_vsc5_gfortran.sh
@@ -0,0 +1,9 @@
+#!/bin/bash
+
+spack unload --all
+spack load netcdf-fortran@4.5.3%gcc@11.2.0
+
+export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:\
+/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/hdf5-1.10.7-xktnxpzgzprfgpldxnnkjsu7ostkg37b/lib:\
+/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/netcdf-c-4.8.1-jsfjwaz7qp52fjxfeg6mbhtt2lj3l573/lib:\
+/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen3/gcc-11.2.0/netcdf-fortran-4.5.3-t6jqlxq6bnz62g4kwezpffg6fzj4d6qg/lib
diff --git a/WRF/config_files/modules_vsc5_intel.sh b/WRF/config_files/modules_vsc5_intel.sh
new file mode 100755
index 0000000000000000000000000000000000000000..b2fe5cefcad7be4932b820c2801aab6afe34c211
--- /dev/null
+++ b/WRF/config_files/modules_vsc5_intel.sh
@@ -0,0 +1,6 @@
+#!/bin/bash
+
+spack unload --all
+spack load intel-oneapi-compilers netcdf-fortran@4.4.5%intel
+export NETCDF=/gpfs/opt/sw/spack-0.17.1/opt/spack/linux-almalinux8-zen2/intel-2021.5.0/netcdf-fortran-4.4.5-um5yjit56ufokugazyhqgpcldrjfb2w4
+
diff --git a/mkdocs/imgw-cheatsheet.pdf b/mkdocs/imgw-cheatsheet.pdf
new file mode 100644
index 0000000000000000000000000000000000000000..cff080ee1c63f0c00f5460c9e5a9da1bec7a3e57
Binary files /dev/null and b/mkdocs/imgw-cheatsheet.pdf differ