Skip to content
Success

Console Output

Started by an SCM change
Obtained jenkins_tests/clubb_cmake_test/Jenkinsfile from git https://github.com/larson-group/clubb.git
[Pipeline] Start of Pipeline
[Pipeline] node
Still waiting to schedule task
Waiting for next available executor
Running on mitch in /home/jenkins/workspace/clubb_cmake_test
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Declarative: Checkout SCM)
[Pipeline] checkout
The recommended git tool is: git
Fetching changes from the remote Git repository
 > git rev-parse --resolve-git-dir /home/jenkins/workspace/clubb_cmake_test/.git # timeout=10
 > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10
Fetching upstream changes from https://github.com/larson-group/clubb.git
 > git --version # timeout=10
 > git --version # 'git version 2.34.1'
using GIT_ASKPASS to set credentials larsongroupsysadmin github token
 > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10
Checking out Revision 37da5d26c1a8137c484f3b8b0eb1a5d79ac011b8 (refs/remotes/origin/master)
Commit message: "Fixing microphys bug that has been around for quite a while. This happened when making clubb standalone use multiple columns, and only affects columns other than the first. This is BIT_CHANGING, but only for microphysics cases using multiple columns (#1358)"
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 37da5d26c1a8137c484f3b8b0eb1a5d79ac011b8 # timeout=10
 > git rev-list --no-walk ff0eeed50d1271837294a505a65d5848a79f2ec8 # timeout=10
[Pipeline] }
[Pipeline] // stage
[Pipeline] withEnv
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Compile gfortran)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-wiuv7wc (required by: mpich/4.2.1, hdf5/1.14.3-nhc23hl,
netcdf-c/4.9.2-xduzp77, netcdf-fortran/4.5.3), glibc/2.35-tdr5czg (required by:
mpich/4.2.1, hdf5/1.14.3-nhc23hl, netcdf-c/4.9.2-xduzp77, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -run_tests
-- Compiling with double precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/include
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/gcc_PRECdouble
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_gcc.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/gcc_PRECdouble
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/gcc_PRECdouble
Running CMake configure...
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target scm_activation_lib
[  1%] Built target clubb_lapack_shared
[  1%] Built target scm_activation_lib
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[ 19%] Built target clubb_lapack_double
[ 36%] Built target clubb_lapack_single
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 38%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
Scanning dependencies of target morrison_microphys_lib
Scanning dependencies of target KK_microphys_lib
Scanning dependencies of target bugsrad_lib
[ 52%] Built target morrison_microphys_lib
[ 53%] Built target text_writer_lib
Scanning dependencies of target coamps_lib
[ 63%] Built target coamps_lib
[ 68%] Built target bugsrad_lib
[ 72%] Built target KK_microphys_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target numerical_recipes_lib
Scanning dependencies of target radiation_lib
[ 78%] Built target numerical_recipes_lib
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target microphys_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target G_unit_test_lib
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 86%] Built target G_unit_test_lib
[ 93%] Built target benchmark_cases_lib
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[ 93%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Linking Fortran executable G_unit_tests
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_standalone_loss
Scanning dependencies of target clubb_thread_test
Scanning dependencies of target clubb_driver_test
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_loss_driver_test
Scanning dependencies of target clubb_tuner
[ 97%] Linking Fortran executable clubb_driver_test
[ 97%] Linking Fortran executable clubb_standalone
[ 97%] Linking Fortran executable clubb_standalone_loss
[ 97%] Linking Fortran executable clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_thread_test
[ 97%] Linking Fortran executable clubb_tuner
[ 97%] Built target clubb_thread_test
[ 97%] Built target G_unit_tests
[ 98%] Built target clubb_standalone_loss
[ 99%] Built target clubb_loss_driver_test
[ 99%] Built target clubb_driver_test
[100%] Built target clubb_tuner
[100%] Built target clubb_standalone
Install the project...
-- Install configuration: "Release"
-- Up-to-date: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/gcc_PRECdouble
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.03 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    0.81 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    0.73 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    0.76 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    1.11 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    0.91 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    1.13 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    0.86 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    0.93 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    0.89 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed    1.52 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =   9.69 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Compile gfortran: openmp+debug)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-wiuv7wc (required by: mpich/4.2.1, hdf5/1.14.3-nhc23hl,
netcdf-c/4.9.2-xduzp77, netcdf-fortran/4.5.3), glibc/2.35-tdr5czg (required by:
mpich/4.2.1, hdf5/1.14.3-nhc23hl, netcdf-c/4.9.2-xduzp77, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -debug -openmp -run_tests
-- Compiling with double precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/include
-- OpenMP Fortran support found
-- Flags:    -fopenmp
-- Includes: 
-- Libraries:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/gcc-13.1.0-m5i6qvtqmd4lm4sd2zvpgk75ong5ehbm/lib64/libgomp.so;/lib/x86_64-linux-gnu/libpthread.a
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/gcc_DEBUG_PRECdouble_OPENMP
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_gcc.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/gcc_DEBUG_PRECdouble_OPENMP
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/gcc_DEBUG_PRECdouble_OPENMP
Running CMake configure...
Scanning dependencies of target scm_activation_lib
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[  1%] Built target clubb_lapack_shared
[  1%] Built target scm_activation_lib
[ 19%] Built target clubb_lapack_double
[ 36%] Built target clubb_lapack_single
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 38%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
[ 39%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
Scanning dependencies of target bugsrad_lib
Scanning dependencies of target KK_microphys_lib
Scanning dependencies of target morrison_microphys_lib
Scanning dependencies of target coamps_lib
[ 52%] Built target morrison_microphys_lib
[ 53%] Built target text_writer_lib
[ 63%] Built target coamps_lib
[ 68%] Built target bugsrad_lib
[ 72%] Built target KK_microphys_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target numerical_recipes_lib
Scanning dependencies of target radiation_lib
[ 78%] Built target numerical_recipes_lib
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target microphys_lib
Scanning dependencies of target G_unit_test_lib
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 86%] Built target G_unit_test_lib
[ 93%] Built target benchmark_cases_lib
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[ 93%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Linking Fortran executable G_unit_tests
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_tuner
Scanning dependencies of target clubb_thread_test
[ 97%] Linking Fortran executable clubb_standalone
Scanning dependencies of target clubb_driver_test
Scanning dependencies of target clubb_standalone_loss
Scanning dependencies of target clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_standalone_loss
[ 97%] Linking Fortran executable clubb_driver_test
[ 97%] Linking Fortran executable clubb_tuner
[ 97%] Linking Fortran executable clubb_thread_test
[ 97%] Built target G_unit_tests
[ 97%] Built target clubb_thread_test
[ 98%] Built target clubb_standalone_loss
[ 98%] Built target clubb_driver_test
[ 98%] Built target clubb_standalone
[ 99%] Built target clubb_loss_driver_test
[100%] Built target clubb_tuner
Install the project...
-- Install configuration: "Debug"
-- Up-to-date: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib:/home/jenkins/workspace/clubb_cmake_test/install/gcc_DEBUG_PRECdouble_OPENMP/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-13.1.0/netcdf-fortran-4.5.3-rr4amopxiouymfpd5tw5ducrmg4u7a6i/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/gcc_DEBUG_PRECdouble_OPENMP
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.03 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    1.51 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    1.35 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    1.43 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    2.18 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    1.93 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    2.72 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    1.77 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    1.87 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    2.73 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed    5.73 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =  23.25 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Compile ifx)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load intel netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -run_tests
-- Compiling with double precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/include
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECdouble
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_intel.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECdouble
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECdouble
Running CMake configure...
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target scm_activation_lib
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[  1%] Built target clubb_lapack_shared
[ 19%] Built target clubb_lapack_double
[ 19%] Built target scm_activation_lib
[ 36%] Built target clubb_lapack_single
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
[ 39%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
Scanning dependencies of target coamps_lib
Scanning dependencies of target bugsrad_lib
Scanning dependencies of target KK_microphys_lib
[ 53%] Built target text_writer_lib
Scanning dependencies of target morrison_microphys_lib
[ 63%] Built target coamps_lib
[ 63%] Built target morrison_microphys_lib
[ 68%] Built target bugsrad_lib
[ 72%] Built target KK_microphys_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target numerical_recipes_lib
Scanning dependencies of target radiation_lib
[ 78%] Built target numerical_recipes_lib
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target G_unit_test_lib
Scanning dependencies of target microphys_lib
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 86%] Built target G_unit_test_lib
[ 93%] Built target benchmark_cases_lib
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[ 93%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Linking Fortran executable G_unit_tests
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_driver_test
Scanning dependencies of target clubb_thread_test
Scanning dependencies of target clubb_tuner
[ 97%] Linking Fortran executable clubb_standalone
Scanning dependencies of target clubb_standalone_loss
Scanning dependencies of target clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_driver_test
[ 97%] Linking Fortran executable clubb_thread_test
[ 97%] Linking Fortran executable clubb_standalone_loss
[ 97%] Linking Fortran executable clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_tuner
[ 98%] Built target clubb_standalone_loss
[ 98%] Built target G_unit_tests
[ 98%] Built target clubb_standalone
[ 98%] Built target clubb_thread_test
[ 98%] Built target clubb_driver_test
[ 99%] Built target clubb_loss_driver_test
[100%] Built target clubb_tuner
Install the project...
-- Install configuration: "Release"
-- Up-to-date: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECdouble
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.04 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    1.01 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    0.92 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    0.94 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    1.27 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    1.23 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    1.51 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    1.15 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    1.12 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    0.54 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed    2.24 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =  11.96 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Compile ifx: single precision)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load intel netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -precision single -run_tests
-- Compiling with single precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/include
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECsingle
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_intel.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECsingle
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECsingle
Running CMake configure...
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target scm_activation_lib
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[  1%] Built target clubb_lapack_shared
[ 19%] Built target clubb_lapack_double
[ 36%] Built target clubb_lapack_single
[ 36%] Built target scm_activation_lib
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 38%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
[ 39%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
Scanning dependencies of target KK_microphys_lib
Scanning dependencies of target morrison_microphys_lib
Scanning dependencies of target bugsrad_lib
Scanning dependencies of target coamps_lib
[ 53%] Built target text_writer_lib
[ 53%] Built target morrison_microphys_lib
[ 63%] Built target coamps_lib
[ 68%] Built target bugsrad_lib
[ 72%] Built target KK_microphys_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target radiation_lib
Scanning dependencies of target numerical_recipes_lib
[ 78%] Built target numerical_recipes_lib
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target microphys_lib
Scanning dependencies of target G_unit_test_lib
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 83%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 86%] Built target G_unit_test_lib
[ 93%] Built target benchmark_cases_lib
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[ 93%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[ 93%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Linking Fortran executable G_unit_tests
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_thread_test
Scanning dependencies of target clubb_tuner
[ 97%] Linking Fortran executable clubb_thread_test
Scanning dependencies of target clubb_driver_test
[ 97%] Linking Fortran executable clubb_standalone
Scanning dependencies of target clubb_loss_driver_test
Scanning dependencies of target clubb_standalone_loss
[ 97%] Linking Fortran executable clubb_driver_test
[ 97%] Linking Fortran executable clubb_loss_driver_test
[ 97%] Linking Fortran executable clubb_tuner
[ 97%] Linking Fortran executable clubb_standalone_loss
[ 98%] Built target clubb_loss_driver_test
[ 98%] Built target clubb_thread_test
[ 99%] Built target clubb_standalone_loss
[ 99%] Built target G_unit_tests
[100%] Built target clubb_tuner
[100%] Built target clubb_standalone
[100%] Built target clubb_driver_test
Install the project...
-- Install configuration: "Release"
-- Up-to-date: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib:/home/jenkins/workspace/clubb_cmake_test/install/intel_PRECsingle/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/oneapi-2023.2.0/netcdf-fortran-4.5.3-inkjvmgdy5ao7uwihl6lzsnlpstmyoyt/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/intel_PRECsingle
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.04 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    1.00 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    0.91 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    0.93 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    1.30 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    1.23 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    1.48 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    1.12 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    1.14 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    0.52 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed    2.33 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =  12.01 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Compile nvfortran)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load nvhpc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -run_tests
-- Configuring for CPU build
-- Compiling with double precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_PRECdouble
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_nvhpc.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_PRECdouble
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_PRECdouble
Running CMake configure...
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target scm_activation_lib
[  1%] Built target clubb_lapack_shared
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[  1%] Built target scm_activation_lib
[ 19%] Built target clubb_lapack_double
[ 36%] Built target clubb_lapack_single
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 38%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
[ 40%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_clubb_core_module.F90.o
[ 40%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/clubb_api_module.F90.o
[ 40%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
Scanning dependencies of target bugsrad_lib
Scanning dependencies of target KK_microphys_lib
[ 57%] Built target bugsrad_lib
[ 58%] Built target text_writer_lib
Scanning dependencies of target morrison_microphys_lib
Scanning dependencies of target coamps_lib
[ 62%] Built target KK_microphys_lib
[ 62%] Building Fortran object src/Microphys/Morrison_microphys/CMakeFiles/morrison_microphys_lib.dir/module_mp_graupel.F90.o
[ 72%] Built target coamps_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/silhs_api_module.F90.o
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target radiation_lib
Scanning dependencies of target numerical_recipes_lib
[ 78%] Built target numerical_recipes_lib
[ 78%] Building Fortran object src/Radiation/CMakeFiles/radiation_lib.dir/radiation_module.F90.o
  0 inform,   1 warnings,   0 severes, 0 fatal for module_mp_graupel
[ 78%] Linking Fortran static library libradiation_lib.a
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target G_unit_test_lib
[ 83%] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/prescribe_forcings.F90.o
[ 83%] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/spurious_source_test.F90.o
[ 83%] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/rev_direction_grid_test.F90.o
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 219)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 223)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 276)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 279)
[ 83%] Linking Fortran static library libbenchmark_cases_lib.a
[ 90%] Built target benchmark_cases_lib
[ 90%] Linking Fortran static library libmorrison_microphys_lib.a
[ 90%] Linking Fortran static library libG_unit_test_lib.a
[ 90%] Built target morrison_microphys_lib
Scanning dependencies of target microphys_lib
[ 90%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 90%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 91%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/morrison_microphys_module.F90.o
[ 91%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_init_cleanup.F90.o
[ 94%] Built target G_unit_test_lib
[ 95%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/pdf_hydromet_microphys_wrapper.F90.o
[ 95%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[ 95%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[ 96%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/lh_microphys_driver_module.F90.o
[ 96%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[ 96%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Building Fortran object src/CMakeFiles/G_unit_tests.dir/G_unit_tests.F90.o
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/generalized_grid_test.F90.o
[ 97%] Linking Fortran executable G_unit_tests
[ 97%] Built target G_unit_tests
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/clubb_driver.F90.o
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/clubb_loss_driver.F90.o
[ 97%] Linking Fortran static library libclubb_driver_lib.a
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_thread_test
Scanning dependencies of target clubb_standalone_loss
[ 97%] Building Fortran object src/CMakeFiles/clubb_thread_test.dir/clubb_thread_test.F90.o
Scanning dependencies of target clubb_loss_driver_test
Scanning dependencies of target clubb_tuner
[ 97%] Building Fortran object src/CMakeFiles/clubb_standalone.dir/clubb_standalone.F90.o
[ 98%] Building Fortran object src/CMakeFiles/clubb_standalone_loss.dir/clubb_standalone_loss.F90.o
[ 99%] Building Fortran object src/CMakeFiles/clubb_loss_driver_test.dir/clubb_loss_driver_test.F90.o
[100%] Building Fortran object src/CMakeFiles/clubb_tuner.dir/error.F90.o
Scanning dependencies of target clubb_driver_test
[100%] Building Fortran object src/CMakeFiles/clubb_driver_test.dir/clubb_driver_test.F90.o
[100%] Linking Fortran executable clubb_driver_test
[100%] Linking Fortran executable clubb_standalone
[100%] Linking Fortran executable clubb_standalone_loss
[100%] Linking Fortran executable clubb_thread_test
[100%] Built target clubb_driver_test
[100%] Built target clubb_standalone
[100%] Built target clubb_standalone_loss
[100%] Built target clubb_thread_test
[100%] Linking Fortran executable clubb_loss_driver_test
[100%] Building Fortran object src/CMakeFiles/clubb_tuner.dir/clubb_tuner.F90.o
[100%] Built target clubb_loss_driver_test
[100%] Linking Fortran executable clubb_tuner
[100%] Built target clubb_tuner
Install the project...
-- Install configuration: "Release"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_PRECdouble
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.03 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    1.66 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    1.47 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    1.53 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    2.03 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    2.03 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    2.73 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    1.82 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    1.93 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    1.01 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed    4.16 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =  20.40 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Compile nvfortran: openacc)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load nvhpc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ./compile.py -gpu openacc -run_tests
-- Configuring for OpenACC GPU build
-- Compiling with double precision
-- SUCCESS: netcdf-fortran found.
--   -> Library : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib/libnetcdff.so
--   -> Modules : /usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include
-- Configuring done
-- Generating done
-- Build files have been written to: /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_GPUopenacc_PRECdouble
Using inferred toolchain file: /home/jenkins/workspace/clubb_cmake_test/cmake/toolchains/linux_x86_64_nvhpc.cmake
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_GPUopenacc_PRECdouble
Setting CLUBB installation dir: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble
about to cmnake /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_GPUopenacc_PRECdouble
Running CMake configure...
Scanning dependencies of target clubb_lapack_shared
Scanning dependencies of target scm_activation_lib
Scanning dependencies of target clubb_lapack_double
Scanning dependencies of target clubb_lapack_single
[  1%] Built target clubb_lapack_shared
[  1%] Built target scm_activation_lib
[ 18%] Built target clubb_lapack_single
[ 36%] Built target clubb_lapack_double
[ 37%] Built target lapack_lib
Scanning dependencies of target clubb_core_lib
[ 38%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_xp2_xpyp_module.F90.o
[ 39%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/stats_clubb_utilities.F90.o
stats_accumulate:
    205, Generating enter data create(wp3_on_wp2(:,:),wp3_on_wp2_zt(:,:))
    210, Generating update self(wp3_on_wp2(:,:),ddzt_umvm_sqd(:,:),exner(:,:),kh_zm(:,:),cloud_frac(:,:),thvm(:,:),thv_ds_zt(:,:),p_in_pa(:,:),wm_zm(:,:),thv_ds_zm(:,:),thlp3(:,:),rho_ds_zm(:,:),rho(:,:),rho_ds_zt(:,:),rcm(:,:),em(:,:),kh_zt(:,:),rtpthlp(:,:),rtp3(:,:),thlp2(:,:),thlm_forcing(:,:),rtp2(:,:),rtm_forcing(:,:),wp3(:,:),wp2(:,:),wm_zt(:,:),wpthlp(:,:),wprtp_sfc(:),wprtp(:,:),wp3_on_wp2_zt(:,:),rtm_before(:,:),thlm_before(:,:),rtm(:,:),rho_zm(:,:),thlm(:,:),vp2(:,:),up2(:,:),vpwp(:,:),upwp(:,:),vm(:,:),vg(:,:),um(:,:),ug(:,:),wpthlp_sfc(:))
    223, Generating update self(stability_correction(:,:))
    225, Generating update self(sclrpthlp(:,:,:),wpedsclrp(:,:,:),sclrm(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:),sclrm_forcing(:,:,:),wpsclrp(:,:,:))
    229, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:))
    327, Generating copyout(gamma_skw_fnc(:,:)) [if not already present]
         Generating create(wp3_zm(:,:),skw_zm(:,:)) [if not already present]
    513, Generating exit data delete(wp3_on_wp2_zt(:,:),wp3_on_wp2(:,:))
stats_accumulate_lh_tend:
    700, Generating update device(lh_rcm_mc(:,:),lh_thlm_mc(:,:),lh_rvm_mc(:,:))
advance_xp2_xpyp:
    442, Generating enter data create(wp3_on_wp2(:,:),vp2_old(:,:),wp2_zt(:,:),lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),wp3_on_wp2_zt(:,:))
    452, Generating enter data create(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:))
    469, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        470, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        471,   ! blockidx%x threadidx%x collapsed
    469, Generating default present(c2thl_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6),cloud_frac_zm(:ngrdcol,:nzm),c2rtthl_1d(:ngrdcol,:nzm),c2rt_1d(:ngrdcol,:nzm))
    490, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        491, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        492,   ! blockidx%x threadidx%x collapsed
    490, Generating default present(c2rt_1d(:ngrdcol,:nzm),c2rtthl_1d(:ngrdcol,:nzm),c2thl_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6))
    501, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        502, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        503,   ! blockidx%x threadidx%x collapsed
    501, Generating default present(c2sclr_1d(:ngrdcol,:nzm),c14_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:27),c4_1d(:ngrdcol,:nzm))
    520, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        521, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        522,   ! blockidx%x threadidx%x collapsed
    520, Generating default present(kw9(:ngrdcol,:nzt),kw2(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,40:46))
    542, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        543, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        544,   ! blockidx%x threadidx%x collapsed
    542, Generating default present(rtpthlp(:ngrdcol,:nzm),rtp2_old(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm),thlp2_old(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),rtpthlp_old(:ngrdcol,:nzm))
    553, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm)
         Generating NVIDIA GPU code
        554, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
        555,   ! blockidx%x threadidx%x collapsed
        556,   ! blockidx%x threadidx%x collapsed
    553, Generating default present(sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrp2_old(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrprtp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim))
    604, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        605, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
             Generating reduction(.and.:l_single_solve_possible)
    604, Generating default present(clubb_params(:ngrdcol,4:6))
         Generating implicit copy(l_single_solve_possible) [if not already present]
    605, Generating implicit firstprivate(c2thl,c2rtthl,c2rt)
    679, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        680, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        681,   ! blockidx%x threadidx%x collapsed
    679, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm))
    699, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        700, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        701,   ! blockidx%x threadidx%x collapsed
    699, Generating default present(lhs_dp1_c4(:ngrdcol,2:nzm-1),lhs_dp1_c14(:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1))
    736, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        737, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        738,   ! blockidx%x threadidx%x collapsed
    736, Generating default present(fcor_y(:ngrdcol),uv_rhs(:ngrdcol,:nzm,:1),upwp(:ngrdcol,:nzm))
    745, Generating update self(upwp(:,:),fcor_y(:))
    847, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        848, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        849,   ! blockidx%x threadidx%x collapsed
    847, Generating default present(fcor_y(:ngrdcol),uv_rhs(:ngrdcol,:nzm,:1),upwp(:ngrdcol,:nzm))
    856, Generating update self(upwp(:,:),fcor_y(:))
    891, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        892, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        893,   ! blockidx%x threadidx%x collapsed
    891, Generating default present(vp2(:ngrdcol,:nzm),uv_solution(:ngrdcol,:nzm,:),up2(:ngrdcol,:nzm))
    901, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        902, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        903,   ! blockidx%x threadidx%x collapsed
    901, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm))
    912, Generating update self(lhs_diff_uv(:,:,:),lhs_dp1_c14(:,:),vp2(:,:),up2(:,:),lhs_dp1_c4(:,:),lhs_ma(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpvp2(:,:,:))
    987, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        988, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        989,   ! blockidx%x threadidx%x collapsed
    987, Generating default present(threshold_array(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm))
   1004, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1005, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1006,   ! blockidx%x threadidx%x collapsed
   1004, Generating default present(threshold_array(:ngrdcol,:nzm))
   1027, Generating update self(rtp2(:,:))
   1033, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1034, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1035,   ! blockidx%x threadidx%x collapsed
   1033, Generating default present(rtp2(:ngrdcol,:nzm),rtm_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,93))
   1035, Generating implicit firstprivate(threshold)
   1046, Generating update self(rtp2(:,:))
   1080, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1081, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1082,   ! blockidx%x threadidx%x collapsed
   1080, Generating default present(threshold_array(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm))
   1097, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1098, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1099,   ! blockidx%x threadidx%x collapsed
   1097, Generating default present(threshold_array(:ngrdcol,:nzm))
   1115, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1116, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1117,   ! blockidx%x threadidx%x collapsed
   1115, Generating default present(threshold_array(:ngrdcol,:nzm))
   1130, Generating update self(up2(:,:))
   1134, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1135, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1136,   ! blockidx%x threadidx%x collapsed
   1134, Generating default present(up2(:ngrdcol,:nzm))
   1143, Generating update self(up2(:,:))
   1150, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1151, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1152,   ! blockidx%x threadidx%x collapsed
   1150, Generating default present(threshold_array(:ngrdcol,:nzm))
   1163, Generating update self(vp2(:,:))
   1167, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1168, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1169,   ! blockidx%x threadidx%x collapsed
   1167, Generating default present(vp2(:ngrdcol,:nzm))
   1176, Generating update self(vp2(:,:))
   1183, Generating update self(vp2(:,:),up2(:,:))
   1205, Generating update device(vp2(:,:),up2(:,:))
   1218, Generating update self(rtpthlp(:,:))
   1224, Generating update self(rtpthlp(:,:))
   1265, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1266, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1267,   ! blockidx%x threadidx%x collapsed
   1265, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr))
   1291, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1292, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1293,   ! blockidx%x threadidx%x collapsed
   1291, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr))
   1319, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1320, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1321,   ! blockidx%x threadidx%x collapsed
   1319, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr))
   1342, Generating update self(sclrprtp_old(:,:,:),sclrpthlp(:,:,:),sclrp2_old(:,:,:),sclrprtp(:,:,:),sclrm(:,:,:),sclrp2(:,:,:),vm(:,:),vp2(:,:),um(:,:),up2(:,:),rtp2_old(:,:),rtpthlp_forcing(:,:),thlm(:,:),thlp2_forcing(:,:),rtm(:,:),rtp2_forcing(:,:),wprtp(:,:),rtpthlp_old(:,:),wp2(:,:),thlp2_old(:,:),rho_ds_zm(:,:),kh_zt(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),invrs_tau_xp2_zm(:,:),sclrpthlp_old(:,:,:),vp2_old(:,:),up2_old(:,:),wp2_zt(:,:),wm_zm(:,:),upwp(:,:),thv_ds_zm(:,:),wpthvp(:,:),wpthlp(:,:),wpsclrp(:,:,:),sigma_sqd_w(:,:),wp3(:,:),rho_ds_zt(:,:),vpwp(:,:),invrs_rho_ds_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:))
   1420, Generating exit data delete(wp3_on_wp2(:,:),vp2_old(:,:),wp2_zt(:,:),lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),wp3_on_wp2_zt(:,:))
   1430, Generating exit data delete(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:))
solve_xp2_xpyp_with_single_lhs:
   1603, Generating enter data create(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:))
   1605, Generating enter data create(sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:),sclrp2_forcing(:,:))
   1612, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1613, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1614,   ! blockidx%x threadidx%x collapsed
   1612, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1))
   1655, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1656, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1657,   ! blockidx%x threadidx%x collapsed
   1655, Generating default present(sclrp2_forcing(:ngrdcol,:nzm))
   1678, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1679, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1680,   ! blockidx%x threadidx%x collapsed
   1678, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm))
   1688, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1689, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1690,   ! blockidx%x threadidx%x collapsed
   1688, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm))
   1712, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1713, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1714,   ! blockidx%x threadidx%x collapsed
   1712, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm))
   1722, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       1723, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1724,   ! blockidx%x threadidx%x collapsed
   1722, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm))
   1764, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1765, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1766,   ! blockidx%x threadidx%x collapsed
   1764, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm))
   1775, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm)
         Generating NVIDIA GPU code
       1776, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       1777,   ! blockidx%x threadidx%x collapsed
       1778,   ! blockidx%x threadidx%x collapsed
   1775, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim))
   1793, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1794, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1795,   ! blockidx%x threadidx%x collapsed
   1793, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm))
   1804, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm)
         Generating NVIDIA GPU code
       1805, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       1806,   ! blockidx%x threadidx%x collapsed
       1807,   ! blockidx%x threadidx%x collapsed
   1804, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim))
   1820, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:),lhs_ta(:,:,:))
   1833, Generating exit data delete(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:))
   1835, Generating exit data delete(sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:),sclrp2_forcing(:,:))
solve_xp2_xpyp_with_multiple_lhs:
   2032, Generating enter data create(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold)
   2035, Generating enter data create(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_forcing(:,:),sclrpthlp_solution(:,:,:),sclrprtp_forcing(:,:))
   2045, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       2046, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2047,   ! blockidx%x threadidx%x collapsed
   2045, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1))
   2083, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       2084, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2085,   ! blockidx%x threadidx%x collapsed
   2083, Generating default present(rtp2(:ngrdcol,:nzm),rtp2_solution(:ngrdcol,:nzm))
   2091, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2092, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2093,   ! blockidx%x threadidx%x collapsed
   2091, Generating default present(rtp2(:ngrdcol,:nzm),rtp2_solution(:ngrdcol,:nzm))
   2101, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),lhs_ta_wprtp2(:,:,:))
   2112, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2113, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2114,   ! blockidx%x threadidx%x collapsed
   2112, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1))
   2151, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2152, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2153,   ! blockidx%x threadidx%x collapsed
   2151, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm))
   2159, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2160, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2161,   ! blockidx%x threadidx%x collapsed
   2159, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm))
   2169, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),thlp2(:,:),lhs_ta_wpthlp2(:,:,:))
   2180, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2181, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2182,   ! blockidx%x threadidx%x collapsed
   2180, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1))
   2219, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2220, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2221,   ! blockidx%x threadidx%x collapsed
   2219, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm))
   2227, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2228, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2229,   ! blockidx%x threadidx%x collapsed
   2227, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm))
   2237, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtpthlp(:,:),lhs_ta_wprtpthlp(:,:,:))
   2249, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2250, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2251,   ! blockidx%x threadidx%x collapsed
   2249, Generating default present(lhs_dp1(:ngrdcol,:nzm))
   2419, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2420, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2421,   ! blockidx%x threadidx%x collapsed
   2419, Generating default present(sclrp2_forcing(:ngrdcol,:nzm))
   2442, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2443, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2444,   ! blockidx%x threadidx%x collapsed
   2442, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm))
   2452, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2453, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2454,   ! blockidx%x threadidx%x collapsed
   2452, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm))
   2477, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2478, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2479,   ! blockidx%x threadidx%x collapsed
   2477, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm))
   2487, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2488, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2489,   ! blockidx%x threadidx%x collapsed
   2487, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm))
   2528, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm)
         Generating NVIDIA GPU code
       2529, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       2530,   ! blockidx%x threadidx%x collapsed
       2531,   ! blockidx%x threadidx%x collapsed
   2528, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim))
   2545, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm)
         Generating NVIDIA GPU code
       2546, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       2547,   ! blockidx%x threadidx%x collapsed
       2548,   ! blockidx%x threadidx%x collapsed
   2545, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim))
   2562, Generating exit data delete(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold)
   2565, Generating exit data delete(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_solution(:,:,:),sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:))
xp2_xpyp_lhs:
   2645, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       2646, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2647,   ! blockidx%x threadidx%x collapsed
   2645, Generating default present(lhs_diff(:,:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1),lhs_ma(:,:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1))
   2659, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2660, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2661,   ! blockidx%x threadidx%x collapsed
   2659, Generating default present(lhs(2,:ngrdcol,2:nzm-1))
   2661, Generating implicit firstprivate(dt)
   2674, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       2675, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   2674, Generating default present(lhs(:,:ngrdcol,:),gr)
xp2_xpyp_uv_rhs:
   3211, Generating enter data create(rhs_pr2(:,:),rhs_term_tp(:,:),rhs_pr1(:,:))
   3239, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       3240, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3241,   ! blockidx%x threadidx%x collapsed
   3239, Generating default present(lhs_splat_wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1))
   3266, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       3267, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3268,   ! blockidx%x threadidx%x collapsed
   3266, Generating default present(rhs_pr1(:ngrdcol,2:nzm-1),gr,lhs_dp1_c14(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1),lhs_dp1_c4(:ngrdcol,2:nzm-1),xap2(:ngrdcol,:),rhs_term_tp(:ngrdcol,2:nzm-1),c_uu_shr(:ngrdcol))
   3297, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       3298, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3299,   ! blockidx%x threadidx%x collapsed
   3297, Generating default present(xap2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1))
   3299, Generating implicit firstprivate(dt)
   3310, Generating copyin(c14_zeros(:),c4_zeros(:)) [if not already present]
         Generating copyout(stats_pr2(:,:),stats_pr1(:,:)) [if not already present]
   3323, Generating update self(lhs_dp1_c14(:,:),invrs_tau_c4_zm(:,:),rhs_ta(:,:),lhs_dp1_c4(:,:),lhs_ta(:,:,:),invrs_tau_c14_zm(:,:),rhs_term_tp(:,:),xbp2(:,:),xap2(:,:),wp2(:,:),lhs_splat_wp2(:,:),rhs_pr2(:,:))
   3416, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3417, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   3416, Generating default present(xap2(:ngrdcol,gr%k_lb_zm),rhs(:ngrdcol,:),gr)
   3425, Generating exit data delete(rhs_term_tp(:,:),rhs_pr2(:,:),rhs_pr1(:,:))
xp2_xpyp_rhs:
   3589, Generating enter data create(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:))
   3644, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       3645, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3646,   ! blockidx%x threadidx%x collapsed
   3644, Generating default present(lhs_ta(:,:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1),rhs_term_dp1(:ngrdcol,2:nzm-1),lhs_term_dp1(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),gr,xapxbp(:ngrdcol,:),rhs_term_tp(:ngrdcol,2:nzm-1))
   3701, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       3702, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3703,   ! blockidx%x threadidx%x collapsed
   3701, Generating default present(xpyp_forcing(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1))
   3710, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       3711, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3712,   ! blockidx%x threadidx%x collapsed
   3710, Generating default present(xapxbp(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1))
   3712, Generating implicit firstprivate(dt)
   3724, Generating copyin(xm_zeros(:,:),wpxp_zeros(:,:)) [if not already present]
         Generating copyout(stats_tp2(:,:),stats_tp1(:,:)) [if not already present]
   3741, Generating update self(lhs_ta(:,:,:),rhs_ta(:,:),xbm(:,:),xpyp_forcing(:,:),rhs_term_tp(:,:),wpxap(:,:),xapxbp(:,:),rhs_term_dp1(:,:),wpxbp(:,:),cn(:,:),xam(:,:),invrs_tau_zm(:,:),lhs_term_dp1(:,:))
   3869, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3870, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   3869, Generating default present(xapxbp(:ngrdcol,gr%k_lb_zm),rhs(:ngrdcol,:),gr)
   3870, Generating implicit firstprivate(threshold)
   3876, Generating exit data delete(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:))
calc_xp2_xpyp_ta_terms:
   4174, Generating enter data create(sgn_t_vel_rtpthlp(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2_zt(:,:),sgn_t_vel_rtp2_zt(:,:),sgn_t_vel_rtpthlp_zt(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:))
   4187, Generating enter data create(wpsclrp_zt(:,:,:),term_wpthlpsclrp_explicit_zm(:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:))
   4202, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       4203, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4204,   ! blockidx%x threadidx%x collapsed
   4202, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm))
   4213, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       4214, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4215,   ! blockidx%x threadidx%x collapsed
   4213, Generating default present(wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm))
   4222, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       4223, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4224,   ! blockidx%x threadidx%x collapsed
   4222, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp2_zt(:ngrdcol,:nzt))
   4491, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4492, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4493,   ! blockidx%x threadidx%x collapsed
   4491, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt))
   4506, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       4507, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4508,   ! blockidx%x threadidx%x collapsed
   4506, Generating default present(coef_wprtp2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm))
   4530, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       4531, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4532,   ! blockidx%x threadidx%x collapsed
   4530, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt))
   4550, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       4551, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       4552,   ! blockidx%x threadidx%x collapsed
       4553,   ! blockidx%x threadidx%x collapsed
   4550, Generating default present(lhs_ta_wprtpthlp(:,:ngrdcol,:nzm),lhs_ta_wpthlp2(:,:ngrdcol,:nzm),lhs_ta_wprtp2(:,:ngrdcol,:nzm))
   4562, Generating implicit firstprivate(ngrdcol,nzm,sclr_dim)
         Generating NVIDIA GPU code
       4563, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
       4564,   ! blockidx%x threadidx%x collapsed
       4565,   ! blockidx%x threadidx%x collapsed
       4566,   ! blockidx%x threadidx%x collapsed
   4562, Generating default present(lhs_ta_wpthlpsclrp(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wpsclrp2(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wprtp2(:,:ngrdcol,:nzm),lhs_ta_wprtpsclrp(:,:ngrdcol,:nzm,:sclr_dim))
   4587, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4588, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4589,   ! blockidx%x threadidx%x collapsed
   4587, Generating default present(term_wprtp2_explicit(:ngrdcol,:nzt),term_wprtpthlp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wprtp_zt(:ngrdcol,:nzt),term_wpthlp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt))
   4601, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       4602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4603,   ! blockidx%x threadidx%x collapsed
   4601, Generating default present(term_wprtp2_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm))
   4629, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4630, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4631,   ! blockidx%x threadidx%x collapsed
   4629, Generating default present(wprtp(:ngrdcol,:nzm),term_wprtp2_explicit_zm(:ngrdcol,:nzm))
   4637, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4638, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4639,   ! blockidx%x threadidx%x collapsed
   4637, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_rtp2_zt(:ngrdcol,:nzt))
   4657, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4658, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4659,   ! blockidx%x threadidx%x collapsed
   4657, Generating default present(wpthlp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),term_wpthlp2_explicit_zm(:ngrdcol,:nzm))
   4664, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4665, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4666,   ! blockidx%x threadidx%x collapsed
   4664, Generating default present(wp3_on_wp2(:ngrdcol,:nzt),sgn_t_vel_thlp2(:ngrdcol,:nzt))
   4688, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4689, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4690,   ! blockidx%x threadidx%x collapsed
   4688, Generating default present(wpthlp(:ngrdcol,:nzm),term_wpthlp2_explicit_zm(:ngrdcol,:nzm))
   4696, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4697, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4698,   ! blockidx%x threadidx%x collapsed
   4696, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_thlp2_zt(:ngrdcol,:nzt))
   4716, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4717, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4718,   ! blockidx%x threadidx%x collapsed
   4716, Generating default present(term_wprtpthlp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_rtpthlp(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm))
   4742, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4743, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4744,   ! blockidx%x threadidx%x collapsed
   4742, Generating default present(wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),term_wprtpthlp_explicit_zm(:ngrdcol,:nzm))
   4750, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4751, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4752,   ! blockidx%x threadidx%x collapsed
   4750, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_rtpthlp_zt(:ngrdcol,:nzt))
   4782, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4783, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4784,   ! blockidx%x threadidx%x collapsed
   4782, Generating default present(term_wpsclrp2_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrp2(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm))
   4791, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4792, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4793,   ! blockidx%x threadidx%x collapsed
   4791, Generating default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wp_coef_zt(:ngrdcol,:nzt),term_wpsclrp2_explicit(:ngrdcol,:nzt))
   4816, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4817, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4818,   ! blockidx%x threadidx%x collapsed
   4816, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),term_wpsclrp2_explicit_zm(:ngrdcol,:nzm))
   4823, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4824, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4825,   ! blockidx%x threadidx%x collapsed
   4823, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrp2_zt(:ngrdcol,:nzt))
   4846, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4847, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4848,   ! blockidx%x threadidx%x collapsed
   4846, Generating default present(term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrprtp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr),wprtp(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm))
   4855, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4856, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4857,   ! blockidx%x threadidx%x collapsed
   4855, Generating default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wprtp_zt(:ngrdcol,:nzt),term_wprtpsclrp_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt))
   4880, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4881, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4882,   ! blockidx%x threadidx%x collapsed
   4880, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),wprtp(:ngrdcol,:nzm),term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm))
   4887, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4888, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4889,   ! blockidx%x threadidx%x collapsed
   4887, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrprtp_zt(:ngrdcol,:nzt))
   4910, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4911, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4912,   ! blockidx%x threadidx%x collapsed
   4910, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrpthlp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr))
   4919, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4920, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4921,   ! blockidx%x threadidx%x collapsed
   4919, Generating default present(wp_coef_zt(:ngrdcol,:nzt),term_wpthlpsclrp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wpsclrp_zt(:ngrdcol,:nzt,sclr))
   4944, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       4945, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4946,   ! blockidx%x threadidx%x collapsed
   4944, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr))
   4951, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       4952, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       4953,   ! blockidx%x threadidx%x collapsed
   4951, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrpthlp_zt(:ngrdcol,:nzt))
   5388, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       5389, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5390,   ! blockidx%x threadidx%x collapsed
   5388, Generating default present(term_wpup2_explicit_zm(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),coef_wpvp2_implicit_zm(:ngrdcol,:nzm),term_wpvp2_explicit_zm(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),coef_wpup2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm))
   5402, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       5403, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5404,   ! blockidx%x threadidx%x collapsed
   5402, Generating default present(sgn_t_vel_up2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),sgn_t_vel_vp2(:ngrdcol,:nzm))
   5420, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       5421, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5422,   ! blockidx%x threadidx%x collapsed
   5420, Generating default present(coef_wpup2_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpvp2_implicit(:ngrdcol,:nzt))
   5430, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       5431, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5432,   ! blockidx%x threadidx%x collapsed
   5430, Generating default present(term_wpup2_explicit(:ngrdcol,:nzt),upwp_zt(:ngrdcol,:nzt),term_wpvp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),vpwp_zt(:ngrdcol,:nzt))
   5452, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       5453, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       5454,   ! blockidx%x threadidx%x collapsed
       5455,   ! blockidx%x threadidx%x collapsed
   5452, Generating default present(lhs_ta_wpvp2(:,:ngrdcol,:nzm),lhs_ta_wpup2(:,:ngrdcol,:nzm))
   5487, Generating update self(term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit(:,:),coef_wprtpthlp_implicit(:,:),coef_wpthlp2_implicit(:,:))
   5498, Generating exit data delete(sgn_t_vel_rtpthlp(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2_zt(:,:),sgn_t_vel_rtp2_zt(:,:),sgn_t_vel_rtpthlp_zt(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:))
   5511, Generating exit data delete(wpsclrp_zt(:,:,:),term_wpthlpsclrp_explicit_zm(:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:))
term_tp_rhs:
   5588, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       5589, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5590,   ! blockidx%x threadidx%x collapsed
   5588, Generating default present(invrs_dzm(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),xbm(:ngrdcol,:nzm-1),xam(:ngrdcol,:nzm-1),wpxap(:ngrdcol,2:nzm-1),wpxbp(:ngrdcol,2:nzm-1))
term_dp1_lhs:
   5683, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       5684, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   5683, Generating default present(gr,lhs(:ngrdcol,:))
   5692, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       5693, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5694,   ! blockidx%x threadidx%x collapsed
   5692, Generating default present(lhs(:ngrdcol,2:nzm-1),invrs_tau_zm(:ngrdcol,2:nzm-1),cn(:ngrdcol,2:nzm-1))
term_dp1_rhs:
   5773, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       5774, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5775,   ! blockidx%x threadidx%x collapsed
   5773, Generating default present(rhs(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm),cn(:ngrdcol,:nzm))
   5775, Generating implicit firstprivate(threshold)
term_pr1:
   5901, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       5902, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       5903,   ! blockidx%x threadidx%x collapsed
   5901, Generating default present(invrs_tau_c4_zm(:ngrdcol,2:nzm-1),c14(:ngrdcol),xbp2(:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),invrs_tau_c14_zm(:ngrdcol,2:nzm-1),c4(:ngrdcol))
term_pr2:
   6017, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       6018, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       6019,   ! blockidx%x threadidx%x collapsed
   6017, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1),wpthvp(:ngrdcol,2:nzm-1),c_uu_buoy(:ngrdcol),vm(:ngrdcol,:nzm-1),upwp(:ngrdcol,2:nzm-1),um(:ngrdcol,:nzm-1),c_uu_shr(:ngrdcol),gr,thv_ds_zm(:ngrdcol,2:nzm-1))
pos_definite_variances:
   6124, Generating update self(xp2_np1(:,:))
   6148, Generating update self(xp2_np1(:,:))
   6154, Generating update self(xp2_np1(:,:))
[ 40%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/advance_clubb_core_module.F90.o
advance_clubb_core:
    676, Generating enter data create(lhs_splat_wp2(:,:),invrs_tau_zt(:,:),tau_max_zm(:,:),stability_correction(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_smth(:,:),invrs_tau_c6_zm(:,:),invrs_tau_xp2_zm(:,:),em_zt(:,:),invrs_tau_c1_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),sigma_sqd_w_zt(:,:),mixt_frac_zm(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),thvm(:,:),w_1_zm(:,:),varnce_w_2_zm(:,:),em(:,:),sigma_sqd_w(:,:),rtm_before(:,:),tau_max_zt(:,:),ddzt_umvm_sqd(:,:),lhs_splat_wp3(:,:),lscale_up(:,:),lscale_down(:,:),wprtp2(:,:),w_2_zm(:,:),wprtpthlp(:,:),tau_zm(:,:),rcp2_zt(:,:),cx_fnc_richardson(:,:),thlm_before(:,:),wpthlp2(:,:))
    691, Generating enter data create(wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wp2sclrp(:,:,:),wpsclrpthlp(:,:,:))
    695, Generating enter data create(wpedsclrp(:,:,:))
    736, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        737, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        738,   ! blockidx%x threadidx%x collapsed
    736, Generating default present(thlm_before(:ngrdcol,:nzt),thlm(:ngrdcol,:nzt),rtm_before(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt))
    745, Generating update self(wp2(:,:),upwp(:,:),thlp2(:,:),rtpthlp(:,:),rfrzm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),vp2(:,:),up2(:,:),wprtp(:,:),wpthlp(:,:),wp3(:,:),um(:,:),vm(:,:),vpwp(:,:))
    882, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        883, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        884,   ! blockidx%x threadidx%x collapsed
    882, Generating default present(sigma_sqd_w_zt(:ngrdcol,:nzt))
    891, Generating update self(sigma_sqd_w_zt(:,:))
    901, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        902, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        903,   ! blockidx%x threadidx%x collapsed
    901, Generating default present(wp2(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2(:ngrdcol,:nzm),em(:ngrdcol,:nzm))
    910, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        911, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        912,   ! blockidx%x threadidx%x collapsed
    910, Generating default present(mixt_frac_zm(:ngrdcol,:nzm),pdf_params_zm,varnce_w_1_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_1(1:ngrdcol,1:nzm),pdf_params_zm%w_2(1:ngrdcol,1:nzm),pdf_params_zm%mixt_frac(1:ngrdcol,1:nzm),w_2_zm(:ngrdcol,:nzm),w_1_zm(:ngrdcol,:nzm),pdf_params_zm%w_1(1:ngrdcol,1:nzm),varnce_w_2_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_2(1:ngrdcol,1:nzm))
    930, Generating update self(exner(:,:),thlm(:,:),rtm(:,:),p_in_pa(:,:),rcm(:,:))
   1014, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1015, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1016,   ! blockidx%x threadidx%x collapsed
   1014, Generating default present(invrs_tau_c1_zm(:ngrdcol,:nzm),invrs_tau_c6_zm(:ngrdcol,:nzm),stability_correction(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm))
   1035, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1036, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1037,   ! blockidx%x threadidx%x collapsed
   1035, Generating default present(em_zt(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,37))
   1043, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1044, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1045,   ! blockidx%x threadidx%x collapsed
   1043, Generating default present(em(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,37))
   1107, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1109,   ! blockidx%x threadidx%x collapsed
   1107, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm))
   1541, Generating update self(wp2(:,:),up2(:,:),thlp2(:,:),rtpthlp(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),wpthlp(:,:),wprtp(:,:),wp3(:,:),um(:,:),vm(:,:),vp2(:,:))
   1561, Generating update self(vpwp(:,:),upwp(:,:))
   1595, Generating exit data delete(wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wp2sclrp(:,:,:),wpsclrpthlp(:,:,:))
   1599, Generating exit data delete(wpedsclrp(:,:,:))
   1602, Generating exit data delete(lhs_splat_wp2(:,:),invrs_tau_zt(:,:),tau_max_zm(:,:),stability_correction(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_smth(:,:),invrs_tau_c6_zm(:,:),invrs_tau_xp2_zm(:,:),em_zt(:,:),invrs_tau_c1_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),sigma_sqd_w_zt(:,:),mixt_frac_zm(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),thvm(:,:),w_1_zm(:,:),varnce_w_2_zm(:,:),em(:,:),sigma_sqd_w(:,:),rtm_before(:,:),tau_zm(:,:),rcp2_zt(:,:),cx_fnc_richardson(:,:),tau_max_zt(:,:),ddzt_umvm_sqd(:,:),lhs_splat_wp3(:,:),lscale_up(:,:),lscale_down(:,:),wprtp2(:,:),w_2_zm(:,:),wpthlp2(:,:),wprtpthlp(:,:),thlm_before(:,:))
set_sfc_value_of_flux_profiles:
   1709, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1710, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1709, Generating default present(wpthlp_sfc(:ngrdcol),wpthlp(:ngrdcol,gr%k_lb_zm),wprtp_sfc(:ngrdcol),wprtp(:ngrdcol,gr%k_lb_zm),vpwp_sfc(:ngrdcol),upwp(:ngrdcol,gr%k_lb_zm),gr,vpwp(:ngrdcol,gr%k_lb_zm),upwp_sfc(:ngrdcol))
   1719, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1720, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1719, Generating default present(upwp_pert(:ngrdcol,gr%k_lb_zm),gr,vpwp_sfc_pert(:ngrdcol),vpwp_pert(:ngrdcol,gr%k_lb_zm),upwp_sfc_pert(:ngrdcol))
   1729, Generating implicit firstprivate(sclr_dim,ngrdcol)
         Generating NVIDIA GPU code
       1730, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1731,   ! blockidx%x threadidx%x collapsed
   1729, Generating default present(gr,wpsclrp_sfc(:ngrdcol,:sclr_dim),wpsclrp(:ngrdcol,gr%k_lb_zm,:sclr_dim))
   1742, Generating implicit firstprivate(ngrdcol,edsclr_dim)
         Generating NVIDIA GPU code
       1743, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1744,   ! blockidx%x threadidx%x collapsed
   1742, Generating default present(gr,wpedsclrp_sfc(:ngrdcol,:edsclr_dim),wpedsclrp(:ngrdcol,gr%k_lb_zm,:edsclr_dim))
   1753, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1754, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1753, Generating default present(wpthlp(:ngrdcol,gr%k_lb_zm),wprtp(:ngrdcol,gr%k_lb_zm),vpwp(:ngrdcol,gr%k_lb_zm),gr,upwp(:ngrdcol,gr%k_lb_zm))
   1764, Generating implicit firstprivate(sclr_dim,ngrdcol)
         Generating NVIDIA GPU code
       1765, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1766,   ! blockidx%x threadidx%x collapsed
   1764, Generating default present(wpsclrp(:ngrdcol,gr%k_lb_zm,:sclr_dim),gr)
   1777, Generating implicit firstprivate(ngrdcol,edsclr_dim)
         Generating NVIDIA GPU code
       1778, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1779,   ! blockidx%x threadidx%x collapsed
   1777, Generating default present(wpedsclrp(:ngrdcol,gr%k_lb_zm,:edsclr_dim),gr)
[ 40%] Building Fortran object src/CLUBB_core/CMakeFiles/clubb_core_lib.dir/clubb_api_module.F90.o
advance_clubb_core_api_single_col:
   1120, Generating copyin(fcor_col(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present]
         Generating copyout(lscale_col(:,:)) [if not already present]
         Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present]
         Generating copy(rtpthvp_col(:,:)) [if not already present]
         Generating copyout(cloudy_updraft_frac_col(:,:)) [if not already present]
         Generating copy(exner_col(:,:)) [if not already present]
         Generating copyin(sclr_idx) [if not already present]
         Generating copy(thlm_col(:,:),rtm_col(:,:),um_col(:,:),vm_col(:,:),wprtp_col(:,:),wpthlp_col(:,:),rtp2_col(:,:),thlp2_col(:,:),rtpthlp_col(:,:)) [if not already present]
         Generating copyout(w_up_in_cloud_col(:,:)) [if not already present]
         Generating copyin(wm_zm_col(:,:),rho_ds_zt_col(:,:),rfrzm_col(:,:),rho_col(:,:),rho_ds_zm_col(:,:)) [if not already present]
         Generating copy(ice_supersat_frac_col(:,:)) [if not already present]
         Generating copyin(invrs_rho_ds_zm_col(:,:)) [if not already present]
         Generating copy(thlpthvp_col(:,:)) [if not already present]
         Generating copyin(thv_ds_zm_col(:,:)) [if not already present]
         Generating copyout(rcm_in_layer_col(:,:)) [if not already present]
         Generating copyin(wpthlp_forcing_col(:,:),wprtp_forcing_col(:,:)) [if not already present]
         Generating copy(upwp_pert_col(:,:),vpwp_pert_col(:,:),p_in_pa_col(:,:)) [if not already present]
         Generating copyin(upwp_sfc_col(:),vpwp_sfc_col(:),rtm_forcing_col(:,:),thlm_forcing_col(:,:)) [if not already present]
         Generating copy(um_pert_col(:,:),vm_pert_col(:,:)) [if not already present]
         Generating copyin(thv_ds_zt_col(:,:),upwp_sfc_pert_col(:),gr%zt(:,:),host_dx_col(:),p_sfc_col(:)) [if not already present]
         Generating copy(pdf_params%w_2(:,:)) [if not already present]
         Generating copyin(clubb_params_col(:,:)) [if not already present]
         Generating copy(err_info_api%err_code(:)) [if not already present]
         Generating copyin(ug_col(:,:)) [if not already present]
         Generating copy(uprcp_col(:,:)) [if not already present]
         Generating copyin(vg_col(:,:)) [if not already present]
         Generating copy(vprcp_col(:,:)) [if not already present]
         Generating copyin(um_ref_col(:,:),vm_ref_col(:,:)) [if not already present]
         Generating copy(up2_col(:,:),vp2_col(:,:)) [if not already present]
         Generating copyin(rho_zm_col(:,:)) [if not already present]
         Generating copyout(wprcp_col(:,:)) [if not already present]
         Generating copyin(sfc_elevation_col(:),wprtp_sfc_col(:),rtm_ref_col(:,:),rtp2_forcing_col(:,:),thlm_ref_col(:,:),thlp2_forcing_col(:,:)) [if not already present]
         Generating copy(rtp3_col(:,:)) [if not already present]
         Generating copyin(wm_zt_col(:,:)) [if not already present]
         Generating copy(wp2vp2_col(:,:)) [if not already present]
         Generating copyin(nu_vert_res_dep%nu9(:),err_info_api%err_header(:)) [if not already present]
         Generating copy(rc_coef_zm_col(:,:)) [if not already present]
         Generating copyout(cloud_cover_col(:,:)) [if not already present]
         Generating copyin(wpthlp_sfc_col(:)) [if not already present]
         Generating copy(wp2thlp_col(:,:)) [if not already present]
         Generating copyin(rtpthlp_forcing_col(:,:)) [if not already present]
         Generating copyout(thlprcp_col(:,:)) [if not already present]
         Generating copy(wp2_col(:,:),wp2rtp_col(:,:),up3_col(:,:),vp3_col(:,:),pdf_params_zm%w_2(:,:),wp2up2_col(:,:),wp3_col(:,:),wpthvp_col(:,:),wpup2_col(:,:),wp2thvp_col(:,:),wp2up_col(:,:)) [if not already present]
         Generating copyin(host_dy_col(:),um_forcing_col(:,:),vm_forcing_col(:,:)) [if not already present]
         Generating copy(upwp_col(:,:),vpwp_col(:,:)) [if not already present]
         Generating copyin(err_info_api) [if not already present]
         Generating copy(pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present]
         Generating copyin(pdf_params) [if not already present]
         Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present]
         Generating copyin(pdf_params_zm) [if not already present]
         Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm_col(:,:),wp4_col(:,:)) [if not already present]
         Generating copyout(w_down_in_cloud_col(:,:)) [if not already present]
         Generating copyin(vpwp_sfc_pert_col(:)) [if not already present]
         Generating copyout(cloudy_downdraft_frac_col(:,:)) [if not already present]
         Generating copy(cloud_frac_col(:,:)) [if not already present]
         Generating copyin(invrs_rho_ds_zt_col(:,:)) [if not already present]
         Generating copyout(kh_zm_col(:,:),invrs_tau_zm_col(:,:)) [if not already present]
         Generating copy(thlp3_col(:,:)) [if not already present]
         Generating copyout(kh_zt_col(:,:)) [if not already present]
         Generating copy(wpvp2_col(:,:)) [if not already present]
   1201, Generating copy(sclrm_col(:,:,:),wpsclrp_col(:,:,:)) [if not already present]
         Generating copyin(sclr_tol(:)) [if not already present]
         Generating copy(sclrpthvp_col(:,:,:)) [if not already present]
         Generating copyin(sclrm_forcing_col(:,:,:)) [if not already present]
         Generating copy(sclrp2_col(:,:,:),sclrp3_col(:,:,:),sclrprtp_col(:,:,:),sclrpthlp_col(:,:,:)) [if not already present]
         Generating copyin(wpsclrp_sfc_col(:,:)) [if not already present]
   1206, Generating copyin(edsclrm_forcing_col(:,:,:)) [if not already present]
         Generating copy(edsclrm_col(:,:,:)) [if not already present]
         Generating copyin(wpedsclrp_sfc_col(:,:)) [if not already present]
   1210, Generating copyin(wphydrometp_col(:,:,:),wp2hmp_col(:,:,:),thlphmp_zt_col(:,:,:),l_mix_rat_hm(:),rtphmp_zt_col(:,:,:)) [if not already present]
advance_clubb_core_api_multi_col:
   1657, Generating copyin(fcor(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present]
         Generating copyout(lscale(:,:)) [if not already present]
         Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present]
         Generating copy(rtpthvp(:,:)) [if not already present]
         Generating copyout(cloudy_updraft_frac(:,:)) [if not already present]
         Generating copy(exner(:,:)) [if not already present]
         Generating copyin(sclr_idx) [if not already present]
         Generating copy(thlm(:,:),rtm(:,:),um(:,:),vm(:,:),wprtp(:,:),wpthlp(:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:)) [if not already present]
         Generating copyout(w_up_in_cloud(:,:)) [if not already present]
         Generating copyin(wm_zm(:,:),rho_ds_zt(:,:),rfrzm(:,:),rho(:,:),rho_ds_zm(:,:)) [if not already present]
         Generating copy(ice_supersat_frac(:,:)) [if not already present]
         Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present]
         Generating copy(thlpthvp(:,:)) [if not already present]
         Generating copyin(thv_ds_zm(:,:)) [if not already present]
         Generating copyout(rcm_in_layer(:,:)) [if not already present]
         Generating copyin(wpthlp_forcing(:,:),wprtp_forcing(:,:)) [if not already present]
         Generating copy(upwp_pert(:,:),vpwp_pert(:,:),p_in_pa(:,:)) [if not already present]
         Generating copyin(upwp_sfc(:),vpwp_sfc(:),rtm_forcing(:,:),thlm_forcing(:,:)) [if not already present]
         Generating copy(um_pert(:,:),vm_pert(:,:)) [if not already present]
         Generating copyin(thv_ds_zt(:,:),upwp_sfc_pert(:),gr%zt(:,:),host_dx(:),p_sfc(:)) [if not already present]
         Generating copy(pdf_params%w_2(:,:)) [if not already present]
         Generating copyin(clubb_params(:,:)) [if not already present]
         Generating copyout(err_info_api%err_code(:)) [if not already present]
         Generating copyin(ug(:,:)) [if not already present]
         Generating copy(uprcp(:,:)) [if not already present]
         Generating copyin(vg(:,:)) [if not already present]
         Generating copy(vprcp(:,:)) [if not already present]
         Generating copyin(um_ref(:,:),vm_ref(:,:)) [if not already present]
         Generating copy(up2(:,:),vp2(:,:)) [if not already present]
         Generating copyin(rho_zm(:,:)) [if not already present]
         Generating copyout(wprcp(:,:)) [if not already present]
         Generating copyin(sfc_elevation(:),wprtp_sfc(:),rtm_ref(:,:),rtp2_forcing(:,:),thlm_ref(:,:),thlp2_forcing(:,:)) [if not already present]
         Generating copy(rtp3(:,:)) [if not already present]
         Generating copyin(wm_zt(:,:)) [if not already present]
         Generating copy(wp2vp2(:,:)) [if not already present]
         Generating copyin(nu_vert_res_dep%nu9(:),err_info_api%err_header(:)) [if not already present]
         Generating copy(rc_coef_zm(:,:)) [if not already present]
         Generating copyout(cloud_cover(:,:)) [if not already present]
         Generating copyin(wpthlp_sfc(:)) [if not already present]
         Generating copy(wp2thlp(:,:),wp2thvp(:,:)) [if not already present]
         Generating copyin(rtpthlp_forcing(:,:)) [if not already present]
         Generating copyout(thlprcp(:,:)) [if not already present]
         Generating copy(wp2(:,:),wp2rtp(:,:),up3(:,:),vp3(:,:),pdf_params_zm%w_2(:,:),wp3(:,:),wpthvp(:,:),wpup2(:,:),wp2up(:,:),wp2up2(:,:)) [if not already present]
         Generating copyin(host_dy(:),um_forcing(:,:),vm_forcing(:,:)) [if not already present]
         Generating copy(upwp(:,:),vpwp(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present]
         Generating copyin(pdf_params) [if not already present]
         Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present]
         Generating copyin(pdf_params_zm) [if not already present]
         Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm(:,:),wp4(:,:)) [if not already present]
         Generating copyout(w_down_in_cloud(:,:)) [if not already present]
         Generating copyin(vpwp_sfc_pert(:)) [if not already present]
         Generating copyout(cloudy_downdraft_frac(:,:)) [if not already present]
         Generating copy(cloud_frac(:,:)) [if not already present]
         Generating copyin(invrs_rho_ds_zt(:,:)) [if not already present]
         Generating copyout(kh_zm(:,:),invrs_tau_zm(:,:)) [if not already present]
         Generating copy(thlp3(:,:)) [if not already present]
         Generating copyout(kh_zt(:,:)) [if not already present]
         Generating copyin(err_info_api) [if not already present]
         Generating copy(wpvp2(:,:)) [if not already present]
   1728, Generating copy(sclrm(:,:,:),wpsclrp(:,:,:)) [if not already present]
         Generating copyin(sclr_tol(:)) [if not already present]
         Generating copy(sclrpthvp(:,:,:)) [if not already present]
         Generating copyin(sclrm_forcing(:,:,:)) [if not already present]
         Generating copy(sclrp2(:,:,:),sclrp3(:,:,:),sclrprtp(:,:,:),sclrpthlp(:,:,:)) [if not already present]
         Generating copyin(wpsclrp_sfc(:,:)) [if not already present]
   1732, Generating copyin(edsclrm_forcing(:,:,:)) [if not already present]
         Generating copy(edsclrm(:,:,:)) [if not already present]
         Generating copyin(wpedsclrp_sfc(:,:)) [if not already present]
   1736, Generating copyin(wphydrometp(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:),l_mix_rat_hm(:),rtphmp_zt(:,:,:)) [if not already present]
calculate_thlp2_rad_api:
   1853, Generating copyin(radht(:,:),thlprcp(:,:)) [if not already present]
         Generating copy(thlp2_forcing(:,:)) [if not already present]
         Generating copyin(clubb_params(:,:),rcm(:,:)) [if not already present]
[ 40%] Linking Fortran static library libclubb_core_lib.a
[ 52%] Built target clubb_core_lib
Scanning dependencies of target text_writer_lib
[ 53%] Built target text_writer_lib
Scanning dependencies of target bugsrad_lib
Scanning dependencies of target KK_microphys_lib
Scanning dependencies of target morrison_microphys_lib
Scanning dependencies of target coamps_lib
[ 58%] Built target bugsrad_lib
[ 62%] Built target KK_microphys_lib
[ 62%] Building Fortran object src/Microphys/Morrison_microphys/CMakeFiles/morrison_microphys_lib.dir/module_mp_graupel.F90.o
[ 72%] Built target coamps_lib
Scanning dependencies of target silhs_lib
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/est_kessler_microphys_module.F90.o
  0 inform,   1 warnings,   0 severes, 0 fatal for module_mp_graupel
[ 73%] Building Fortran object src/SILHS/CMakeFiles/silhs_lib.dir/silhs_api_module.F90.o
generate_silhs_sample_api:
    268, Generating copyin(mu2(:,:,:),precip_fracs,precip_fracs%precip_frac_1(:,:),corr_cholesky_mtx_2(:,:,:,:)) [if not already present]
         Generating copyout(lh_sample_point_weights(:,:,:)) [if not already present]
         Generating copyin(corr_cholesky_mtx_1(:,:,:,:),lscale(:,:),mu1(:,:,:),precip_fracs%precip_frac_2(:,:),sigma1(:,:,:)) [if not already present]
         Generating copyout(x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) [if not already present]
         Generating copyin(sigma2(:,:,:),delta_zm(:,:)) [if not already present]
clip_transform_silhs_output_api:
    369, Generating copyout(lh_thl_clipped(:,:,:)) [if not already present]
         Generating copyin(pdf_params%cthl_2(:,:),pdf_params%rt_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_1(:,:),pdf_params%chi_2(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cthl_1(:,:),pdf_params,pdf_params%chi_1(:,:),pdf_params%thl_2(:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) [if not already present]
         Generating copyout(lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_rt_clipped(:,:,:)) [if not already present]
         Generating copyin(hm_metadata) [if not already present]
[ 73%] Linking Fortran static library libsilhs_lib.a
[ 75%] Built target silhs_lib
Scanning dependencies of target numerical_recipes_lib
Scanning dependencies of target radiation_lib
[ 76%] Building Fortran object src/Radiation/CMakeFiles/radiation_lib.dir/radiation_module.F90.o
[ 78%] Built target numerical_recipes_lib
radiation_driver:
    386, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        387, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        388,   ! blockidx%x threadidx%x collapsed
    386, Generating default present(frad_sw_down(:ngrdcol,:gr%nzm),frad_lw_down(:ngrdcol,:gr%nzm),frad_lw_up(:ngrdcol,:gr%nzm),frad(:ngrdcol,:gr%nzm),frad_sw_up(:ngrdcol,:gr%nzm),gr)
    397, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        398, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        399,   ! blockidx%x threadidx%x collapsed
    397, Generating default present(radht(:ngrdcol,:gr%nzt),gr)
    438, Generating update self(frad(:,:),frad_lw_up(:,:),radht_lw(:,:),p_in_pa(:,:),frad_lw(:,:),frad_sw(:,:),frad_lw_down(:,:),frad_sw_down(:,:),exner(:,:),radht_sw(:,:),rho_zm(:,:),thlm(:,:),rtm(:,:),frad_sw_up(:,:),cloud_frac(:,:),ice_supersat_frac(:,:),rho(:,:),rcm(:,:))
    465, Generating update device(frad(:,:),frad_lw_up(:,:),radht_lw(:,:),radht_sw(:,:),radht(:,:),frad_lw(:,:),frad_sw(:,:),frad_lw_down(:,:),frad_sw_down(:,:),frad_sw_up(:,:))
    478, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        479, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        480,   ! blockidx%x threadidx%x collapsed
    478, Generating default present(frad_lw(1:ngrdcol,1:gr%nzm),gr,frad_sw(1:ngrdcol,1:gr%nzm))
    486, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        487, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        488,   ! blockidx%x threadidx%x collapsed
    486, Generating default present(radht_sw(1:ngrdcol,1:gr%nzt),radht_lw(1:ngrdcol,1:gr%nzt),gr)
    511, Generating create(radht_sw_ddzm(:,:)) [if not already present]
    514, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        515, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        516,   ! blockidx%x threadidx%x collapsed
    514, Generating default present(rho(:ngrdcol,:gr%nzt),radht_sw(1:ngrdcol,1:gr%nzt),gr)
    527, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        528, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        529,   ! blockidx%x threadidx%x collapsed
    527, Generating default present(frad(:ngrdcol,:gr%nzm),frad_lw(1:ngrdcol,1:gr%nzm),gr,frad_sw(1:ngrdcol,1:gr%nzm))
    534, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        535, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        536,   ! blockidx%x threadidx%x collapsed
    534, Generating default present(radht(:ngrdcol,:gr%nzt),radht_sw(1:ngrdcol,1:gr%nzt),radht_lw(1:ngrdcol,1:gr%nzt),gr)
    548, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        549, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        550,   ! blockidx%x threadidx%x collapsed
    548, Generating default present(gr,frad(:ngrdcol,:gr%nzm))
    560, Generating update device(radht(:,:))
    562, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        563, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        564,   ! blockidx%x threadidx%x collapsed
    562, Generating default present(gr,frad(:ngrdcol,:gr%nzm))
update_radiation_variables:
    642, Generating update self(frad(:,:),frad_lw_up(:,:),frad_lw_down(:,:),frad_sw_down(:,:),frad_sw_up(:,:),radht(:,:))
    652, Generating update self(frad_lw(:,:),radht_lw(:,:),radht_sw(:,:),frad_sw(:,:))
[ 78%] Linking Fortran static library libradiation_lib.a
[ 80%] Built target radiation_lib
Scanning dependencies of target input_fields_lib
[ 83%] Built target input_fields_lib
Scanning dependencies of target benchmark_cases_lib
Scanning dependencies of target G_unit_test_lib
[ 83%] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/rev_direction_grid_test.F90.o
[ 83%] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/prescribe_forcings.F90.o
[ 83%] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/spurious_source_test.F90.o
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 219)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 223)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 276)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_cmake_test/src/G_unit_test_types/spurious_source_test.F90: 279)
[ 83%] Linking Fortran static library libmorrison_microphys_lib.a
[ 83%] Built target morrison_microphys_lib
Scanning dependencies of target microphys_lib
prescribe_forcings:
    299, Generating enter data create(thlm_bot(:),um_bot(:),vm_bot(:),z_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:))
    315, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        316, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        317,   ! blockidx%x threadidx%x collapsed
    315, Generating default present(rtm_forcing(:ngrdcol,:nzt),thlm_forcing(:ngrdcol,:nzt))
    323, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        324, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        325,   ! blockidx%x threadidx%x collapsed
    323, Generating default present(rtp2_forcing(:ngrdcol,:nzm),rtpthlp_forcing(:ngrdcol,:nzm),wpthlp_forcing(:ngrdcol,:nzm),wprtp_forcing(:ngrdcol,:nzm),thlp2_forcing(:ngrdcol,:nzm))
    371, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        372, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    371, Generating default present(rtm_forcing(:ngrdcol,nzt),thlm_forcing(:ngrdcol,nzt))
    372, Generating implicit firstprivate(nzt)
    444, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        445, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        446,   ! blockidx%x threadidx%x collapsed
    444, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
    468, Generating update self(p_in_pa(:,:))
    474, Generating update device(rtm_forcing(:,:),um_ref(:,:),thlm_forcing(:,:),edsclrm_forcing(:,:,:),sclrm_forcing(:,:,:),vm_ref(:,:),wm_zt(:,:),wm_zm(:,:))
    493, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        494, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        495,   ! blockidx%x threadidx%x collapsed
    493, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
    502, Generating implicit firstprivate(sclr_dim,ngrdcol)
         Generating NVIDIA GPU code
        503, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        504,   ! blockidx%x threadidx%x collapsed
        505, !$acc loop seq
    502, Generating default present(sclrm_forcing(:ngrdcol,:gr%nzt,:sclr_dim),gr)
    505, Loop is parallelizable
    513, Generating implicit firstprivate(ngrdcol,edsclr_dim)
         Generating NVIDIA GPU code
        514, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        515,   ! blockidx%x threadidx%x collapsed
        516, !$acc loop seq
    513, Generating default present(gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:edsclr_dim))
    516, Loop is parallelizable
    594, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        595, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    594, Generating default present(ustar(:ngrdcol))
    618, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        619, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    618, Generating default present(ustar(:ngrdcol))
    632, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        633, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    632, Generating default present(ustar(:ngrdcol))
    654, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        655, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    654, Generating default present(ustar(:ngrdcol))
    792, Generating update self(rho_bot(:))
    795, Generating update device(ustar(:),wpthlp_sfc(:),wprtp_sfc(:))
    846, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        847, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    846, Generating default present(ustar(:ngrdcol))
    874, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        875, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    874, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol))
    875, Generating implicit firstprivate(sens_ht,latent_ht)
    881, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        882, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        883,   ! blockidx%x threadidx%x collapsed
    881, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_thl),sclr_idx)
    883, Generating implicit firstprivate(sens_ht)
    890, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        891, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        892,   ! blockidx%x threadidx%x collapsed
    890, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_rt),sclr_idx)
    892, Generating implicit firstprivate(latent_ht)
    904, Generating update self(rho_zm(:,:),upwp_sfc(:),ustar(:),t_sfc(:),vpwp_sfc(:),wpthlp_sfc(:),wprtp_sfc(:))
    915, Generating exit data delete(thlm_bot(:),um_bot(:),z_bot(:),vm_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:))
[ 84%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/morrison_microphys_module.F90.o
[ 84%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
[ 84%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[ 84%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_init_cleanup.F90.o
read_surface_var_for_bc:
   1020, Generating create(thlm_zm(:,:),um_zm(:,:),vm_zm(:,:),k_min(:),rtm_zm(:,:),exner_zm(:,:)) [if not already present]
   1025, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1026, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1025, Generating default present(exner_bot(:ngrdcol),gr,z_bot(:ngrdcol),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um(:ngrdcol,:1),um_bot(:ngrdcol),vm(:ngrdcol,:1),rho_zm(:ngrdcol,:1),rtm(:ngrdcol,:1),rtm_bot(:ngrdcol),thlm(:ngrdcol,:1),rho_bot(:ngrdcol),p_sfc(:ngrdcol),gr%zt(1:ngrdcol,1))
   1045, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1046, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
       1053, !$acc loop seq
   1045, Generating default present(gr,z_bot(:ngrdcol),gr%zt(1:ngrdcol,:))
   1046, Generating implicit firstprivate(k,min_val)
   1053, Loop carried scalar dependence for min_val at line 1054
         Loop carried reuse of k_min prevents parallelization
   1063, Generating update self(k_min(:))
   1096, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1097, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1096, Generating default present(gr,rho_bot(:ngrdcol),p_sfc(:ngrdcol),exner_bot(:ngrdcol),z_bot(:),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um_bot(:ngrdcol),rtm_bot(:ngrdcol),rho_zm(:ngrdcol,:))
   1097, Generating implicit firstprivate(k00,km1,kp2,kp1)
advance_hydrometeor:
    823, Generating copyin(gr,hydromet(:,:,ihm),gr%invrs_dzm(:,:)) [if not already present]
         Generating copyout(xpwp(:,:)) [if not already present]
         Generating copyin(k_hm_nu_hm(:,:)) [if not already present]
    949, Generating copyin(gr,hydromet(:,:,ihm),gr%invrs_dzm(:,:)) [if not already present]
         Generating copyout(xpwp(:,:)) [if not already present]
         Generating copyin(k_hm_nu_hm(:,:)) [if not already present]
    990, Generating update device(wphydrometp(:,:,ihm))
[ 84%] Linking Fortran static library libG_unit_test_lib.a
advance_ncm:
   1202, Generating copyin(gr,gr%invrs_dzm(:,:),k_nc_nu_hm(:,:),ncm(:,:)) [if not already present]
         Generating copyout(xpwp(:,:)) [if not already present]
   1365, Generating copyin(gr,gr%invrs_dzm(:,:),k_nc_nu_hm(:,:)) [if not already present]
         Generating copyout(xpwp(:,:)) [if not already present]
         Generating copyin(ncm(:,:)) [if not already present]
microphys_solve:
   1540, Generating copyout(hmm(:,:)) [if not already present]
         Generating copyin(rhs(:,:),lhs(:,:,:)) [if not already present]
microphys_lhs:
   1812, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
         Generating copyout(lhs_ta(:,:,:)) [if not already present]
         Generating copyin(gr%invrs_dzt(:,:),nu_col(:),rho_ds_zm_col(:,:),kh_zt(:,:)) [if not already present]
   1844, Generating copyin(gr%invrs_dzt(:,:),gr%invrs_dzm(:,:),gr,wm_zt_col(:,:)) [if not already present]
         Generating copyout(lhs_ma(:,:,:)) [if not already present]
         Generating copyin(gr%weights_zt2zm(:,:,:)) [if not already present]
[ 85%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/pdf_hydromet_microphys_wrapper.F90.o
microphys_rhs:
   2144, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
         Generating copyout(lhs_ta(:,:,:)) [if not already present]
         Generating copyin(gr%invrs_dzt(:,:),nu_col(:),rho_ds_zm_col(:,:),kh_zt(:,:)) [if not already present]
[ 88%] Built target G_unit_test_lib
[ 88%] Linking Fortran static library libbenchmark_cases_lib.a
[ 95%] Built target benchmark_cases_lib
pdf_hydromet_microphys_prep:
    235, Generating update self(cloud_frac(:,:),ice_supersat_frac(:,:),kh_zm(:,:))
    237, Generating update self(wphydrometp(:,:,:))
    287, Generating update device(corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:),sigma_x_1_n(:,:,:),mu_x_2_n(:,:,:),mu_x_1_n(:,:,:),corr_cholesky_mtx_2(:,:,:,:),sigma_x_2_n(:,:,:))
    290, Generating update device(rtphmp_zt(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:))
    369, Generating update self(lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),x_nl_all_levs(:,:,:,:),rho_ds_zt(:,:),lh_rv_clipped(:,:,:),lh_thl_clipped(:,:,:))
[ 95%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
kk_upscaled_microphys:
   1112, Generating update self(rtp2_mc(:,:),rtpthlp_mc(:,:),wpthlp_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:))
[ 95%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
est_silhs_tndcy:
    288, Generating update self(lh_rtp2_mc(:,:),lh_wpthlp_mc(:,:),lh_wprtp_mc(:,:),lh_thlp2_mc(:,:),lh_rtpthlp_mc(:,:))
morrison_microphys_driver:
    398, Generating copyout(t_in_k_core(:,:)) [if not already present]
         Generating copyin(thlm(:,:),exner(:,:),rcm(:,:)) [if not already present]
[ 96%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/lh_microphys_driver_module.F90.o
[ 96%] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
calc_microphys_scheme_tendcies:
    393, Generating copyout(skw_zm(:,:)) [if not already present]
         Generating copyin(wp3_zm(:,:),wp2(:,:),clubb_params(:,:)) [if not already present]
    453, Generating copyin(thlm(:,:)) [if not already present]
         Generating copyout(t_in_k(:,:)) [if not already present]
         Generating copyin(exner(:,:),rcm(:,:)) [if not already present]
[ 96%] Linking Fortran static library libmicrophys_lib.a
[ 96%] Built target microphys_lib
Scanning dependencies of target G_unit_tests
Scanning dependencies of target clubb_driver_lib
[ 96%] Building Fortran object src/CMakeFiles/G_unit_tests.dir/G_unit_tests.F90.o
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/generalized_grid_test.F90.o
[ 97%] Linking Fortran executable G_unit_tests
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[ 97%] Built target G_unit_tests
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/clubb_driver.F90.o
init_clubb_case:
   2733, Generating enter data create(pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:))
         Generating enter data copyin(pdf_params_zm%mixt_frac(:,:))
         Generating enter data create(pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:))
         Generating enter data copyin(pdf_params_zm)
         Generating enter data create(pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:))
         Generating enter data copyin(pdf_params%mixt_frac(:,:))
         Generating enter data create(pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:))
         Generating enter data copyin(pdf_params)
         Generating enter data create(pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:))
         Generating enter data copyin(err_info,thv_ds_zt_init(:))
         Generating enter data create(rcm_mc(:,:),corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:))
         Generating enter data copyin(clubb_params(:,:))
         Generating enter data create(sigma_x_1_n(:,:,:))
         Generating enter data copyin(sfc_soil_t_in_k_init(:))
         Generating enter data create(mu_x_1_n(:,:,:),lscale(:,:),kh_zt(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),wpvp2(:,:),x_mixt_comp_all_levs(:,:,:),lh_thl_clipped(:,:,:),invrs_tau_zm(:,:),kh_zm(:,:))
         Generating enter data copyin(invrs_rho_ds_zt_init(:))
         Generating enter data create(cloud_frac(:,:),cloudy_downdraft_frac(:,:),vpwp_sfc_pert(:),w_down_in_cloud(:,:),wp4(:,:),rcm(:,:),vpwp(:,:))
         Generating enter data copyin(upwp_init(:),vm_init(:),um_init(:),hm_metadata)
         Generating enter data create(wp2up2(:,:),wp2up(:,:),wpup2(:,:),wpthvp(:,:),wp3(:,:),radht(:,:),vp3(:,:),up3(:,:),wp2rtp(:,:),wp2thvp(:,:))
         Generating enter data copyin(wp2_init(:))
         Generating enter data create(wpthlp_sfc(:),cloud_cover(:,:),rc_coef_zm(:,:))
         Generating enter data copyin(err_info%err_header(:),nu_vert_res_dep%nu9(:))
         Generating enter data create(thlp2_mc(:,:),rtp2_mc(:,:))
         Generating enter data copyin(t_sfc(:),vp2_init(:),up2_init(:),vm_ref_init(:),um_ref_init(:))
         Generating enter data create(vprcp(:,:))
         Generating enter data copyin(vg_init(:))
         Generating enter data create(uprcp(:,:))
         Generating enter data copyin(ug_init(:))
         Generating enter data create(thlm_mc(:,:))
         Generating enter data copyin(rtm_init(:))
         Generating enter data create(vpwp_sfc(:),upwp_sfc(:))
         Generating enter data copyin(thv_ds_zm_init(:))
         Generating enter data create(thlpthvp(:,:))
         Generating enter data copyin(invrs_rho_ds_zm_init(:))
         Generating enter data create(ice_supersat_frac(:,:))
         Generating enter data copyin(rho_ds_zm_init(:))
         Generating enter data create(rho(:,:),rfrzm(:,:))
         Generating enter data copyin(rho_init(:))
         Generating enter data create(thlprcp(:,:),rtpthlp_mc(:,:),wp2thlp(:,:),wp2vp2(:,:))
         Generating enter data copyin(wm_zt_init(:))
         Generating enter data create(rtp3(:,:))
         Generating enter data copyin(thlm_ref_init(:),rtm_ref_init(:))
         Generating enter data create(wprtp_sfc(:),wprcp(:,:),thlp3(:,:),rtpthlp_forcing(:,:),thlp2_forcing(:,:),rtp2_forcing(:,:),wpthlp_forcing(:,:),wprtp_forcing(:,:))
         Generating enter data copyin(pdf_params_zm%w_2(:,:),thlm_init(:))
         Generating enter data create(rtpthvp(:,:))
         Generating enter data copyin(rcm_init(:))
         Generating enter data create(upwp_sfc_pert(:))
         Generating enter data copyin(sfc_elevation(:))
         Generating enter data create(corr_cholesky_mtx_2(:,:,:,:),vpwp_pert(:,:),upwp_pert(:,:),wprtp_mc(:,:),wpthlp_mc(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),wpthlp(:,:),wprtp(:,:),w_up_in_cloud(:,:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),vm_pert(:,:),um_pert(:,:))
         Generating enter data copyin(veg_t_in_k_init(:),thvm_init(:),wm_zm_init(:),rho_zm_init(:))
         Generating enter data create(err_info%err_code(:))
         Generating enter data copyin(em_init(:))
         Generating enter data create(vm_ref(:,:),veg_t_in_k(:),sfc_soil_t_in_k(:),deep_soil_t_in_k(:),um_ref(:,:),thlm_ref(:,:),rtm_ref(:,:),thv_ds_zt(:,:),thv_ds_zm(:,:),invrs_rho_ds_zt(:,:),invrs_rho_ds_zm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),rho_zm(:,:))
         Generating enter data copyin(rho_ds_zt_init(:),p_in_pa_init(:))
         Generating enter data create(p_in_pa(:,:),thvm(:,:),exner(:,:))
         Generating enter data copyin(dummy_dy(:))
         Generating enter data create(wm_zm(:,:),wm_zt(:,:),rcm_in_layer(:,:),upwp(:,:),vp2(:,:),up2(:,:),wp2(:,:),vg(:,:),ug(:,:),vm_forcing(:,:),um_forcing(:,:),rtm_forcing(:,:),thlm_forcing(:,:),pdf_params_zm%ice_supersat_frac_2(:,:))
         Generating enter data copyin(pdf_params_zm%varnce_w_1(:,:))
         Generating enter data create(pdf_params_zm%varnce_thl_2(:,:))
         Generating enter data copyin(pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:))
         Generating enter data create(pdf_params%ice_supersat_frac_2(:,:))
         Generating enter data copyin(pdf_params%varnce_w_1(:,:))
         Generating enter data create(pdf_params%varnce_thl_2(:,:))
         Generating enter data copyin(pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),deep_soil_t_in_k_init(:),dummy_dx(:),deltaz(:),sclr_idx,fcor(:),exner_init(:),p_in_pa_zm_init(:))
         Generating enter data create(sigma_x_2_n(:,:,:))
         Generating enter data copyin(gr%zt(:,:))
         Generating enter data create(cloudy_updraft_frac(:,:),rvm_mc(:,:))
         Generating enter data copyin(pdf_params%w_2(:,:),p_sfc(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep,nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu10(:))
         Generating enter data create(mu_x_2_n(:,:,:))
         Generating enter data copyin(gr%invrs_dzt(:,:),gr%weights_zm2zt(:,:,:),gr%dzt(:,:),gr%invrs_dzm(:,:),gr%dzm(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:),fcor_y(:))
         Generating enter data create(x_nl_all_levs(:,:,:,:))
   2808, Generating enter data create(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp3(:,:,:),sclrp2(:,:,:))
         Generating enter data copyin(sclrm_init(:,:))
         Generating enter data create(sclrpthvp(:,:,:))
         Generating enter data copyin(sclr_tol(:))
         Generating enter data create(wpsclrp(:,:,:),sclrm(:,:,:),sclrm_forcing(:,:,:),wpsclrp_sfc(:,:))
   2813, Generating enter data create(edsclrm(:,:,:))
         Generating enter data copyin(edsclrm_init(:,:))
         Generating enter data create(edsclrm_forcing(:,:,:),wpedsclrp_sfc(:,:))
   2817, Generating enter data create(rtphmp_zt(:,:,:))
         Generating enter data copyin(hm_metadata%l_mix_rat_hm(:))
         Generating enter data create(thlphmp_zt(:,:,:),wphydrometp(:,:,:),wp2hmp(:,:,:))
set_case_initial_conditions:
   2952, Generating implicit firstprivate(ngrdcol,lh_num_samples)
         Generating NVIDIA GPU code
       2953, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       2954,   ! blockidx%x threadidx%x collapsed
       2955,   ! blockidx%x threadidx%x collapsed
       2956, !$acc loop seq
   2952, Generating default present(x_nl_all_levs(1:ngrdcol,1:lh_num_samples,1:gr%nzt,:),x_mixt_comp_all_levs(1:ngrdcol,1:lh_num_samples,1:gr%nzt),lh_sample_point_weights(1:ngrdcol,1:lh_num_samples,1:gr%nzt),gr)
   2956, Loop is parallelizable
   2963, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       2964, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2965,   ! blockidx%x threadidx%x collapsed
   2963, Generating default present(um_forcing(1:ngrdcol,1:gr%nzt),ug_init(1:gr%nzt),vm_forcing(1:ngrdcol,1:gr%nzt),vg_init(1:gr%nzt),um_ref_init(1:gr%nzt),vm_ref_init(1:gr%nzt),thlm_forcing(1:ngrdcol,1:gr%nzt),rvm_mc(1:ngrdcol,1:gr%nzt),rtm_forcing(1:ngrdcol,1:gr%nzt),rho_init(1:gr%nzt),w_down_in_cloud(1:ngrdcol,1:gr%nzt),vp3(1:ngrdcol,1:gr%nzt),cloudy_downdraft_frac(1:ngrdcol,1:gr%nzt),cloud_frac(1:ngrdcol,1:gr%nzt),wp2up(1:ngrdcol,1:gr%nzt),p_in_pa(1:ngrdcol,1:gr%nzt),lscale(1:ngrdcol,1:gr%nzt),exner(1:ngrdcol,1:gr%nzt),cloudy_updraft_frac(1:ngrdcol,1:gr%nzt),rho_ds_zt_init(1:gr%nzt),rfrzm(1:ngrdcol,1:gr%nzt),rho_ds_zt(1:ngrdcol,1:gr%nzt),rho(1:ngrdcol,1:gr%nzt),invrs_rho_ds_zt(1:ngrdcol,1:gr%nzt),ice_supersat_frac(1:ngrdcol,1:gr%nzt),thv_ds_zt(1:ngrdcol,1:gr%nzt),thlp3(1:ngrdcol,1:gr%nzt),thlm(1:ngrdcol,1:gr%nzt),rtm(1:ngrdcol,1:gr%nzt),um(1:ngrdcol,1:gr%nzt),vm(1:ngrdcol,1:gr%nzt),um_init(1:gr%nzt),vm_init(1:gr%nzt),wm_zt(1:ngrdcol,1:gr%nzt),w_up_in_cloud(1:ngrdcol,1:gr%nzt),rcm_in_layer(1:ngrdcol,1:gr%nzt),radht(1:ngrdcol,1:gr%nzt),cloud_cover(1:ngrdcol,1:gr%nzt),gr,rcm(1:ngrdcol,1:gr%nzt),ug(1:ngrdcol,1:gr%nzt),thvm_init(1:gr%nzt),vg(1:ngrdcol,1:gr%nzt),up3(1:ngrdcol,1:gr%nzt),um_ref(1:ngrdcol,1:gr%nzt),um_pert(1:ngrdcol,1:gr%nzt),vm_ref(1:ngrdcol,1:gr%nzt),vm_pert(1:ngrdcol,1:gr%nzt),thlm_ref(1:ngrdcol,1:gr%nzt),thlm_mc(1:ngrdcol,1:gr%nzt),rtm_ref(1:ngrdcol,1:gr%nzt),rtm_init(1:gr%nzt),thvm(1:ngrdcol,1:gr%nzt),thv_ds_zt_init(1:gr%nzt),p_in_pa_init(1:gr%nzt),thlm_ref_init(1:gr%nzt),rtm_ref_init(1:gr%nzt),wp2thlp(1:ngrdcol,1:gr%nzt),wp2thvp(1:ngrdcol,1:gr%nzt),wm_zt_init(1:gr%nzt),wp2rtp(1:ngrdcol,1:gr%nzt),wp3(1:ngrdcol,1:gr%nzt),wpvp2(1:ngrdcol,1:gr%nzt),wpup2(1:ngrdcol,1:gr%nzt),invrs_rho_ds_zt_init(1:gr%nzt),kh_zt(1:ngrdcol,1:gr%nzt),rtp3(1:ngrdcol,1:gr%nzt),rcm_init(1:gr%nzt),thlm_init(1:gr%nzt),rcm_mc(1:ngrdcol,1:gr%nzt),exner_init(1:gr%nzt))
   3020, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3021, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3022,   ! blockidx%x threadidx%x collapsed
   3020, Generating default present(upwp(1:ngrdcol,1:gr%nzm),uprcp(1:ngrdcol,1:gr%nzm),vprcp(1:ngrdcol,1:gr%nzm),up2(1:ngrdcol,1:gr%nzm),thv_ds_zm_init(1:gr%nzm),vp2(1:ngrdcol,1:gr%nzm),upwp_pert(1:ngrdcol,1:gr%nzm),wprcp(1:ngrdcol,1:gr%nzm),wprtp_mc(1:ngrdcol,1:gr%nzm),wp4(1:ngrdcol,1:gr%nzm),wp2(1:ngrdcol,1:gr%nzm),wm_zm_init(1:gr%nzm),rho_zm_init(1:gr%nzm),rtpthvp(1:ngrdcol,1:gr%nzm),rtp2_mc(1:ngrdcol,1:gr%nzm),rho_zm(1:ngrdcol,1:gr%nzm),rho_ds_zm_init(1:gr%nzm),rho_ds_zm(1:ngrdcol,1:gr%nzm),rc_coef_zm(1:ngrdcol,1:gr%nzm),invrs_rho_ds_zm(1:ngrdcol,1:gr%nzm),gr,thv_ds_zm(1:ngrdcol,1:gr%nzm),thlpthvp(1:ngrdcol,1:gr%nzm),wprtp(1:ngrdcol,1:gr%nzm),wpthlp(1:ngrdcol,1:gr%nzm),rtp2(1:ngrdcol,1:gr%nzm),thlp2(1:ngrdcol,1:gr%nzm),rtpthlp(1:ngrdcol,1:gr%nzm),upwp_init(1:gr%nzm),vpwp(1:ngrdcol,1:gr%nzm),wm_zm(1:ngrdcol,1:gr%nzm),vpwp_pert(1:ngrdcol,1:gr%nzm),invrs_rho_ds_zm_init(1:gr%nzm),thlp2_mc(1:ngrdcol,1:gr%nzm),rtpthlp_mc(1:ngrdcol,1:gr%nzm),thlprcp(1:ngrdcol,1:gr%nzm),wpthvp(1:ngrdcol,1:gr%nzm),wpthlp_mc(1:ngrdcol,1:gr%nzm),up2_init(1:gr%nzm),vp2_init(1:gr%nzm),kh_zm(1:ngrdcol,1:gr%nzm),wp2vp2(1:ngrdcol,1:gr%nzm),wp2_init(1:gr%nzm),wp2up2(1:ngrdcol,1:gr%nzm),invrs_tau_zm(1:ngrdcol,1:gr%nzm),wprtp_forcing(1:ngrdcol,1:gr%nzm),wpthlp_forcing(1:ngrdcol,1:gr%nzm),rtp2_forcing(1:ngrdcol,1:gr%nzm),thlp2_forcing(1:ngrdcol,1:gr%nzm),rtpthlp_forcing(1:ngrdcol,1:gr%nzm))
   3067, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3068, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   3067, Generating default present(wpthlp_sfc(1:ngrdcol),wprtp_sfc(1:ngrdcol),vpwp_sfc(1:ngrdcol),sfc_soil_t_in_k_init(:),veg_t_in_k_init(:),deep_soil_t_in_k(1:ngrdcol),sfc_soil_t_in_k(1:ngrdcol),deep_soil_t_in_k_init(:),veg_t_in_k(1:ngrdcol),upwp_sfc(1:ngrdcol))
   3081, Generating implicit firstprivate(ngrdcol,sclr_dim)
         Generating NVIDIA GPU code
       3082, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       3083,   ! blockidx%x threadidx%x collapsed
       3084,   ! blockidx%x threadidx%x collapsed
   3081, Generating default present(sclrm_forcing(1:ngrdcol,1:gr%nzt,1:sclr_dim),gr,sclrm(1:ngrdcol,1:gr%nzt,1:sclr_dim),sclrp3(1:ngrdcol,1:gr%nzt,1:sclr_dim),sclrm_init(1:gr%nzt,1:sclr_dim))
   3092, Generating implicit firstprivate(sclr_dim,ngrdcol)
         Generating NVIDIA GPU code
       3093, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       3094,   ! blockidx%x threadidx%x collapsed
       3095,   ! blockidx%x threadidx%x collapsed
   3092, Generating default present(sclrpthlp(1:ngrdcol,1:gr%nzm,1:sclr_dim),gr,sclr_tol(1:sclr_dim),sclrp2(1:ngrdcol,1:gr%nzm,1:sclr_dim),sclrprtp(1:ngrdcol,1:gr%nzm,1:sclr_dim),wpsclrp(1:ngrdcol,1:gr%nzm,1:sclr_dim),sclrpthvp(1:ngrdcol,1:gr%nzm,1:sclr_dim))
   3105, Generating implicit firstprivate(sclr_dim,ngrdcol)
         Generating NVIDIA GPU code
       3106, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3107,   ! blockidx%x threadidx%x collapsed
   3105, Generating default present(wpsclrp_sfc(1:ngrdcol,1:sclr_dim))
   3116, Generating implicit firstprivate(ngrdcol,edsclr_dim)
         Generating NVIDIA GPU code
       3117, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       3118,   ! blockidx%x threadidx%x collapsed
       3119,   ! blockidx%x threadidx%x collapsed
   3116, Generating default present(edsclrm_forcing(1:ngrdcol,1:gr%nzt,1:edsclr_dim),edsclrm(1:ngrdcol,1:gr%nzt,1:edsclr_dim),gr,edsclrm_init(1:gr%nzt,1:edsclr_dim))
   3126, Generating implicit firstprivate(ngrdcol,edsclr_dim)
         Generating NVIDIA GPU code
       3127, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3128,   ! blockidx%x threadidx%x collapsed
   3126, Generating default present(wpedsclrp_sfc(1:ngrdcol,1:edsclr_dim))
   3137, Generating implicit firstprivate(ngrdcol,hydromet_dim)
         Generating NVIDIA GPU code
       3138, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       3139,   ! blockidx%x threadidx%x collapsed
       3140,   ! blockidx%x threadidx%x collapsed
   3137, Generating default present(rtphmp_zt(1:ngrdcol,1:gr%nzt,1:hydromet_dim),gr,wp2hmp(1:ngrdcol,1:gr%nzt,1:hydromet_dim),thlphmp_zt(1:ngrdcol,1:gr%nzt,1:hydromet_dim))
   3148, Generating implicit firstprivate(ngrdcol,hydromet_dim)
         Generating NVIDIA GPU code
       3149, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       3150,   ! blockidx%x threadidx%x collapsed
       3151,   ! blockidx%x threadidx%x collapsed
   3148, Generating default present(wphydrometp(1:ngrdcol,1:gr%nzm,1:hydromet_dim),gr)
   3274, Generating update self(deltaz(:),gr%zm(:,:),gr%zt(:,:))
   3276, Generating update self(deltaz(:),gr%zt(:,:),gr%zm(:,:),clubb_params(:,:))
   3304, Generating update device(nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu9(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu10(:),clubb_params(:,:))
advance_clubb_to_end:
   3513, Generating update self(wp2thvp(:,:),thlp2(:,:),rtpthlp(:,:),wp2(:,:),wp2up(:,:),vm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),wprtp(:,:),rtpthvp(:,:),wp3(:,:),um(:,:),thlpthvp(:,:),wpthlp(:,:))
   3516, Generating update self(sclrm(:,:,:))
   3517, Generating update self(edsclrm(:,:,:))
   3583, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3584, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3585,   ! blockidx%x threadidx%x collapsed
   3583, Generating default present(rcm_mc(1:ngrdcol,1:gr%nzt),rtm_forcing(1:ngrdcol,1:gr%nzt),radht(1:ngrdcol,1:gr%nzt),rfrzm(1:ngrdcol,1:gr%nzt),gr,thlm_mc(1:ngrdcol,1:gr%nzt),thlm_forcing(1:ngrdcol,1:gr%nzt),rvm_mc(1:ngrdcol,1:gr%nzt))
   3601, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       3602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       3603,   ! blockidx%x threadidx%x collapsed
   3601, Generating default present(wprtp_forcing(1:ngrdcol,1:gr%nzm),thlp2_mc(1:ngrdcol,1:gr%nzm),wpthlp_mc(1:ngrdcol,1:gr%nzm),wpthlp_forcing(1:ngrdcol,1:gr%nzm),wprtp_mc(1:ngrdcol,1:gr%nzm),rtp2_forcing(1:ngrdcol,1:gr%nzm),gr,thlp2_forcing(1:ngrdcol,1:gr%nzm),rtpthlp_mc(1:ngrdcol,1:gr%nzm),rtpthlp_forcing(1:ngrdcol,1:gr%nzm),rtp2_mc(1:ngrdcol,1:gr%nzm))
   3614, Generating update self(rfrzm(:,:))
   3624, Generating update device(rfrzm(:,:))
   3843, Generating update self(pdf_params%varnce_w_1(:,:),pdf_params%thl_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rt_1(:,:),pdf_params%rc_2(:,:),pdf_params%chi_1(:,:),p_in_pa(:,:),pdf_params%cthl_2(:,:),kh_zm(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),corr_array_1_n(:,:,:,:),cloud_frac(:,:),sigma_x_1_n(:,:,:),rtm(:,:),mu_x_1_n(:,:,:),lh_thl_clipped(:,:,:),lh_rv_clipped(:,:,:),wp3(:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),invrs_rho_ds_zt(:,:),wp2(:,:),wm_zt(:,:),thlm(:,:),wm_zm(:,:),pdf_params%w_2(:,:),rho_zm(:,:),rho_ds_zt(:,:),rcm(:,:),corr_array_2_n(:,:,:,:),mu_x_2_n(:,:,:),sigma_x_2_n(:,:,:))
   3907, Generating update device(rtp2_mc(:,:),thlm_mc(:,:),rcm_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:),rvm_mc(:,:),rtpthlp_mc(:,:),wpthlp_mc(:,:))
   3909, Generating update device(wphydrometp(:,:,:))
   3932, Generating update self(cloud_frac(:,:),rcm(:,:),rho_zm(:,:),rho(:,:),exner(:,:))
   3944, Generating update device(thlm_mc(:,:),rcm_mc(:,:))
   3952, Generating update self(cloud_frac(:,:))
   3963, Generating update self(rtp2_mc(:,:),thlm_mc(:,:),rcm_mc(:,:),wpthlp_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:),rvm_mc(:,:),rtpthlp_mc(:,:))
clean_up_clubb:
   4276, Generating exit data delete(pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm,pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),pdf_params,pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),err_info,deep_soil_t_in_k_init(:),thv_ds_zt_init(:),rcm_mc(:,:),corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:),clubb_params(:,:),sigma_x_1_n(:,:,:),sfc_soil_t_in_k_init(:),mu_x_1_n(:,:,:),lscale(:,:),kh_zt(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),wpvp2(:,:),x_mixt_comp_all_levs(:,:,:),lh_thl_clipped(:,:,:),invrs_tau_zm(:,:),kh_zm(:,:),invrs_rho_ds_zt_init(:),cloud_frac(:,:),cloudy_downdraft_frac(:,:),vpwp_sfc_pert(:),w_down_in_cloud(:,:),wp4(:,:),rcm(:,:),vpwp(:,:),upwp_init(:),vm_init(:),um_init(:),hm_metadata,wp2up2(:,:),wp2up(:,:),wpup2(:,:),wpthvp(:,:),wp3(:,:),radht(:,:),vp3(:,:),up3(:,:),wp2rtp(:,:),wp2thvp(:,:),wp2_init(:),wpthlp_sfc(:),cloud_cover(:,:),rc_coef_zm(:,:),err_info%err_header(:),nu_vert_res_dep%nu9(:),thlp2_mc(:,:),rtp2_mc(:,:),t_sfc(:),vp2_init(:),up2_init(:),vm_ref_init(:),um_ref_init(:),vprcp(:,:),vg_init(:),uprcp(:,:),ug_init(:),thlm_mc(:,:),rtm_init(:),vpwp_sfc(:),upwp_sfc(:),thv_ds_zm_init(:),thlpthvp(:,:),invrs_rho_ds_zm_init(:),ice_supersat_frac(:,:),rho_ds_zm_init(:),rho(:,:),rfrzm(:,:),rho_init(:),thlprcp(:,:),rtpthlp_mc(:,:),wp2thlp(:,:),wp2vp2(:,:),wm_zt_init(:),rtp3(:,:),thlm_ref_init(:),rtm_ref_init(:),wprtp_sfc(:),wprcp(:,:),thlp3(:,:),rtpthlp_forcing(:,:),thlp2_forcing(:,:),rtp2_forcing(:,:),wpthlp_forcing(:,:),wprtp_forcing(:,:),pdf_params_zm%w_2(:,:),thlm_init(:),rtpthvp(:,:),rcm_init(:),upwp_sfc_pert(:),sfc_elevation(:),corr_cholesky_mtx_2(:,:,:,:),vpwp_pert(:,:),upwp_pert(:,:),wprtp_mc(:,:),wpthlp_mc(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),wpthlp(:,:),wprtp(:,:),w_up_in_cloud(:,:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),vm_pert(:,:),um_pert(:,:),veg_t_in_k_init(:),thvm_init(:),wm_zm_init(:),rho_zm_init(:),err_info%err_code(:),em_init(:),vm_ref(:,:),veg_t_in_k(:),sfc_soil_t_in_k(:),deep_soil_t_in_k(:),um_ref(:,:),thlm_ref(:,:),rtm_ref(:,:),thv_ds_zt(:,:),thv_ds_zm(:,:),invrs_rho_ds_zt(:,:),invrs_rho_ds_zm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),rho_zm(:,:),rho_ds_zt_init(:),p_in_pa_init(:),p_in_pa(:,:),thvm(:,:),exner(:,:),dummy_dy(:),wm_zm(:,:),wm_zt(:,:),rcm_in_layer(:,:),upwp(:,:),vp2(:,:),up2(:,:),wp2(:,:),vg(:,:),ug(:,:),vm_forcing(:,:),um_forcing(:,:),rtm_forcing(:,:),thlm_forcing(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),dummy_dx(:),deltaz(:),sclr_idx,fcor(:),exner_init(:),p_in_pa_zm_init(:),sigma_x_2_n(:,:,:),gr%zt(:,:),cloudy_updraft_frac(:,:),rvm_mc(:,:),pdf_params%w_2(:,:),p_sfc(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep,nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu10(:),mu_x_2_n(:,:,:),gr%invrs_dzt(:,:),gr%weights_zm2zt(:,:,:),gr%dzt(:,:),gr%invrs_dzm(:,:),gr%dzm(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:),fcor_y(:),x_nl_all_levs(:,:,:,:))
   4352, Generating exit data delete(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp3(:,:,:),sclrp2(:,:,:),sclrm_init(:,:),sclrpthvp(:,:,:),sclr_tol(:),wpsclrp(:,:,:),sclrm(:,:,:),sclrm_forcing(:,:,:),wpsclrp_sfc(:,:))
   4357, Generating exit data delete(edsclrm(:,:,:),edsclrm_init(:,:),edsclrm_forcing(:,:,:),wpedsclrp_sfc(:,:))
   4361, Generating exit data delete(rtphmp_zt(:,:,:),hm_metadata%l_mix_rat_hm(:),thlphmp_zt(:,:,:),wphydrometp(:,:,:),wp2hmp(:,:,:))
[ 97%] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/clubb_loss_driver.F90.o
[ 97%] Linking Fortran static library libclubb_driver_lib.a
[ 97%] Built target clubb_driver_lib
Scanning dependencies of target clubb_tuner
Scanning dependencies of target clubb_standalone
Scanning dependencies of target clubb_thread_test
Scanning dependencies of target clubb_driver_test
Scanning dependencies of target clubb_loss_driver_test
Scanning dependencies of target clubb_standalone_loss
[ 98%] Building Fortran object src/CMakeFiles/clubb_tuner.dir/error.F90.o
[ 98%] Building Fortran object src/CMakeFiles/clubb_standalone.dir/clubb_standalone.F90.o
[ 99%] Building Fortran object src/CMakeFiles/clubb_thread_test.dir/clubb_thread_test.F90.o
[ 99%] Building Fortran object src/CMakeFiles/clubb_loss_driver_test.dir/clubb_loss_driver_test.F90.o
[ 99%] Building Fortran object src/CMakeFiles/clubb_driver_test.dir/clubb_driver_test.F90.o
[100%] Building Fortran object src/CMakeFiles/clubb_standalone_loss.dir/clubb_standalone_loss.F90.o
[100%] Linking Fortran executable clubb_standalone_loss
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[100%] Linking Fortran executable clubb_standalone
[100%] Linking Fortran executable clubb_thread_test
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[100%] Linking Fortran executable clubb_driver_test
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[100%] Linking Fortran executable clubb_loss_driver_test
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[100%] Building Fortran object src/CMakeFiles/clubb_tuner.dir/clubb_tuner.F90.o
[100%] Built target clubb_standalone_loss
[100%] Built target clubb_driver_test
[100%] Built target clubb_standalone
[100%] Built target clubb_thread_test
[100%] Built target clubb_loss_driver_test
[100%] Linking Fortran executable clubb_tuner
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.

[100%] Built target clubb_tuner
Install the project...
-- Install configuration: "Release"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_tuner" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/G_unit_tests" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_thread_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone_loss
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone_loss" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
-- Installing: /home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_loss_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/clubb_loss_driver_test" to "/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib:/home/jenkins/workspace/clubb_cmake_test/install/nvhpc_GPUopenacc_PRECdouble/lib64:/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types

Build completed successfully, and all source code checks passed.

Running CMake ctests
Test project /home/jenkins/workspace/clubb_cmake_test/build/nvhpc_GPUopenacc_PRECdouble
      Start  1: _init_output_dir
 1/11 Test  #1: _init_output_dir .................   Passed    0.03 sec
      Start  2: bomex_100iter
 2/11 Test  #2: bomex_100iter ....................   Passed    4.54 sec
      Start  3: wangara_100iter
 3/11 Test  #3: wangara_100iter ..................   Passed    4.11 sec
      Start  4: fire_100iter
 4/11 Test  #4: fire_100iter .....................   Passed    4.34 sec
      Start  5: atex_100iter
 5/11 Test  #5: atex_100iter .....................   Passed    5.70 sec
      Start  6: rico_silhs_100iter
 6/11 Test  #6: rico_silhs_100iter ...............   Passed    5.17 sec
      Start  7: arm_97_50iter
 7/11 Test  #7: arm_97_50iter ....................   Passed    5.02 sec
      Start  8: cobra_100iter
 8/11 Test  #8: cobra_100iter ....................   Passed    5.55 sec
      Start  9: arm_r8029_100iter
 9/11 Test  #9: arm_r8029_100iter ................   Passed    4.75 sec
      Start 10: arm_100iter_8col
10/11 Test #10: arm_100iter_8col .................   Passed    2.72 sec
      Start 11: arm_1000iter_5dt
11/11 Test #11: arm_1000iter_5dt .................   Passed   22.68 sec

100% tests passed, 0 tests failed out of 11

Total Test time (real) =  64.63 sec
All tests passed.
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS