![[Jenkins]](/jenkins/static/57c8a776/images/svgs/logo.svg){kind=logo}
Started by an SCM change Obtained jenkins_tests/clubb_plot_nvhpc_gpu_vs_cpu/Jenkinsfile from git https://github.com/larson-group/clubb.git [Pipeline] Start of Pipeline [Pipeline] node Running on nelson in /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git Fetching changes from the remote Git repository Cleaning workspace > git rev-parse --resolve-git-dir /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/.git # timeout=10 > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10 > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -ffdx # timeout=10 Fetching upstream changes from https://github.com/larson-group/clubb.git > git --version # timeout=10 > git --version # 'git version 2.34.1' > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10 Checking out Revision 97516ee5ba8fdaacf484c04aa71a590a43989482 (refs/remotes/origin/master) Commit message: "Added a .json file for run_bindiff_w_flags that checks most of the core flags in configurable_model_flags, sectioned into 20 groups." > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 > git config core.sparsecheckout # timeout=10 > git checkout -f 97516ee5ba8fdaacf484c04aa71a590a43989482 # timeout=10 > git rev-list --no-walk 1fcbf0455fe43a2fc873f59afedf92e0824640a4 # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Modify Config Flags) [Pipeline] sh + sed -i 's:penta_solve_method.*:penta_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:tridiag_solve_method.*:tridiag_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:lh_straight_mc.*:lh_straight_mc = true:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile CPU) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-qorv6nkkjzyzntx6wbjupmoxrot26t6r/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + compile/compile.bash -c config/linux_x86_64_nvhpc.bash ......................................................................................................................................................................... Make.clubb_lapack is ready. .................................................................................. Make.clubb_param is ready. ......................... Make.clubb_bugsrad is ready. ... Make.microphys_utils is ready. ..... Make.clubb_parabolic is ready. .............. Make.clubb_KK_microphys is ready. ................................................. Make.clubb_coamps is ready. ... Make.clubb_morrison is ready. ... Make.clubb_gfdlact is ready. ............. Make.silhs is ready. .................................................................. Make.clubb_other is ready. ... Make.clubb_standalone is ready. ... Make.clubb_thread_test is ready. ............ Make.clubb_tuner is ready. ... Make.jacobian is ready. ................ Make.G_unit_tests is ready. ... Make.int2txt is ready. cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_param cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_gfdlact make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SCM_Activation/aer_ccn_act_k.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mt95.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clubb_precision.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/error_code.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/input_names.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/model_flags.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/lapack_interfaces.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/array_index.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameter_indices.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stat_file_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_variables.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameters_model.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/penta_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/tridiag_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/endian.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/code_timer_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/constants_clubb.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_type.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/interpolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/matrix_operations.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/hydromet_pdf_parameter_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/file_functions.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_parameter_module.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_gfdlact.a aer_ccn_act_k.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_gfdlact.a a - aer_ccn_act_k.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_type_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/saturation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/T_in_K_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/lapack_wrap.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/Skx_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sigma_sqd_w_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calendar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_lh_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_lh_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calc_roots.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_hybrid_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_tsdadg_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/LY93_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/precipitation_fraction.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/Nc_Ncn_eqns.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/diagnose_correlations_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/input_reader.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/grid_class.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_rad_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_rad_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/matrix_solver_wrapper.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/output_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/adg1_adg2_3d_luhar_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/corr_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameters_tunable.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sponge_layer_damping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_helper_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mean_adv.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/turbulent_adv_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/diffusion.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pos_definite_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clip_explicit.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/index_mapping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calc_pressure.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/output_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mono_flux_limiter.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/fill_holes.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_windm_edsclrm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/numerical_check.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xm_wpxp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xp2_xpyp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_wp2_wp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_hybrid_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/setup_clubb_pdf_params.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sfc_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mixing_length.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_clubb_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_closure_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_clubb_core_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clubb_api_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/grid_adaptation.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_param.a clubb_api_module.o new_pdf_main.o error_code.o advance_xp2_xpyp_module.o penta_lu_solver.o stat_file_module.o advance_helper_module.o grid_class.o stats_sfc_module.o output_grads.o stats_lh_zt_module.o lapack_wrap.o tridiag_lu_solver.o Skx_module.o stats_lh_sfc_module.o precipitation_fraction.o diffusion.o adg1_adg2_3d_luhar_pdf.o setup_clubb_pdf_params.o output_netcdf.o Nc_Ncn_eqns.o hydromet_pdf_parameter_module.o sigma_sqd_w_module.o stats_rad_zt_module.o pdf_utilities.o mt95.o clubb_precision.o T_in_K_module.o sfc_varnce_module.o saturation.o stats_variables.o parameter_indices.o turbulent_adv_pdf.o mono_flux_limiter.o advance_wp2_wp3_module.o new_hybrid_pdf.o model_flags.o LY93_pdf.o stats_zt_module.o pdf_parameter_module.o code_timer_module.o diagnose_correlations_module.o numerical_check.o interpolation.o pdf_closure_module.o advance_xm_wpxp_module.o corr_varnce_module.o grid_adaptation.o input_names.o new_hybrid_pdf_main.o sponge_layer_damping.o advance_windm_edsclrm_module.o stats_zm_module.o advance_clubb_core_module.o array_index.o advance_xp3_module.o lapack_interfaces.o parameters_tunable.o stats_clubb_utilities.o fill_holes.o input_reader.o index_mapping.o file_functions.o matrix_operations.o calendar.o parameters_model.o endian.o new_pdf.o calc_roots.o clip_explicit.o matrix_solver_wrapper.o stats_type.o mixing_length.o pos_definite_module.o constants_clubb.o stats_rad_zm_module.o new_tsdadg_pdf.o calc_pressure.o stats_type_utilities.o mean_adv.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_param.a a - clubb_api_module.o a - new_pdf_main.o a - error_code.o a - advance_xp2_xpyp_module.o a - penta_lu_solver.o a - stat_file_module.o a - advance_helper_module.o a - grid_class.o a - stats_sfc_module.o a - output_grads.o a - stats_lh_zt_module.o a - lapack_wrap.o a - tridiag_lu_solver.o a - Skx_module.o a - stats_lh_sfc_module.o a - precipitation_fraction.o a - diffusion.o a - adg1_adg2_3d_luhar_pdf.o a - setup_clubb_pdf_params.o a - output_netcdf.o a - Nc_Ncn_eqns.o a - hydromet_pdf_parameter_module.o a - sigma_sqd_w_module.o a - stats_rad_zt_module.o a - pdf_utilities.o a - mt95.o a - clubb_precision.o a - T_in_K_module.o a - sfc_varnce_module.o a - saturation.o a - stats_variables.o a - parameter_indices.o a - turbulent_adv_pdf.o a - mono_flux_limiter.o a - advance_wp2_wp3_module.o a - new_hybrid_pdf.o a - model_flags.o a - LY93_pdf.o a - stats_zt_module.o a - pdf_parameter_module.o a - code_timer_module.o a - diagnose_correlations_module.o a - numerical_check.o a - interpolation.o a - pdf_closure_module.o a - advance_xm_wpxp_module.o a - corr_varnce_module.o a - grid_adaptation.o a - input_names.o a - new_hybrid_pdf_main.o a - sponge_layer_damping.o a - advance_windm_edsclrm_module.o a - stats_zm_module.o a - advance_clubb_core_module.o a - array_index.o a - advance_xp3_module.o a - lapack_interfaces.o a - parameters_tunable.o a - stats_clubb_utilities.o a - fill_holes.o a - input_reader.o a - index_mapping.o a - file_functions.o a - matrix_operations.o a - calendar.o a - parameters_model.o a - endian.o a - new_pdf.o a - calc_roots.o a - clip_explicit.o a - matrix_solver_wrapper.o a - stats_type.o a - mixing_length.o a - pos_definite_module.o a - constants_clubb.o a - stats_rad_zm_module.o a - new_tsdadg_pdf.o a - calc_pressure.o a - stats_type_utilities.o a - mean_adv.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_lapack make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/scopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_shared/lsame.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iladlr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/snrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/disnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dnrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dcopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ilaslc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlamch.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlamch.f: 109) 0 inform, 1 warnings, 0 severes, 0 fatal for dlamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slamch.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sswap.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slamch.f: 113) 0 inform, 1 warnings, 0 severes, 0 fatal for slamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/stbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ddot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/idamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_shared/xerbla.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/drscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ilaslr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ilaenv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/srscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sdot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ieeeck.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iladlc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/saxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/daxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/isamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iparmq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtf2.f ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_lapack.a scopy.o dgtts2.o slaev2.o dlarf.o slabad.o dsyev.o dasum.o sscal.o lsame.o sorg2r.o sorg2l.o iladlr.o dlantb.o snrm2.o sgbequ.o sgttrf.o sisnan.o dlabad.o ssyev.o sasum.o dscal.o slarf.o dgttrf.o disnan.o dorg2r.o slantb.o dorg2l.o dgbequ.o dnrm2.o dcopy.o dlaev2.o sgtts2.o dlangt.o spoequ.o sgtcon.o dsteqr.o ilaslc.o dsyr2k.o dsyr2.o slaswp.o slatrd.o slagtm.o sgbtrs.o slassq.o slartg.o slaset.o dtrsm.o dlatbs.o dgbsv.o slacn2.o ssymv.o sgtrfs.o dgtsvx.o dlanst.o dtbsv.o dlarft.o ssytrd.o dtrmv.o dlamch.o dlascl.o dswap.o dtrmm.o dgbmv.o dsymv.o dgtrfs.o sgtsvx.o slanst.o slatbs.o strsm.o sgbsv.o dlacn2.o slascl.o slamch.o sswap.o strmm.o sgbmv.o slarft.o stbsv.o dsytrd.o strmv.o ssteqr.o slangt.o dpoequ.o dgtcon.o dgbtrs.o dlassq.o dlartg.o dlaset.o ssyr2k.o ssyr2.o dlaswp.o dlatrd.o dlagtm.o dsyrk.o sgemm.o ddot.o idamax.o sgemv.o dgbrfs.o xerbla.o sgbsvx.o dlarfb.o ssytd2.o sgtsv.o dgttrs.o slaqsy.o dlangb.o drscl.o slae2.o dpotrf.o ilaslr.o sger.o dgbcon.o dlasr.o ilaenv.o dlae2.o dlaqsy.o sgttrs.o slangb.o srscl.o sgbcon.o slasr.o spotrf.o dger.o sdot.o dgemv.o ssyrk.o dgemm.o dgtsv.o ieeeck.o sgbrfs.o dgbsvx.o slarfb.o dsytd2.o dgbtrf.o iladlc.o sgbtf2.o dpotrf2.o slarfg.o dorgqr.o dorgql.o sorgtr.o saxpy.o dlansy.o dlasrt.o slaqgb.o dlacpy.o dlaisnan.o dsterf.o slapy2.o slansy.o dlaqgb.o slasrt.o slacpy.o dorgtr.o daxpy.o ssterf.o dlapy2.o slaisnan.o isamax.o sgbtrf.o iparmq.o spotrf2.o dlarfg.o sorgql.o sorgqr.o dgbtf2.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_lapack.a a - scopy.o a - dgtts2.o a - slaev2.o a - dlarf.o a - slabad.o a - dsyev.o a - dasum.o a - sscal.o a - lsame.o a - sorg2r.o a - sorg2l.o a - iladlr.o a - dlantb.o a - snrm2.o a - sgbequ.o a - sgttrf.o a - sisnan.o a - dlabad.o a - ssyev.o a - sasum.o a - dscal.o a - slarf.o a - dgttrf.o a - disnan.o a - dorg2r.o a - slantb.o a - dorg2l.o a - dgbequ.o a - dnrm2.o a - dcopy.o a - dlaev2.o a - sgtts2.o a - dlangt.o a - spoequ.o a - sgtcon.o a - dsteqr.o a - ilaslc.o a - dsyr2k.o a - dsyr2.o a - slaswp.o a - slatrd.o a - slagtm.o a - sgbtrs.o a - slassq.o a - slartg.o a - slaset.o a - dtrsm.o a - dlatbs.o a - dgbsv.o a - slacn2.o a - ssymv.o a - sgtrfs.o a - dgtsvx.o a - dlanst.o a - dtbsv.o a - dlarft.o a - ssytrd.o a - dtrmv.o a - dlamch.o a - dlascl.o a - dswap.o a - dtrmm.o a - dgbmv.o a - dsymv.o a - dgtrfs.o a - sgtsvx.o a - slanst.o a - slatbs.o a - strsm.o a - sgbsv.o a - dlacn2.o a - slascl.o a - slamch.o a - sswap.o a - strmm.o a - sgbmv.o a - slarft.o a - stbsv.o a - dsytrd.o a - strmv.o a - ssteqr.o a - slangt.o a - dpoequ.o a - dgtcon.o a - dgbtrs.o a - dlassq.o a - dlartg.o a - dlaset.o a - ssyr2k.o a - ssyr2.o a - dlaswp.o a - dlatrd.o a - dlagtm.o a - dsyrk.o a - sgemm.o a - ddot.o a - idamax.o a - sgemv.o a - dgbrfs.o a - xerbla.o a - sgbsvx.o a - dlarfb.o a - ssytd2.o a - sgtsv.o a - dgttrs.o a - slaqsy.o a - dlangb.o a - drscl.o a - slae2.o a - dpotrf.o a - ilaslr.o a - sger.o a - dgbcon.o a - dlasr.o a - ilaenv.o a - dlae2.o a - dlaqsy.o a - sgttrs.o a - slangb.o a - srscl.o a - sgbcon.o a - slasr.o a - spotrf.o a - dger.o a - sdot.o a - dgemv.o a - ssyrk.o a - dgemm.o a - dgtsv.o a - ieeeck.o a - sgbrfs.o a - dgbsvx.o a - slarfb.o a - dsytd2.o a - dgbtrf.o a - iladlc.o a - sgbtf2.o a - dpotrf2.o a - slarfg.o a - dorgqr.o a - dorgql.o a - sorgtr.o a - saxpy.o a - dlansy.o a - dlasrt.o a - slaqgb.o a - dlacpy.o a - dlaisnan.o a - dsterf.o a - slapy2.o a - slansy.o a - dlaqgb.o a - slasrt.o a - slacpy.o a - dorgtr.o a - daxpy.o a - ssterf.o a - dlapy2.o a - slaisnan.o a - isamax.o a - sgbtrf.o a - iparmq.o a - spotrf2.o a - dlarfg.o a - sorgql.o a - sorgqr.o a - dgbtf2.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_bugsrad cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.microphys_utils cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_parabolic cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_coamps make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Parabolic_constants.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/kinds.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Microphys_utils/microphys_stats_vars_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/variables_radiation_module.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa26.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa25.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/AiryFunction.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/cloudg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esatv.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/newexp.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa15.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/cloud_correlate.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugsrad_planck.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa5g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugsrad_physconst.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libmicrophys_utils.a microphys_stats_vars_module.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libmicrophys_utils.a a - microphys_stats_vars_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_sel.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_bs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmcol.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/comscp2.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_ocastrndm.F90 cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_morrison make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Morrison_microphys/module_mp_graupel.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa8g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/frzh.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa21.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Parabolic.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esat_new.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/rayle.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa9.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa21g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/comscp1.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/gascon.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/slope.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa7.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa11g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/gamma.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/conice.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa14g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa27r.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_iter.F NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 300) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_rad.F 0 inform, 1 warnings, 0 severes, 0 fatal for module_mp_graupel nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa18.F NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5894) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5905) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5928) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5976) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5980) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6066) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6073) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6079) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6204) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6210) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6248) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6253) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6257) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa12.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/BUGSrad ../src/BUGSrad/gases_ckd.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmtqw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa9g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa27.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/qtadj.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa19g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/qsatvi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa28.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa22.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa7g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa22g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa19.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa10g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/adjtq.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa13g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa18g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa6.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa12g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esati.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa20g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/adjmlt.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmtqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_lwr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa17g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_swr.F ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_bugsrad.a cloudg.o two_rt_sw_iter.o bugs_rad.o two_rt_lw_iter.o bugs_lwr.o bugsrad_physconst.o two_rt_lw_sel.o two_rt_sw_bs.o comscp2.o two_rt_sw_ocastrndm.o bugs_swr.o gases_ckd.o two_rt_lw_ocastrndm.o two_rt_sw.o rayle.o comscp1.o gascon.o newexp.o bugsrad_planck.o two_rt_lw.o variables_radiation_module.o cloud_correlate.o kinds.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_bugsrad.a a - cloudg.o a - two_rt_sw_iter.o a - bugs_rad.o a - two_rt_lw_iter.o a - bugs_lwr.o a - bugsrad_physconst.o a - two_rt_lw_sel.o a - two_rt_sw_bs.o a - comscp2.o a - two_rt_sw_ocastrndm.o a - bugs_swr.o a - gases_ckd.o a - two_rt_lw_ocastrndm.o a - two_rt_sw.o a - rayle.o a - comscp1.o a - gascon.o a - newexp.o a - bugsrad_planck.o a - two_rt_lw.o a - variables_radiation_module.o a - cloud_correlate.o a - kinds.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_parabolic.a Parabolic_constants.o AiryFunction.o Parabolic.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_parabolic.a a - Parabolic_constants.o a - AiryFunction.o a - Parabolic.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_KK_microphys make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/parameters_KK.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/text_writer.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_coamps.a eqa26.o eqa25.o tgqs.o esatv.o eqa15.o eqa5g.o nrmcol.o eqa8g.o frzh.o eqa21.o esat_new.o tgqr.o eqa9.o eqa21g.o tgqg.o slope.o eqa7.o eqa11g.o gamma.o conice.o eqa14g.o eqa27r.o eqa18.o eqa12.o nrmtqw.o eqa9g.o eqa27.o qtadj.o eqa19g.o qsatvi.o eqa28.o eqa22.o tgqi.o eqa7g.o eqa22g.o eqa19.o eqa10g.o adjtq.o eqa13g.o eqa18g.o eqa6.o eqa12g.o esati.o eqa20g.o adjmlt.o nrmtqi.o eqa17g.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_coamps.a a - eqa26.o a - eqa25.o a - tgqs.o a - esatv.o a - eqa15.o a - eqa5g.o a - nrmcol.o a - eqa8g.o a - frzh.o a - eqa21.o a - esat_new.o a - tgqr.o a - eqa9.o a - eqa21g.o a - tgqg.o a - slope.o a - eqa7.o a - eqa11g.o a - gamma.o a - conice.o a - eqa14g.o a - eqa27r.o a - eqa18.o a - eqa12.o a - nrmtqw.o a - eqa9g.o a - eqa27.o a - qtadj.o a - eqa19g.o a - qsatvi.o a - eqa28.o a - eqa22.o a - tgqi.o a - eqa7g.o a - eqa22g.o a - eqa19.o a - eqa10g.o a - adjtq.o a - eqa13g.o a - eqa18g.o a - eqa6.o a - eqa12g.o a - esati.o a - eqa20g.o a - adjmlt.o a - nrmtqi.o a - eqa17g.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_local_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_covar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_all_MM.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_Nrm_tendencies.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_covariances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_turbulent_sed.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_variances.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_morrison.a module_mp_graupel.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_morrison.a a - module_mp_graupel.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_KK_microphys.a PDF_integrals_covar.o KK_Nrm_tendencies.o KK_upscaled_means.o KK_upscaled_covariances.o PDF_integrals_means.o KK_upscaled_turbulent_sed.o PDF_integrals_all_MM.o parameters_KK.o KK_local_means.o text_writer.o KK_utilities.o KK_upscaled_variances.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_KK_microphys.a a - PDF_integrals_covar.o a - KK_Nrm_tendencies.o a - KK_upscaled_means.o a - KK_upscaled_covariances.o a - PDF_integrals_means.o a - KK_upscaled_turbulent_sed.o a - PDF_integrals_all_MM.o a - parameters_KK.o a - KK_local_means.o a - text_writer.o a - KK_utilities.o a - KK_upscaled_variances.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.silhs make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/math_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/parameters_silhs.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/transform_to_pdf_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/output_2D_samples_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/latin_hypercube_arrays.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/est_kessler_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/generate_uniform_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/lh_microphys_var_covar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/silhs_importance_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/latin_hypercube_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/silhs_api_module.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libsilhs.a lh_microphys_var_covar_module.o silhs_api_module.o latin_hypercube_driver_module.o math_utilities.o silhs_importance_sample_module.o parameters_silhs.o generate_uniform_sample_module.o est_kessler_microphys_module.o latin_hypercube_arrays.o transform_to_pdf_module.o output_2D_samples_module.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libsilhs.a a - lh_microphys_var_covar_module.o a - silhs_api_module.o a - latin_hypercube_driver_module.o a - math_utilities.o a - silhs_importance_sample_module.o a - parameters_silhs.o a - generate_uniform_sample_module.o a - est_kessler_microphys_module.o a - latin_hypercube_arrays.o a - transform_to_pdf_module.o a - output_2D_samples_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_other make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/cos_solar_zen_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_model_settings.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/CLUBB_core ../src/input_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/extrapolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/parameters_microphys.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cloud_sed_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/silhs_category_variance_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/ice_dfsn_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/gfdl_activation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/hydrostatic_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/parameters_radiation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/time_dependent_input.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/rad_lwsw_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/soil_vegetation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/mixed_moment_PDF_integrals.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/diag_ustar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/spec_hum_to_mixing_ratio.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/wangara.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/quicksort.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/advance_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/morrison_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/coamps_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/microphys_init_cleanup.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_interpret.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/simple_rad_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/mpace_a.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/sfc_flux.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/bomex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/clex9_nov02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/clex9_oct14.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cloud_feedback.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cobra.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/dycoms2_rf01.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/dycoms2_rf02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/fire.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls2.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls3.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls3_night.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/jun25.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/lba.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/mpace_b.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/nov11.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/rico.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/neutral_case.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/twp_ice.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/stat_file_utils.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/extended_atmosphere_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_0003.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_3year.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/astex_a209.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/atex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_97.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_fields.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/bugsrad_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/sounding.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/estimate_scm_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/lh_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/microphys_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/error.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/enhanced_simann.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_other.a cos_solar_zen_module.o enhanced_simann.o bomex.o clubb_model_settings.o arm_0003.o rad_lwsw_module.o clex9_oct14.o error.o stat_file_utils.o ice_dfsn_module.o extrapolation.o coamps_microphys_driver_module.o gabls2.o bugsrad_driver.o sounding.o extended_atmosphere_module.o dycoms2_rf01.o twp_ice.o sfc_flux.o fire.o nov11.o cobra.o arm_3year.o microphys_init_cleanup.o cloud_sed_module.o mpace_a.o input_netcdf.o time_dependent_input.o clubb_driver.o astex_a209.o gabls3.o silhs_category_variance_module.o parameters_radiation.o simple_rad_module.o input_grads.o diag_ustar_module.o estimate_scm_microphys_module.o input_fields.o neutral_case.o arm_97.o gfdl_activation.o gabls3_night.o KK_microphys_module.o arm.o hydrostatic_module.o quicksort.o rico.o morrison_microphys_module.o spec_hum_to_mixing_ratio.o soil_vegetation.o cloud_feedback.o microphys_driver.o atex.o lba.o wangara.o lh_microphys_driver_module.o input_interpret.o dycoms2_rf02.o advance_microphys_module.o parameters_microphys.o clex9_nov02.o mpace_b.o jun25.o mixed_moment_PDF_integrals.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_other.a a - cos_solar_zen_module.o a - enhanced_simann.o a - bomex.o a - clubb_model_settings.o a - arm_0003.o a - rad_lwsw_module.o a - clex9_oct14.o a - error.o a - stat_file_utils.o a - ice_dfsn_module.o a - extrapolation.o a - coamps_microphys_driver_module.o a - gabls2.o a - bugsrad_driver.o a - sounding.o a - extended_atmosphere_module.o a - dycoms2_rf01.o a - twp_ice.o a - sfc_flux.o a - fire.o a - nov11.o a - cobra.o a - arm_3year.o a - microphys_init_cleanup.o a - cloud_sed_module.o a - mpace_a.o a - input_netcdf.o a - time_dependent_input.o a - clubb_driver.o a - astex_a209.o a - gabls3.o a - silhs_category_variance_module.o a - parameters_radiation.o a - simple_rad_module.o a - input_grads.o a - diag_ustar_module.o a - estimate_scm_microphys_module.o a - input_fields.o a - neutral_case.o a - arm_97.o a - gfdl_activation.o a - gabls3_night.o a - KK_microphys_module.o a - arm.o a - hydrostatic_module.o a - quicksort.o a - rico.o a - morrison_microphys_module.o a - spec_hum_to_mixing_ratio.o a - soil_vegetation.o a - cloud_feedback.o a - microphys_driver.o a - atex.o a - lba.o a - wangara.o a - lh_microphys_driver_module.o a - input_interpret.o a - dycoms2_rf02.o a - advance_microphys_module.o a - parameters_microphys.o a - clex9_nov02.o a - mpace_b.o a - jun25.o a - mixed_moment_PDF_integrals.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_standalone cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_tuner cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.jacobian cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.G_unit_tests cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.int2txt cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_thread_test make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nrtype.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/CLUBB_core ../src/int2txt.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_standalone.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/jacobian.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_thread_test.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/KK_integrals_tests.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nrutil.f90 nvfortran int2txt.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/int2txt -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff nvfortran clubb_thread_test.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_thread_test -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff nvfortran clubb_standalone.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_standalone -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nr.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_tuner.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/corr_cholesky_mtx_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/hole_filling_tests.F90 nvfortran jacobian.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/jacobian -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/Nc_Ncn_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/read_corr_mtx_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/silhs_category_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/mu_sigma_hm_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/spurious_source_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/tuner_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/w_up_in_cloud_tests.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 218) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 222) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 275) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 278) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/smooth_heaviside_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/smooth_min_max_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/pdf_parameter_tests.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/pdf_parameter_tests.F90: 413) nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran_state.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/amoeba.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/amebsa.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran1_s.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran1_v.f90 nvfortran nrutil.o ran1_s.o nrtype.o amoeba.o amebsa.o nr.o ran1_v.o clubb_tuner.o ran_state.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_tuner -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_tests.F90 nvfortran G_unit_tests.o smooth_min_max_tests.o read_corr_mtx_test.o smooth_heaviside_tests.o silhs_category_test.o spurious_source_test.o corr_cholesky_mtx_tests.o tuner_tests.o KK_integrals_tests.o pdf_parameter_tests.o w_up_in_cloud_tests.o mu_sigma_hm_tests.o hole_filling_tests.o Nc_Ncn_test.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/G_unit_tests -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' python ../utilities/check_for_missing_threadprivate.py ../src/CLUBB_core/ ../src/SILHS/ check_for_missing_threadprivate.py has begun. [91mcheck_for_missing_threadprivate.py did not pass.[0m [91mfailedFiles = ['../src/CLUBB_core/sponge_layer_damping.F90', '../src/CLUBB_core/parameters_model.F90', '../src/CLUBB_core/grid_adaptation.F90', '../src/CLUBB_core/error_code.F90', '../src/CLUBB_core/corr_varnce_module.F90'][0m perl ../utilities/CLUBBStandardsCheck.pl ../src/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 174 : call stat_update_var_pt( stats_metadata%isfc_soil_T_in_K, 1, sfc_soil_T_in_K(i), stats_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 175 : call stat_update_var_pt( stats_metadata%ideep_soil_T_in_K, 1, deep_soil_T_in_K(i), stats_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 212 : call stat_update_var_pt( stats_metadata%isoil_heat_flux, 1, soil_heat_flux(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 213 : stats_sfc(i) ) ! intent(inout) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/soil_vegetation.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 381 : um(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 383 : vm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 385 : ugm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 387 : vgm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 389 : thlm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 391 : rtm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 393 : press(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 396 : wm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 413 : edsclr_snd(km1,edsclr), edsclr_snd(k00,edsclr), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 414 : edsclr_snd(kp1,edsclr), edsclr_snd(kp2,edsclr) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 438 : um(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), u(k_above), u(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 439 : vm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), v(k_above), v(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 440 : ugm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), ug(k_above), ug(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 441 : vgm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), vg(k_above), vg(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 442 : thlm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), theta(k_above), theta(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 443 : rtm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), rt(k_above), rt(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 444 : press(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), p_in_Pa(k_above), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 446 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 450 : sclrm(i,k,sclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 456 : edsclrm(i,k,edsclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 485 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 511 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/sounding.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Expected read_random_seed for end function. CLUBBStandardsCheck.pl WARNING: Endings of either program, module, subroutine, or function blocks to not match the beginning ../src/error.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1776 : allocate( um_ref(ngrdcol, gr%nzt) ) ! Reference u wind for nudging; Michael Falk, 17 Oct 2007 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1777 : allocate( vm_ref(ngrdcol, gr%nzt) ) ! Reference v wind for nudging; Michael Falk, 17 Oct 2007 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2428 : !$acc pdf_params%corr_w_thl_2, pdf_params%corr_rt_thl_1, pdf_params%corr_rt_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2429 : !$acc pdf_params%alpha_thl, pdf_params%alpha_rt, pdf_params%crt_1, pdf_params%crt_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2432 : !$acc pdf_params%stdev_eta_2, pdf_params%covar_chi_eta_1, pdf_params%covar_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2434 : !$acc pdf_params%corr_w_eta_2, pdf_params%corr_chi_eta_1, pdf_params%corr_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2441 : !$acc pdf_params_zm%thl_2, pdf_params_zm%varnce_thl_1, pdf_params_zm%varnce_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2442 : !$acc pdf_params_zm%corr_w_rt_1, pdf_params_zm%corr_w_rt_2, pdf_params_zm%corr_w_thl_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2443 : !$acc pdf_params_zm%corr_w_thl_2, pdf_params_zm%corr_rt_thl_1, pdf_params_zm%corr_rt_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2444 : !$acc pdf_params_zm%alpha_thl, pdf_params_zm%alpha_rt, pdf_params_zm%crt_1, pdf_params_zm%crt_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2445 : !$acc pdf_params_zm%cthl_1, pdf_params_zm%cthl_2, pdf_params_zm%chi_1, pdf_params_zm%chi_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2446 : !$acc pdf_params_zm%stdev_chi_1, pdf_params_zm%stdev_chi_2, pdf_params_zm%stdev_eta_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2447 : !$acc pdf_params_zm%stdev_eta_2, pdf_params_zm%covar_chi_eta_1, pdf_params_zm%covar_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2448 : !$acc pdf_params_zm%corr_w_chi_1, pdf_params_zm%corr_w_chi_2, pdf_params_zm%corr_w_eta_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2449 : !$acc pdf_params_zm%corr_w_eta_2, pdf_params_zm%corr_chi_eta_1, pdf_params_zm%corr_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2450 : !$acc pdf_params_zm%rsatl_1, pdf_params_zm%rsatl_2, pdf_params_zm%rc_1, pdf_params_zm%rc_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2451 : !$acc pdf_params_zm%cloud_frac_1, pdf_params_zm%cloud_frac_2, pdf_params_zm%mixt_frac, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2470 : !$acc rcm_in_layer, cloud_cover, wprcp, w_up_in_cloud, w_down_in_cloud, cloudy_updraft_frac, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2571 : um(i,:), vm(i,:), rtm(i,:), wprtp(i,:), thlm(i,:), wpthlp(i,:), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2765 : call setup_pdf_parameters( gr, gr%nzm, gr%nzt, ngrdcol, pdf_dim, hydromet_dim, dt_main, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2766 : Nc_in_cloud, cloud_frac, Kh_zm, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2767 : ice_supersat_frac, hydromet, wphydrometp, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2768 : corr_array_n_cloud, corr_array_n_below, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2769 : hm_metadata, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2770 : pdf_params, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2771 : clubb_params, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2772 : clubb_config_flags%iiPDF_type, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2773 : l_use_precip_frac, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2774 : clubb_config_flags%l_predict_upwp_vpwp, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2775 : clubb_config_flags%l_diagnose_correlations, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2776 : clubb_config_flags%l_calc_w_corr, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2777 : clubb_config_flags%l_const_Nc_in_cloud, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2778 : clubb_config_flags%l_fix_w_chi_eta_correlations, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2779 : stats_metadata, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2780 : stats_zt, stats_zm, stats_sfc, err_code, & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2781 : hydrometp2, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2782 : mu_x_1_n, mu_x_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2783 : sigma_x_1_n, sigma_x_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2784 : corr_array_1_n, corr_array_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2785 : corr_cholesky_mtx_1, corr_cholesky_mtx_2, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2786 : precip_fracs, & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2787 : hydromet_pdf_params ) ! Optional(out) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2807 : stats_zt(i), stats_zm(i), & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2811 : !$acc update device( mu_x_1_n, mu_x_2_n, sigma_x_1_n, sigma_x_2_n, corr_array_1_n, corr_array_2_n, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2898 : !$acc lh_rt_clipped, lh_thl_clipped, lh_rc_clipped, lh_rv_clipped, lh_Nc_clipped ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2930 : !$acc X_nl_all_levs, X_mixt_comp_all_levs, lh_sample_point_weights, mu_x_1_n, mu_x_2_n, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2932 : !$acc lh_rt_clipped, lh_thl_clipped, lh_rc_clipped, lh_rv_clipped, lh_Nc_clipped, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2936 : !$acc pdf_params%cloud_frac_1, pdf_params%cloud_frac_2, pdf_params%cthl_1, pdf_params%cthl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2937 : !$acc pdf_params%crt_1, pdf_params%crt_2, pdf_params%stdev_chi_1, pdf_params%stdev_chi_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2960 : thlm(i,:), p_in_Pa(i,:), exner(i,:), rho(i,:), rho_zm(i,:), rtm(i,:), &! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2961 : rcm(i,:), cloud_frac(i,:), wm_zt(i,:), wm_zm(i,:), wp2_zt(i,:), & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2962 : hydromet(i,:,:), Nc_in_cloud(i,:), & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2978 : stats_zt(i), stats_zm(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2979 : stats_sfc(i), stats_lh_zt(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2980 : Nccnm(i,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2981 : hydromet_mc(i,:,:), Ncm_mc(i,:), rcm_mc(i,:), rvm_mc(i,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2982 : thlm_mc(i,:), hydromet_vel_zt(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2983 : hydromet_vel_covar_zt_impc(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2984 : hydromet_vel_covar_zt_expc(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2985 : wprtp_mc(i,:), wpthlp_mc(i,:), rtp2_mc(i,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2986 : thlp2_mc(i,:), rtpthlp_mc(i,:) ) ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3010 : stats_zt(i), stats_zm(i), stats_sfc(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3011 : hydromet(i,:,:), hydromet_vel_zt(i,:,:), hydrometp2(i,:,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3012 : K_hm(i,:,:), Ncm(i,:), Nc_in_cloud(i,:), rvm_mc(i,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3013 : thlm_mc(i,:), err_code, & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3014 : wphydrometp(i,:,:), wpNcp(i,:) ) ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3017 : !$acc update device( rcm_mc, rvm_mc, thlm_mc, wprtp_mc, wpthlp_mc, rtp2_mc, thlp2_mc, rtpthlp_mc ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3079 : call stat_update_var( stats_metadata%irtm_mc, rvm_mc(i,:)+rcm_mc(i,:), stats_zt(i) ) ! kg/kg/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3081 : call stat_update_var( stats_metadata%iwprtp_mc, wprtp_mc(i,:), stats_zm(i) ) ! m*(kg/kg)/s^2 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3083 : call stat_update_var( stats_metadata%irtp2_mc, rtp2_mc(i,:), stats_zm(i) ) ! (kg/kg)^2/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3085 : call stat_update_var( stats_metadata%irtpthlp_mc, rtpthlp_mc(i,:), stats_zm(i) ) ! K*(kg/kg)/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3102 : !$acc update host( rho, rho_zm, p_in_Pa, exner, cloud_frac, ice_supersat_frac, X_nl_all_levs, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3122 : !$acc update host( rho, rho_zm, p_in_Pa, exner, cloud_frac, ice_supersat_frac, thlm, rtm, rcm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3151 : call update_radiation_variables( gr%nzm, gr%nzt, radht(i,:), Frad_SW_up(i,:), Frad_LW_up(i,:), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3180 : if ( ( stats_metadata%l_stats_last .or. stats_metadata%l_stats .or. l_output_multi_col ) .and. l_stdout ) then CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 5777 : !$acc enter data create( um_bot, vm_bot, rtm_bot, thlm_bot, rho_bot, exner_bot, z_bot, ustar, ubar ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 5930 : !$acc update device( wm_zt, wm_zm, thlm_forcing, rtm_forcing, um_ref, vm_ref, sclrm_forcing, edsclrm_forcing ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6332 : call stat_update_var_pt( stats_metadata%ish, 1, wpthlp_sfc(i)*rho_zm(i,1)*Cp,& ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6335 : call stat_update_var_pt( stats_metadata%ilh, 1, wprtp_sfc(i)*rho_zm(i,1)*Lv, & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6338 : call stat_update_var_pt( stats_metadata%iwpthlp_sfc, 1, wpthlp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6341 : call stat_update_var_pt( stats_metadata%iwprtp_sfc, 1, wprtp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6344 : call stat_update_var_pt( stats_metadata%iupwp_sfc, 1, upwp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6347 : call stat_update_var_pt( stats_metadata%ivpwp_sfc, 1, vpwp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6350 : call stat_update_var_pt( stats_metadata%iustar, 1, ustar(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6353 : call stat_update_var_pt( stats_metadata%iT_sfc, 1, T_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6359 : !$acc exit data delete( um_bot, vm_bot, rtm_bot, thlm_bot, rho_bot, exner_bot, z_bot, ustar, ubar ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6561 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6565 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6569 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6570 : exner_zm(i,km1), exner_zm(i,k00), exner_zm(i,kp1), exner_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6573 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6574 : thlm_zm(i,km1), thlm_zm(i,k00), thlm_zm(i,kp1), thlm_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6577 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6578 : rtm_zm(i,km1), rtm_zm(i,k00), rtm_zm(i,kp1), rtm_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/clubb_driver.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/CLUBB_core/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 689 : !$acc parallel loop gang vector collapse(2) default(present) reduction(.or.:l_any_adjustment_needed) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 805 : ! MONOFLUX TEST COMMENT DO NOT REMOVE if( any(wpxp_net_adjust /= 0.0) ) write(fstderr,*) "MONOFLUX: wpxp adjusted " CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/mono_flux_limiter.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Missing 'implicit none' statements. 'Implicit None' check FAILED! CLUBBStandardsCheck.pl Add a line containing 'implicit none' to each program, module, subroutine, and function. ../src/CLUBB_core/mt95.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1308 : status = nf90_def_var( ncid_zm, "columns", NF90_INT, (/column_id_zm/), column_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1309 : status = nf90_def_var( ncid_zm, "altitude", NF90_PREC, (/vertical_id_zm/), vertical_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1310 : status = nf90_def_var( ncid_zm, "time", NF90_PREC, (/time_id_zm/), time_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1362 : status = nf90_def_var( ncid_zt, "columns", NF90_INT, (/column_id_zt/), column_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1363 : status = nf90_def_var( ncid_zt, "altitude", NF90_PREC, (/vertical_id_zt/), vertical_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1364 : status = nf90_def_var( ncid_zt, "time", NF90_PREC, (/time_id_zt/), time_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1410 : status = nf90_put_var( ncid_zm, column_var_id_zm, column_list, start=(/1/), count=(/ngrdcol/) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1411 : status = nf90_put_var( ncid_zt, column_var_id_zt, column_list, start=(/1/), count=(/ngrdcol/) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1413 : !=================================== Allocate Output Arrays =================================== CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1540 : !$acc upwp_out, vpwp_out, up2_out, vp2_out, wp3_out, rcm_out, cloud_frac_out, rtm_out, thlm_out ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/output_netcdf.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3354 : if ( err_code_api == clubb_fatal_error ) error stop "Error in CLUBB calling setup_pdf_parameters" CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3557 : if ( err_code_api == clubb_fatal_error ) error stop "Error in CLUBB calling setup_pdf_parameters" CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/clubb_api_module.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2026 : ! calculate p_in_Pa instead of remapping directly since it can run into problems if for example CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/grid_adaptation.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/Benchmark_cases/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 127 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 128 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/bomex.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 121 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 122 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/dycoms2_rf02.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 91 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 92 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/dycoms2_rf01.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 152 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 153 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/gabls2.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 96 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 97 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 176 : wpthlp_sfc(i) = convert_sens_ht_to_km_s( ( 270._core_rknd * ft**1.5_core_rknd ), rho_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 177 : wprtp_sfc(i) = convert_latent_ht_to_m_s( ( 554._core_rknd * ft**1.3_core_rknd ), rho_sfc(i) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/lba.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 157 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 158 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/mpace_b.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 272 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 273 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/mpace_a.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 159 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 160 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/rico.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 104 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 105 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/wangara.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/KK_microphys/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/SILHS/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/G_unit_test_types/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run CPU) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-qorv6nkkjzyzntx6wbjupmoxrot26t6r/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + run_scripts/run_scm_all.bash -i Performing priority-cases run Running arm Running arm_97 Running atex Running bomex Running cgils_s6 Running cgils_s11 Running cgils_s12 Running dycoms2_rf01 Running dycoms2_rf01_fixed_sst Running dycoms2_rf02_ds Running dycoms2_rf02_nd Running gabls3_night Running lba Running mpace_b Running rico Running twp_ice Running wangara All cases ran to completion. + mv output cpu_97516ee + mkdir output [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile GPU_ACC) [Pipeline] sh + compile/clean_all.bash rm -f /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj/*.* /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj/.cppdefs /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/lib* /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_standalone /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_tuner /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_thread_test /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/int2txt /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/jacobian /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/G_unit_tests /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/mkmf_template /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/Makefile + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-qorv6nkkjzyzntx6wbjupmoxrot26t6r/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + compile/compile.bash -c config/linux_x86_64_nvhpc_gpu_openacc.bash ......................................................................................................................................................................... Make.clubb_lapack is ready. .................................................................................. Make.clubb_param is ready. ......................... Make.clubb_bugsrad is ready. ... Make.microphys_utils is ready. ..... Make.clubb_parabolic is ready. .............. Make.clubb_KK_microphys is ready. ................................................. Make.clubb_coamps is ready. ... Make.clubb_morrison is ready. ... Make.clubb_gfdlact is ready. ............. Make.silhs is ready. .................................................................. Make.clubb_other is ready. ... Make.clubb_standalone is ready. ... Make.clubb_thread_test is ready. ............ Make.clubb_tuner is ready. ... Make.jacobian is ready. ................ Make.G_unit_tests is ready. ... Make.int2txt is ready. cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_param cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_gfdlact make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SCM_Activation/aer_ccn_act_k.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clubb_precision.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/error_code.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/input_names.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/model_flags.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/lapack_interfaces.F90 clubb_at_least_debug_level: 53, Generating acc routine seq Generating NVIDIA GPU code set_clubb_debug_level: 114, Generating update device(clubb_debug_level) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameter_indices.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/code_timer_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mt95.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/constants_clubb.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/endian.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stat_file_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_variables.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameters_model.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/saturation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/lapack_wrap.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/penta_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/tridiag_lu_solver.F90 sat_mixrat_liq_k: 88, Generating acc routine seq Generating NVIDIA GPU code sat_mixrat_liq_2d: 365, Generating create(esat(:,:)) [if not already present] Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present] 380, Generating implicit firstprivate(ngrdcol,nz,start_index) Generating NVIDIA GPU code 381, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 382, ! blockidx%x threadidx%x collapsed 382, Generating implicit firstprivate(t_in_c_sqd,t_in_c) 435, Generating implicit firstprivate(ngrdcol,nz,start_index) Generating NVIDIA GPU code 436, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 437, ! blockidx%x threadidx%x collapsed 449, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 450, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 451, ! blockidx%x threadidx%x collapsed 451, Generating implicit firstprivate(t_in_k_clipped) 476, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 477, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 478, ! blockidx%x threadidx%x collapsed 478, Generating implicit firstprivate(t_in_k_int) 498, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 499, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 500, ! blockidx%x threadidx%x collapsed tridiag_lu_solve_single_rhs_lhs: 117, Generating create(lower_diag_invrs(:),upper(:)) [if not already present] 119, Accelerator serial kernel generated Generating NVIDIA GPU code Generating implicit copyin(soln(:ndim-1)) [if not already present] Generating implicit copyin(rhs(1:ndim),lhs(-1:1,1:ndim)) [if not already present] Generating implicit copyout(soln(1:ndim)) [if not already present] 124, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 124, !$acc loop seq 124, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 127, Accelerator serial kernel generated Generating NVIDIA GPU code 133, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 133, !$acc loop seq 133, Loop carried dependence of soln prevents parallelization 137, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 137, !$acc loop seq 137, Loop carried backward dependence of soln prevents vectorization sat_mixrat_ice_2d: 952, Generating create(esat_ice(:,:)) [if not already present] Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present] 961, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 962, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 963, ! blockidx%x threadidx%x collapsed 976, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 977, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 978, ! blockidx%x threadidx%x collapsed 978, Generating implicit firstprivate(t_in_c) 1005, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1006, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1007, ! blockidx%x threadidx%x collapsed 1007, Generating implicit firstprivate(t_in_k_clipped) 1035, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1036, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1037, ! blockidx%x threadidx%x collapsed tridiag_lu_solve_single_rhs_multiple_lhs: 182, Generating create(lower_diag_invrs(:,:),upper(:,:)) [if not already present] 184, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 185, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 184, Generating default present(lhs(:0,:ngrdcol,:1)) 191, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 192, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 193, !$acc loop seq 191, Generating default present(lhs(:,:ngrdcol,2:ndim-1)) 192, Generating implicit firstprivate(k) 193, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 200, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 201, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 200, Generating default present(lhs(0:,:ngrdcol,ndim)) 201, Generating implicit firstprivate(ndim) 207, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 208, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 212, !$acc loop seq 207, Generating default present(lhs(1,:ngrdcol,2:ndim),soln(:ngrdcol,:ndim),rhs(:ngrdcol,:ndim)) 208, Generating implicit firstprivate(k) 212, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 218, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 219, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 220, !$acc loop seq 218, Generating default present(soln(:ngrdcol,:ndim)) 219, Generating implicit firstprivate(k) 220, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization penta_lu_solve_single_rhs_multiple_lhs: 146, Generating create(lower_diag_invrs(:,:),upper_2(:,:),upper_1(:,:),lower_1(:,:),lower_2(:,:)) [if not already present] 148, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 149, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 148, Generating default present(lhs(:1,:ngrdcol,:2)) 161, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 162, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 163, !$acc loop seq 161, Generating default present(lhs(:,:ngrdcol,3:ndim-2)) 162, Generating implicit firstprivate(k) 163, Loop carried dependence of upper_1 prevents parallelization Loop carried backward dependence of upper_1 prevents vectorization Loop carried dependence of upper_2 prevents parallelization Loop carried backward dependence of upper_2 prevents vectorization 176, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 177, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 176, Generating default present(lhs(-1:,:ngrdcol,ndim-1:ndim)) 177, Generating implicit firstprivate(ndim) 197, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 198, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 204, !$acc loop seq 197, Generating default present(soln(:ngrdcol,:),rhs(:ngrdcol,:)) 198, Generating implicit firstprivate(k) 204, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 211, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 212, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 215, !$acc loop seq 211, Generating default present(soln(:ngrdcol,:ndim)) 212, Generating implicit firstprivate(k) 215, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization tridiag_lu_solve_multiple_rhs_lhs: 268, Generating create(upper(:,:),lower_diag_invrs(:,:)) [if not already present] 270, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 271, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 270, Generating default present(lhs(:0,:ngrdcol,:1)) 277, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 278, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 279, !$acc loop seq 277, Generating default present(lhs(:,:ngrdcol,2:ndim-1)) 278, Generating implicit firstprivate(k) 279, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 286, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 287, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 286, Generating default present(lhs(0:,:ngrdcol,ndim)) 287, Generating implicit firstprivate(ndim) 293, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 294, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 295, ! blockidx%x threadidx%x collapsed 299, !$acc loop seq 293, Generating default present(soln(:ngrdcol,:ndim,:nrhs),rhs(:ngrdcol,:ndim,:nrhs),lhs(1,:ngrdcol,2:ndim)) 295, Generating implicit firstprivate(k) 299, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 306, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 307, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 308, ! blockidx%x threadidx%x collapsed 309, !$acc loop seq 306, Generating default present(soln(:ngrdcol,:ndim,:nrhs)) 308, Generating implicit firstprivate(k) 309, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_gfdlact.a aer_ccn_act_k.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_gfdlact.a a - aer_ccn_act_k.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_parameter_module.F90 penta_lu_solve_multiple_rhs_lhs: 266, Generating create(lower_diag_invrs(:,:),upper_2(:,:),upper_1(:,:),lower_1(:,:),lower_2(:,:)) [if not already present] 268, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 269, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 268, Generating default present(lhs(:1,:ngrdcol,:2)) 281, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 282, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 283, !$acc loop seq 281, Generating default present(lhs(:,:ngrdcol,3:ndim-2)) 282, Generating implicit firstprivate(k) 283, Loop carried dependence of upper_1 prevents parallelization Loop carried backward dependence of upper_1 prevents vectorization Loop carried dependence of upper_2 prevents parallelization Loop carried backward dependence of upper_2 prevents vectorization 296, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 297, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 296, Generating default present(lhs(-1:,:ngrdcol,ndim-1:ndim)) 297, Generating implicit firstprivate(ndim) 317, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 318, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 319, ! blockidx%x threadidx%x collapsed 325, !$acc loop seq 317, Generating default present(soln(:ngrdcol,:,:nrhs),rhs(:ngrdcol,:,:nrhs)) 319, Generating implicit firstprivate(k) 325, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 333, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 334, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 335, ! blockidx%x threadidx%x collapsed 338, !$acc loop seq 333, Generating default present(soln(:ngrdcol,:ndim,:nrhs)) 335, Generating implicit firstprivate(k) 338, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calc_roots.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/array_index.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calendar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/adg1_adg2_3d_luhar_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_hybrid_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_tsdadg_pdf.F90 adg1_pdf_driver: 152, Generating enter data create(w_1_n(:,:),w_2_n(:,:)) 209, Generating exit data delete(w_2_n(:,:),w_1_n(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/diagnose_correlations_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/LY93_pdf.F90 adg1_w_closure: 660, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 661, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 662, ! blockidx%x threadidx%x collapsed 660, Generating default present(wp2(:ngrdcol,:nz),wm(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),w_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),skw(:ngrdcol,:nz),w_2_n(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) 662, Generating implicit firstprivate(mixt_frac_max_mag) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/hydromet_pdf_parameter_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sigma_sqd_w_module.F90 adg1_adg2_responder_params: 1116, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1117, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1118, ! blockidx%x threadidx%x collapsed 1116, Generating default present(wp2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),alpha_x(:ngrdcol,:nz),beta(:ngrdcol),w_2_n(:ngrdcol,:nz),xm(:ngrdcol,:nz),xp2(:ngrdcol,:nz),x_2(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),x_1(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz)) 1118, Generating implicit firstprivate(x_tol,width_factor_1) compute_sigma_sqd_w: 97, Generating enter data create(max_corr_w_x_sqd(:,:)) 108, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 109, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 110, ! blockidx%x threadidx%x collapsed 108, Generating default present(rtp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 120, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 121, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 122, ! blockidx%x threadidx%x collapsed 120, Generating default present(max_corr_w_x_sqd(:ngrdcol,:nzm),up2(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm)) 134, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 135, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 136, ! blockidx%x threadidx%x collapsed 134, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm)) 142, Generating exit data delete(max_corr_w_x_sqd(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/Nc_Ncn_eqns.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/interpolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/matrix_operations.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/T_in_K_module.F90 mono_cubic_interp: 116, Generating acc routine seq Generating NVIDIA GPU code thlm2t_in_k_2d: 140, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 141, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 142, ! blockidx%x threadidx%x collapsed 140, Generating default present(thlm(:ngrdcol,:nz),rcm(:ngrdcol,:nz),exner(:ngrdcol,:nz)) pvertinterp: 548, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 549, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 548, Generating default present(p_mid(:ngrdcol,:),interp_var(:ngrdcol),input_var(:ngrdcol,:)) 549, Generating implicit firstprivate(p_out,l_found,k_upper,k,dpu,dpl) 568, Accelerator restriction: induction variable live-out from loop: k 573, Accelerator restriction: induction variable live-out from loop: k nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/Skx_module.F90 skx_func: 73, Generating create(skx_denom_tol(:)) [if not already present] 75, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 76, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 75, Generating default present(clubb_params(:ngrdcol,73)) 76, Generating implicit firstprivate(x_tol) 84, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 85, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 86, ! blockidx%x threadidx%x collapsed 84, Generating default present(xp3(:ngrdcol,:nz),xp2(:ngrdcol,:nz),skx(:ngrdcol,:nz)) lg_2005_ansatz: 171, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 172, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 173, ! blockidx%x threadidx%x collapsed 171, Generating default present(skw(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),beta(:ngrdcol),skx(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),xp2(:ngrdcol,:nz),wp2(:ngrdcol,:nz)) 173, Generating implicit firstprivate(x_tol,nrmlzd_skw,nrmlzd_corr_wx) xp3_lg_2005_ansatz: 247, Generating create(skx_zt(:,:),skx_denom_tol(:)) [if not already present] 254, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 255, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 254, Generating default present(clubb_params(:ngrdcol,73)) 255, Generating implicit firstprivate(x_tol) 262, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 263, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 264, ! blockidx%x threadidx%x collapsed 262, Generating default present(xp3(:ngrdcol,:nzt),xp2_zt(:ngrdcol,:nzt)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/file_functions.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_type.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/matrix_solver_wrapper.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/output_grads.F90 band_solve_single_rhs_multiple_lhs: 110, Generating update self(lhs(:,:,:),rhs(:,:)) 123, Generating update device(rcond(:)) 130, Generating update self(rhs(:,:),lhs(:,:,:)) 138, Generating update device(soln(:,:)) band_solve_multiple_rhs_lhs: 225, Generating update self(lhs(:,:,:),rhs(:,:,:)) 238, Generating update device(rcond(:)) 245, Generating update self(rhs(:,:,:),lhs(:,:,:)) 253, Generating update device(soln(:,:,:)) tridiag_solve_single_rhs_multiple_lhs: 443, Generating update self(lhs(:,:,:),rhs(:,:)) 454, Generating update device(rcond(:)) 461, Generating update self(rhs(:,:),lhs(:,:,:)) 468, Generating update device(soln(:,:)) tridiag_solve_multiple_rhs_lhs: 552, Generating update self(lhs(:,:,:),rhs(:,:,:)) 563, Generating update device(rcond(:)) 570, Generating update self(rhs(:,:,:),lhs(:,:,:)) 577, Generating update device(soln(:,:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/input_reader.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/grid_class.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_type_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_lh_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_lh_zt_module.F90 linear_interpolated_azm_2d: 1546, Generating copyin(azt(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:)) [if not already present] Generating copyout(linear_interpolated_azm(:,:)) [if not already present] Generating copyin(gr%zt(:,:)) [if not already present] 1552, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1553, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1554, ! blockidx%x threadidx%x collapsed 1565, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1566, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1576, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1577, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1577, Generating implicit firstprivate(nzt,nzm) 1585, Generating copyin(zm_min) [if not already present] Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1586, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1587, ! blockidx%x threadidx%x collapsed zt2zm2zt: 1642, Generating create(azt_zm(:,:)) [if not already present] zm2zt2zm: 1698, Generating create(azm_zt(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_sfc_module.F90 linear_interpolated_azt_2d: 2112, Generating copyin(azm(:,:),gr,gr%zm(:,:),gr%weights_zm2zt(:,:,:)) [if not already present] Generating copyout(linear_interpolated_azt(:,:)) [if not already present] Generating copyin(gr%zt(:,:)) [if not already present] 2118, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2120, ! blockidx%x threadidx%x collapsed 2129, Generating copyin(zt_min) [if not already present] Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2130, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2131, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_zm_module.F90 gradzm_2d: 2417, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2418, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2419, ! blockidx%x threadidx%x collapsed 2417, Generating default present(azm(:ngrdcol,:nzt+1),gr%invrs_dzt(1:ngrdcol,1:nzt),gr) gradzm_1d: 2466, Generating copyin(azm_col(:,:),gr) [if not already present] Generating copyout(gradzm_1d_col(:,:)) [if not already present] Generating copyin(gr%invrs_dzt(:,:)) [if not already present] gradzt_2d: 2513, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2514, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2515, ! blockidx%x threadidx%x collapsed 2513, Generating default present(azt(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr) 2527, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2528, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2528, Generating implicit firstprivate(nzm) gradzt_1d: 2574, Generating copyin(azt_col(:,:),gr) [if not already present] Generating copyout(gradzt_1d_col(:,:)) [if not already present] Generating copyin(gr%invrs_dzm(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_rad_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_rad_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/precipitation_fraction.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/corr_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/index_mapping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sponge_layer_damping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/parameters_tunable.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_helper_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mean_adv.F90 term_ma_zt_lhs: 194, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 195, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 196, ! blockidx%x threadidx%x collapsed 194, Generating default present(lhs_ma(:,:ngrdcol,2:nzt-1),invrs_dzt(:ngrdcol,2:nzt-1),wm_zt(:ngrdcol,2:nzt-1),weights_zt2zm(:ngrdcol,2:nzt,:)) 217, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 218, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 217, Generating default present(invrs_dzt(:ngrdcol,nzt),lhs_ma(:,:ngrdcol,nzt),wm_zt(:ngrdcol,nzt),weights_zt2zm(:ngrdcol,nzm-1,:)) 218, Generating implicit firstprivate(nzt,nzm) 237, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 238, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 237, Generating default present(lhs_ma(:,:ngrdcol,:1),wm_zt(:ngrdcol,:1),weights_zt2zm(:ngrdcol,2,:),invrs_dzt(:ngrdcol,:1)) 256, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 257, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 258, ! blockidx%x threadidx%x collapsed 256, Generating default present(wm_zt(:ngrdcol,2:nzt-1),lhs_ma(:,:ngrdcol,2:nzt-1),invrs_dzm(:ngrdcol,2:nzt)) 288, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 289, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 288, Generating default present(invrs_dzm(:ngrdcol,nzm-1),wm_zt(:ngrdcol,nzt),lhs_ma(:,:ngrdcol,nzt)) 289, Generating implicit firstprivate(nzt,nzm) 317, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 318, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 317, Generating default present(invrs_dzm(:ngrdcol,2),wm_zt(:ngrdcol,:1),lhs_ma(:,:ngrdcol,:1)) term_ma_zm_lhs: 451, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 452, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 453, ! blockidx%x threadidx%x collapsed 451, Generating default present(lhs_ma(:,:ngrdcol,:1)) 460, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 461, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 462, ! blockidx%x threadidx%x collapsed 460, Generating default present(lhs_ma(:,:ngrdcol,2:nzm-1),invrs_dzm(:ngrdcol,2:nzm-1),wm_zm(:ngrdcol,2:nzm-1),weights_zm2zt(:ngrdcol,:nzm-1,:)) 479, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 480, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 481, ! blockidx%x threadidx%x collapsed 479, Generating default present(lhs_ma(:,:ngrdcol,nzm)) 481, Generating implicit firstprivate(nzm) calc_stability_correction: 309, Generating enter data create(brunt_vaisala_freq_sqd_smth(:,:),lambda0_stability(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:)) 327, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 328, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 329, ! blockidx%x threadidx%x collapsed 327, Generating default present(lambda0_stability_coef(:ngrdcol),lambda0_stability(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm)) 339, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 340, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 341, ! blockidx%x threadidx%x collapsed 339, Generating default present(stability_correction(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm),em(:ngrdcol,:nzm),lambda0_stability(:ngrdcol,:nzm)) 349, Generating exit data delete(lambda0_stability(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:)) calc_brunt_vaisala_freq_sqd: 468, Generating create(rsat_zm(:,:),t_in_k(:,:),ice_supersat_frac_zm(:,:),rsat(:,:),t_in_k_zm(:,:),thm(:,:),ddzt_rtm(:,:),ddzt_thlm(:,:),brunt_vaisala_freq_clipped(:,:),ddzt_rsat(:,:),thm_zm(:,:),thvm_zm(:,:),ddzt_thm(:,:),ddzt_thvm(:,:)) [if not already present] 472, Generating enter data create(tmp_calc(:,:)) 482, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 483, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 484, ! blockidx%x threadidx%x collapsed 482, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm)) 492, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 493, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 494, ! blockidx%x threadidx%x collapsed 492, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm)) 494, Generating implicit firstprivate(t0) 508, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 509, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 510, ! blockidx%x threadidx%x collapsed 508, Generating default present(thlm(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),exner(:ngrdcol,:nzt)) 520, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 521, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 522, ! blockidx%x threadidx%x collapsed 520, Generating default present(brunt_vaisala_freq_sqd_dry(:ngrdcol,:nzm)) 528, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 530, ! blockidx%x threadidx%x collapsed 528, Generating default present(brunt_vaisala_freq_sqd_moist(:ngrdcol,:nzm)) 544, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 545, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 546, ! blockidx%x threadidx%x collapsed 544, Generating default present(brunt_vaisala_freq_sqd_dry(:ngrdcol,:nzm),bv_efold(:ngrdcol),brunt_vaisala_freq_sqd_moist(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_mixed(:ngrdcol,:nzm)) 582, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 583, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 584, ! blockidx%x threadidx%x collapsed 582, Generating default present(brunt_vaisala_freq_sqd_mixed(:ngrdcol,:nzm)) 603, Generating exit data delete(tmp_calc(:,:)) compute_cx_fnc_richardson: 727, Generating enter data create(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm_cx(:,:),fnc_richardson_smooth(:,:)) 743, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 744, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 745, ! blockidx%x threadidx%x collapsed 743, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm),ri_zm_cx(:ngrdcol,:nzm)) 758, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 759, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 760, ! blockidx%x threadidx%x collapsed 758, Generating default present(clubb_params(:ngrdcol,96:97),fnc_richardson(:ngrdcol,:nzm),ri_zm_cx(:ngrdcol,:nzm)) 760, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max) 780, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 781, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 782, ! blockidx%x threadidx%x collapsed 780, Generating default present(clubb_params(:ngrdcol,94:95),fnc_richardson_smooth(:ngrdcol,:nzm),cx_fnc_interp(:ngrdcol,:nzm)) 782, Generating implicit firstprivate(cx_min,cx_max) 795, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 796, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 797, ! blockidx%x threadidx%x collapsed 795, Generating default present(clubb_params(:ngrdcol,94:97),ri_zm_cx(:ngrdcol,:nzm),cx_fnc_richardson(:ngrdcol,:nzm)) 797, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max,cx_max,cx_min) 831, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 832, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 833, ! blockidx%x threadidx%x collapsed 831, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm)) 839, Generating exit data delete(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm_cx(:,:),fnc_richardson_smooth(:,:)) calc_ri_zm: 884, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 885, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 886, ! blockidx%x threadidx%x collapsed 884, Generating default present(bv_freq_sqd(:ngrdcol,:nzm),shear(:ngrdcol,:nzm),ri_zm(:ngrdcol,:nzm)) 886, Generating implicit firstprivate(lim_shear,lim_bv) lscale_width_vert_avg: 958, Generating enter data create(denom_terms(:,:),numer_terms(:,:),one_half_avg_width(:,:)) 961, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 962, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 963, ! blockidx%x threadidx%x collapsed 961, Generating default present(lscale_zm(:ngrdcol,:nzm),one_half_avg_width(:ngrdcol,:nzm)) 968, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 969, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 970, ! blockidx%x threadidx%x collapsed 968, Generating default present(one_half_avg_width(:ngrdcol,:nzm)) 977, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 978, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 979, ! blockidx%x threadidx%x collapsed 977, Generating default present(gr%dzm(1:ngrdcol,1:nzm),numer_terms(:ngrdcol,:nzm),denom_terms(:ngrdcol,:nzm),gr,var_profile(:ngrdcol,:nzm),rho_ds_zm(:ngrdcol,:nzm)) 986, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 987, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 988, ! blockidx%x threadidx%x collapsed 1046, !$acc loop seq Generating implicit reduction(+:numer_integral,denom_integral) 986, Generating default present(gr%zm(1:ngrdcol,:),denom_terms(:ngrdcol,:),gr,one_half_avg_width(:ngrdcol,:nzm),numer_terms(:ngrdcol,:)) 988, Generating implicit firstprivate(k_avg_lower,k_avg,n_below_ground_levels,k_avg_upper,var_below_ground_value,numer_integral,denom_integral) 1008, Accelerator restriction: induction variable live-out from loop: k_avg_upper 1011, Accelerator restriction: induction variable live-out from loop: k_avg_upper 1015, Accelerator restriction: induction variable live-out from loop: k_avg_lower 1018, Accelerator restriction: induction variable live-out from loop: k_avg_lower 1046, Loop is parallelizable 1058, Generating exit data delete(denom_terms(:,:),one_half_avg_width(:,:),numer_terms(:,:)) wp2_term_splat_lhs: 1116, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_smooth(:,:)) 1118, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1120, ! blockidx%x threadidx%x collapsed 1118, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm)) 1130, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1131, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1132, ! blockidx%x threadidx%x collapsed 1130, Generating default present(lhs_splat_wp2(:ngrdcol,:nzm),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_smooth(:ngrdcol,:nzm)) 1138, Generating exit data delete(brunt_vaisala_freq_splat_smooth(:,:),brunt_vaisala_freq_splat_clipped(:,:)) wp3_term_splat_lhs: 1199, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_clipped_zt(:,:)) 1201, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1202, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1203, ! blockidx%x threadidx%x collapsed 1201, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm)) 1213, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1214, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1215, ! blockidx%x threadidx%x collapsed 1213, Generating default present(lhs_splat_wp3(:ngrdcol,:nzt),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_clipped_zt(:ngrdcol,:nzt)) 1222, Generating exit data delete(brunt_vaisala_freq_splat_clipped_zt(:,:),brunt_vaisala_freq_splat_clipped(:,:)) smooth_min_sclr_idx: 1270, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1271, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1272, ! blockidx%x threadidx%x collapsed 1270, Generating default present(input_var2(:ngrdcol,:nz)) 1272, Generating implicit firstprivate(smth_coef,input_var1) smooth_min_array_scalar: 1325, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1326, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1327, ! blockidx%x threadidx%x collapsed 1325, Generating default present(input_var1(:ngrdcol,:nz)) 1327, Generating implicit firstprivate(smth_coef,input_var2) smooth_min_arrays: 1380, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1381, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1382, ! blockidx%x threadidx%x collapsed 1380, Generating default present(input_var2(:ngrdcol,:nz),input_var1(:ngrdcol,:nz)) 1382, Generating implicit firstprivate(smth_coef) smooth_max_sclr_idx: 1474, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1475, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1476, ! blockidx%x threadidx%x collapsed 1474, Generating default present(input_var2(:ngrdcol,:nz)) 1476, Generating implicit firstprivate(smth_coef,input_var1) smooth_max_array_scalar: 1529, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1530, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1531, ! blockidx%x threadidx%x collapsed 1529, Generating default present(input_var1(:ngrdcol,:nz)) 1531, Generating implicit firstprivate(smth_coef,input_var2) smooth_max_array_1d_scalar: 1583, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1584, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1583, Generating default present(input_var1(:ngrdcol)) 1584, Generating implicit firstprivate(smth_coef,input_var2) smooth_max_arrays: 1636, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1637, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1638, ! blockidx%x threadidx%x collapsed 1636, Generating default present(input_var2(:ngrdcol,:nz),input_var1(:ngrdcol,:nz)) 1638, Generating implicit firstprivate(smth_coef) smooth_max_scalars: 1650, Generating acc routine seq Generating NVIDIA GPU code smooth_heaviside_peskin: 1734, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1735, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1736, ! blockidx%x threadidx%x collapsed 1734, Generating default present(input(:ngrdcol,:nz)) 1736, Generating implicit firstprivate(smth_range,input_over_smth_range) calc_xpwp_2d: 1846, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1847, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1848, ! blockidx%x threadidx%x collapsed 1846, Generating default present(xm(:ngrdcol,:nzm-1),xpwp(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,km_zm(:ngrdcol,2:nzm-1)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/turbulent_adv_pdf.F90 xpyp_term_ta_pdf_lhs: 372, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 373, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 374, ! blockidx%x threadidx%x collapsed 372, Generating default present(lhs_ta(:,:ngrdcol,:1)) 383, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 384, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 385, ! blockidx%x threadidx%x collapsed 383, Generating default present(coef_wpxpyp_implicit(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%weights_zm2zt(1:ngrdcol,1:nzm-1,1:2),gr,rho_ds_zt(:ngrdcol,:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1)) 414, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 415, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 416, ! blockidx%x threadidx%x collapsed 414, Generating default present(sgn_turbulent_vel(:ngrdcol,2:nzm-1),rho_ds_zm(:ngrdcol,:nzm),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1),gr%invrs_dzt(1:ngrdcol,1:nzm-1),coef_wpxpyp_implicit_zm(:ngrdcol,:nzm),gr) 461, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 462, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 463, ! blockidx%x threadidx%x collapsed 461, Generating default present(lhs_ta(:,:ngrdcol,nzm)) 463, Generating implicit firstprivate(nzm) xpyp_term_ta_pdf_lhs_godunov: 536, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 537, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 538, ! blockidx%x threadidx%x collapsed 536, Generating default present(lhs_ta(:,:ngrdcol,:1)) 545, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 546, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 547, ! blockidx%x threadidx%x collapsed 545, Generating default present(invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),coef_wpxpyp_implicit(:ngrdcol,:nzm-1),gr,rho_ds_zm(:ngrdcol,:nzm),lhs_ta(:,:ngrdcol,2:nzm-1)) 569, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 570, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 571, ! blockidx%x threadidx%x collapsed 569, Generating default present(lhs_ta(:,:ngrdcol,nzm)) 571, Generating implicit firstprivate(nzm) xpyp_term_ta_pdf_rhs: 880, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 881, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 880, Generating default present(rhs_ta(:ngrdcol,:1)) 889, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 890, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 891, ! blockidx%x threadidx%x collapsed 889, Generating default present(rho_ds_zt(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,invrs_rho_ds_zm(:ngrdcol,2:nzm-1),term_wpxpyp_explicit(:ngrdcol,:nzm-1),rhs_ta(:ngrdcol,2:nzm-1)) 905, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 906, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 907, ! blockidx%x threadidx%x collapsed 905, Generating default present(rhs_ta(:ngrdcol,2:nzm-1),term_wpxpyp_explicit_zm(:ngrdcol,:nzm),sgn_turbulent_vel(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%invrs_dzt(1:ngrdcol,1:nzm-1),gr,rho_ds_zm(:ngrdcol,:nzm)) 936, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 937, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 936, Generating default present(rhs_ta(:ngrdcol,nzm)) 937, Generating implicit firstprivate(nzm) xpyp_term_ta_pdf_rhs_godunov: 1005, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1006, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1005, Generating default present(rhs_ta(:ngrdcol,:1)) 1011, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1012, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1013, ! blockidx%x threadidx%x collapsed 1011, Generating default present(rho_ds_zm(:ngrdcol,:nzm),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,rhs_ta(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),term_wpxpyp_explicit_zm(:ngrdcol,:nzm),sgn_turbulent_vel(:ngrdcol,:nzm-1)) 1029, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1030, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1029, Generating default present(rhs_ta(:ngrdcol,nzm)) 1030, Generating implicit firstprivate(nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/diffusion.F90 diffusion_zt_lhs: 310, Generating create(k_zm_nu(:,:),ddzm_rho_k_zm_nu(:,:),drhokdz_zt(:,:),lhs_upwind(:,:,:),rho_k_zm_nu(:,:)) [if not already present] 312, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 314, ! blockidx%x threadidx%x collapsed 312, Generating default present(k_zm(:ngrdcol,:nzm),nu(:ngrdcol)) 391, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 392, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 391, Generating default present(gr,rho_ds_zm(:ngrdcol,2),nu(:ngrdcol),lhs(:,:ngrdcol,:1),invrs_rho_ds_zt(:ngrdcol,:1),gr%invrs_dzt(1:ngrdcol,1),gr%invrs_dzm(1:ngrdcol,2),k_zm(:ngrdcol,2)) 432, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 433, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 434, ! blockidx%x threadidx%x collapsed 432, Generating default present(invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%invrs_dzm(1:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),rho_ds_zm(:ngrdcol,2:nzt),lhs(:,:ngrdcol,2:nzt-1),gr) 488, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 489, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 488, Generating default present(k_zm(:ngrdcol,nzm-1),gr,rho_ds_zm(:ngrdcol,nzm-1),nu(:ngrdcol),lhs(:,:ngrdcol,nzt),invrs_rho_ds_zt(:ngrdcol,nzt),gr%invrs_dzt(1:ngrdcol,nzt),gr%invrs_dzm(1:ngrdcol,nzm-1)) 489, Generating implicit firstprivate(nzt,nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pos_definite_module.F90 diffusion_zm_lhs: 813, Generating create(drhokdz_zm(:,:),ddzt_rho_k_zt_nu(:,:),lhs_upwind(:,:,:),rho_k_zt_nu(:,:)) [if not already present] 815, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 816, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 817, ! blockidx%x threadidx%x collapsed 815, Generating default present(rho_ds_zt(:ngrdcol,:nzt),nu(:ngrdcol),k_zt(:ngrdcol,:nzt)) 826, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 827, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 828, ! blockidx%x threadidx%x collapsed 826, Generating default present(invrs_rho_ds_zm(:ngrdcol,:nzm)) 836, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 837, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 836, Generating default present(gr%invrs_dzt(1:ngrdcol,1),gr) 845, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 846, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 847, ! blockidx%x threadidx%x collapsed 845, Generating default present(gr%invrs_dzt(1:ngrdcol,1:nzm-1),gr) 861, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 862, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 861, Generating default present(gr%invrs_dzt(1:ngrdcol,nzt),gr) 862, Generating implicit firstprivate(nzt,nzm) 877, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 878, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 877, Generating default present(gr%invrs_dzm(1:ngrdcol,1),rho_ds_zt(:ngrdcol,:1),nu(:ngrdcol),lhs(:,:ngrdcol,:1),invrs_rho_ds_zm(:ngrdcol,:1),gr%invrs_dzt(1:ngrdcol,1),gr,k_zt(:ngrdcol,:1)) 918, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 919, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 920, ! blockidx%x threadidx%x collapsed 918, Generating default present(k_zt(:ngrdcol,:nzm-1),gr,gr%invrs_dzt(1:ngrdcol,1:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,2:nzm-1),rho_ds_zt(:ngrdcol,:nzm-1),nu(:ngrdcol),gr%invrs_dzm(1:ngrdcol,2:nzm-1)) 974, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 975, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 974, Generating default present(k_zt(:ngrdcol,nzt),gr%invrs_dzm(1:ngrdcol,nzm),rho_ds_zt(:ngrdcol,nzt),nu(:ngrdcol),lhs(:,:ngrdcol,nzm),invrs_rho_ds_zm(:ngrdcol,nzm),gr%invrs_dzt(1:ngrdcol,nzt),gr) 975, Generating implicit firstprivate(nzt,nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/fill_holes.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/output_netcdf.F90 fill_holes_vertical_api: 128, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 130, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_field_below_threshold) 131, ! blockidx%x threadidx%x collapsed 128, Generating default present(field(:ngrdcol,:nz)) Generating implicit copy(l_field_below_threshold) [if not already present] 131, Generating implicit firstprivate(threshold) 144, Generating enter data create(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),numer_integral_global(:),rho_ds_dz(:,:),field_avg_global(:),field_clipped(:,:)) 148, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 149, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 150, ! blockidx%x threadidx%x collapsed 148, Generating default present(rho_ds(:ngrdcol,:nz),rho_ds_dz(:ngrdcol,:nz),dz(:ngrdcol,:nz)) 159, Generating implicit firstprivate(ngrdcol,upper_hf_level,lower_hf_level) Generating NVIDIA GPU code 160, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 161, ! blockidx%x threadidx%x collapsed 171, !$acc loop seq Generating implicit reduction(+:rho_k_sum) 159, Generating default present(rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2)) 161, Generating implicit firstprivate(j,rho_k_sum) 171, Loop is parallelizable 180, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 181, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 190, !$acc loop seq 199, !$acc loop seq Generating implicit reduction(+:field$r1) 205, !$acc loop seq 209, !$acc loop seq 215, !$acc loop seq Generating implicit reduction(+:rho_ds_dz$r) 226, !$acc loop seq 180, Generating default present(field(:ngrdcol,:),field_clipped(:ngrdcol,:),rho_ds_dz(:ngrdcol,:),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2)) 190, Loop carried dependence of field,field_clipped prevents parallelization Loop carried backward dependence of field_clipped,field prevents vectorization Generating implicit firstprivate(k_end,field_clipped_avg,threshold,mass_fraction,field_avg,k_start) Loop carried dependence of field,field_clipped prevents parallelization Loop carried backward dependence of field_clipped prevents vectorization Loop carried dependence of field_clipped prevents parallelization 199, Loop is parallelizable 205, Loop is parallelizable 209, Loop is parallelizable 215, Loop is parallelizable 226, Loop is parallelizable 239, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 241, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_field_below_threshold) 242, ! blockidx%x threadidx%x collapsed 239, Generating default present(field(:ngrdcol,:nz)) Generating implicit copy(l_field_below_threshold) [if not already present] 242, Generating implicit firstprivate(threshold) 252, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:)) 265, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 266, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 265, Generating default present(numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol)) 272, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 273, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 274, !$acc loop seq 272, Generating default present(field(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol)) 274, Complex loop carried dependence of numer_integral_global prevents parallelization Loop carried dependence of numer_integral_global prevents parallelization Loop carried backward dependence of numer_integral_global prevents vectorization Complex loop carried dependence of denom_integral_global prevents parallelization Loop carried dependence of denom_integral_global prevents parallelization Loop carried backward dependence of denom_integral_global prevents vectorization 283, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level) Generating NVIDIA GPU code 284, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 293, !$acc loop seq 298, !$acc loop seq 283, Generating default present(field_avg_global(:ngrdcol),denom_integral_global(:ngrdcol),field(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level)) 284, Generating implicit firstprivate(threshold) 293, Loop is parallelizable 298, Loop is parallelizable 306, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 307, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 309, !$acc loop seq 306, Generating default present(field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol)) 309, Complex loop carried dependence of numer_integral_global prevents parallelization Loop carried reuse of numer_integral_global prevents parallelization 315, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level) Generating NVIDIA GPU code 316, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 335, !$acc loop seq 315, Generating default present(denom_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),field(:ngrdcol,lower_hf_level:upper_hf_level),field_avg_global(:ngrdcol),numer_integral_global(:ngrdcol),mass_fraction_global(:ngrdcol)) 316, Generating implicit firstprivate(threshold,field_clipped_avg) 335, Loop is parallelizable 344, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:)) fill_holes_wp2_from_horz_tke: 430, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 432, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_field_below_threshold) 433, ! blockidx%x threadidx%x collapsed 430, Generating default present(wp2(:ngrdcol,:nz)) Generating implicit copy(l_field_below_threshold) [if not already present] 433, Generating implicit firstprivate(threshold) 447, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level) Generating NVIDIA GPU code 448, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 449, ! blockidx%x threadidx%x collapsed 447, Generating default present(up2(:ngrdcol,lower_hf_level:upper_hf_level),wp2(:ngrdcol,lower_hf_level:upper_hf_level),vp2(:ngrdcol,lower_hf_level:upper_hf_level)) 449, Generating implicit firstprivate(tke_diff,up2_avail,vp2_avail,wp2_old,vp2_old,ratio,tke_x2_old,up2_vp2_avail,up2_old,missing_wp2,threshold) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/calc_pressure.F90 fill_holes_driver_api: 1035, Generating copyin(gr,rho_ds_zt(:)) [if not already present] Generating copy(hydromet(:,i)) [if not already present] Generating copyin(gr%dzt(:,:)) [if not already present] calculate_thvm: 245, Generating copyin(rtm(:,:),rcm(:,:),exner(:,:),thlm(:,:)) [if not already present] Generating copyout(thvm(:,:)) [if not already present] Generating copyin(thv_ds_zt(:,:)) [if not already present] 249, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 250, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 251, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mono_flux_limiter.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clip_explicit.F90 clip_covars_denom: 156, Generating enter data create(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:)) 157, Generating enter data create(wpsclrp_chnge(:,:,:)) 414, Generating exit data delete(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:)) 415, Generating exit data delete(wpsclrp_chnge(:,:,:)) clip_covar: 566, Generating update self(xpyp(:,:)) 599, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 600, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 601, ! blockidx%x threadidx%x collapsed 599, Generating default present(xp2(:ngrdcol,2:nzm-1),yp2(:ngrdcol,2:nzm-1),xpyp_chnge(:ngrdcol,2:nzm-1),xpyp(:ngrdcol,2:nzm-1)) 601, Generating implicit firstprivate(xpyp_bound,max_mag_corr) 629, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 630, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 629, Generating default present(xpyp_chnge(:ngrdcol,:)) 630, Generating implicit firstprivate(nzm) 638, Generating update self(xpyp(:,:)) clip_variance: 940, Generating copyin(threshold_lo(:,:)) [if not already present] Generating copy(xp2(:,:)) [if not already present] 947, Generating copyin(threshold_hi) [if not already present] Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 948, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 949, ! blockidx%x threadidx%x collapsed 977, Generating update self(xp2(:,:)) 995, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 996, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 997, ! blockidx%x threadidx%x collapsed 997, Generating implicit firstprivate(solve_type) 1012, Generating copyin(threshold_hi) [if not already present] Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1013, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1014, ! blockidx%x threadidx%x collapsed 1014, Generating implicit firstprivate(solve_type) 1028, Generating update self(xp2(:,:)) clip_skewness: 1143, Generating copyin(gr,gr%zt(:,:),sfc_elevation(:)) [if not already present] Generating copy(wp3(:,:)) [if not already present] Generating copyin(wp2_zt(:,:)) [if not already present] 1149, Generating update self(wp3(:,:)) 1164, Generating update self(wp3(:,:)) clip_skewness_core: 1234, Generating enter data create(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:)) 1253, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1254, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1255, ! blockidx%x threadidx%x collapsed 1253, Generating default present(wp2_zt(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt)) 1264, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1265, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1266, ! blockidx%x threadidx%x collapsed 1264, Generating default present(sfc_elevation(:ngrdcol),zagl_thresh(:ngrdcol,:nzt),gr%zt(1:ngrdcol,1:nzt),gr) 1276, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1277, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1278, ! blockidx%x threadidx%x collapsed 1276, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt),skw_max_mag(:ngrdcol),h_zagl(:ngrdcol,:nzt)) 1289, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1290, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1291, ! blockidx%x threadidx%x collapsed 1289, Generating default present(gr%zt(1:ngrdcol,1:nzt),gr,skw_max_mag(:ngrdcol),sfc_elevation(:ngrdcol),wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt)) 1309, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1310, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1311, ! blockidx%x threadidx%x collapsed 1309, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1322, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1323, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1324, ! blockidx%x threadidx%x collapsed 1322, Generating default present(wp3(:ngrdcol,:nzt)) 1332, Generating exit data delete(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:)) monotonic_turbulent_flux_limit: 480, Generating enter data create(wpxp_net_adjust(:,:),wpxp_thresh_term(:,:),wpxp_mfl_min(:,:),wpxp_mfl_max(:,:),xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_xm_adjustment_needed(:),wpxp_mfl_max_term_zt(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min_term_zt(:,:),xm_mfl(:,:),wpxp_thresh_term_zt(:,:),xm_without_ta(:,:),xp2_zt(:,:)) 513, Generating update self(wpxp(:,:),xm_old(:,:),xm(:,:)) 545, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 546, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 547, ! blockidx%x threadidx%x collapsed 545, Generating default present(wpxp_net_adjust(:ngrdcol,:nzm)) 563, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 564, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 565, ! blockidx%x threadidx%x collapsed 563, Generating default present(xm(:ngrdcol,:nzt),xp2_zt(:ngrdcol,:nzt),xm_enter_mfl(:ngrdcol,:nzt)) 565, Generating implicit firstprivate(xp2_threshold,max_xp2) 579, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 580, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 581, ! blockidx%x threadidx%x collapsed 579, Generating default present(xp2_zt(:ngrdcol,:nzt),xm_without_ta(:ngrdcol,:nzt),min_x_allowable_lev(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt),xm_old(:ngrdcol,:nzt),max_x_allowable_lev(:ngrdcol,:nzt)) 581, Generating implicit firstprivate(xm_tol,solve_type,dt,max_dev) 644, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 645, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 646, ! blockidx%x threadidx%x collapsed 654, !$acc loop seq Generating implicit reduction(min:min_tmp) Generating implicit reduction(max:max_tmp) 644, Generating default present(low_lev_effect(:ngrdcol,:nzt),max_x_allowable_lev(:ngrdcol,:),min_x_allowable_lev(:ngrdcol,:),min_x_allowable(:ngrdcol,:nzt),max_x_allowable(:ngrdcol,:nzt),high_lev_effect(:ngrdcol,:nzt)) 646, Generating implicit firstprivate(j,min_tmp,max_tmp,low_lev,high_lev) 654, Loop is parallelizable 666, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 667, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 668, ! blockidx%x threadidx%x collapsed 666, Generating default present(wpxp_mfl_max_term_zt(:ngrdcol,:nzt),gr%dzt(1:ngrdcol,1:nzt),rho_ds_zt(:ngrdcol,:nzt),min_x_allowable(:ngrdcol,:nzt),wpxp_mfl_min_term_zt(:ngrdcol,:nzt),gr,max_x_allowable(:ngrdcol,:nzt),xm_without_ta(:ngrdcol,:nzt),wpxp_thresh_term_zt(:ngrdcol,:nzt)) 668, Generating implicit firstprivate(invrs_dt) 689, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 690, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_any_adjustment_needed) 691, ! blockidx%x threadidx%x collapsed 689, Generating default present(wpxp_mfl_max_term_zt(:ngrdcol,:nzm-2),wpxp_mfl_min(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),wpxp_mfl_max(:ngrdcol,2:nzm-1),wpxp_thresh_term(:ngrdcol,:nzm-2),wpxp_mfl_min_term_zt(:ngrdcol,:nzm-2),rho_ds_zm(:ngrdcol,:nzm-2),wpxp(:ngrdcol,:nzm-1)) Generating implicit copy(l_any_adjustment_needed) [if not already present] 691, Generating implicit firstprivate(solve_type,l_mono_flux_lim_spikefix) 735, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 736, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 740, !$acc loop seq 735, Generating default present(invrs_rho_ds_zm(:ngrdcol,2:nzm-1),l_xm_adjustment_needed(:ngrdcol),wpxp_mfl_max(:ngrdcol,2:nzm-1),wpxp_thresh_term(:ngrdcol,:nzm-2),wpxp_net_adjust(:ngrdcol,2:nzm-1),rho_ds_zm(:ngrdcol,:nzm-2),wpxp(:ngrdcol,:nzm-1),wpxp_mfl_min_term_zt(:ngrdcol,:nzm-2),wpxp_mfl_max_term_zt(:ngrdcol,:nzm-2),wpxp_mfl_min(:ngrdcol,2:nzm-1)) 740, Loop carried dependence of wpxp prevents parallelization Loop carried backward dependence of wpxp prevents vectorization Generating implicit firstprivate(solve_type,l_mono_flux_lim_spikefix) Loop carried dependence of wpxp prevents parallelization 831, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 832, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 833, ! blockidx%x threadidx%x collapsed 831, Generating default present(xm_mfl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),l_xm_adjustment_needed(:ngrdcol)) 881, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 882, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 891, !$acc loop seq Generating implicit reduction(+:rho_ds_zt$r) 916, !$acc loop seq 881, Generating default present(xm_enter_mfl(:ngrdcol,nzt),xm(:ngrdcol,:),rho_ds_zt(:ngrdcol,:nzt),gr,gr%dzt(1:ngrdcol,1:nzt-1),gr%zm(1:ngrdcol,nzm-1:nzm)) 882, Generating implicit firstprivate(xm_density_weighted,dz,xm_adj_coef,xm_vert_integral,xm_tol,nzm) 891, Loop is parallelizable 916, Loop is parallelizable 949, Generating update self(wpxp_mfl_min(:,:),min_x_allowable(:,:),wpxp(:,:),wpxp_mfl_max(:,:),max_x_allowable(:,:),xm_without_ta(:,:),xm(:,:)) 1014, Generating exit data delete(wpxp_net_adjust(:,:),wpxp_thresh_term(:,:),wpxp_mfl_min(:,:),wpxp_mfl_max(:,:),xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_xm_adjustment_needed(:),wpxp_mfl_max_term_zt(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min_term_zt(:,:),xm_mfl(:,:),wpxp_thresh_term_zt(:,:),xp2_zt(:,:),xm_without_ta(:,:)) mfl_xm_lhs: 1108, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1109, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1110, ! blockidx%x threadidx%x collapsed 1111, ! blockidx%x threadidx%x collapsed 1108, Generating default present(lhs(:,:ngrdcol,:nzt)) 1120, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1121, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1122, ! blockidx%x threadidx%x collapsed 1120, Generating default present(lhs(2,:ngrdcol,:nzt)) 1122, Generating implicit firstprivate(dt) mfl_xm_rhs: 1183, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1184, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1185, ! blockidx%x threadidx%x collapsed 1183, Generating default present(wpxp(:ngrdcol,:nzt+1),invrs_dzt(:ngrdcol,:nzt),invrs_rho_ds_zt(:ngrdcol,:nzt),rhs(:ngrdcol,:nzt),rho_ds_zm(:ngrdcol,:nzt+1),xm_old(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt)) 1185, Generating implicit firstprivate(dt) calc_turb_adv_range: 1408, Generating enter data create(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:)) 1511, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1512, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1513, ! blockidx%x threadidx%x collapsed 1511, Generating default present(w_min(:ngrdcol,:nzm),gr%dzm(1:ngrdcol,1:nzm),gr) 1513, Generating implicit firstprivate(invrs_dt) 1532, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1533, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1534, ! blockidx%x threadidx%x collapsed 1532, Generating default present(gr,gr%dzm(1:ngrdcol,:),low_lev_effect(:ngrdcol,2:nzt-2),vert_vel_up_zm(:ngrdcol,:)) 1534, Generating implicit firstprivate(j,dt_all_grid_levs) 1545, Loop carried reuse of low_lev_effect prevents parallelization Loop carried scalar dependence for dt_all_grid_levs at line 1558 Generating implicit firstprivate(dt_one_grid_lev,dt) Loop carried reuse of low_lev_effect prevents parallelization 1547, Accelerator restriction: induction variable live-out from loop: j 1550, Accelerator restriction: induction variable live-out from loop: j 1554, Accelerator restriction: induction variable live-out from loop: j 1581, Accelerator restriction: induction variable live-out from loop: j 1592, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1593, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1594, ! blockidx%x threadidx%x collapsed 1592, Generating default present(gr,gr%dzm(1:ngrdcol,:),vert_vel_down_zm(:ngrdcol,:),high_lev_effect(:ngrdcol,2:nzt-2)) 1594, Generating implicit firstprivate(j,dt_all_grid_levs) 1601, Loop carried reuse of high_lev_effect prevents parallelization Loop carried scalar dependence for dt_all_grid_levs at line 1618 Generating implicit firstprivate(dt_one_grid_lev,dt) Loop carried reuse of high_lev_effect prevents parallelization 1603, Accelerator restriction: induction variable live-out from loop: j 1606, Accelerator restriction: induction variable live-out from loop: j 1614, Accelerator restriction: induction variable live-out from loop: j 1641, Accelerator restriction: induction variable live-out from loop: j 1653, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1654, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1653, Generating default present(low_lev_effect(:ngrdcol,:),high_lev_effect(:ngrdcol,:)) 1654, Generating implicit firstprivate(nzt) 1664, Generating exit data delete(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:)) mean_vert_vel_up_down: 1920, Generating enter data create(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:)) 1933, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1934, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1935, ! blockidx%x threadidx%x collapsed 1933, Generating default present(mean_w_down(:ngrdcol,:nzm),mean_w_down_2nd(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_down_1st(:ngrdcol,:nzm)) 1943, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1944, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1945, ! blockidx%x threadidx%x collapsed 1943, Generating default present(mean_w_up(:ngrdcol,:nzm),mean_w_up_1st(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_up_2nd(:ngrdcol,:nzm)) 1953, Generating update self(mean_w_up(:,:),mean_w_down(:,:)) 1963, Generating exit data delete(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:)) calc_mean_w_up_down_component: 2045, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2046, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2047, ! blockidx%x threadidx%x collapsed 2045, Generating default present(w_min(:ngrdcol,2:nzm-1),w_i_zm(:ngrdcol,2:nzm-1),varnce_w_i_zm(:ngrdcol,2:nzm-1),mean_w_up_i(:ngrdcol,2:nzm-1),mean_w_down_i(:ngrdcol,2:nzm-1)) 2047, Generating implicit firstprivate(exp_cache,w_ref,sigma_w_i_zm,erf_cache) 2091, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2092, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2091, Generating default present(mean_w_up_i(:ngrdcol,:),mean_w_down_i(:ngrdcol,:)) 2092, Generating implicit firstprivate(nzm) output_multi_col_fields: 1432, Generating enter data create(rtpthlp_out(:,:),rcm_out(:,:),cloud_frac_out(:,:),wp2_out(:,:),upwp_out(:,:),thlp2_out(:,:),vp2_out(:,:),up2_out(:,:),rtp2_out(:,:),rtm_out(:,:),thlm_out(:,:),vpwp_out(:,:),wp3_out(:,:),wpthlp_out(:,:),wprtp_out(:,:)) 1441, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1442, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1443, ! blockidx%x threadidx%x collapsed 1441, Generating default present(upwp_out(1:ngrdcol,1:nzm),thlp2_out(1:ngrdcol,1:nzm),vp2_out(1:ngrdcol,1:nzm),up2_out(1:ngrdcol,1:nzm),rtp2_out(1:ngrdcol,1:nzm),rtpthlp_out(1:ngrdcol,1:nzm),vpwp_out(1:ngrdcol,1:nzm),wp2_out(1:ngrdcol,1:nzm),wprtp_out(1:ngrdcol,1:nzm),wpthlp_out(1:ngrdcol,1:nzm)) 1457, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1458, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1459, ! blockidx%x threadidx%x collapsed 1457, Generating default present(rtm_out(1:ngrdcol,1:nzt),rcm_out(1:ngrdcol,1:nzt),cloud_frac_out(1:ngrdcol,1:nzt),wp3_out(1:ngrdcol,1:nzt),thlm_out(1:ngrdcol,1:nzt)) 1478, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1479, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1480, ! blockidx%x threadidx%x collapsed 1478, Generating default present(vp2(:ngrdcol,:nzm),upwp_out(1:ngrdcol,1:nzm),up2(:ngrdcol,:nzm),thlp2_out(1:ngrdcol,1:nzm),vpwp(:ngrdcol,:nzm),vp2_out(1:ngrdcol,1:nzm),upwp(:ngrdcol,:nzm),up2_out(1:ngrdcol,1:nzm),rtpthlp(:ngrdcol,:nzm),rtp2_out(1:ngrdcol,1:nzm),rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),rtpthlp_out(1:ngrdcol,1:nzm),wp2(:ngrdcol,:nzm),vpwp_out(1:ngrdcol,1:nzm),wprtp(:ngrdcol,:nzm),wp2_out(1:ngrdcol,1:nzm),wpthlp_out(1:ngrdcol,1:nzm),wpthlp(:ngrdcol,:nzm),wprtp_out(1:ngrdcol,1:nzm)) 1495, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1496, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1497, ! blockidx%x threadidx%x collapsed 1495, Generating default present(thlm(:ngrdcol,:nzt),rtm_out(1:ngrdcol,1:nzt),rtm(:ngrdcol,:nzt),rcm_out(1:ngrdcol,1:nzt),cloud_frac(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),cloud_frac_out(1:ngrdcol,1:nzt),wp3_out(1:ngrdcol,1:nzt),wp3(:ngrdcol,:nzt),thlm_out(1:ngrdcol,1:nzt)) 1512, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1513, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1514, ! blockidx%x threadidx%x collapsed 1512, Generating default present(upwp_out(1:ngrdcol,1:nzm),thlp2_out(1:ngrdcol,1:nzm),vp2_out(1:ngrdcol,1:nzm),up2_out(1:ngrdcol,1:nzm),rtp2_out(1:ngrdcol,1:nzm),rtpthlp_out(1:ngrdcol,1:nzm),vpwp_out(1:ngrdcol,1:nzm),wp2_out(1:ngrdcol,1:nzm),wpthlp_out(1:ngrdcol,1:nzm),wprtp_out(1:ngrdcol,1:nzm)) 1514, Generating implicit firstprivate(sample_weight) 1528, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1530, ! blockidx%x threadidx%x collapsed 1528, Generating default present(rtm_out(1:ngrdcol,1:nzt),rcm_out(1:ngrdcol,1:nzt),cloud_frac_out(1:ngrdcol,1:nzt),wp3_out(1:ngrdcol,1:nzt),thlm_out(1:ngrdcol,1:nzt)) 1530, Generating implicit firstprivate(sample_weight) 1539, Generating update self(rtpthlp_out(:,:),rcm_out(:,:),cloud_frac_out(:,:),wp2_out(:,:),upwp_out(:,:),thlp2_out(:,:),vp2_out(:,:),up2_out(:,:),rtp2_out(:,:),rtm_out(:,:),thlm_out(:,:),vpwp_out(:,:),wp3_out(:,:),wpthlp_out(:,:),wprtp_out(:,:)) 1612, Generating exit data delete(rtpthlp_out(:,:),rcm_out(:,:),cloud_frac_out(:,:),wp2_out(:,:),upwp_out(:,:),thlp2_out(:,:),vp2_out(:,:),up2_out(:,:),rtp2_out(:,:),rtm_out(:,:),thlm_out(:,:),vpwp_out(:,:),wp3_out(:,:),wpthlp_out(:,:),wprtp_out(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_hybrid_pdf_main.F90 compute_mean_binormal: 679, Generating acc routine seq Generating NVIDIA GPU code calc_comp_corrs_binormal: 880, Generating enter data create(denominator(:,:),numerator(:,:)) 882, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 883, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 884, ! blockidx%x threadidx%x collapsed 882, Generating default present(numerator(:ngrdcol,:nz),sigma_x_2_sqd(:ngrdcol,:nz),sigma_x_1_sqd(:ngrdcol,:nz),sigma_y_1_sqd(:ngrdcol,:nz),mu_y_2(:ngrdcol,:nz),mu_x_1(:ngrdcol,:nz),mu_y_1(:ngrdcol,:nz),sigma_y_2_sqd(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),denominator(:ngrdcol,:nz),xpyp(:ngrdcol,:nz),ym(:ngrdcol,:nz),mu_x_2(:ngrdcol,:nz),xm(:ngrdcol,:nz)) 900, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 901, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 902, ! blockidx%x threadidx%x collapsed 900, Generating default present(corr_x_y_2(:ngrdcol,:nz),corr_x_y_1(:ngrdcol,:nz)) 908, Generating exit data delete(numerator(:,:),denominator(:,:)) smooth_corr_quotient: 1403, Generating enter data create(tmp_denom(:,:)) 1405, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1406, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1407, ! blockidx%x threadidx%x collapsed 1405, Generating default present(numerator(:ngrdcol,:nz),tmp_denom(:,:),quotient(:ngrdcol,:nz),denominator(:,:)) 1407, Generating implicit firstprivate(denom_thresh) 1420, Generating exit data delete(tmp_denom(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/numerical_check.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/new_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/stats_clubb_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/sfc_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/mixing_length.F90 calc_sfc_varnce: 204, Generating enter data create(vsp2_sfc(:),wp2_splat_sfc_correction(:),zeta(:),usp2_sfc(:),vm_sfc_sqd(:),um_sfc_sqd(:),ustar(:),uf(:),depth_pos_wpthlp(:),min_wp2_sfc_val(:)) 211, Generating update self(rtp2(:,:),rtpthlp(:,:),up2(:,:),thlp2(:,:),vp2(:,:),wp2(:,:)) 240, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 241, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 240, Generating default present(wpthlp(:ngrdcol,:),sfc_elevation(:ngrdcol),gr%zm(1:ngrdcol,:),depth_pos_wpthlp(:ngrdcol),gr) 241, Generating implicit firstprivate(k) 248, Accelerator restriction: induction variable live-out from loop: k 249, Accelerator restriction: induction variable live-out from loop: k 250, Accelerator restriction: induction variable live-out from loop: k 512, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 513, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 512, Generating default present(depth_pos_wpthlp(:ngrdcol),upwp_sfc(:ngrdcol),uf(:ngrdcol),vpwp_sfc(:ngrdcol),wpthlp(:ngrdcol,:1)) 513, Generating implicit firstprivate(t0,l_vary_convect_depth,ustar2,wstar) 540, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 541, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 540, Generating default present(a_const(:ngrdcol),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1),up2(:ngrdcol,:1),uf(:ngrdcol),up2_sfc_coef(:ngrdcol)) 554, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 555, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 554, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),thlp2(:ngrdcol,:1),rtpthlp(:ngrdcol,:1),uf(:ngrdcol),a_const(:ngrdcol),rtp2(:ngrdcol,:1)) 563, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 564, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 563, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),thlp2(:ngrdcol,:1),rtpthlp(:ngrdcol,:1),uf(:ngrdcol),a_const(:ngrdcol),rtp2(:ngrdcol,:1)) 572, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 573, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 572, Generating default present(thlp2(:ngrdcol,:1),rtp2(:ngrdcol,:1)) 584, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 585, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 584, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),rtp2(:ngrdcol,:1),thlp2(:ngrdcol,:1),min_wp2_sfc_val(:ngrdcol)) 593, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 594, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 593, Generating default present(wp2_splat_sfc_correction(:ngrdcol),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1),min_wp2_sfc_val(:ngrdcol),lhs_splat_wp2(:ngrdcol,:1),tau_zm(:ngrdcol,:1),up2(:ngrdcol,:1)) 614, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 615, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 616, ! blockidx%x threadidx%x collapsed 614, Generating default present(sclr_idx,a_const(:ngrdcol),wprtp_sfc(:ngrdcol),sclrpthlp(:ngrdcol,:1,:sclr_dim),uf(:ngrdcol),sclrp2(:ngrdcol,:1,:sclr_dim),wpthlp(:ngrdcol,:1),wpsclrp_sfc(:ngrdcol,:sclr_dim),sclrprtp(:ngrdcol,:1,:sclr_dim)) 671, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 672, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 671, Generating default present(wp2(:ngrdcol,:1)) 677, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 678, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 677, Generating default present(rtpthlp(:ngrdcol,:1),gr,rtp2(:ngrdcol,:1),gr%zm(1:ngrdcol,1),sfc_elevation(:ngrdcol),up2(:ngrdcol,:1),thlp2(:ngrdcol,:1),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1)) 696, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 697, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 698, ! blockidx%x threadidx%x collapsed 696, Generating default present(gr%zm(1:ngrdcol,1),sclrp2(:ngrdcol,:1,:sclr_dim),sclrprtp(:ngrdcol,:1,:sclr_dim),gr,sfc_elevation(:ngrdcol),sclrpthlp(:ngrdcol,:1,:sclr_dim)) 713, Generating update self(rtp2(:,:),rtpthlp(:,:),up2(:,:),thlp2(:,:),wp2(:,:),vp2(:,:)) 744, Generating update self(wp2(:,:),wprtp_sfc(:),vp2(:,:),up2(:,:),rtp2(:,:),rtpthlp(:,:),upwp_sfc(:),thlp2(:,:),vpwp_sfc(:),wpthlp(:,:)) 747, Generating update self(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:)) 789, Generating exit data delete(vsp2_sfc(:),zeta(:),wp2_splat_sfc_correction(:),usp2_sfc(:),vm_sfc_sqd(:),um_sfc_sqd(:),ustar(:),uf(:),depth_pos_wpthlp(:),min_wp2_sfc_val(:)) compute_mixing_length: 248, Generating enter data create(thv_par_1(:,:),thl_par_j_precalc(:,:),lv_coef(:,:),rt_par_j_precalc(:,:),cape_incr_1(:,:),s_par_1(:,:),rc_par_1(:,:),rsatl_par_1(:,:),tl_par_1(:,:),tke_i(:,:),rt_par_1(:,:),thl_par_1(:,:),dcape_dz_1(:,:),invrs_dzm_on_mu(:,:),exp_mu_dzm(:,:),grav_on_thvm(:,:),entrain_coef(:,:)) 253, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 254, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 253, Generating default present(mu(:ngrdcol)) 254, Generating implicit firstprivate(err_code) 271, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 272, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 273, ! blockidx%x threadidx%x collapsed 271, Generating default present(lscale_up(:ngrdcol,:nzt),lv_coef(:ngrdcol,:nzt),exner(:ngrdcol,:nzt),thvm(:ngrdcol,:nzt),thv_ds(:ngrdcol,:nzt),grav_on_thvm(:ngrdcol,:nzt),lscale_down(:ngrdcol,:nzt)) 287, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 288, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 289, ! blockidx%x threadidx%x collapsed 287, Generating default present(gr%invrs_dzm(1:ngrdcol,1:nzm),exp_mu_dzm(:ngrdcol,:nzm),gr%dzm(1:ngrdcol,1:nzm),entrain_coef(:ngrdcol,:nzm),gr,mu(:ngrdcol),invrs_dzm_on_mu(:ngrdcol,:nzm)) 311, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 312, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 313, ! blockidx%x threadidx%x collapsed 311, Generating default present(exp_mu_dzm(:ngrdcol,2:nzt-1),rt_par_j_precalc(:ngrdcol,2:nzt-1),rtm(:ngrdcol,:nzt-1),entrain_coef(:ngrdcol,2:nzt-1),thlm(:ngrdcol,:nzt-1),thl_par_j_precalc(:ngrdcol,2:nzt-1)) 334, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 335, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 336, ! blockidx%x threadidx%x collapsed 334, Generating default present(exner(:ngrdcol,2:nzt),rt_par_1(:ngrdcol,2:nzt),thlm(:ngrdcol,:nzt),tl_par_1(:ngrdcol,2:nzt),entrain_coef(:ngrdcol,2:nzt),rtm(:ngrdcol,:nzt),thl_par_1(:ngrdcol,2:nzt)) 362, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 363, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 364, !$acc loop seq 400, !$acc loop seq 362, Generating default present(exp_mu_dzm(:ngrdcol,:),gr,cape_incr_1(:ngrdcol,2:nzt),gr%zt(1:ngrdcol,:),thv_par_1(:ngrdcol,2:nzt),thv_ds(:ngrdcol,:),thl_par_j_precalc(:ngrdcol,:),s_par_1(:ngrdcol,2:nzt),lscale_up(:ngrdcol,:nzt-2),p_in_pa(:,:),rt_par_j_precalc(:ngrdcol,:),rc_par_1(:ngrdcol,2:nzt),rsatl_par_1(:ngrdcol,2:nzt),tl_par_1(:ngrdcol,2:nzt),tke_i(:ngrdcol,:nzt-2),gr%dzm(1:ngrdcol,:),exner(:ngrdcol,:),thl_par_1(:ngrdcol,2:nzt),rt_par_1(:ngrdcol,2:nzt),dcape_dz_1(:ngrdcol,2:nzt),lv_coef(:ngrdcol,:),thvm(:ngrdcol,:),grav_on_thvm(:ngrdcol,:),gr%invrs_dzm(1:ngrdcol,:)) 363, Scalar last value needed after loop for dcape_dz_j at line 748,755,768,766 Generating implicit firstprivate(lscale_up_max_alt) 364, Loop is parallelizable Generating implicit firstprivate(tl_par_j_sqd) 400, Loop carried scalar dependence for dcape_dz_j at line 518 Loop carried scalar dependence for lscale_up_max_alt at line 546,542 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 501,508,516 Scalar last value needed after loop for dcape_dz_j at line 748,755,768,766 Loop carried scalar dependence for lscale_up_max_alt at line 546 Generating implicit firstprivate(tke,thl_par_j,rt_par_j,j,dcape_dz_j,dcape_dz_j_minus_1,invrs_dcape_diff) Loop carried scalar dependence for dcape_dz_j at line 518 Loop carried scalar dependence for lscale_up_max_alt at line 542 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 501,508,516 422, Loop carried scalar dependence for rt_par_j at line 440 Loop carried scalar dependence for thl_par_j at line 433 Scalar last value needed after loop for dcape_dz_j at line 766,748,768,755 Loop carried scalar dependence for thl_par_j at line 433 Loop carried scalar dependence for tke at line 477 Loop carried scalar dependence for dcape_dz_j_minus_1 at line 474 Loop carried scalar dependence for tke at line 485 Loop carried scalar dependence for dcape_dz_j_minus_1 at line 474 Generating implicit firstprivate(tl_par_j,thv_par_j,s_par_j,rc_par_j,rsatl_par_j,j,saturation_formula,cape_incr) Loop carried scalar dependence for tke at line 485 433, Accelerator restriction: induction variable live-out from loop: j 440, Accelerator restriction: induction variable live-out from loop: j 447, Accelerator restriction: induction variable live-out from loop: j 449, Accelerator restriction: induction variable live-out from loop: j Reference argument passing prevents parallelization: tl_par_j 466, Accelerator restriction: induction variable live-out from loop: j 470, Accelerator restriction: induction variable live-out from loop: j 474, Accelerator restriction: induction variable live-out from loop: j 486, Accelerator restriction: induction variable live-out from loop: j 488, Accelerator restriction: induction variable live-out from loop: j 563, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 564, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 565, ! blockidx%x threadidx%x collapsed 563, Generating default present(exp_mu_dzm(:ngrdcol,2:nzt),rt_par_j_precalc(:ngrdcol,:nzt-1),rtm(:ngrdcol,:nzt),entrain_coef(:ngrdcol,2:nzt),thlm(:ngrdcol,:nzt),thl_par_j_precalc(:ngrdcol,:nzt-1)) 585, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 586, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 587, ! blockidx%x threadidx%x collapsed 585, Generating default present(exner(:ngrdcol,:nzt-1),rt_par_1(:ngrdcol,:nzt-1),tl_par_1(:ngrdcol,:nzt-1),thlm(:ngrdcol,:nzt),entrain_coef(:ngrdcol,2:nzt),rtm(:ngrdcol,:nzt),thl_par_1(:ngrdcol,:nzt-1)) 612, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 613, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 614, !$acc loop seq 649, !$acc loop seq 612, Generating default present(exp_mu_dzm(:ngrdcol,:),gr,cape_incr_1(:ngrdcol,:nzt-1),gr%zt(1:ngrdcol,:),thv_par_1(:ngrdcol,:nzt-1),thv_ds(:ngrdcol,:),thl_par_j_precalc(:ngrdcol,:),s_par_1(:ngrdcol,:nzt-1),lscale_down(:ngrdcol,2:nzt),p_in_pa(:,:),rt_par_j_precalc(:ngrdcol,:),rc_par_1(:ngrdcol,:nzt-1),rsatl_par_1(:ngrdcol,:nzt-1),tl_par_1(:ngrdcol,:nzt-1),tke_i(:ngrdcol,2:nzt),gr%invrs_dzm(1:ngrdcol,:),gr%dzm(1:ngrdcol,:),thl_par_1(:ngrdcol,:nzt-1),exner(:ngrdcol,:),rt_par_1(:ngrdcol,:nzt-1),dcape_dz_1(:ngrdcol,:nzt-1),lv_coef(:ngrdcol,:),thvm(:ngrdcol,:),grav_on_thvm(:ngrdcol,:)) 613, Generating implicit firstprivate(lscale_down_min_alt) 614, Loop is parallelizable Generating implicit firstprivate(tl_par_j_sqd) 649, Loop carried scalar dependence for dcape_dz_j at line 768 Loop carried scalar dependence for lscale_down_min_alt at line 792,791 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 748,755,766 Loop carried scalar dependence for lscale_down_min_alt at line 792 Generating implicit firstprivate(tke,thl_par_j,rt_par_j,j,dcape_dz_j,dcape_dz_j_plus_1,invrs_dcape_diff) Loop carried scalar dependence for dcape_dz_j at line 768 Loop carried scalar dependence for lscale_down_min_alt at line 791 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 748,755,766 671, Loop carried scalar dependence for thl_par_j at line 682 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 748 Scalar last value needed after loop for tke at line 755 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 766 Loop carried scalar dependence for rt_par_j at line 689 Scalar last value needed after loop for dcape_dz_j at line 748,766,768 Loop carried scalar dependence for dcape_dz_j_plus_1 at line 722 Loop carried scalar dependence for tke at line 733,725 Scalar last value needed after loop for dcape_dz_j at line 755 Scalar last value needed after loop for tke at line 768 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 768 Generating implicit firstprivate(tl_par_j,thv_par_j,s_par_j,rc_par_j,rsatl_par_j,j,saturation_formula,cape_incr) Loop carried scalar dependence for thl_par_j at line 682 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 748 Scalar last value needed after loop for tke at line 755 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 766 Loop carried scalar dependence for rt_par_j at line 689 Scalar last value needed after loop for dcape_dz_j at line 748,766,768 Loop carried scalar dependence for dcape_dz_j_plus_1 at line 722 Loop carried scalar dependence for tke at line 733,725 Scalar last value needed after loop for dcape_dz_j at line 755 Scalar last value needed after loop for tke at line 768 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 768 682, Accelerator restriction: induction variable live-out from loop: j 689, Accelerator restriction: induction variable live-out from loop: j 696, Accelerator restriction: induction variable live-out from loop: j 698, Accelerator restriction: induction variable live-out from loop: j Reference argument passing prevents parallelization: tl_par_j 715, Accelerator restriction: induction variable live-out from loop: j 718, Accelerator restriction: induction variable live-out from loop: j 722, Accelerator restriction: induction variable live-out from loop: j 734, Accelerator restriction: induction variable live-out from loop: j 736, Accelerator restriction: induction variable live-out from loop: j 803, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 804, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 805, !$acc loop seq 837, !$acc loop seq 803, Generating default present(gr,gr%zm(1:ngrdcol,1),lscale_up(:ngrdcol,:nzt),lscale_max(:ngrdcol),lscale(:ngrdcol,:),gr%zt(1:ngrdcol,1:nzt),lscale_down(:ngrdcol,:nzt)) 805, Loop is parallelizable Generating implicit firstprivate(l_implemented,lminh,lmin) 837, Loop is parallelizable 845, Generating update self(thlm(:,:),lscale_up(:,:),em(:,:),p_in_pa(:,:),rtm(:,:),thvm(:,:),thv_ds(:,:),lscale(:,:),lscale_down(:,:),exner(:,:)) 877, Generating exit data delete(thv_par_1(:,:),thl_par_j_precalc(:,:),lv_coef(:,:),rt_par_j_precalc(:,:),cape_incr_1(:,:),s_par_1(:,:),rc_par_1(:,:),rsatl_par_1(:,:),tl_par_1(:,:),tke_i(:,:),rt_par_1(:,:),thl_par_1(:,:),dcape_dz_1(:,:),invrs_dzm_on_mu(:,:),exp_mu_dzm(:,:),grav_on_thvm(:,:),entrain_coef(:,:)) calc_lscale_directly: 1031, Generating enter data create(mu_pert_2(:),mu_pert_neg_rt(:),mu_pert_1(:),lscale_pert_2(:,:),rtm_pert_2(:,:),rtm_pert_neg_rt(:,:),thlm_pert_2(:,:),thlm_pert_neg_rt(:,:),thlm_pert_pos_rt(:,:),rtm_pert_1(:,:),mu_pert_pos_rt(:),thlm_pert_1(:,:),sign_rtpthlp_zt(:,:),lscale_pert_1(:,:),rtm_pert_pos_rt(:,:)) 1207, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1208, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1209, ! blockidx%x threadidx%x collapsed 1207, Generating default present(lscale_pert_2(:ngrdcol,:nzt),lscale_pert_1(:ngrdcol,:nzt)) 1219, Generating update self(lscale_pert_2(:,:),lscale_pert_1(:,:)) 1274, Generating exit data delete(mu_pert_2(:),mu_pert_neg_rt(:),mu_pert_1(:),lscale_pert_2(:,:),rtm_pert_2(:,:),rtm_pert_neg_rt(:,:),thlm_pert_2(:,:),thlm_pert_pos_rt(:,:),thlm_pert_neg_rt(:,:),rtm_pert_1(:,:),mu_pert_pos_rt(:),thlm_pert_1(:,:),sign_rtpthlp_zt(:,:),lscale_pert_1(:,:),rtm_pert_pos_rt(:,:)) diagnose_lscale_from_tau: 1484, Generating enter data create(smooth_norm_ddzt_umvm(:,:),ice_supersat_frac_zm(:,:),h_invrs_tau_wpxp_n2(:,:),brunt_freq_pos(:,:),norm_ddzt_umvm(:,:),invrs_tau_shear_smooth(:,:),tmp_calc_ngrdcol(:),bvf_thresh(:,:),brunt_vaisala_freq_clipped(:,:),brunt_freq_out_cloud(:,:),ustar(:)) 1491, Generating enter data create(tmp_calc_max(:,:),tmp_calc_min_max(:,:),tmp_calc(:,:),tau_zt_unclipped(:,:),em_clipped(:,:),tau_zm_unclipped(:,:),ri_zm_smooth(:,:)) 1495, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1496, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1495, Generating default present(gr%zm(1:ngrdcol,1),sfc_elevation(:ngrdcol),clubb_params(:ngrdcol,102),gr) 1496, Generating implicit firstprivate(err_code) 1509, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1510, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1509, Generating default present(vpwp_sfc(:ngrdcol),upwp_sfc(:ngrdcol),tmp_calc_ngrdcol(:ngrdcol)) 1525, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1526, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1525, Generating default present(tmp_calc_ngrdcol(:ngrdcol),ustar(:ngrdcol)) 1526, Generating implicit firstprivate(ufmin) 1533, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1534, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1535, ! blockidx%x threadidx%x collapsed 1533, Generating default present(invrs_tau_bkgnd(:ngrdcol,:nzm),clubb_params(:ngrdcol,80)) 1535, Generating implicit firstprivate(tau_const) 1541, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1542, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1543, ! blockidx%x threadidx%x collapsed 1541, Generating default present(norm_ddzt_umvm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1551, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1552, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1553, ! blockidx%x threadidx%x collapsed 1551, Generating default present(clubb_params(:ngrdcol,82),smooth_norm_ddzt_umvm(:ngrdcol,:nzm),invrs_tau_shear_smooth(:ngrdcol,:nzm)) 1564, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1565, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1566, ! blockidx%x threadidx%x collapsed 1564, Generating default present(gr%zm(1:ngrdcol,1:nzm),invrs_tau_sfc(:ngrdcol,:nzm),clubb_params(:ngrdcol,81:),gr,ustar(:ngrdcol),sfc_elevation(:ngrdcol)) 1575, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1576, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1577, ! blockidx%x threadidx%x collapsed 1575, Generating default present(invrs_tau_bkgnd(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),invrs_tau_shear(:ngrdcol,:nzm),invrs_tau_sfc(:ngrdcol,:nzm)) 1599, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1600, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1601, ! blockidx%x threadidx%x collapsed 1599, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm)) 1638, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1639, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1640, ! blockidx%x threadidx%x collapsed 1638, Generating default present(ice_supersat_frac_zm(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1651, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1652, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1653, ! blockidx%x threadidx%x collapsed 1651, Generating default present(clubb_params(:ngrdcol,92),gr%zm(1:ngrdcol,1:nzm),gr,brunt_freq_out_cloud(:ngrdcol,:nzm)) 1664, Generating update self(brunt_freq_pos(:,:),brunt_freq_out_cloud(:,:)) 1678, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1679, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1680, ! blockidx%x threadidx%x collapsed 1678, Generating default present(invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_shear(:ngrdcol,:nzm),invrs_tau_n2_iso(:ngrdcol,:nzm),invrs_tau_bkgnd(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:84),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm)) 1680, Generating implicit firstprivate(c_invrs_tau_n2_wp2,c_invrs_tau_n2) 1701, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1702, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1703, ! blockidx%x threadidx%x collapsed 1701, Generating default present(invrs_tau_zm(:ngrdcol,:nzm)) 1709, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1710, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1711, ! blockidx%x threadidx%x collapsed 1709, Generating default present(invrs_tau_no_n2_zm(:ngrdcol,:nzm),gr%zm(1:ngrdcol,1:nzm),sfc_elevation(:ngrdcol),invrs_tau_xp2_zm(:ngrdcol,:nzm),em(:ngrdcol,:nzm),gr,brunt_freq_pos(:ngrdcol,:nzm),clubb_params(:ngrdcol,81:)) 1752, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1753, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1754, ! blockidx%x threadidx%x collapsed 1752, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),invrs_tau_xp2_zm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1766, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1767, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1768, ! blockidx%x threadidx%x collapsed 1766, Generating default present(clubb_params(:ngrdcol,86),invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1778, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1779, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1780, ! blockidx%x threadidx%x collapsed 1778, Generating default present(invrs_tau_xp2_zm(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:85),brunt_freq_pos(:ngrdcol,:nzm)) 1801, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1802, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1803, ! blockidx%x threadidx%x collapsed 1801, Generating default present(invrs_tau_wpxp_zm(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:86),brunt_freq_pos(:ngrdcol,:nzm)) 1815, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1816, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1817, ! blockidx%x threadidx%x collapsed 1815, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),clubb_params(:ngrdcol,89),bvf_thresh(:ngrdcol,:nzm)) 1829, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1830, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1831, ! blockidx%x threadidx%x collapsed 1829, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),h_invrs_tau_wpxp_n2(:ngrdcol,:nzm),clubb_params(:ngrdcol,89)) 1873, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1874, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1875, ! blockidx%x threadidx%x collapsed 1873, Generating default present(h_invrs_tau_wpxp_n2(:ngrdcol,:nzm),gr%zm(1:ngrdcol,1:nzm),ri_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,88:101),gr) 1888, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1889, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1890, ! blockidx%x threadidx%x collapsed 1888, Generating default present(invrs_tau_wp3_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,87),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1922, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1923, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1924, ! blockidx%x threadidx%x collapsed 1922, Generating default present(tau_max_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale_max(:ngrdcol)) 1930, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1931, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1932, ! blockidx%x threadidx%x collapsed 1930, Generating default present(tau_max_zm(:ngrdcol,:nzm),lscale_max(:ngrdcol),em(:ngrdcol,:nzm)) 1960, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1961, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1962, ! blockidx%x threadidx%x collapsed 1960, Generating default present(tau_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm)) 1970, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1971, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1972, ! blockidx%x threadidx%x collapsed 1970, Generating default present(tau_zt(:ngrdcol,:nzt),tau_max_zt(:ngrdcol,:nzt)) 1983, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1984, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1985, ! blockidx%x threadidx%x collapsed 1983, Generating default present(lscale(:ngrdcol,:nzt),lscale_down(:ngrdcol,:nzt),tau_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale_up(:ngrdcol,:nzt)) 1998, Generating exit data delete(smooth_norm_ddzt_umvm(:,:),ice_supersat_frac_zm(:,:),h_invrs_tau_wpxp_n2(:,:),brunt_freq_pos(:,:),norm_ddzt_umvm(:,:),invrs_tau_shear_smooth(:,:),tmp_calc_ngrdcol(:),bvf_thresh(:,:),brunt_vaisala_freq_clipped(:,:),brunt_freq_out_cloud(:,:),ustar(:)) 2005, Generating exit data delete(tmp_calc_min_max(:,:),tmp_calc_max(:,:),tmp_calc(:,:),tau_zt_unclipped(:,:),em_clipped(:,:),tau_zm_unclipped(:,:),ri_zm_smooth(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/pdf_closure_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_windm_edsclrm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/setup_clubb_pdf_params.F90 advance_windm_edsclrm: 283, Generating enter data create(wind_speed_pert(:,:),km_zt(:,:),km_zm_p_nu10(:,:),lhs_diff(:,:,:),lhs(:,:,:),lhs_ma_zt(:,:,:),u_star_sqd(:),solution(:,:,:),wind_speed(:,:),vpwp_chnge(:,:),rhs(:,:,:),nu_zero(:),kmh_zt(:,:),vm_tndcy(:,:),um_tndcy(:,:),vm_old(:,:),um_old(:,:),upwp_chnge(:,:),u_star_sqd_pert(:),xpwp(:,:)) 289, Generating enter data create(edsclrm_old(:,:,:)) 291, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 292, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 291, Generating default present(nu_zero(:ngrdcol)) 297, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 298, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 299, ! blockidx%x threadidx%x collapsed 297, Generating default present(km_zm(:ngrdcol,:nzm),km_zm_p_nu10(:ngrdcol,:nzm),nu_vert_res_dep%nu10(1:ngrdcol),nu_vert_res_dep) 313, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 314, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 315, ! blockidx%x threadidx%x collapsed 316, ! blockidx%x threadidx%x collapsed 313, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt)) 334, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 335, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 336, ! blockidx%x threadidx%x collapsed 334, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 371, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 372, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 373, ! blockidx%x threadidx%x collapsed 371, Generating default present(wind_speed(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 380, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 381, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 380, Generating default present(upwp(:ngrdcol,:1),vpwp(:ngrdcol,:1),u_star_sqd(:ngrdcol)) 418, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 419, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 420, ! blockidx%x threadidx%x collapsed 418, Generating default present(upwp(:ngrdcol,2:nzm-1),xpwp(:ngrdcol,2:nzm-1)) 430, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 431, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 432, ! blockidx%x threadidx%x collapsed 430, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1)) 441, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 442, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 441, Generating default present(vpwp(:ngrdcol,nzm),upwp(:ngrdcol,nzm)) 442, Generating implicit firstprivate(nzm) 478, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 479, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 480, ! blockidx%x threadidx%x collapsed 478, Generating default present(solution(:ngrdcol,:nzt,:1),um(:ngrdcol,:nzt)) 489, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 490, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 491, ! blockidx%x threadidx%x collapsed 489, Generating default present(vm(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,2)) 499, Generating update self(um(:,:),wind_speed(:,:),vm(:,:),lhs_ma_zt(:,:,:),rho_ds_zm(:,:),lhs_diff(:,:,:),invrs_rho_ds_zt(:,:),u_star_sqd(:)) 525, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 526, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 527, ! blockidx%x threadidx%x collapsed 525, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 537, Generating update self(vm_ref(:,:),vm(:,:),um(:,:),um_ref(:,:)) 578, Generating update device(vm(:,:),um(:,:)) 590, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 591, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 592, ! blockidx%x threadidx%x collapsed 590, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp(:ngrdcol,2:nzm-1)) 602, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 603, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 604, ! blockidx%x threadidx%x collapsed 602, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1)) 615, Generating update self(vm(:,:),um(:,:)) 624, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 625, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 626, ! blockidx%x threadidx%x collapsed 624, Generating default present(vm_ref(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_ref(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 626, Generating implicit firstprivate(ts_nudge,dt) 634, Generating update self(vm(:,:),um(:,:)) 646, Generating update self(vm_ref(:,:),um_ref(:,:)) 749, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 750, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 751, ! blockidx%x threadidx%x collapsed 749, Generating default present(wind_speed_pert(:ngrdcol,:nzt),vm_pert(:ngrdcol,:nzt),um_pert(:ngrdcol,:nzt)) 758, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 759, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 758, Generating default present(vpwp_pert(:ngrdcol,:1),upwp_pert(:ngrdcol,:1),u_star_sqd_pert(:ngrdcol)) 796, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 797, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 798, ! blockidx%x threadidx%x collapsed 796, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp_pert(:ngrdcol,2:nzm-1)) 808, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 809, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 810, ! blockidx%x threadidx%x collapsed 808, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp_pert(:ngrdcol,2:nzm-1)) 819, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 820, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 819, Generating default present(vpwp_pert(:ngrdcol,nzm),upwp_pert(:ngrdcol,nzm)) 820, Generating implicit firstprivate(nzm) 856, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 857, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 858, ! blockidx%x threadidx%x collapsed 856, Generating default present(um_pert(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,:1)) 867, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 868, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 869, ! blockidx%x threadidx%x collapsed 867, Generating default present(vm_pert(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,2)) 883, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 884, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 885, ! blockidx%x threadidx%x collapsed 883, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp_pert(:ngrdcol,2:nzm-1)) 895, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 896, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 897, ! blockidx%x threadidx%x collapsed 895, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp_pert(:ngrdcol,2:nzm-1)) 984, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 985, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 986, ! blockidx%x threadidx%x collapsed 987, ! blockidx%x threadidx%x collapsed 984, Generating default present(edsclrm_old(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1028, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1029, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1030, ! blockidx%x threadidx%x collapsed 1028, Generating default present(xpwp(:ngrdcol,2:nzm-1),wpedsclrp(:ngrdcol,2:nzm-1,edsclr)) 1040, Generating implicit firstprivate(edsclr_dim,ngrdcol) Generating NVIDIA GPU code 1041, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1042, ! blockidx%x threadidx%x collapsed 1040, Generating default present(wpedsclrp(:ngrdcol,nzm,:edsclr_dim)) 1042, Generating implicit firstprivate(nzm) 1075, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 1076, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1077, ! blockidx%x threadidx%x collapsed 1078, ! blockidx%x threadidx%x collapsed 1075, Generating default present(solution(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1086, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 1087, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1088, ! blockidx%x threadidx%x collapsed 1089, ! blockidx%x threadidx%x collapsed 1086, Generating default present(edsclrm_old(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1107, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1109, ! blockidx%x threadidx%x collapsed 1107, Generating default present(xpwp(:ngrdcol,2:nzm-1),wpedsclrp(:ngrdcol,2:nzm-1,edsclr)) 1124, Generating update self(wpedsclrp(:,:,:),wp2(:,:),vp2(:,:),up2(:,:),edsclrm_forcing(:,:,:),vg(:,:),vm_forcing(:,:),ug(:,:),um_forcing(:,:),edsclrm_old(:,:,:),edsclrm(:,:,:),vm(:,:),um(:,:),vm_ref(:,:),um_ref(:,:),wm_zt(:,:),vm_old(:,:),um_old(:,:),upwp(:,:),km_zm(:,:),fcor(:),vpwp(:,:)) 1172, Generating exit data delete(wind_speed_pert(:,:),km_zt(:,:),km_zm_p_nu10(:,:),lhs_diff(:,:,:),lhs(:,:,:),lhs_ma_zt(:,:,:),u_star_sqd(:),solution(:,:,:),wind_speed(:,:),vpwp_chnge(:,:),rhs(:,:,:),nu_zero(:),kmh_zt(:,:),vm_tndcy(:,:),um_tndcy(:,:),vm_old(:,:),um_old(:,:),upwp_chnge(:,:),u_star_sqd_pert(:),xpwp(:,:)) 1178, Generating exit data delete(edsclrm_old(:,:,:)) compute_uv_tndcy: 2009, Generating enter data create(xm_gf(:,:),xm_cf(:,:)) 2023, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2024, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2025, ! blockidx%x threadidx%x collapsed 2023, Generating default present(perp_wind_g(:ngrdcol,:nzt),xm_gf(:ngrdcol,:nzt),fcor(:ngrdcol)) 2031, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2032, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2033, ! blockidx%x threadidx%x collapsed 2031, Generating default present(xm_cf(:ngrdcol,:nzt),perp_wind_m(:ngrdcol,:nzt),fcor(:ngrdcol)) 2045, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2046, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2047, ! blockidx%x threadidx%x collapsed 2045, Generating default present(xm_gf(:ngrdcol,:nzt),perp_wind_g(:ngrdcol,:nzt),fcor(:ngrdcol)) 2053, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2054, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2055, ! blockidx%x threadidx%x collapsed 2053, Generating default present(perp_wind_m(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt),fcor(:ngrdcol)) 2067, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2068, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2069, ! blockidx%x threadidx%x collapsed 2067, Generating default present(xm_gf(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt)) 2078, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2079, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2080, ! blockidx%x threadidx%x collapsed 2078, Generating default present(xm_tndcy(:ngrdcol,:nzt),xm_gf(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt)) 2088, Generating update self(xm_cf(:,:),xm_gf(:,:),xm_forcing(:,:)) 2107, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2109, ! blockidx%x threadidx%x collapsed 2107, Generating default present(xm_tndcy(:ngrdcol,:nzt)) 2117, Generating exit data delete(xm_gf(:,:),xm_cf(:,:)) windm_edsclrm_lhs: 2193, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2194, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2195, ! blockidx%x threadidx%x collapsed 2193, Generating default present(lhs(:,:ngrdcol,:nzt),lhs_diff(:,:ngrdcol,:nzt)) 2195, Generating implicit firstprivate(invrs_dt) 2210, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2211, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2212, ! blockidx%x threadidx%x collapsed 2213, !$acc loop seq 2210, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt-1),lhs(:,:ngrdcol,:nzt-1)) 2213, Loop is parallelizable 2223, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2224, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2223, Generating default present(rho_ds_zm(:ngrdcol,:1),wind_speed(:ngrdcol,:1),u_star_sqd(:ngrdcol),lhs(2,:ngrdcol,:1),gr,gr%invrs_dzt(1:ngrdcol,1),invrs_rho_ds_zt(:ngrdcol,:1)) windm_edsclrm_rhs: 2340, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2341, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2340, Generating default present(rhs(:ngrdcol,:1),xm_tndcy(:ngrdcol,:1),xm(:ngrdcol,:2),lhs_diff(:2,:ngrdcol,:1)) 2341, Generating implicit firstprivate(invrs_dt) 2351, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2352, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2353, ! blockidx%x threadidx%x collapsed 2351, Generating default present(lhs_diff(:,:ngrdcol,2:nzt-1),xm_tndcy(:ngrdcol,2:nzt-1),xm(:ngrdcol,:nzt),rhs(:ngrdcol,2:nzt-1)) 2353, Generating implicit firstprivate(invrs_dt) 2365, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2366, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2365, Generating default present(rhs(:ngrdcol,nzt),xm_tndcy(:ngrdcol,nzt),xm(:ngrdcol,nzt-1:nzt),lhs_diff(2:,:ngrdcol,nzt)) 2366, Generating implicit firstprivate(nzt,invrs_dt) 2377, Generating update self(xm(:,:),lhs_diff(:,:,:)) 2417, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2418, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2417, Generating default present(xpwp_sfc(:ngrdcol),rhs(:ngrdcol,:1),invrs_rho_ds_zt(:ngrdcol,:1),gr,gr%invrs_dzt(1:ngrdcol,1),rho_ds_zm(:ngrdcol,:1)) 2427, Generating update self(xpwp_sfc(:),rho_ds_zm(:,:),invrs_rho_ds_zt(:,:)) pdf_closure: 423, Generating enter data create(rsatl_1(:,:),rc_2_ice(:,:),rc_1_ice(:,:),corr_v_w_2(:,:),vprcp_contrib_comp_1(:,:),varnce_v_2(:,:),uprcp_contrib_comp_1(:,:),u_2(:,:),thlprcp_contrib_comp_1(:,:),sqrt_wp2(:,:),rtprcp_contrib_comp_1(:,:),rsatl_2(:,:),wp2rcp_contrib_comp_1(:,:),vprcp_contrib_comp_2(:,:),wprcp_contrib_comp_1(:,:),wp2rcp_contrib_comp_2(:,:),sku(:,:),skthl(:,:),rtprcp_contrib_comp_2(:,:),skrt(:,:),skv(:,:),tl1(:,:),thlprcp_contrib_comp_2(:,:),corr_v_w_1(:,:),corr_u_w_2(:,:),corr_u_w_1(:,:),alpha_v(:,:),alpha_u(:,:),varnce_v_1(:,:),varnce_u_2(:,:),v_1(:,:),uprcp_contrib_comp_2(:,:),varnce_u_1(:,:),v_2(:,:),u_1(:,:),tl2(:,:),wprcp_contrib_comp_2(:,:)) 435, Generating enter data create(sclr2(:,:,:),corr_w_sclr_1(:,:,:),corr_sclr_thl_2(:,:,:),corr_sclr_rt_1(:,:,:),alpha_sclr(:,:,:),corr_sclr_thl_1(:,:,:),corr_sclr_rt_2(:,:,:),varnce_sclr1(:,:,:),varnce_sclr2(:,:,:),sksclr(:,:,:),sclr1(:,:,:),corr_w_sclr_2(:,:,:)) 486, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 487, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 488, ! blockidx%x threadidx%x collapsed 486, Generating default present(wp2(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz)) 637, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 638, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 639, ! blockidx%x threadidx%x collapsed 637, Generating default present(corr_v_w_1(:ngrdcol,:nz),corr_u_w_2(:ngrdcol,:nz),corr_u_w_1(:ngrdcol,:nz),corr_v_w_2(:ngrdcol,:nz),pdf_params%corr_w_thl_2(1:ngrdcol,1:nz),pdf_params%corr_w_thl_1(1:ngrdcol,1:nz),pdf_params%corr_w_rt_2(1:ngrdcol,1:nz),pdf_params%corr_w_rt_1(1:ngrdcol,1:nz),pdf_params) 706, Generating implicit firstprivate(ngrdcol,sclr_dim,nz) Generating NVIDIA GPU code 707, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 708, ! blockidx%x threadidx%x collapsed 709, !$acc loop seq 706, Generating default present(corr_w_sclr_1(:ngrdcol,:nz,:sclr_dim),corr_w_sclr_2(:ngrdcol,:nz,:sclr_dim)) 709, Loop is parallelizable 900, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 901, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 902, ! blockidx%x threadidx%x collapsed 900, Generating default present(tl2(:ngrdcol,:nz),tl1(:ngrdcol,:nz),exner(:ngrdcol,:nz),pdf_params%thl_1(1:ngrdcol,1:nz),pdf_params%thl_2(1:ngrdcol,1:nz),pdf_params) 968, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 969, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 970, ! blockidx%x threadidx%x collapsed 968, Generating default present(pdf_params%rsatl_1(1:ngrdcol,1:nz),rsatl_2(:ngrdcol,:nz),rsatl_1(:ngrdcol,:nz),pdf_params,pdf_params%rsatl_2(1:ngrdcol,1:nz)) 1034, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1035, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1036, ! blockidx%x threadidx%x collapsed 1034, Generating default present(ice_supersat_frac(:ngrdcol,:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%ice_supersat_frac_2(1:ngrdcol,1:nz),pdf_params%ice_supersat_frac_1(1:ngrdcol,1:nz)) 1067, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1068, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1069, ! blockidx%x threadidx%x collapsed 1067, Generating default present(rcm(:ngrdcol,:nz),pdf_params%rc_2(1:ngrdcol,1:nz),cloud_frac(:ngrdcol,:nz),pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),pdf_params,pdf_params%cloud_frac_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz)) 1084, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1085, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1086, ! blockidx%x threadidx%x collapsed 1084, Generating default present(pdf_params%corr_w_eta_2(1:ngrdcol,1:nz),pdf_params%corr_w_eta_1(1:ngrdcol,1:nz),pdf_params%corr_w_chi_2(1:ngrdcol,1:nz),pdf_params%corr_w_chi_1(1:ngrdcol,1:nz),pdf_params) 1173, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1174, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1175, ! blockidx%x threadidx%x collapsed 1173, Generating default present(uprcp_contrib_comp_2(:ngrdcol,:nz),vprcp(:ngrdcol,:nz),vprcp_contrib_comp_1(:ngrdcol,:nz),thv_ds(:ngrdcol,:nz),uprcp(:ngrdcol,:nz),uprcp_contrib_comp_1(:ngrdcol,:nz),rtprcp_contrib_comp_2(:ngrdcol,:nz),thlprcp(:ngrdcol,:nz),thlprcp_contrib_comp_1(:ngrdcol,:nz),rc_coef(:ngrdcol,:nz),rtprcp(:ngrdcol,:nz),rtprcp_contrib_comp_1(:ngrdcol,:nz),vprcp_contrib_comp_2(:ngrdcol,:nz),wp2rcp(:ngrdcol,:nz),wp2rcp_contrib_comp_1(:ngrdcol,:nz),wp2rcp_contrib_comp_2(:ngrdcol,:nz),wprcp(:ngrdcol,:nz),wprcp_contrib_comp_2(:ngrdcol,:nz),wprcp_contrib_comp_1(:ngrdcol,:nz),exner(:ngrdcol,:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),thlprcp_contrib_comp_2(:ngrdcol,:nz)) 1202, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1203, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1204, ! blockidx%x threadidx%x collapsed 1202, Generating default present(thlprcp(:ngrdcol,:nz),rtpthvp(:ngrdcol,:nz),thlp2(:ngrdcol,:nz),rtpthlp(:ngrdcol,:nz),rtprcp(:ngrdcol,:nz),rc_coef(:ngrdcol,:nz),rtp2(:ngrdcol,:nz),wp2thlp(:ngrdcol,:nz),wp2rtp(:ngrdcol,:nz),wp2rcp(:ngrdcol,:nz),thv_ds(:ngrdcol,:nz),wpthvp(:ngrdcol,:nz),wpthlp(:ngrdcol,:nz),wprtp(:ngrdcol,:nz),thlpthvp(:ngrdcol,:nz),wprcp(:ngrdcol,:nz),wp2thvp(:ngrdcol,:nz)) 1240, Generating implicit firstprivate(ngrdcol,sclr_dim,nz) Generating NVIDIA GPU code 1241, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1242, ! blockidx%x threadidx%x collapsed 1243, ! blockidx%x threadidx%x collapsed 1240, Generating default present(corr_sclr_thl_2(:ngrdcol,:nz,:sclr_dim),pdf_params%cloud_frac_1(1:ngrdcol,1:nz),varnce_sclr2(:ngrdcol,:nz,:sclr_dim),varnce_sclr1(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_rt_1(1:ngrdcol,1:nz),pdf_params%crt_1(1:ngrdcol,1:nz),pdf_params%cthl_2(1:ngrdcol,1:nz),corr_sclr_rt_1(:ngrdcol,:nz,:sclr_dim),pdf_params,thv_ds(:ngrdcol,:nz),pdf_params%rc_2(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),sclr1(:ngrdcol,:nz,:sclr_dim),sclr2(:ngrdcol,:nz,:sclr_dim),pdf_params%mixt_frac(1:ngrdcol,1:nz),rc_coef(:ngrdcol,:nz),pdf_params%varnce_rt_2(1:ngrdcol,1:nz),pdf_params%crt_2(1:ngrdcol,1:nz),corr_sclr_rt_2(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_thl_1(1:ngrdcol,1:nz),pdf_params%cthl_1(1:ngrdcol,1:nz),corr_sclr_thl_1(:ngrdcol,:nz,:sclr_dim),sclrm(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_thl_2(1:ngrdcol,1:nz),sclrpthvp(:ngrdcol,:nz,:sclr_dim),sclrprcp(:ngrdcol,:nz,:sclr_dim),sclrprtp(:ngrdcol,:nz,:sclr_dim),sclrpthlp(:ngrdcol,:nz,:sclr_dim)) 1283, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1284, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1285, ! blockidx%x threadidx%x collapsed 1283, Generating default present(rcp2(:ngrdcol,:nz),rcm(:ngrdcol,:nz),pdf_params%stdev_chi_2(1:ngrdcol,1:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%rc_2(1:ngrdcol,1:nz),pdf_params%chi_2(1:ngrdcol,1:nz),pdf_params%chi_1(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),pdf_params%stdev_chi_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz)) 1316, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1317, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1318, ! blockidx%x threadidx%x collapsed 1316, Generating default present(cloudy_downdraft_frac(:ngrdcol,:nz),cloudy_updraft_frac(:ngrdcol,:nz),w_up_in_cloud(:ngrdcol,:nz),w_down_in_cloud(:ngrdcol,:nz)) 1363, Generating update self(pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),cloud_frac(:,:),pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),wprtp2(:,:),rcm(:,:),rtpthvp(:,:),rcp2(:,:),thlpthvp(:,:),wp4(:,:),thlprcp(:,:),rtprcp(:,:),wp2thlp(:,:),wpthlp2(:,:),pdf_params%w_2(:,:),wp2rtp(:,:),wprtpthlp(:,:),wp2rcp(:,:),wprcp(:,:),wp2thvp(:,:),wpthvp(:,:)) 1390, Generating update self(sclrpthvp(:,:,:),wpsclrpthlp(:,:,:),wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:)) 1416, Generating update self(exner(:,:),rtp2(:,:),wprtp(:,:),thlm(:,:),sigma_sqd_w(:,:),wp3(:,:),rtm(:,:),p_in_pa(:,:),rtpthlp(:,:),wp2(:,:),wm(:,:),thv_ds(:,:),thlp2(:,:),ice_supersat_frac(:,:),wpthlp(:,:)) 1419, Generating update self(sclrprtp(:,:,:),sclrp2(:,:,:),sclrm(:,:,:),wpsclrp(:,:,:),sclrpthlp(:,:,:)) 1711, Generating exit data delete(rsatl_1(:,:),rc_2_ice(:,:),rc_1_ice(:,:),corr_v_w_2(:,:),vprcp_contrib_comp_1(:,:),varnce_v_2(:,:),uprcp_contrib_comp_1(:,:),u_2(:,:),thlprcp_contrib_comp_1(:,:),sqrt_wp2(:,:),rtprcp_contrib_comp_1(:,:),rsatl_2(:,:),wp2rcp_contrib_comp_1(:,:),vprcp_contrib_comp_2(:,:),wprcp_contrib_comp_1(:,:),wp2rcp_contrib_comp_2(:,:),sku(:,:),skthl(:,:),rtprcp_contrib_comp_2(:,:),skrt(:,:),skv(:,:),tl1(:,:),thlprcp_contrib_comp_2(:,:),corr_v_w_1(:,:),corr_u_w_2(:,:),corr_u_w_1(:,:),alpha_v(:,:),alpha_u(:,:),varnce_v_1(:,:),varnce_u_2(:,:),v_1(:,:),uprcp_contrib_comp_2(:,:),varnce_u_1(:,:),v_2(:,:),u_1(:,:),tl2(:,:),wprcp_contrib_comp_2(:,:)) 1723, Generating exit data delete(sclr2(:,:,:),corr_w_sclr_1(:,:,:),corr_sclr_thl_2(:,:,:),corr_sclr_rt_1(:,:,:),alpha_sclr(:,:,:),corr_sclr_thl_1(:,:,:),corr_sclr_rt_2(:,:,:),varnce_sclr2(:,:,:),varnce_sclr1(:,:,:),sksclr(:,:,:),sclr1(:,:,:),corr_w_sclr_2(:,:,:)) transform_pdf_chi_eta_component: 1803, Generating enter data create(denominator(:,:)) 1805, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1806, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1807, ! blockidx%x threadidx%x collapsed 1805, Generating default present(crt(:ngrdcol,:nz),cthl(:ngrdcol,:nz),chi(:ngrdcol,:nz),rsatl(:ngrdcol,:nz),exner(:ngrdcol,:nz),tl(:ngrdcol,:nz),rt(:ngrdcol,:nz)) 1807, Generating implicit firstprivate(beta,invrs_beta_rsatl_p1) 1832, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1833, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1834, ! blockidx%x threadidx%x collapsed 1832, Generating default present(cthl(:ngrdcol,:nz),stdev_chi(:ngrdcol,:nz),denominator(:ngrdcol,:nz),corr_rt_thl(:ngrdcol,:nz),crt(:ngrdcol,:nz),varnce_thl(:ngrdcol,:nz),varnce_rt(:ngrdcol,:nz),covar_chi_eta(:ngrdcol,:nz),stdev_eta(:ngrdcol,:nz)) 1834, Generating implicit firstprivate(varnce_eta,varnce_thl_term,varnce_rt_term,corr_rt_thl_term,varnce_chi) 1858, Generating exit data delete(denominator(:,:)) calc_wp4_pdf: 1925, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1926, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1927, ! blockidx%x threadidx%x collapsed 1925, Generating default present(wp4(:ngrdcol,:nz),wm(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz)) calc_wp2xp2_pdf: 2030, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2031, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2032, ! blockidx%x threadidx%x collapsed 2030, Generating default present(wm(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),wp2xp2(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_wp2xp_pdf: 2137, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2138, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2139, ! blockidx%x threadidx%x collapsed 2137, Generating default present(wm(:ngrdcol,:nz),wp2xp(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz)) calc_wpxp2_pdf: 2237, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2238, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2239, ! blockidx%x threadidx%x collapsed 2237, Generating default present(wm(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),wpxp2(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_wpxpyp_pdf: 2364, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2365, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2366, ! blockidx%x threadidx%x collapsed 2364, Generating default present(wm(:ngrdcol,:nz),varnce_y_2(:ngrdcol,:nz),corr_w_y_2(:ngrdcol,:nz),wpxpyp(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),xm(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_x_y_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),corr_x_y_1(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_y_1(:ngrdcol,:nz),varnce_y_1(:ngrdcol,:nz),ym(:ngrdcol,:nz),y_2(:ngrdcol,:nz),y_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_liquid_cloud_frac_component: 2484, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2485, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2486, ! blockidx%x threadidx%x collapsed 2484, Generating default present(rc(:ngrdcol,:nz),stdev_chi(:ngrdcol,:nz),cloud_frac(:ngrdcol,:nz),mean_chi(:ngrdcol,:nz)) 2486, Generating implicit firstprivate(zeta) calc_ice_cloud_frac_component: 2611, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2613, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_any_below_freezing) 2614, ! blockidx%x threadidx%x collapsed 2611, Generating default present(tl(:ngrdcol,:nz),rc_in(:ngrdcol,:nz),cloud_frac(:ngrdcol,:nz),rc(:ngrdcol,:nz),ice_supersat_frac(:ngrdcol,:nz)) Generating implicit copy(l_any_below_freezing) [if not already present] 2631, Generating create(rsat_ice(:,:)) [if not already present] 2636, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2637, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2638, ! blockidx%x threadidx%x collapsed 2636, Generating default present(mean_chi(:ngrdcol,:nz),crt(:ngrdcol,:nz),rc(:ngrdcol,:nz),ice_supersat_frac(:ngrdcol,:nz),rsatl(:ngrdcol,:nz),tl(:ngrdcol,:nz),stdev_chi(:ngrdcol,:nz)) 2638, Generating implicit firstprivate(zeta,chi_at_ice_sat) calc_xprcp_component: 3120, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 3121, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3122, ! blockidx%x threadidx%x collapsed 3120, Generating default present(vm(:ngrdcol,:nz),varnce_w_i(:ngrdcol,:nz),uprcp_contrib_comp_i(:ngrdcol,:nz),um(:ngrdcol,:nz),u_i(:ngrdcol,:nz),thlprcp_contrib_comp_i(:ngrdcol,:nz),thlm(:ngrdcol,:nz),thl_i(:ngrdcol,:nz),stdev_eta_i(:ngrdcol,:nz),crt_i(:ngrdcol,:nz),rtm(:ngrdcol,:nz),rt_i(:ngrdcol,:nz),rcm(:ngrdcol,:nz),corr_chi_eta_i(:ngrdcol,:nz),cloud_frac_i(:ngrdcol,:nz),stdev_chi_i(:ngrdcol,:nz),rtprcp_contrib_comp_i(:ngrdcol,:nz),wm(:ngrdcol,:nz),v_i(:ngrdcol,:nz),wprcp_contrib_comp_i(:ngrdcol,:nz),wp2rcp_contrib_comp_i(:ngrdcol,:nz),w_i(:ngrdcol,:nz),vprcp_contrib_comp_i(:ngrdcol,:nz),rc_i(:ngrdcol,:nz),cthl_i(:ngrdcol,:nz)) calc_w_up_in_cloud: 3256, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 3257, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3258, ! blockidx%x threadidx%x collapsed 3256, Generating default present(w_2(:ngrdcol,:nz),w_up_in_cloud(:ngrdcol,:nz),w_down_in_cloud(:ngrdcol,:nz),cloud_frac_2(:ngrdcol,:nz),cloudy_downdraft_frac(:ngrdcol,:nz),cloudy_updraft_frac(:ngrdcol,:nz),cloud_frac_1(:ngrdcol,:nz),w_1(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz)) 3258, Generating implicit firstprivate(ratio_w_2,stdev_w_1,w_down_2,stdev_w_2,updraft_frac_2,exp_neg_ratio_w_2_sqd,downdraft_frac_2,erf_ratio_w_2,w_up_2,w_up_1,updraft_frac_1,w_down_1,downdraft_frac_1,ratio_w_1,erf_ratio_w_1,exp_neg_ratio_w_1_sqd) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xm_wpxp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_xp2_xpyp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_wp2_wp3_module.F90 advance_wp2_wp3: 430, Generating enter data create(dvm_dz(:,:),wp2_old(:,:),kw8(:,:),kw1(:,:),kw1_zm(:,:),em_smth(:,:),lhs_tp_wp3(:,:,:),kw8_zt(:,:),dum_dz(:,:),coef_wp4_implicit_zt(:,:),a1_coef(:,:),c_wp3_pr_tp(:),coef_wp4_implicit(:,:),lhs_ac_pr2_wp2(:,:),lhs(:,:,:),lhs_ma_zm(:,:,:),lhs_dp1_wp2(:,:),lhs_diff_zt(:,:,:),lhs_diff_zm(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_adv_tp_wp3(:,:,:),rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr3_wp2(:,:),rhs_pr1_wp3(:,:),rhs(:,:),rhs_pr3_wp3(:,:),rhs_bp1_pr2_wp3(:,:),rhs_pr1_wp2(:,:),lhs_pr1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_ma_zt(:,:,:),rhs_bp_pr2_wp2(:,:),lhs_diff_zt_crank(:,:,:),lhs_ta_wp2(:,:,:),lhs_pr1_wp3(:,:),lhs_ac_pr2_wp3(:,:),lhs_ta_wp3(:,:,:),lhs_pr_tp_wp3(:,:,:),wp3_old(:,:),wp3_pr3_lhs(:,:,:),wp3_term_ta_lhs_result(:,:,:),c1_skw_fnc(:,:),c11_skw_fnc(:,:),a1_coef_zt(:,:),c16_fnc(:,:),wp2_smth(:,:),rhs_ta_wp3(:,:)) 479, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 480, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 481, ! blockidx%x threadidx%x collapsed 479, Generating default present(cx_fnc_richardson(:ngrdcol,2:nzt+1),c11_skw_fnc(:ngrdcol,:nzt)) 488, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 489, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 490, ! blockidx%x threadidx%x collapsed 488, Generating default present(c11_skw_fnc(:ngrdcol,:nzt),skw_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,22:24)) 490, Generating implicit firstprivate(c11,c11c,c11b) 510, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 511, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 512, ! blockidx%x threadidx%x collapsed 510, Generating default present(c1_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,:3)) 512, Generating implicit firstprivate(c1,c1b,c1c) 533, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 534, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 535, ! blockidx%x threadidx%x collapsed 533, Generating default present(c1_skw_fnc(:ngrdcol,:nzm)) 543, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 544, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 545, ! blockidx%x threadidx%x collapsed 543, Generating default present(cx_fnc_richardson(:ngrdcol,:nzt),c16_fnc(:ngrdcol,:nzt)) 553, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 554, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 555, ! blockidx%x threadidx%x collapsed 553, Generating default present(c11_skw_fnc(:ngrdcol,:nzt)) Generating implicit copy(err_code) [if not already present] 565, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 566, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 567, ! blockidx%x threadidx%x collapsed 565, Generating default present(c16_fnc(:ngrdcol,:nzt)) Generating implicit copy(err_code) [if not already present] 585, Generating update self(c1_skw_fnc(:,:),c11_skw_fnc(:,:)) 596, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 597, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 598, ! blockidx%x threadidx%x collapsed 596, Generating default present(kw1(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,38)) 606, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 607, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 608, ! blockidx%x threadidx%x collapsed 606, Generating default present(kw8(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,44)) 626, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 627, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 628, ! blockidx%x threadidx%x collapsed 626, Generating default present(coef_wp4_implicit_zt(:ngrdcol,:nzt),pdf_implicit_coefs_terms%coef_wp4_implicit(1:ngrdcol,1:nzt),pdf_implicit_coefs_terms) 660, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 661, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 662, ! blockidx%x threadidx%x collapsed 660, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm)) 678, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 679, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 680, ! blockidx%x threadidx%x collapsed 678, Generating default present(rhs_pr3_wp3(:ngrdcol,:nzt)) 687, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 688, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 689, ! blockidx%x threadidx%x collapsed 690, ! blockidx%x threadidx%x collapsed 687, Generating default present(wp3_term_ta_lhs_result(:,:ngrdcol,:nzt),wp3_pr3_lhs(:,:ngrdcol,:nzt)) 783, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 784, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 783, Generating default present(c_wp3_pr_tp(:ngrdcol)) 794, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 795, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 794, Generating default present(clubb_params(:ngrdcol,29),c_wp3_pr_tp(:ngrdcol)) 806, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 807, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 808, ! blockidx%x threadidx%x collapsed 809, ! blockidx%x threadidx%x collapsed 806, Generating default present(lhs_adv_tp_wp3(:,:ngrdcol,:nzt),lhs_tp_wp3(:,:ngrdcol,:nzt),lhs_pr_tp_wp3(:,:ngrdcol,:nzt)) 945, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 946, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 947, ! blockidx%x threadidx%x collapsed 948, ! blockidx%x threadidx%x collapsed 945, Generating default present(lhs_diff_zt(:,:ngrdcol,:nzt),clubb_params(:ngrdcol,25)) 1007, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1008, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1009, ! blockidx%x threadidx%x collapsed 1007, Generating default present(wp2_old(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1014, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1015, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1016, ! blockidx%x threadidx%x collapsed 1014, Generating default present(wp3_old(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1046, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1047, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1048, ! blockidx%x threadidx%x collapsed 1046, Generating default present(wp2_old(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1053, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1054, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1055, ! blockidx%x threadidx%x collapsed 1053, Generating default present(wp3_old(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1065, Generating update self(wp2(:,:)) 1086, Generating update device(wp2(:,:)) 1092, Generating update self(wp3(:,:)) 1113, Generating update device(wp3(:,:)) 1120, Generating update self(wp2vp2(:,:),wp3(:,:),wm_zt(:,:),wp2(:,:),wp3_on_wp2(:,:),wp2_old(:,:),skw_zt(:,:),rho_ds_zt(:,:),wprtp(:,:),wp4(:,:),lhs_splat_wp2(:,:),kh_zt(:,:),a3_coef_zt(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),em(:,:),rho_ds_zm(:,:),mixt_frac(:,:),invrs_rho_ds_zt(:,:),wp3_old(:,:),a3_coef(:,:),lhs_splat_wp3(:,:),skw_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_c1_zm(:,:),kh_zm(:,:),invrs_tau_wp3_zt(:,:),cx_fnc_richardson(:,:),vm(:,:),um(:,:),vp2(:,:),up2(:,:),upwp(:,:),thv_ds_zt(:,:),wp2_zt(:,:),wpthlp(:,:),wp3_zm(:,:),wp2up2(:,:),wp2thvp(:,:),wpvp2(:,:),wpup2(:,:),wpthvp(:,:),wm_zm(:,:),vpwp(:,:),sigma_sqd_w(:,:),sfc_elevation(:),rtp2(:,:)) 1197, Generating exit data delete(dvm_dz(:,:),wp2_old(:,:),kw8(:,:),kw1(:,:),kw1_zm(:,:),em_smth(:,:),lhs_tp_wp3(:,:,:),kw8_zt(:,:),dum_dz(:,:),coef_wp4_implicit_zt(:,:),a1_coef(:,:),c_wp3_pr_tp(:),coef_wp4_implicit(:,:),lhs_ac_pr2_wp2(:,:),lhs(:,:,:),lhs_ma_zm(:,:,:),lhs_dp1_wp2(:,:),lhs_diff_zt(:,:,:),lhs_diff_zm(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_adv_tp_wp3(:,:,:),rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr3_wp2(:,:),rhs_pr1_wp3(:,:),rhs(:,:),rhs_pr3_wp3(:,:),rhs_bp1_pr2_wp3(:,:),rhs_pr1_wp2(:,:),lhs_pr1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_ma_zt(:,:,:),rhs_bp_pr2_wp2(:,:),lhs_diff_zt_crank(:,:,:),lhs_ta_wp2(:,:,:),lhs_pr1_wp3(:,:),lhs_ac_pr2_wp3(:,:),lhs_ta_wp3(:,:,:),lhs_pr_tp_wp3(:,:,:),wp3_old(:,:),wp3_term_ta_lhs_result(:,:,:),wp3_pr3_lhs(:,:,:),c1_skw_fnc(:,:),c11_skw_fnc(:,:),a1_coef_zt(:,:),c16_fnc(:,:),wp2_smth(:,:),rhs_ta_wp3(:,:)) wp23_solve: 1451, Generating enter data create(wp2_min_array(:,:),solut(:,:),old_solut(:,:),rhs_save(:,:),rcond(:)) 1455, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1456, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1457, ! blockidx%x threadidx%x collapsed 1455, Generating default present(rhs(:ngrdcol,:nzm*2-1),rhs_save(:ngrdcol,:nzm*2-1)) 1488, Generating update self(rcond(:)) 1507, Generating update self(lhs(:,:,:),rhs_save(:,:)) 1544, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1545, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1546, ! blockidx%x threadidx%x collapsed 1544, Generating default present(wp2(:ngrdcol,:nzm),solut(:ngrdcol,:)) 1546, Generating implicit firstprivate(k_wp2) 1553, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1554, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1555, ! blockidx%x threadidx%x collapsed 1553, Generating default present(solut(:ngrdcol,:),wp3(:ngrdcol,:nzt)) 1555, Generating implicit firstprivate(k_wp3) 1564, Generating update self(c11_skw_fnc(:,:),lhs_ta_wp2(:,:,:),lhs_ma_zm(:,:,:),wp3(:,:),lhs_pr1_wp3(:,:),clubb_params(:,:),wp3_term_ta_lhs_result(:,:,:),wp3_pr3_lhs(:,:,:),lhs_diff_zm(:,:,:),lhs_pr1_wp2(:,:),lhs_ma_zt(:,:,:),lhs_dp1_wp2(:,:),wp2(:,:),lhs_pr_tp_wp3(:,:,:),lhs_adv_tp_wp3(:,:,:),wm_zt(:,:),lhs_diff_zt(:,:,:),wm_zm(:,:)) 1574, Generating copyin(c_uu_shr_plus_one(:),c11_skw_fnc_zeros(:,:),c11_skw_fnc_plus_one(:,:),c_uu_shr_zeros(:)) [if not already present] Generating copyout(lhs_wp2_ac_term(:,:),lhs_wp2_pr2_term(:,:),lhs_wp3_pr2_term(:,:),lhs_wp3_ac_term(:,:)) [if not already present] 1775, Generating update self(up2(:,:),wp2(:,:),vp2(:,:)) 1821, Generating update self(up2(:,:),wp2(:,:),vp2(:,:)) 1871, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1872, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1873, ! blockidx%x threadidx%x collapsed 1871, Generating default present(vp2(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),up2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm),wp2_min_array(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm)) 1902, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1903, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1904, ! blockidx%x threadidx%x collapsed 1902, Generating default present(wp2_min_array(:ngrdcol,:nzm)) 1934, Generating exit data delete(wp2_min_array(:,:),solut(:,:),old_solut(:,:),rhs_save(:,:),rcond(:)) wp23_lhs: 2045, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2046, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2047, ! blockidx%x threadidx%x collapsed 2048, ! blockidx%x threadidx%x collapsed 2045, Generating default present(lhs(:,:ngrdcol,:nzm*2-1)) 2056, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2057, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2058, ! blockidx%x threadidx%x collapsed 2056, Generating default present(lhs(:,:ngrdcol,:1)) 2069, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2070, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2071, ! blockidx%x threadidx%x collapsed 2069, Generating default present(lhs(:,:ngrdcol,2)) 2082, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2083, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2084, ! blockidx%x threadidx%x collapsed 2082, Generating default present(lhs_diff_zm(:,:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,:),lhs_ta_wp2(:,:ngrdcol,2:nzm-1),lhs_ma_zm(:,:ngrdcol,2:nzm-1),lhs_dp1_wp2(:ngrdcol,2:nzm-1),lhs_ac_pr2_wp2(:ngrdcol,2:nzm-1)) 2084, Generating implicit firstprivate(invrs_dt,k_wp2) 2122, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2123, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2124, ! blockidx%x threadidx%x collapsed 2122, Generating default present(lhs_pr1_wp3(:ngrdcol,2:nzt-1),lhs_ma_zt(:,:ngrdcol,2:nzt-1),lhs(:,:ngrdcol,:),lhs_tp_wp3(:,:ngrdcol,2:nzt-1),lhs_splat_wp3(:ngrdcol,2:nzt-1),lhs_diff_zt(:,:ngrdcol,2:nzt-1),lhs_ac_pr2_wp3(:ngrdcol,2:nzt-1)) 2124, Generating implicit firstprivate(k_wp3,invrs_dt) 2165, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2166, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2167, ! blockidx%x threadidx%x collapsed 2165, Generating default present(lhs(:,:ngrdcol,nzm*2-2)) 2167, Generating implicit firstprivate(nzm) 2178, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2179, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2180, ! blockidx%x threadidx%x collapsed 2178, Generating default present(lhs(:,:ngrdcol,nzm*2-1)) 2180, Generating implicit firstprivate(nzm) 2201, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2202, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2203, ! blockidx%x threadidx%x collapsed 2201, Generating default present(lhs_pr1_wp2(:ngrdcol,2:nzm-1),lhs(3,:ngrdcol,:)) 2203, Generating implicit firstprivate(k_wp2) 2216, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2217, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2218, ! blockidx%x threadidx%x collapsed 2216, Generating default present(lhs_splat_wp2(:ngrdcol,2:nzm-1),lhs(3,:ngrdcol,:)) 2218, Generating implicit firstprivate(k_wp2) 2246, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2247, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2248, ! blockidx%x threadidx%x collapsed 2249, ! blockidx%x threadidx%x collapsed 2246, Generating default present(wp3_term_ta_lhs_result(:,:ngrdcol,2:nzt-1),lhs(:,:ngrdcol,:)) 2249, Generating implicit firstprivate(k_wp3) wp23_rhs: 2460, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2461, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2462, ! blockidx%x threadidx%x collapsed 2460, Generating default present(rhs(:ngrdcol,:nzm*2-1)) 2469, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2470, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2471, ! blockidx%x threadidx%x collapsed 2469, Generating default present(rhs_pr_dfsn_wp3(:ngrdcol,2:nzt-1),rhs_pr_turb_wp3(:ngrdcol,2:nzt-1),rhs(:ngrdcol,:)) 2471, Generating implicit firstprivate(k_wp3) 2478, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2479, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2480, ! blockidx%x threadidx%x collapsed 2478, Generating default present(rhs(:ngrdcol,:),rhs_pr_dfsn_wp2(:ngrdcol,2:nzm-1)) 2480, Generating implicit firstprivate(k_wp2) 2527, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2528, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2529, ! blockidx%x threadidx%x collapsed 2527, Generating default present(rhs(:ngrdcol,:),up2(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),lhs_diff_zm(:,:ngrdcol,2:nzm-1)) 2529, Generating implicit firstprivate(k_wp2) 2539, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2540, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2541, ! blockidx%x threadidx%x collapsed 2539, Generating default present(rhs(:ngrdcol,:),wpup2(:ngrdcol,:nzt),wpvp2(:ngrdcol,:nzt),lhs_diff_zt(:,:ngrdcol,2:nzt-1)) 2541, Generating implicit firstprivate(k_wp3) 2555, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2556, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2557, ! blockidx%x threadidx%x collapsed 2555, Generating default present(wp2(:ngrdcol,2:nzm-1),rhs_pr1_wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,:),lhs_pr1_wp2(:ngrdcol,2:nzm-1)) 2557, Generating implicit firstprivate(k_wp2) 2575, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2576, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2577, ! blockidx%x threadidx%x collapsed 2575, Generating default present(rhs_bp1_pr2_wp3(:ngrdcol,2:nzt-1),rhs(:ngrdcol,:),lhs_pr1_wp3(:ngrdcol,2:nzt-1),rhs_pr1_wp3(:ngrdcol,2:nzt-1),wp3(:ngrdcol,2:nzt-1),wp2(:ngrdcol,2:nzt),lhs_tp_wp3(:,:ngrdcol,2:nzt-1)) 2577, Generating implicit firstprivate(k_wp3,invrs_dt) 2605, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2606, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2607, ! blockidx%x threadidx%x collapsed 2605, Generating default present(rhs_bp_pr2_wp2(:ngrdcol,2:nzm-1),rhs_dp1_wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,:),wp2(:ngrdcol,2:nzm-1),rhs_pr3_wp2(:ngrdcol,2:nzm-1),lhs_dp1_wp2(:ngrdcol,2:nzm-1)) 2607, Generating implicit firstprivate(k_wp2,invrs_dt) 2657, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2658, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2659, ! blockidx%x threadidx%x collapsed 2657, Generating default present(rhs(:ngrdcol,:),wp3_term_ta_lhs_result(:,:ngrdcol,2:nzt-1),wp3(:ngrdcol,:nzt),wp2(:ngrdcol,2:nzt)) 2659, Generating implicit firstprivate(k_wp3) 2713, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2714, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2713, Generating default present(wp2(:ngrdcol,:1),rhs(:ngrdcol,:)) 2714, Generating implicit firstprivate(nzt,nzm) 2727, Generating update self(c11_skw_fnc(:,:),rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),wpvp2(:,:),wpup2(:,:),wp3_term_ta_lhs_result(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_splat_wp2(:,:),lhs_pr1_wp2(:,:),rhs_pr1_wp2(:,:),rhs_pr3_wp2(:,:),lhs_pr1_wp3(:,:),clubb_params(:,:),lhs_splat_wp3(:,:),wp2(:,:),wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr1_wp3(:,:),lhs_diff_zt(:,:,:),lhs_ta_wp3(:,:,:),lhs_dp1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_pr_tp_wp3(:,:,:),rhs_pr3_wp3(:,:),lhs_adv_tp_wp3(:,:,:),up2(:,:),rhs_ta_wp3(:,:),lhs_diff_zm(:,:,:),vp2(:,:)) 2740, Generating copyin(c_uu_buoy_plus_one(:),c11_skw_fnc_zeros(:,:),c11_skw_fnc_plus_one(:,:)) [if not already present] Generating copyout(rhs_bp1_wp3(:,:),rhs_bp_wp2(:,:)) [if not already present] Generating copyin(c_uu_buoy_zeros(:)) [if not already present] Generating copyout(rhs_pr2_wp3(:,:),rhs_pr2_wp2(:,:)) [if not already present] wp2_term_ta_lhs: 3129, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3130, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3131, ! blockidx%x threadidx%x collapsed 3129, Generating default present(lhs_ta_wp2(:,:ngrdcol,:),gr) 3140, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3141, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3142, ! blockidx%x threadidx%x collapsed 3140, Generating default present(invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,rho_ds_zt(:ngrdcol,:nzm-1),lhs_ta_wp2(:,:ngrdcol,2:nzm-1)) wp2_terms_ac_pr2_lhs: 3254, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3255, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3254, Generating default present(lhs_ac_pr2_wp2(:ngrdcol,:)) 3255, Generating implicit firstprivate(nzm) 3263, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3264, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3265, ! blockidx%x threadidx%x collapsed 3263, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),c_uu_shr(:ngrdcol),gr,wm_zt(:ngrdcol,:nzm-1),lhs_ac_pr2_wp2(:ngrdcol,2:nzm-1)) wp2_term_dp1_lhs: 3344, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3345, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3344, Generating default present(lhs_dp1_wp2(:ngrdcol,:)) 3345, Generating implicit firstprivate(nzm) 3353, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3354, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3355, ! blockidx%x threadidx%x collapsed 3353, Generating default present(lhs_dp1_wp2(:ngrdcol,2:nzm-1),invrs_tau1m(:ngrdcol,2:nzm-1),c1_skw_fnc(:ngrdcol,2:nzm-1)) wp2_term_pr1_lhs: 3440, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3441, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3440, Generating default present(lhs_pr1_wp2(:ngrdcol,:)) 3441, Generating implicit firstprivate(nzm) 3450, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3451, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3452, ! blockidx%x threadidx%x collapsed 3450, Generating default present(lhs_pr1_wp2(:ngrdcol,2:nzm-1),invrs_tau_c4_zm(:ngrdcol,2:nzm-1),c4(:ngrdcol)) wp2_terms_bp_pr2_rhs: 3531, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3532, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3531, Generating default present(rhs_bp_pr2_wp2(:ngrdcol,:)) 3532, Generating implicit firstprivate(nzm) 3540, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3541, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3542, ! blockidx%x threadidx%x collapsed 3540, Generating default present(c_uu_buoy(:ngrdcol),rhs_bp_pr2_wp2(:ngrdcol,2:nzm-1),wpthvp(:ngrdcol,2:nzm-1),thv_ds_zm(:ngrdcol,2:nzm-1)) wp2_term_dp1_rhs: 3629, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3630, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3629, Generating default present(rhs_dp1_wp2(:ngrdcol,:)) 3630, Generating implicit firstprivate(nzm) 3639, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3640, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3641, ! blockidx%x threadidx%x collapsed 3639, Generating default present(invrs_tau1m(:ngrdcol,2:nzm-1),c1_skw_fnc(:ngrdcol,2:nzm-1),rhs_dp1_wp2(:ngrdcol,2:nzm-1),up2(:ngrdcol,2:nzm-1),vp2(:ngrdcol,2:nzm-1)) 3647, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3648, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3649, ! blockidx%x threadidx%x collapsed 3647, Generating default present(rhs_dp1_wp2(:ngrdcol,2:nzm-1),invrs_tau1m(:ngrdcol,2:nzm-1),c1_skw_fnc(:ngrdcol,2:nzm-1)) 3649, Generating implicit firstprivate(threshold) wp2_term_pr3_rhs: 3750, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3751, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3750, Generating default present(rhs_pr3_wp2(:ngrdcol,:)) 3751, Generating implicit firstprivate(nzm) 3759, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3760, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3761, ! blockidx%x threadidx%x collapsed 3759, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),rhs_pr3_wp2(:ngrdcol,2:nzm-1),wpthvp(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1),c_uu_buoy(:ngrdcol),vm(:ngrdcol,:nzm-1),upwp(:ngrdcol,2:nzm-1),um(:ngrdcol,:nzm-1),c_uu_shr(:ngrdcol),gr,thv_ds_zm(:ngrdcol,2:nzm-1)) wp2_term_pr1_rhs: 3866, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3867, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3866, Generating default present(rhs_pr1_wp2(:ngrdcol,:)) 3867, Generating implicit firstprivate(nzm) 3875, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3876, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3877, ! blockidx%x threadidx%x collapsed 3875, Generating default present(invrs_tau_c4_zm(:ngrdcol,2:nzm-1),rhs_pr1_wp2(:ngrdcol,2:nzm-1),vp2(:ngrdcol,2:nzm-1),up2(:ngrdcol,2:nzm-1),c4(:ngrdcol)) wp2_term_pr_dfsn_rhs: 3961, Generating create(wpuip2(:,:)) [if not already present] 3963, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3964, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3965, ! blockidx%x threadidx%x collapsed 3963, Generating default present(wp3(:ngrdcol,:nzt),wpvp2(:ngrdcol,:nzt),wpup2(:ngrdcol,:nzt)) 3971, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3972, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3973, ! blockidx%x threadidx%x collapsed 3971, Generating default present(rho_ds_zt(:ngrdcol,:nzm-1),rhs_pr_dfsn_wp2(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),c_wp2_pr_dfsn(:ngrdcol),gr,invrs_rho_ds_zm(:ngrdcol,2:nzm-1)) 3981, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3982, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3981, Generating default present(rhs_pr_dfsn_wp2(:ngrdcol,:)) 3982, Generating implicit firstprivate(nzm) advance_xp2_xpyp: 428, Generating enter data create(lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),vp2_old(:,:)) 438, Generating enter data create(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrpthlp_old(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:)) 446, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 447, !$acc loop gang, vector(128) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 446, Generating default present(clubb_params(:ngrdcol,8:9)) Generating implicit copy(err_code) [if not already present] 477, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 478, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 479, ! blockidx%x threadidx%x collapsed 477, Generating default present(c2thl_1d(:ngrdcol,:nzm),cloud_frac_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6),c2rtthl_1d(:ngrdcol,:nzm),c2rt_1d(:ngrdcol,:nzm)) 498, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 499, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 500, ! blockidx%x threadidx%x collapsed 498, Generating default present(c2rt_1d(:ngrdcol,:nzm),c2rtthl_1d(:ngrdcol,:nzm),c2thl_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6)) 509, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 510, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 511, ! blockidx%x threadidx%x collapsed 509, Generating default present(c2sclr_1d(:ngrdcol,:nzm),c14_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:27),c4_1d(:ngrdcol,:nzm)) 528, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 530, ! blockidx%x threadidx%x collapsed 528, Generating default present(kw2(:ngrdcol,:nzt),kw9(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,40:46)) 550, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 551, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 552, ! blockidx%x threadidx%x collapsed 550, Generating default present(rtpthlp(:ngrdcol,:nzm),rtp2_old(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm),thlp2_old(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),rtpthlp_old(:ngrdcol,:nzm)) 561, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 562, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 563, ! blockidx%x threadidx%x collapsed 564, ! blockidx%x threadidx%x collapsed 561, Generating default present(sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrp2_old(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrprtp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 613, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 614, !$acc loop gang, vector(128) ! blockidx%x threadidx%x Generating reduction(.and.:l_single_solve_possible) 613, Generating default present(clubb_params(:ngrdcol,4:6)) Generating implicit copy(l_single_solve_possible) [if not already present] 614, Generating implicit firstprivate(c2thl,c2rtthl,c2rt) 688, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 689, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 690, ! blockidx%x threadidx%x collapsed 688, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm)) 708, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 709, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 710, ! blockidx%x threadidx%x collapsed 708, Generating default present(lhs_dp1_c4(:ngrdcol,2:nzm-1),lhs_dp1_c14(:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1)) 852, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 853, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 854, ! blockidx%x threadidx%x collapsed 852, Generating default present(vp2(:ngrdcol,:nzm),uv_solution(:ngrdcol,:nzm,:),up2(:ngrdcol,:nzm)) 862, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 863, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 864, ! blockidx%x threadidx%x collapsed 862, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm)) 874, Generating update self(lhs_diff_uv(:,:,:),lhs_dp1_c14(:,:),vp2(:,:),up2(:,:),lhs_dp1_c4(:,:),lhs_ma(:,:,:),lhs_ta_wpup2(:,:,:)) 951, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 952, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 953, ! blockidx%x threadidx%x collapsed 951, Generating default present(threshold_array(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 969, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 970, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 971, ! blockidx%x threadidx%x collapsed 969, Generating default present(threshold_array(:ngrdcol,:nzm)) 994, Generating update self(rtp2(:,:)) 1004, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1005, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1006, ! blockidx%x threadidx%x collapsed 1004, Generating default present(clubb_params(:ngrdcol,93),rtp2(:ngrdcol,:nzm),rtm_zm(:ngrdcol,:nzm)) 1006, Generating implicit firstprivate(threshold) 1017, Generating update self(rtp2(:,:)) 1055, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1056, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1057, ! blockidx%x threadidx%x collapsed 1055, Generating default present(threshold_array(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1073, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1074, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1075, ! blockidx%x threadidx%x collapsed 1073, Generating default present(threshold_array(:ngrdcol,:nzm)) 1092, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1093, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1094, ! blockidx%x threadidx%x collapsed 1092, Generating default present(threshold_array(:ngrdcol,:nzm)) 1108, Generating update self(up2(:,:)) 1117, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1118, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1119, ! blockidx%x threadidx%x collapsed 1117, Generating default present(up2(:ngrdcol,:nzm)) 1127, Generating update self(up2(:,:)) 1139, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1140, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1141, ! blockidx%x threadidx%x collapsed 1139, Generating default present(threshold_array(:ngrdcol,:nzm)) 1154, Generating update self(vp2(:,:)) 1163, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1164, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1165, ! blockidx%x threadidx%x collapsed 1163, Generating default present(vp2(:ngrdcol,:nzm)) 1173, Generating update self(vp2(:,:)) 1185, Generating update self(vp2(:,:),up2(:,:)) 1215, Generating update device(vp2(:,:),up2(:,:)) 1272, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1273, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1274, ! blockidx%x threadidx%x collapsed 1272, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1299, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1300, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1301, ! blockidx%x threadidx%x collapsed 1299, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1334, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1335, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1336, ! blockidx%x threadidx%x collapsed 1334, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1364, Generating update self(sclrprtp_old(:,:,:),sclrpthlp(:,:,:),sclrp2_old(:,:,:),sclrprtp(:,:,:),sclrm(:,:,:),sclrp2(:,:,:),vm(:,:),vp2(:,:),um(:,:),up2(:,:),rtp2_old(:,:),rtpthlp_forcing(:,:),thlm(:,:),thlp2_forcing(:,:),rtm(:,:),rtp2_forcing(:,:),wprtp(:,:),rtpthlp_old(:,:),wp2(:,:),thlp2_old(:,:),rho_ds_zm(:,:),kh_zt(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),invrs_tau_xp2_zm(:,:),sclrpthlp_old(:,:,:),vp2_old(:,:),up2_old(:,:),wp2_zt(:,:),wm_zm(:,:),upwp(:,:),thv_ds_zm(:,:),wpthvp(:,:),wpthlp(:,:),wpsclrp(:,:,:),sigma_sqd_w(:,:),wp3(:,:),rho_ds_zt(:,:),vpwp(:,:),invrs_rho_ds_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:)) 1441, Generating exit data delete(lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),vp2_old(:,:)) 1451, Generating exit data delete(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:)) wp3_term_ta_new_pdf_lhs: 4120, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4121, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4123, !$acc loop seq 4120, Generating default present(lhs_ta_wp3(:,:ngrdcol,:)) 4123, Loop is parallelizable Generating implicit firstprivate(nzt) 4130, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4131, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4132, ! blockidx%x threadidx%x collapsed 4130, Generating default present(invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%invrs_dzt(1:ngrdcol,2:nzt-1),coef_wp4_implicit(:ngrdcol,2:nzt),gr,lhs_ta_wp3(:,:ngrdcol,2:nzt-1),wp2(:ngrdcol,2:nzt),rho_ds_zm(:ngrdcol,2:nzt)) wp3_term_ta_adg1_lhs: 4315, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4316, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4317, ! blockidx%x threadidx%x collapsed 4315, Generating default present(lhs_ta_wp3(:,:ngrdcol,:)) 4317, Generating implicit firstprivate(nzt) 4338, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4339, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4340, ! blockidx%x threadidx%x collapsed 4338, Generating default present(a3_coef(:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),a1_coef(:ngrdcol,2:nzt),rho_ds_zm(:ngrdcol,2:nzt),invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%weights_zt2zm(1:ngrdcol,2:nzt,1:2),gr,lhs_ta_wp3(:,:ngrdcol,2:nzt-1),wp2(:ngrdcol,2:nzt),wp3_on_wp2(:ngrdcol,2:nzt)) 4388, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4389, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4390, ! blockidx%x threadidx%x collapsed 4388, Generating default present(a1_coef(:ngrdcol,2:nzt),lhs_ta_wp3(:,:ngrdcol,2:nzt-1),rho_ds_zt(:ngrdcol,:nzt),invrs_rho_ds_zt(:ngrdcol,2:nzt-1),rho_ds_zm(:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),a3_coef(:ngrdcol,2:nzt),gr,wp2(:ngrdcol,2:nzt),wp3_on_wp2(:ngrdcol,2:nzt)) 4444, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4445, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4446, ! blockidx%x threadidx%x collapsed 4444, Generating default present(a3_coef_zt(:ngrdcol,2:nzt-1),gr%invrs_dzt(1:ngrdcol,2:nzt-1),a1_coef_zt(:ngrdcol,2:nzt-1),rho_ds_zm(:ngrdcol,2:nzt),invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%weights_zt2zm(1:ngrdcol,2:nzt,1:2),gr,lhs_ta_wp3(:,:ngrdcol,2:nzt-1),wp3_on_wp2(:ngrdcol,2:nzt),wp2(:ngrdcol,2:nzt)) wp3_term_tp_lhs: 4607, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4608, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4609, !$acc loop seq 4607, Generating default present(lhs_tp_wp3(:,:ngrdcol,:)) 4608, Generating implicit firstprivate(i) 4609, Loop is parallelizable Generating implicit firstprivate(nzt) 4619, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4620, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4621, ! blockidx%x threadidx%x collapsed 4619, Generating default present(invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%invrs_dzt(1:ngrdcol,2:nzt-1),lhs_tp_wp3(:,:ngrdcol,2:nzt-1),wp2(:ngrdcol,2:nzt),rho_ds_zm(:ngrdcol,2:nzt),coef_wp3_tp(:ngrdcol),gr) wp3_terms_ac_pr2_lhs: 4734, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4735, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4734, Generating default present(lhs_ac_pr2_wp3(:ngrdcol,:)) 4735, Generating implicit firstprivate(nzt) 4744, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4745, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4746, ! blockidx%x threadidx%x collapsed 4744, Generating default present(gr%invrs_dzt(1:ngrdcol,2:nzt-1),c11_skw_fnc(:ngrdcol,2:nzt-1),gr,wm_zm(:ngrdcol,2:nzt),lhs_ac_pr2_wp3(:ngrdcol,2:nzt-1)) solve_xp2_xpyp_with_single_lhs: 1625, Generating enter data create(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:)) 1627, Generating enter data create(sclrprtp_forcing(:,:),sclrpthlp_forcing(:,:),sclrp2_forcing(:,:)) 1634, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1635, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1636, ! blockidx%x threadidx%x collapsed 1634, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 1680, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1681, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1682, ! blockidx%x threadidx%x collapsed 1680, Generating default present(sclrp2_forcing(:ngrdcol,:nzm)) 1704, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1705, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1706, ! blockidx%x threadidx%x collapsed 1704, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm)) 1714, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1715, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1716, ! blockidx%x threadidx%x collapsed 1714, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm)) 1739, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1740, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1741, ! blockidx%x threadidx%x collapsed 1739, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm)) 1749, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1750, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1751, ! blockidx%x threadidx%x collapsed 1749, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm)) 1784, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1785, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1786, ! blockidx%x threadidx%x collapsed 1784, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm)) 1795, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 1796, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1797, ! blockidx%x threadidx%x collapsed 1798, ! blockidx%x threadidx%x collapsed 1795, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 1813, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1814, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1815, ! blockidx%x threadidx%x collapsed 1813, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm)) 1824, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 1825, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1826, ! blockidx%x threadidx%x collapsed 1827, ! blockidx%x threadidx%x collapsed 1824, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 1841, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:),lhs_ta(:,:,:)) 1865, Generating exit data delete(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:)) 1867, Generating exit data delete(sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:),sclrp2_forcing(:,:)) wp3_term_pr1_lhs: 4851, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4852, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4851, Generating default present(lhs_pr1_wp3(:ngrdcol,:)) 4852, Generating implicit firstprivate(nzt) 4862, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 4863, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4864, ! blockidx%x threadidx%x collapsed 4862, Generating default present(invrs_tau_wp3_zt(:ngrdcol,2:nzt-1),c8b(:ngrdcol),c8(:ngrdcol),skw_zt(:ngrdcol,2:nzt-1),lhs_pr1_wp3(:ngrdcol,2:nzt-1)) 4873, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4874, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4875, ! blockidx%x threadidx%x collapsed 4873, Generating default present(invrs_tau_wp3_zt(:ngrdcol,2:nzt-1),c8(:ngrdcol),skw_zt(:ngrdcol,2:nzt-1),lhs_pr1_wp3(:ngrdcol,2:nzt-1),c8b(:ngrdcol)) wp3_term_ta_explicit_rhs: 4976, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4977, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4976, Generating default present(rhs_ta_wp3(:ngrdcol,:)) 4977, Generating implicit firstprivate(nzt) 4986, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4987, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4988, ! blockidx%x threadidx%x collapsed 4986, Generating default present(rho_ds_zm(:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),gr,invrs_rho_ds_zt(:ngrdcol,2:nzt-1),wp4(:ngrdcol,2:nzt),rhs_ta_wp3(:ngrdcol,2:nzt-1)) wp3_terms_bp1_pr2_rhs: 5060, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5061, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5060, Generating default present(rhs_bp1_pr2_wp3(:ngrdcol,:)) 5061, Generating implicit firstprivate(nzt) 5070, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5071, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5072, ! blockidx%x threadidx%x collapsed 5070, Generating default present(c11_skw_fnc(:ngrdcol,2:nzt-1),rhs_bp1_pr2_wp3(:ngrdcol,2:nzt-1),wp2thvp(:ngrdcol,2:nzt-1),thv_ds_zt(:ngrdcol,2:nzt-1)) wp3_term_pr_turb_rhs: 5159, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5160, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5159, Generating default present(rhs_pr_turb_wp3(:ngrdcol,:)) 5160, Generating implicit firstprivate(nzt) 5170, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5171, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5172, ! blockidx%x threadidx%x collapsed 5170, Generating default present(kh_zt(:ngrdcol,2:nzt-1),gr%invrs_dzt(1:ngrdcol,2:nzt-1),dvm_dz(:ngrdcol,2:nzt),gr,upwp(:ngrdcol,2:nzt),dum_dz(:ngrdcol,2:nzt),thv_ds_zt(:ngrdcol,2:nzt-1),c_wp3_pr_turb(:ngrdcol),rhs_pr_turb_wp3(:ngrdcol,2:nzt-1),wpthvp(:ngrdcol,2:nzt),vpwp(:ngrdcol,2:nzt)) 5184, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5185, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5186, ! blockidx%x threadidx%x collapsed 5184, Generating default present(rho_ds_zm(:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),em(:ngrdcol,2:nzt),gr,invrs_rho_ds_zt(:ngrdcol,2:nzt-1),wp2(:ngrdcol,2:nzt),rhs_pr_turb_wp3(:ngrdcol,2:nzt-1),c_wp3_pr_turb(:ngrdcol)) wp3_term_pr_dfsn_rhs: 5276, Generating create(wp2uip2(:,:),wp2_uip2(:,:)) [if not already present] 5278, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5279, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5280, ! blockidx%x threadidx%x collapsed 5278, Generating default present(up2(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),wp2up2(:ngrdcol,:nzm),wp2vp2(:ngrdcol,:nzm),wp4(:ngrdcol,:nzm)) 5287, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5288, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5287, Generating default present(rhs_pr_dfsn_wp3(:ngrdcol,:)) 5288, Generating implicit firstprivate(nzt) 5296, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5297, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5298, ! blockidx%x threadidx%x collapsed 5296, Generating default present(rhs_pr_dfsn_wp3(:ngrdcol,2:nzt-1),rho_ds_zm(:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),c_wp3_pr_dfsn(:ngrdcol),gr,invrs_rho_ds_zt(:ngrdcol,2:nzt-1)) wp3_term_pr1_rhs: 5399, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5400, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5399, Generating default present(rhs_pr1_wp3(:ngrdcol,:)) 5400, Generating implicit firstprivate(nzt) 5410, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5411, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5412, ! blockidx%x threadidx%x collapsed 5410, Generating default present(invrs_tau_wp3_zt(:ngrdcol,2:nzt-1),c8b(:ngrdcol),c8(:ngrdcol),rhs_pr1_wp3(:ngrdcol,2:nzt-1),wp3(:ngrdcol,2:nzt-1),skw_zt(:ngrdcol,2:nzt-1)) 5419, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5420, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5421, ! blockidx%x threadidx%x collapsed 5419, Generating default present(invrs_tau_wp3_zt(:ngrdcol,2:nzt-1),c8(:ngrdcol),rhs_pr1_wp3(:ngrdcol,2:nzt-1),c8b(:ngrdcol),wp3(:ngrdcol,2:nzt-1),skw_zt(:ngrdcol,2:nzt-1)) advance_xm_wpxp: 496, Generating enter data create(lhs_pr1_wprtp(:,:),lhs_ma_zt(:,:,:),kw6(:,:),lhs_ta_wpvp(:,:,:),lhs_ta_xm(:,:,:),rhs_ta_wpup(:,:),rhs_ta_wpthlp(:,:),rhs_ta_wprtp(:,:),low_lev_effect(:,:),lhs_ta_wpup(:,:,:),lhs_ta_wpthlp(:,:,:),lhs_ta_wprtp(:,:,:),lhs_pr1_wpthlp(:,:),lhs_diff_zt(:,:,:),lhs_ma_zm(:,:,:),lhs_diff_zm(:,:,:),lhs_ac_pr2(:,:),vm_old(:,:),upwp_old(:,:),um_old(:,:),thlm_old(:,:),wprtp_old(:,:),rtm_old(:,:),vpwp_old(:,:),rhs_ta_wpvp(:,:),c7_skw_fnc(:,:),lhs_tp(:,:,:),high_lev_effect(:,:),c6thl_skw_fnc(:,:),c6rt_skw_fnc(:,:),c6_term(:,:),wpthlp_old(:,:)) 505, Generating enter data create(lhs_ta_wpsclrp(:,:,:,:),lhs_pr1_wpsclrp(:,:),sclrm_old(:,:,:),wpsclrp_old(:,:,:),rhs_ta_wpsclrp(:,:,:)) 543, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 544, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 545, ! blockidx%x threadidx%x collapsed 543, Generating default present(thlm_old(:ngrdcol,:nzt),thlm(:ngrdcol,:nzt),rtm_old(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt)) 552, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 553, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 554, ! blockidx%x threadidx%x collapsed 552, Generating default present(wpthlp_old(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp_old(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm)) 562, Generating implicit firstprivate(ngrdcol,sclr_dim,nzt) Generating NVIDIA GPU code 563, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 564, ! blockidx%x threadidx%x collapsed 565, ! blockidx%x threadidx%x collapsed 562, Generating default present(sclrm_old(:ngrdcol,:nzt,:sclr_dim),sclrm(:ngrdcol,:nzt,:sclr_dim)) 572, Generating implicit firstprivate(ngrdcol,nzm,sclr_dim) Generating NVIDIA GPU code 573, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 574, ! blockidx%x threadidx%x collapsed 575, ! blockidx%x threadidx%x collapsed 572, Generating default present(wpsclrp(:ngrdcol,:nzm,:sclr_dim),wpsclrp_old(:ngrdcol,:nzm,:sclr_dim)) 584, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 585, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 586, ! blockidx%x threadidx%x collapsed 584, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 593, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 594, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 595, ! blockidx%x threadidx%x collapsed 593, Generating default present(vpwp(:ngrdcol,:nzm),vpwp_old(:ngrdcol,:nzm),upwp_old(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm)) 607, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 608, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 609, ! blockidx%x threadidx%x collapsed 607, Generating default present(c6rt_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,10:12)) 609, Generating implicit firstprivate(c6rt,c6rtc,c6rtb) 628, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 629, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 630, ! blockidx%x threadidx%x collapsed 628, Generating default present(c6thl_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,13:15),skw_zm(:ngrdcol,:nzm)) 630, Generating implicit firstprivate(c6thl,c6thlc,c6thlb) 661, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 662, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 663, ! blockidx%x threadidx%x collapsed 661, Generating default present(c6rt_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,10:13),c6thl_skw_fnc(:ngrdcol,:nzm)) 675, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 676, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 677, ! blockidx%x threadidx%x collapsed 675, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm),c7_skw_fnc(:ngrdcol,:nzm)) 685, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 686, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 687, ! blockidx%x threadidx%x collapsed 685, Generating default present(c7_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,16:18)) 687, Generating implicit firstprivate(c7,c7b,c7c) 717, Generating update self(c6rt_skw_fnc(:,:),c7_skw_fnc(:,:),c6thl_skw_fnc(:,:)) 735, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 736, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 737, ! blockidx%x threadidx%x collapsed 735, Generating default present(c7_skw_fnc(:ngrdcol,:nzm)) Generating implicit copy(err_code) [if not already present] 755, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 756, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 757, ! blockidx%x threadidx%x collapsed 755, Generating default present(kw6(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,42)) 779, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 780, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 781, ! blockidx%x threadidx%x collapsed 779, Generating default present(c6_term(:ngrdcol,:nzm),invrs_tau_c6_zm(:ngrdcol,:nzm),c6rt_skw_fnc(:ngrdcol,:nzm)) 788, Generating update self(c6_term(:,:)) 903, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 904, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 905, ! blockidx%x threadidx%x collapsed 903, Generating default present(rtm(:ngrdcol,:nzt),thlm_old(:ngrdcol,:nzt),thlm(:ngrdcol,:nzt),rtm_old(:ngrdcol,:nzt)) 912, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 913, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 914, ! blockidx%x threadidx%x collapsed 912, Generating default present(wprtp(:ngrdcol,:nzm),wpthlp_old(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp_old(:ngrdcol,:nzm)) 922, Generating implicit firstprivate(ngrdcol,sclr_dim,nzt) Generating NVIDIA GPU code 923, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 924, ! blockidx%x threadidx%x collapsed 925, ! blockidx%x threadidx%x collapsed 922, Generating default present(sclrm_old(:ngrdcol,:nzt,:sclr_dim),sclrm(:ngrdcol,:nzt,:sclr_dim)) 932, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 933, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 934, ! blockidx%x threadidx%x collapsed 935, ! blockidx%x threadidx%x collapsed 932, Generating default present(wpsclrp_old(:ngrdcol,:nzm,:sclr_dim),wpsclrp(:ngrdcol,:nzm,:sclr_dim)) 945, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 946, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 947, ! blockidx%x threadidx%x collapsed 945, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 954, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 955, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 956, ! blockidx%x threadidx%x collapsed 954, Generating default present(vpwp_old(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm),upwp_old(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm)) 970, Generating update self(vpwp(:,:),vm_forcing(:,:),upwp(:,:),um_forcing(:,:),wpsclrp(:,:,:),sclrm_forcing(:,:,:),wpthlp_forcing(:,:),thlm_forcing(:,:),wprtp_forcing(:,:),rtm_forcing(:,:),vprcp(:,:),vg(:,:),uprcp(:,:),ug(:,:),wprtp_old(:,:),rtpthvp(:,:),wpsclrp_old(:,:,:),skw_zm(:,:),wp3_on_wp2_zt(:,:),rho_ds_zt(:,:),mixt_frac_zm(:,:),vp2(:,:),up2(:,:),vm_ref(:,:),um_ref(:,:),vm_old(:,:),um_old(:,:),em(:,:),wpthvp(:,:),wpthlp_old(:,:),varnce_w_2_zm(:,:),thv_ds_zm(:,:),vm(:,:),um(:,:),sclrm_old(:,:,:),sclrm(:,:,:),sclrp2(:,:,:),wp2rtp(:,:),cx_fnc_richardson(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_old(:,:),w_1_zm(:,:),vpwp_old(:,:),thlm_ref(:,:),rtm_ref(:,:),thlpthvp(:,:),invrs_rho_ds_zm(:,:),fcor(:),rho_ds_zm(:,:),rc_coef_zm(:,:),thlm_old(:,:),wpthlp(:,:),thlm(:,:),thlp2(:,:),wp2sclrp(:,:,:),rtm_old(:,:),wprtp(:,:),rtm(:,:),rtp2(:,:),wp2(:,:),sigma_sqd_w(:,:),invrs_rho_ds_zt(:,:),invrs_tau_c6_zm(:,:),kh_zm(:,:),wp3_on_wp2(:,:),wp2thlp(:,:),kh_zt(:,:),wm_zt(:,:),wm_zm(:,:),w_2_zm(:,:),sclrpthvp(:,:,:)) 1028, Generating update self(rtm_ref(:,:),rtm(:,:)) 1049, Generating update device(rtm(:,:)) 1055, Generating update self(thlm_ref(:,:),thlm(:,:)) 1076, Generating update device(thlm(:,:)) 1084, Generating update self(vm_ref(:,:),vm(:,:),um(:,:),um_ref(:,:)) 1114, Generating update device(vm(:,:),um(:,:)) 1123, Generating update self(vm(:,:),um(:,:)) 1132, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1133, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1134, ! blockidx%x threadidx%x collapsed 1132, Generating default present(vm_ref(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_ref(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 1134, Generating implicit firstprivate(ts_nudge,dt) 1143, Generating update self(vm(:,:),um(:,:)) 1155, Generating update self(vm_ref(:,:),um_ref(:,:)) 1168, Generating exit data delete(lhs_pr1_wprtp(:,:),lhs_ma_zt(:,:,:),kw6(:,:),lhs_ta_wpvp(:,:,:),lhs_ta_xm(:,:,:),rhs_ta_wpup(:,:),rhs_ta_wpthlp(:,:),rhs_ta_wprtp(:,:),low_lev_effect(:,:),lhs_ta_wpup(:,:,:),lhs_ta_wpthlp(:,:,:),lhs_ta_wprtp(:,:,:),lhs_pr1_wpthlp(:,:),lhs_diff_zt(:,:,:),lhs_ma_zm(:,:,:),lhs_diff_zm(:,:,:),lhs_ac_pr2(:,:),vm_old(:,:),upwp_old(:,:),um_old(:,:),thlm_old(:,:),wprtp_old(:,:),rtm_old(:,:),vpwp_old(:,:),rhs_ta_wpvp(:,:),c7_skw_fnc(:,:),lhs_tp(:,:,:),high_lev_effect(:,:),c6thl_skw_fnc(:,:),c6rt_skw_fnc(:,:),c6_term(:,:),wpthlp_old(:,:)) 1177, Generating exit data delete(lhs_ta_wpsclrp(:,:,:,:),lhs_pr1_wpsclrp(:,:),wpsclrp_old(:,:,:),sclrm_old(:,:,:),rhs_ta_wpsclrp(:,:,:)) solve_xp2_xpyp_with_multiple_lhs: 2065, Generating enter data create(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold) 2068, Generating enter data create(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_forcing(:,:),sclrpthlp_solution(:,:,:),sclrprtp_forcing(:,:)) 2078, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2079, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2080, ! blockidx%x threadidx%x collapsed 2078, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2109, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2110, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2111, ! blockidx%x threadidx%x collapsed 2109, Generating default present(rtp2_solution(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm)) 2117, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2118, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2119, ! blockidx%x threadidx%x collapsed 2117, Generating default present(rtp2_solution(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm)) 2128, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),lhs_ta_wprtp2(:,:,:)) 2145, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2146, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2147, ! blockidx%x threadidx%x collapsed 2145, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2177, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2178, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2179, ! blockidx%x threadidx%x collapsed 2177, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm)) 2185, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2186, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2187, ! blockidx%x threadidx%x collapsed 2185, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm)) 2196, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),thlp2(:,:),lhs_ta_wpthlp2(:,:,:)) 2212, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2213, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2214, ! blockidx%x threadidx%x collapsed 2212, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2244, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2245, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2246, ! blockidx%x threadidx%x collapsed 2244, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm)) 2252, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2253, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2254, ! blockidx%x threadidx%x collapsed 2252, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm)) 2263, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtpthlp(:,:),lhs_ta_wprtpthlp(:,:,:)) 2280, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2281, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2282, ! blockidx%x threadidx%x collapsed 2280, Generating default present(lhs_dp1(:ngrdcol,:nzm)) 2426, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2427, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2428, ! blockidx%x threadidx%x collapsed 2426, Generating default present(sclrp2_forcing(:ngrdcol,:nzm)) 2450, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2451, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2452, ! blockidx%x threadidx%x collapsed 2450, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm)) 2460, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2461, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2462, ! blockidx%x threadidx%x collapsed 2460, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm)) 2486, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2487, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2488, ! blockidx%x threadidx%x collapsed 2486, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm)) 2496, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2497, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2498, ! blockidx%x threadidx%x collapsed 2496, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm)) 2529, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2530, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2531, ! blockidx%x threadidx%x collapsed 2532, ! blockidx%x threadidx%x collapsed 2529, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim)) 2546, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2547, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2548, ! blockidx%x threadidx%x collapsed 2549, ! blockidx%x threadidx%x collapsed 2546, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim)) 2564, Generating exit data delete(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold) 2567, Generating exit data delete(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_solution(:,:,:),sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:)) xm_wpxp_lhs: 1326, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1327, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1326, Generating default present(lhs(:,:ngrdcol,:1)) 1337, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1338, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1339, ! blockidx%x threadidx%x collapsed 1337, Generating default present(lhs(:,:ngrdcol,:),lhs_ta_xm(:,:ngrdcol,:nzt)) 1339, Generating implicit firstprivate(k_xm,invrs_dt) 1359, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1360, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1361, ! blockidx%x threadidx%x collapsed 1359, Generating default present(lhs(:,:ngrdcol,:),lhs_ma_zm(:,:ngrdcol,2:nzm-1),lhs_tp(:,:ngrdcol,2:nzm-1),lhs_ta_wpxp(:,:ngrdcol,2:nzm-1),lhs_diff_zm(:,:ngrdcol,2:nzm-1),lhs_ac_pr2(:ngrdcol,2:nzm-1),lhs_pr1(:ngrdcol,2:nzm-1)) 1361, Generating implicit firstprivate(k_wpxp) 1386, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1387, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1386, Generating default present(lhs(:,:ngrdcol,nzm*2-1)) 1387, Generating implicit firstprivate(nzm) 1398, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1399, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1400, ! blockidx%x threadidx%x collapsed 1398, Generating default present(lhs(3,:ngrdcol,:)) 1400, Generating implicit firstprivate(k_wpxp,invrs_dt) 1410, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1411, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1412, ! blockidx%x threadidx%x collapsed 1410, Generating default present(lhs_diff_zt(:,:ngrdcol,:nzt),lhs(:,:ngrdcol,:)) 1412, Generating implicit firstprivate(k_xm) 1424, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1425, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1426, ! blockidx%x threadidx%x collapsed 1424, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt),lhs(:,:ngrdcol,:)) 1426, Generating implicit firstprivate(k_xm) xp2_xpyp_lhs: 2644, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2645, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2646, ! blockidx%x threadidx%x collapsed 2644, Generating default present(lhs_diff(:,:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1),lhs_ma(:,:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1)) 2658, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2659, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2660, ! blockidx%x threadidx%x collapsed 2658, Generating default present(lhs(2,:ngrdcol,2:nzm-1)) 2660, Generating implicit firstprivate(dt) 2673, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2674, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2673, Generating default present(lhs(:,:ngrdcol,:)) 2674, Generating implicit firstprivate(nzm) calc_xm_wpxp_lhs_terms: 1565, Generating enter data create(zeros_array(:),kw6_zm(:,:),kh_n2_zm(:,:),k_zm(:,:),k_zt(:,:)) 1601, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1603, ! blockidx%x threadidx%x collapsed 1601, Generating default present(kh_zm(:ngrdcol,:nzm),stability_correction(:ngrdcol,:nzm),kh_n2_zm(:ngrdcol,:nzm)) 1610, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1611, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1612, ! blockidx%x threadidx%x collapsed 1610, Generating default present(kh_zm(:ngrdcol,:nzm),kh_n2_zm(:ngrdcol,:nzm)) 1619, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1620, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1621, ! blockidx%x threadidx%x collapsed 1619, Generating default present(kh_n2_zm(:ngrdcol,:nzm),k_zm(:ngrdcol,:nzm)) 1629, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1630, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1629, Generating default present(zeros_array(:ngrdcol)) 1649, Generating exit data delete(zeros_array(:),kw6_zm(:,:),kh_n2_zm(:,:),k_zm(:,:),k_zt(:,:)) xm_wpxp_rhs: 1796, Generating enter data create(rhs_bp_pr3(:,:)) 1805, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1806, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1805, Generating default present(rhs(:ngrdcol,:1),wpxp(:ngrdcol,:1)) 1813, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1814, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1815, ! blockidx%x threadidx%x collapsed 1813, Generating default present(rhs(:ngrdcol,:),xm(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt)) 1815, Generating implicit firstprivate(k_xm,invrs_dt) 1829, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1830, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1831, ! blockidx%x threadidx%x collapsed 1829, Generating default present(lhs_ta_wpxp(:,:ngrdcol,2:nzm-1),rhs(:ngrdcol,:),wpxp_forcing(:ngrdcol,2:nzm-1),wpxp(:ngrdcol,:nzm),rhs_bp_pr3(:ngrdcol,2:nzm-1),lhs_pr1(:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1)) 1831, Generating implicit firstprivate(k_wpxp) 1846, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1847, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1846, Generating default present(rhs(:ngrdcol,nzm*2-1)) 1847, Generating implicit firstprivate(nzm) 1855, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1856, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1857, ! blockidx%x threadidx%x collapsed 1855, Generating default present(wpxp(:ngrdcol,2:nzm-1),rhs(:ngrdcol,:)) 1857, Generating implicit firstprivate(k_wpxp,invrs_dt) 1912, Generating copyin(c7_skw_fnc_plus_one(:,:),c7_skw_fnc_zeros(:,:)) [if not already present] Generating copyout(rhs_pr3(:,:),rhs_bp(:,:)) [if not already present] 1940, Generating update self(lhs_ta_wpxp(:,:,:),rhs(:,:),c7_skw_fnc(:,:),rhs_ta(:,:),xpthvp(:,:),xm_forcing(:,:),wpxp(:,:),xm(:,:),thv_ds_zm(:,:),wpxp_forcing(:,:),lhs_pr1(:,:)) 2002, Generating exit data delete(rhs_bp_pr3(:,:)) xp2_xpyp_uv_rhs: 3168, Generating enter data create(rhs_term_tp(:,:),rhs_pr2(:,:),rhs_pr1(:,:)) 3196, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3197, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3198, ! blockidx%x threadidx%x collapsed 3196, Generating default present(lhs_splat_wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1)) 3223, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3224, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3225, ! blockidx%x threadidx%x collapsed 3223, Generating default present(rhs_pr1(:ngrdcol,2:nzm-1),c_uu_shr(:ngrdcol),lhs_dp1_c14(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1),lhs_dp1_c4(:ngrdcol,2:nzm-1),xap2(:ngrdcol,:nzm),rhs_term_tp(:ngrdcol,2:nzm-1)) 3252, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3253, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3254, ! blockidx%x threadidx%x collapsed 3252, Generating default present(rhs(:ngrdcol,2:nzm-1),xap2(:ngrdcol,2:nzm-1)) 3254, Generating implicit firstprivate(dt) 3272, Generating copyin(c14_zeros(:),c4_zeros(:)) [if not already present] Generating copyout(stats_pr2(:,:),stats_pr1(:,:)) [if not already present] 3286, Generating update self(lhs_dp1_c14(:,:),invrs_tau_c4_zm(:,:),rhs_ta(:,:),lhs_dp1_c4(:,:),lhs_ta(:,:,:),invrs_tau_c14_zm(:,:),rhs_term_tp(:,:),xbp2(:,:),xap2(:,:),wp2(:,:),lhs_splat_wp2(:,:),rhs_pr2(:,:)) 3355, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3356, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3355, Generating default present(xap2(:ngrdcol,:1),rhs(:ngrdcol,:)) 3356, Generating implicit firstprivate(nzm) 3364, Generating exit data delete(rhs_term_tp(:,:),rhs_pr2(:,:),rhs_pr1(:,:)) xp2_xpyp_rhs: 3524, Generating enter data create(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:)) 3575, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3576, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3577, ! blockidx%x threadidx%x collapsed 3575, Generating default present(lhs_ta(:,:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1),rhs_term_dp1(:ngrdcol,2:nzm-1),lhs_term_dp1(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),xapxbp(:ngrdcol,:nzm),rhs_term_tp(:ngrdcol,2:nzm-1)) 3630, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3631, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3632, ! blockidx%x threadidx%x collapsed 3630, Generating default present(xpyp_forcing(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1)) 3639, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3640, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3641, ! blockidx%x threadidx%x collapsed 3639, Generating default present(rhs(:ngrdcol,2:nzm-1),xapxbp(:ngrdcol,2:nzm-1)) 3641, Generating implicit firstprivate(dt) 3652, Generating copyin(xm_zeros(:,:),wpxp_zeros(:,:)) [if not already present] Generating copyout(stats_tp2(:,:),stats_tp1(:,:)) [if not already present] 3669, Generating update self(lhs_ta(:,:,:),rhs_ta(:,:),xpyp_forcing(:,:),xbm(:,:),rhs_term_tp(:,:),wpxap(:,:),xapxbp(:,:),rhs_term_dp1(:,:),wpxbp(:,:),cn(:,:),xam(:,:),invrs_tau_zm(:,:),lhs_term_dp1(:,:)) 3756, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3757, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3756, Generating default present(xapxbp(:ngrdcol,:1),rhs(:ngrdcol,:)) 3757, Generating implicit firstprivate(threshold,nzm) 3763, Generating exit data delete(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:)) calc_xm_wpxp_ta_terms: 2192, Generating enter data create(a1_coef(:,:),sgn_t_vel_wprtp(:,:),coef_wp2thlp_implicit_zm(:,:),term_wp2thlp_explicit(:,:),coef_wp2thlp_implicit(:,:),term_wp2rtp_explicit_zm(:,:),coef_wp2rtp_implicit_zm(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),sgn_t_vel_wpthlp(:,:),a1_coef_zt(:,:),term_wp2thlp_explicit_zm(:,:)) 2198, Generating enter data create(term_wp2sclrp_explicit(:,:),term_wp2sclrp_explicit_zm(:,:),sgn_t_vel_wpsclrp(:,:)) 2221, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2222, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2223, ! blockidx%x threadidx%x collapsed 2224, ! blockidx%x threadidx%x collapsed 2221, Generating default present(lhs_ta_wpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2233, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2234, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 2235, ! blockidx%x threadidx%x collapsed 2236, ! blockidx%x threadidx%x collapsed 2237, ! blockidx%x threadidx%x collapsed 2233, Generating default present(lhs_ta_wpsclrp(:,:ngrdcol,:nzm,sclr_dim)) 2246, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2247, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2248, ! blockidx%x threadidx%x collapsed 2246, Generating default present(term_wp2rtp_explicit(:ngrdcol,:nzt),wp2rtp(:ngrdcol,:nzt),wp2thlp(:ngrdcol,:nzt),term_wp2thlp_explicit(:ngrdcol,:nzt)) 2275, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2276, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2277, ! blockidx%x threadidx%x collapsed 2275, Generating default present(wp2sclrp(:ngrdcol,:nzt,sclr),term_wp2sclrp_explicit(:ngrdcol,:nzt)) 2309, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2310, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2311, ! blockidx%x threadidx%x collapsed 2309, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm)) 2322, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2323, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2324, ! blockidx%x threadidx%x collapsed 2322, Generating default present(coef_wp2rtp_implicit(:ngrdcol,:nzt),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wp2thlp_implicit(:ngrdcol,:nzt)) 2345, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2346, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2347, ! blockidx%x threadidx%x collapsed 2345, Generating default present(coef_wp2rtp_implicit(:ngrdcol,:nzt),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wp2thlp_implicit(:ngrdcol,:nzt)) 2363, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2364, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2365, ! blockidx%x threadidx%x collapsed 2366, ! blockidx%x threadidx%x collapsed 2363, Generating default present(lhs_ta_wpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2374, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2375, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 2376, ! blockidx%x threadidx%x collapsed 2377, ! blockidx%x threadidx%x collapsed 2378, ! blockidx%x threadidx%x collapsed 2374, Generating default present(lhs_ta_wpsclrp(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2388, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2389, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2390, ! blockidx%x threadidx%x collapsed 2388, Generating default present(term_wp2thlp_explicit(:ngrdcol,:nzt),term_wp2rtp_explicit(:ngrdcol,:nzt)) 2400, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2401, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2402, ! blockidx%x threadidx%x collapsed 2400, Generating default present(rhs_ta_wpthlp(:ngrdcol,:nzm),rhs_ta_wprtp(:ngrdcol,:nzm)) 2410, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2411, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2412, ! blockidx%x threadidx%x collapsed 2413, ! blockidx%x threadidx%x collapsed 2410, Generating default present(rhs_ta_wpsclrp(:ngrdcol,:nzm,:sclr_dim)) 2425, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2426, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2427, ! blockidx%x threadidx%x collapsed 2428, ! blockidx%x threadidx%x collapsed 2425, Generating default present(lhs_ta_wprtp(:,:ngrdcol,:nzm),lhs_ta_wpvp(:,:ngrdcol,:nzm),lhs_ta_wpup(:,:ngrdcol,:nzm)) 2438, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2439, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2440, ! blockidx%x threadidx%x collapsed 2438, Generating default present(rhs_ta_wpvp(:ngrdcol,:nzm),rhs_ta_wpup(:ngrdcol,:nzm)) 2572, Generating update self(term_wp2thlp_explicit(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),coef_wp2thlp_implicit(:,:)) 2590, Generating exit data delete(a1_coef(:,:),sgn_t_vel_wprtp(:,:),coef_wp2thlp_implicit_zm(:,:),term_wp2thlp_explicit(:,:),coef_wp2thlp_implicit(:,:),term_wp2rtp_explicit_zm(:,:),coef_wp2rtp_implicit_zm(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),sgn_t_vel_wpthlp(:,:),a1_coef_zt(:,:),term_wp2thlp_explicit_zm(:,:)) 2596, Generating exit data delete(term_wp2sclrp_explicit_zm(:,:),term_wp2sclrp_explicit(:,:),sgn_t_vel_wpsclrp(:,:)) solve_xm_wpxp_with_single_lhs: 2946, Generating enter data create(upwp_forcing_pert(:,:),tau_c6_zm(:,:),vpthvp_pert(:,:),upthvp_pert(:,:),ddzt_vm(:,:),ddzt_um(:,:),ddzt_um_pert(:,:),vpwp_forcing_pert(:,:),old_solution(:,:,:),lhs(:,:,:),rhs_save(:,:,:),rhs(:,:,:),rcond(:),vprtp(:,:),uprtp(:,:),vpthlp(:,:),upthlp(:,:),vpthvp(:,:),upthvp(:,:),vpwp_forcing(:,:),upwp_forcing(:,:),solution(:,:,:),vm_tndcy(:,:),um_tndcy(:,:),vprtp_pert(:,:),uprtp_pert(:,:),vpthlp_pert(:,:),upthlp_pert(:,:),vpthvp_tmp(:,:),upthvp_tmp(:,:),vm_smth(:,:),um_smth(:,:),ddzt_vm_pert(:,:),zeros_vector(:,:)) 2954, Generating enter data create(wpsclrp_forcing(:,:,:)) 2958, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 3011, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3012, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3013, ! blockidx%x threadidx%x collapsed 3011, Generating default present(wpsclrp_forcing(:ngrdcol,:nzm,sclr)) 3013, Generating implicit firstprivate(sclr) 3043, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3044, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3045, ! blockidx%x threadidx%x collapsed 3043, Generating default present(vm_tndcy(:ngrdcol,:nzt),vm_forcing(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),ug(:ngrdcol,:nzt),fcor(:ngrdcol),um_forcing(:ngrdcol,:nzt),vg(:ngrdcol,:nzt),um_tndcy(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 3054, Generating update self(ug(:,:),vg(:,:),fcor(:),um_forcing(:,:),vm_forcing(:,:),vm(:,:),um(:,:)) 3084, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3085, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3086, ! blockidx%x threadidx%x collapsed 3084, Generating default present(vm_tndcy(:ngrdcol,:nzt),um_tndcy(:ngrdcol,:nzt)) 3099, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3100, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3101, ! blockidx%x threadidx%x collapsed 3099, Generating default present(upwp_forcing(:ngrdcol,:nzm),ddzt_um(:ngrdcol,:nzm),ddzt_vm(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vpwp_forcing(:ngrdcol,:nzm),c_uu_shr(:ngrdcol)) 3113, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3114, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3115, ! blockidx%x threadidx%x collapsed 3113, Generating default present(upwp_forcing_pert(:ngrdcol,:nzm),ddzt_um_pert(:ngrdcol,:nzm),ddzt_vm_pert(:ngrdcol,:nzm),c_uu_shr(:ngrdcol),wp2(:ngrdcol,:nzm),vpwp_forcing_pert(:ngrdcol,:nzm)) 3126, Generating update self(ddzt_um(:,:),c_uu_shr(:),wp2(:,:),ddzt_vm(:,:)) 3139, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3140, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3141, ! blockidx%x threadidx%x collapsed 3139, Generating default present(invrs_tau_c6_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm),tau_c6_zm(:ngrdcol,:nzm)) 3193, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3194, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3195, ! blockidx%x threadidx%x collapsed 3193, Generating default present(vpthvp_tmp(:ngrdcol,:nzm),vpthlp(:ngrdcol,:nzm),vprtp(:ngrdcol,:nzm),vprcp(:ngrdcol,:nzm),upthvp_tmp(:ngrdcol,:nzm),upthlp(:ngrdcol,:nzm),uprtp(:ngrdcol,:nzm),rc_coef_zm(:ngrdcol,:nzm),uprcp(:ngrdcol,:nzm),thv_ds_zm(:ngrdcol,:nzm)) 3210, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3211, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3212, ! blockidx%x threadidx%x collapsed 3210, Generating default present(vpthvp_pert(:ngrdcol,:nzm),vpthlp_pert(:ngrdcol,:nzm),vprtp_pert(:ngrdcol,:nzm),vprcp(:ngrdcol,:nzm),upthvp_pert(:ngrdcol,:nzm),upthlp_pert(:ngrdcol,:nzm),uprtp_pert(:ngrdcol,:nzm),uprcp(:ngrdcol,:nzm),rc_coef_zm(:ngrdcol,:nzm),thv_ds_zm(:ngrdcol,:nzm)) 3227, Generating update self(vpthvp(:,:),vpthlp(:,:),upthlp(:,:),upthvp(:,:),vprtp(:,:),uprtp(:,:)) 3295, Generating implicit firstprivate(nzm,nrhs,ngrdcol) Generating NVIDIA GPU code 3296, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 3297, ! blockidx%x threadidx%x collapsed 3298, ! blockidx%x threadidx%x collapsed 3295, Generating default present(rhs_save(:ngrdcol,:nzm*2-1,:nrhs),rhs(:ngrdcol,:nzm*2-1,:nrhs)) 3308, Generating implicit firstprivate(nzt) Generating NVIDIA GPU code 3317, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 3326, Generating implicit firstprivate(sclr_dim,nzt) Generating NVIDIA GPU code 3327, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3328, ! blockidx%x threadidx%x collapsed 3336, Generating implicit firstprivate(sclr_dim,nzm) Generating NVIDIA GPU code 3337, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3338, ! blockidx%x threadidx%x collapsed 3347, Generating implicit firstprivate(nzt) Generating NVIDIA GPU code 3356, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 3386, Generating update self(rhs_save(:,:,:),lhs(:,:,:),gr%zt(:,:),gr%zm(:,:)) 3697, Generating exit data delete(upwp_forcing_pert(:,:),tau_c6_zm(:,:),vpthvp_pert(:,:),upthvp_pert(:,:),ddzt_vm(:,:),ddzt_um(:,:),ddzt_um_pert(:,:),vpwp_forcing_pert(:,:),old_solution(:,:,:),lhs(:,:,:),rhs_save(:,:,:),rhs(:,:,:),rcond(:),vprtp(:,:),uprtp(:,:),vpthlp(:,:),upthlp(:,:),vpthvp(:,:),upthvp(:,:),vpwp_forcing(:,:),upwp_forcing(:,:),solution(:,:,:),vm_tndcy(:,:),um_tndcy(:,:),vprtp_pert(:,:),uprtp_pert(:,:),vpthlp_pert(:,:),upthlp_pert(:,:),vpthvp_tmp(:,:),upthvp_tmp(:,:),vm_smth(:,:),um_smth(:,:),ddzt_vm_pert(:,:),zeros_vector(:,:)) 3705, Generating exit data delete(wpsclrp_forcing(:,:,:)) xm_wpxp_clipping_and_stats: 4639, Generating enter data create(xm_pd(:,:),xp2_relaxed(:,:),xm_old(:,:),wpxp_chnge(:,:),wpxp_pd(:,:)) 4729, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4730, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4731, ! blockidx%x threadidx%x collapsed 4729, Generating default present(xm_old(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),solution(:ngrdcol,:)) 4731, Generating implicit firstprivate(k_xm) 4740, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4741, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4742, ! blockidx%x threadidx%x collapsed 4740, Generating default present(solution(:ngrdcol,:),wpxp(:ngrdcol,:nzm)) 4742, Generating implicit firstprivate(k_wpxp) 4751, Generating update self(wm_zt(:,:),xm(:,:),wpxp(:,:),lhs_ma_zt(:,:,:),lhs_ta_wpxp(:,:,:),lhs_ta_xm(:,:,:),lhs_pr1(:,:),lhs_diff_zm(:,:,:),lhs_ma_zm(:,:,:),c7_skw_fnc(:,:),lhs_tp(:,:,:),rcond(:)) 4759, Generating copyin(c7_skw_fnc_plus_one(:,:),c7_skw_fnc_zeros(:,:)) [if not already present] Generating copyout(wpxp_pr2(:,:),wpxp_ac(:,:)) [if not already present] 4927, Generating update self(xm(:,:)) 4948, Generating update self(xm(:,:)) 4981, Generating update self(xm(:,:)) 5006, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5007, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5008, ! blockidx%x threadidx%x collapsed 5006, Generating default present(xp2_relaxed(:ngrdcol,:nzm),xp2(:ngrdcol,:nzm)) 5016, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5017, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5018, ! blockidx%x threadidx%x collapsed 5016, Generating default present(xp2_relaxed(:ngrdcol,:nzm),xp2(:ngrdcol,:nzm)) 5026, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5027, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5028, ! blockidx%x threadidx%x collapsed 5026, Generating default present(xp2_relaxed(:ngrdcol,:nzm),xp2(:ngrdcol,:nzm)) 5038, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5039, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5040, ! blockidx%x threadidx%x collapsed 5038, Generating default present(xp2_relaxed(:ngrdcol,:nzm),xp2(:ngrdcol,:nzm)) 5109, Generating exit data delete(xp2_relaxed(:,:),xm_pd(:,:),xm_old(:,:),wpxp_chnge(:,:),wpxp_pd(:,:)) xm_term_ta_lhs: 5200, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5201, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5202, ! blockidx%x threadidx%x collapsed 5200, Generating default present(invrs_rho_ds_zt(:ngrdcol,:nzt),gr%invrs_dzt(1:ngrdcol,1:nzt),gr,rho_ds_zm(:ngrdcol,:nzt+1),lhs_ta_xm(:,:ngrdcol,:nzt)) wpxp_term_tp_lhs: 5299, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5300, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5299, Generating default present(lhs_tp(:,:ngrdcol,:1)) 5307, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5308, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5309, ! blockidx%x threadidx%x collapsed 5307, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1),lhs_tp(:,:ngrdcol,2:nzm-1),gr) 5322, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5323, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5322, Generating default present(lhs_tp(:,:ngrdcol,nzm)) 5323, Generating implicit firstprivate(nzm) wpxp_terms_ac_pr2_lhs: 5418, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5419, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5418, Generating default present(lhs_ac_pr2(:ngrdcol,:1)) 5425, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5426, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5427, ! blockidx%x threadidx%x collapsed 5425, Generating default present(invrs_dzm(:ngrdcol,2:nzm-1),c7_skw_fnc(:ngrdcol,2:nzm-1),lhs_ac_pr2(:ngrdcol,2:nzm-1),wm_zt(:ngrdcol,:nzm-1)) 5436, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5437, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5436, Generating default present(lhs_ac_pr2(:ngrdcol,nzm)) 5437, Generating implicit firstprivate(nzm) wpxp_term_pr1_lhs: 5513, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5514, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5515, ! blockidx%x threadidx%x collapsed 5513, Generating default present(lhs_pr1_wprtp(:ngrdcol,2:nzm-1),lhs_pr1_wpthlp(:ngrdcol,2:nzm-1),c6rt_skw_fnc(:ngrdcol,2:nzm-1),invrs_tau_c6_zm(:ngrdcol,2:nzm-1),c6thl_skw_fnc(:ngrdcol,2:nzm-1)) 5527, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5528, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5527, Generating default present(lhs_pr1_wpthlp(:ngrdcol,:),lhs_pr1_wprtp(:ngrdcol,:)) 5528, Generating implicit firstprivate(nzm) 5547, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5548, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5549, ! blockidx%x threadidx%x collapsed 5547, Generating default present(lhs_pr1_wpsclrp(:ngrdcol,2:nzm-1),invrs_tau_c6_zm(:ngrdcol,2:nzm-1),c7_skw_fnc(:ngrdcol,2:nzm-1)) 5558, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5559, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5558, Generating default present(lhs_pr1_wpsclrp(:ngrdcol,:)) 5559, Generating implicit firstprivate(nzm) wpxp_terms_bp_pr3_rhs: 5631, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5632, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5631, Generating default present(rhs_bp_pr3(:ngrdcol,:1)) 5637, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5638, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5639, ! blockidx%x threadidx%x collapsed 5637, Generating default present(c7_skw_fnc(:ngrdcol,2:nzm-1),rhs_bp_pr3(:ngrdcol,2:nzm-1),thv_ds_zm(:ngrdcol,2:nzm-1),xpthvp(:ngrdcol,2:nzm-1)) 5645, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5646, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5645, Generating default present(rhs_bp_pr3(:ngrdcol,nzm)) 5646, Generating implicit firstprivate(nzm) xm_correction_wpxp_cl: 5831, Generating enter data create(l_any_clipping_needed,xm_tndcy_wpxp_cl(:,:),l_clipping_needed(:)) 5835, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5836, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5837, ! blockidx%x threadidx%x collapsed 5835, Generating default present(l_clipping_needed(:ngrdcol),wpxp_chnge(:ngrdcol,:nzm)) 5837, Generating implicit firstprivate(l_any_clipping_needed) 5846, Generating update self(l_any_clipping_needed) 5864, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5865, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5866, ! blockidx%x threadidx%x collapsed 5864, Generating default present(l_clipping_needed(:ngrdcol),xm_tndcy_wpxp_cl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),wpxp_chnge(:ngrdcol,:nzt+1),invrs_dzt(:ngrdcol,:nzt)) 5866, Generating implicit firstprivate(dt) 5877, Generating update self(xm_tndcy_wpxp_cl(:,:)) 5888, Generating exit data delete(l_any_clipping_needed,xm_tndcy_wpxp_cl(:,:),l_clipping_needed(:)) damp_coefficient: 5936, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5937, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5938, ! blockidx%x threadidx%x collapsed 5936, Generating default present(coefficient(:ngrdcol),damped_value(:ngrdcol,:nzm),gr,gr%zm(1:ngrdcol,1:nzm),threshold(:ngrdcol),max_coeff_value(:ngrdcol),lscale_zm(:ngrdcol,:nzm),altitude_threshold(:ngrdcol),cx_skw_fnc(:ngrdcol,:nzm)) diagnose_upxp: 6016, Generating enter data create(ddzt_xm(:,:),ddzt_ym(:,:)) 6021, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 6022, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 6023, ! blockidx%x threadidx%x collapsed 6021, Generating default present(ypxp(:ngrdcol,2:nzm-1),ypwp(:ngrdcol,2:nzm-1),ddzt_ym(:ngrdcol,2:nzm-1),c6x_skw_fnc(:ngrdcol,2:nzm-1),tau_c6_zm(:ngrdcol,2:nzm-1),ddzt_xm(:ngrdcol,2:nzm-1),wpxp(:ngrdcol,2:nzm-1),c7_skw_fnc(:ngrdcol,2:nzm-1)) 6033, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6034, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6033, Generating default present(ypxp(:ngrdcol,:)) 6034, Generating implicit firstprivate(nzm) 6040, Generating exit data delete(ddzt_ym(:,:),ddzt_xm(:,:)) calc_xp2_xpyp_ta_terms: 4070, Generating enter data create(wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),sgn_t_vel_rtpthlp(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:)) 4083, Generating enter data create(term_wpthlpsclrp_explicit_zm(:,:),wpsclrp_zt(:,:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:)) 4098, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4099, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4100, ! blockidx%x threadidx%x collapsed 4098, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm)) 4109, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 4110, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4111, ! blockidx%x threadidx%x collapsed 4109, Generating default present(wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 4118, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4120, ! blockidx%x threadidx%x collapsed 4118, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp2_zt(:ngrdcol,:nzt)) 4384, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4385, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4386, ! blockidx%x threadidx%x collapsed 4384, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt)) 4399, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4400, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4401, ! blockidx%x threadidx%x collapsed 4399, Generating default present(coef_wprtp2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm)) 4423, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4424, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4425, ! blockidx%x threadidx%x collapsed 4423, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt)) 4443, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4444, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 4445, ! blockidx%x threadidx%x collapsed 4446, ! blockidx%x threadidx%x collapsed 4443, Generating default present(lhs_ta_wpthlp2(:,:ngrdcol,:nzm),lhs_ta_wprtpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp2(:,:ngrdcol,:nzm)) 4455, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 4456, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 4457, ! blockidx%x threadidx%x collapsed 4458, ! blockidx%x threadidx%x collapsed 4459, ! blockidx%x threadidx%x collapsed 4455, Generating default present(lhs_ta_wpthlpsclrp(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wpsclrp2(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wprtp2(:,:ngrdcol,:nzm),lhs_ta_wprtpsclrp(:,:ngrdcol,:nzm,:sclr_dim)) 4479, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4480, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4481, ! blockidx%x threadidx%x collapsed 4479, Generating default present(term_wprtp2_explicit(:ngrdcol,:nzt),term_wprtpthlp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wprtp_zt(:ngrdcol,:nzt),term_wpthlp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt)) 4493, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4494, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4495, ! blockidx%x threadidx%x collapsed 4493, Generating default present(term_wprtp2_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm)) 4521, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4522, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4523, ! blockidx%x threadidx%x collapsed 4521, Generating default present(wprtp(:ngrdcol,:nzm),term_wprtp2_explicit_zm(:ngrdcol,:nzm)) 4528, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4530, ! blockidx%x threadidx%x collapsed 4528, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_rtp2_zt(:ngrdcol,:nzt)) 4548, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4549, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4550, ! blockidx%x threadidx%x collapsed 4548, Generating default present(wpthlp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),term_wpthlp2_explicit_zm(:ngrdcol,:nzm)) 4555, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4556, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4557, ! blockidx%x threadidx%x collapsed 4555, Generating default present(wp3_on_wp2(:ngrdcol,:nzt),sgn_t_vel_thlp2(:ngrdcol,:nzt)) 4579, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4580, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4581, ! blockidx%x threadidx%x collapsed 4579, Generating default present(wpthlp(:ngrdcol,:nzm),term_wpthlp2_explicit_zm(:ngrdcol,:nzm)) 4586, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4587, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4588, ! blockidx%x threadidx%x collapsed 4586, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_thlp2_zt(:ngrdcol,:nzt)) 4606, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4607, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4608, ! blockidx%x threadidx%x collapsed 4606, Generating default present(term_wprtpthlp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_rtpthlp(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm)) 4632, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 4633, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4634, ! blockidx%x threadidx%x collapsed 4632, Generating default present(wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),term_wprtpthlp_explicit_zm(:ngrdcol,:nzm)) 4639, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4640, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4641, ! blockidx%x threadidx%x collapsed 4639, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_rtpthlp_zt(:ngrdcol,:nzt)) 4671, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 4672, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4673, ! blockidx%x threadidx%x collapsed 4671, Generating default present(term_wpsclrp2_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrp2(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm)) 4680, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4681, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4682, ! blockidx%x threadidx%x collapsed 4680, Generating default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wp_coef_zt(:ngrdcol,:nzt),term_wpsclrp2_explicit(:ngrdcol,:nzt)) 4705, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4706, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4707, ! blockidx%x threadidx%x collapsed 4705, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),term_wpsclrp2_explicit_zm(:ngrdcol,:nzm)) 4712, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4713, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4714, ! blockidx%x threadidx%x collapsed 4712, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrp2_zt(:ngrdcol,:nzt)) 4735, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4736, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4737, ! blockidx%x threadidx%x collapsed 4735, Generating default present(term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrprtp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr),wprtp(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm)) 4744, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4745, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4746, ! blockidx%x threadidx%x collapsed 4744, Generating default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wprtp_zt(:ngrdcol,:nzt),term_wprtpsclrp_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt)) 4769, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4770, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4771, ! blockidx%x threadidx%x collapsed 4769, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),wprtp(:ngrdcol,:nzm),term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm)) 4776, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4777, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4778, ! blockidx%x threadidx%x collapsed 4776, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrprtp_zt(:ngrdcol,:nzt)) 4799, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4800, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4801, ! blockidx%x threadidx%x collapsed 4799, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrpthlp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr)) 4808, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4809, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4810, ! blockidx%x threadidx%x collapsed 4808, Generating default present(wp_coef_zt(:ngrdcol,:nzt),term_wpthlpsclrp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wpsclrp_zt(:ngrdcol,:nzt,sclr)) 4833, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4834, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4835, ! blockidx%x threadidx%x collapsed 4833, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr)) 4840, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4841, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4842, ! blockidx%x threadidx%x collapsed 4840, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrpthlp_zt(:ngrdcol,:nzt)) 5276, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5277, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5278, ! blockidx%x threadidx%x collapsed 5276, Generating default present(term_wpup2_explicit_zm(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),coef_wpvp2_implicit_zm(:ngrdcol,:nzm),term_wpvp2_explicit_zm(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),coef_wpup2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm)) 5290, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5291, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5292, ! blockidx%x threadidx%x collapsed 5290, Generating default present(sgn_t_vel_up2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),sgn_t_vel_vp2(:ngrdcol,:nzm)) 5308, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5309, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5310, ! blockidx%x threadidx%x collapsed 5308, Generating default present(coef_wpup2_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpvp2_implicit(:ngrdcol,:nzt)) 5318, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5319, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5320, ! blockidx%x threadidx%x collapsed 5318, Generating default present(term_wpup2_explicit(:ngrdcol,:nzt),upwp_zt(:ngrdcol,:nzt),term_wpvp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),vpwp_zt(:ngrdcol,:nzt)) 5340, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5341, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 5342, ! blockidx%x threadidx%x collapsed 5343, ! blockidx%x threadidx%x collapsed 5340, Generating default present(lhs_ta_wpvp2(:,:ngrdcol,:nzm),lhs_ta_wpup2(:,:ngrdcol,:nzm)) 5374, Generating update self(term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit(:,:),coef_wprtpthlp_implicit(:,:),coef_wpthlp2_implicit(:,:)) 5399, Generating exit data delete(wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),sgn_t_vel_rtpthlp(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:)) 5412, Generating exit data delete(wpsclrp_zt(:,:,:),term_wpthlpsclrp_explicit_zm(:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:)) term_tp_rhs: 5489, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5490, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5491, ! blockidx%x threadidx%x collapsed 5489, Generating default present(invrs_dzm(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),xbm(:ngrdcol,:nzm-1),xam(:ngrdcol,:nzm-1),wpxap(:ngrdcol,2:nzm-1),wpxbp(:ngrdcol,2:nzm-1)) term_dp1_lhs: 5579, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5580, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5579, Generating default present(lhs(:ngrdcol,:)) 5580, Generating implicit firstprivate(nzm) 5587, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5588, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5589, ! blockidx%x threadidx%x collapsed 5587, Generating default present(lhs(:ngrdcol,2:nzm-1),invrs_tau_zm(:ngrdcol,2:nzm-1),cn(:ngrdcol,2:nzm-1)) term_dp1_rhs: 5668, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5669, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5670, ! blockidx%x threadidx%x collapsed 5668, Generating default present(rhs(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm),cn(:ngrdcol,:nzm)) 5670, Generating implicit firstprivate(threshold) term_pr1: 5796, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5797, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5798, ! blockidx%x threadidx%x collapsed 5796, Generating default present(invrs_tau_c4_zm(:ngrdcol,2:nzm-1),c14(:ngrdcol),xbp2(:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),invrs_tau_c14_zm(:ngrdcol,2:nzm-1),c4(:ngrdcol)) term_pr2: 5912, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5913, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5914, ! blockidx%x threadidx%x collapsed 5912, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1),wpthvp(:ngrdcol,2:nzm-1),c_uu_buoy(:ngrdcol),vm(:ngrdcol,:nzm-1),upwp(:ngrdcol,2:nzm-1),um(:ngrdcol,:nzm-1),c_uu_shr(:ngrdcol),gr,thv_ds_zm(:ngrdcol,2:nzm-1)) pos_definite_variances: 6015, Generating update self(xp2_np1(:,:)) 6034, Generating update self(xp2_np1(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/advance_clubb_core_module.F90 advance_clubb_core: 880, Generating enter data create(lhs_splat_wp2(:,:),kmh_zm(:,:),mixt_frac_zm(:,:),tau_max_zm(:,:),stability_correction(:,:),lscale_down(:,:),rcp2_zt(:,:),a3_coef_zt(:,:),brunt_vaisala_freq_sqd_splat(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_clipped(:,:),cloud_frac_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_xp2_zm(:,:),invrs_tau_no_n2_zm(:,:),invrs_tau_sfc(:,:),ice_supersat_frac_zm(:,:),invrs_tau_n2_zm(:,:),invrs_tau_wp2_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_shear(:,:),invrs_tau_bkgnd(:,:),invrs_tau_c1_zm(:,:),invrs_tau_c6_zm(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_n2_iso(:,:),sqrt_em_zt(:,:),rc_coef(:,:),thlm1000(:),tau_zt(:,:),rcm_supersat_adj(:,:),thlm700(:),ri_zm(:,:),gamma_skw_fnc(:,:),brunt_vaisala_freq_sqd_zt(:,:),rcp2(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_zt(:,:),w_1_zm(:,:),vpwp_zt(:,:),wpthlp_zt(:,:),skw_zt(:,:),sigma_sqd_w_tmp(:,:),sigma_sqd_w(:,:),rtpthlp_zt(:,:),em(:,:),km_zm(:,:),invrs_tau_zt(:,:),mu(:),wp3_on_wp2(:,:),wp2rcp(:,:),a3_coef(:,:),sigma_sqd_w_zt(:,:),vp2_zt(:,:),up2_zt(:,:),varnce_w_2_zm(:,:),thvm_zm(:,:),rtprcp(:,:),rtm_zm(:,:),wprtp2(:,:),wpthlp2(:,:),thlm_zm(:,:),w_2_zm(:,:),tau_zm(:,:),tau_max_zt(:,:),ddzt_vm(:,:),lhs_splat_wp3(:,:),lscale_up(:,:),lscale_max(:),wp3_on_wp2_zt(:,:),wp2_zt(:,:),wprtp_zt(:,:),wp3_zm(:,:),wprtpthlp(:,:),ddzt_umvm_sqd(:,:),ddzt_um(:,:),ddzt_umvm_sqd_clipped(:,:),ddzm_thvm_zm(:,:),rcm_zm(:,:),rtp2_zt(:,:),cx_fnc_richardson(:,:),thvm(:,:),thlp2_zt(:,:),skw_zm(:,:),skw_velocity(:,:),xp3_coef_fnc(:,:)) 901, Generating enter data create(wpsclrp2(:,:,:),wpsclrprtp(:,:,:),wpsclrp_zt(:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:),sclrp2_zt(:,:),wpsclrpthlp(:,:,:)) 905, Generating enter data create(wpedsclrp(:,:,:)) 920, Generating update self(rtm(:,:),rho_ds_zt(:,:),gr%dzt(:,:),thlm(:,:),wm_zt(:,:),wm_zm(:,:)) 947, Generating update self(rtp2(:,:),thlm_forcing(:,:),rtm_forcing(:,:),wp2(:,:),wm_zt(:,:),wprtp_sfc(:),rtpthlp(:,:),wp3(:,:),rho_zm(:,:),vm_forcing(:,:),um_forcing(:,:),vp2(:,:),upwp_sfc(:),up2(:,:),thv_ds_zt(:,:),p_in_pa(:,:),vpwp(:,:),upwp(:,:),wprtp(:,:),wpthlp(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),p_sfc(:),rho_ds_zt(:,:),invrs_rho_ds_zt(:,:),wm_zm(:,:),vpwp_sfc(:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),wpthlp_sfc(:)) 954, Generating update self(sclrm(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:),sclrm_forcing(:,:,:),wpedsclrp_sfc(:,:),sclrpthlp(:,:,:),wpsclrp(:,:,:),wpsclrp_sfc(:,:)) 958, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 991, Generating update self(wp2(:,:),upwp(:,:),thlp2(:,:),rtpthlp(:,:),rfrzm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),vp2(:,:),up2(:,:),wprtp(:,:),wpthlp(:,:),wp3(:,:),um(:,:),vm(:,:),vpwp(:,:)) 1052, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1053, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1052, Generating default present(wpthlp(:ngrdcol,:1),wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),wprtp(:ngrdcol,:1),vpwp_sfc(:ngrdcol),upwp(:ngrdcol,:1),vpwp(:ngrdcol,:1),upwp_sfc(:ngrdcol)) 1062, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1063, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1062, Generating default present(upwp_pert(:ngrdcol,:1),vpwp_sfc_pert(:ngrdcol),vpwp_pert(:ngrdcol,:1),upwp_sfc_pert(:ngrdcol)) 1072, Generating implicit firstprivate(ngrdcol,sclr_dim) Generating NVIDIA GPU code 1073, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1074, ! blockidx%x threadidx%x collapsed 1072, Generating default present(wpsclrp(:ngrdcol,:1,:sclr_dim),wpsclrp_sfc(:ngrdcol,:sclr_dim)) 1082, Generating implicit firstprivate(ngrdcol,edsclr_dim) Generating NVIDIA GPU code 1083, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1084, ! blockidx%x threadidx%x collapsed 1082, Generating default present(wpedsclrp_sfc(:ngrdcol,:edsclr_dim),wpedsclrp(:ngrdcol,:1,:edsclr_dim)) 1093, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1094, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1093, Generating default present(wprtp(:ngrdcol,:1),wpthlp(:ngrdcol,:1),vpwp(:ngrdcol,:1),upwp(:ngrdcol,:1)) 1104, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 1105, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1106, ! blockidx%x threadidx%x collapsed 1104, Generating default present(wpsclrp(:ngrdcol,:1,:sclr_dim)) 1114, Generating implicit firstprivate(ngrdcol,edsclr_dim) Generating NVIDIA GPU code 1115, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1116, ! blockidx%x threadidx%x collapsed 1114, Generating default present(wpedsclrp(:ngrdcol,:1,:edsclr_dim)) 1132, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1133, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1132, Generating default present(mu(:ngrdcol),clubb_params(:ngrdcol,60)) 1240, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1241, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1242, ! blockidx%x threadidx%x collapsed 1240, Generating default present(skw_zm(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,57:59)) 1242, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 1296, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1297, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1298, ! blockidx%x threadidx%x collapsed 1296, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a3_coef(:ngrdcol,:nzm)) 1307, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1308, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1309, ! blockidx%x threadidx%x collapsed 1307, Generating default present(clubb_params(:ngrdcol,98),a3_coef(:ngrdcol,:nzm)) 1326, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1327, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1328, ! blockidx%x threadidx%x collapsed 1326, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt),wp2_zt(:ngrdcol,:nzt)) 1335, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1336, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1337, ! blockidx%x threadidx%x collapsed 1335, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt)) 1365, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1366, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1367, ! blockidx%x threadidx%x collapsed 1365, Generating default present(em(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1373, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1374, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1375, ! blockidx%x threadidx%x collapsed 1373, Generating default present(up2(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),em(:ngrdcol,:nzm)) 1384, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1385, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1386, ! blockidx%x threadidx%x collapsed 1384, Generating default present(sqrt_em_zt(:ngrdcol,:nzt)) 1415, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1416, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1417, ! blockidx%x threadidx%x collapsed 1415, Generating default present(ddzt_um(:ngrdcol,:nzm),ddzt_vm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1424, Generating update self(ddzt_umvm_sqd(:,:)) 1487, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1488, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1489, ! blockidx%x threadidx%x collapsed 1487, Generating default present(tau_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt),clubb_params(:ngrdcol,69)) 1497, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1498, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1499, ! blockidx%x threadidx%x collapsed 1497, Generating default present(tau_zm(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,69),em(:ngrdcol,:nzm)) 1506, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1507, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1508, ! blockidx%x threadidx%x collapsed 1506, Generating default present(invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_wp3_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,69),invrs_tau_xp2_zm(:ngrdcol,:nzm),tau_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm)) 1519, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1520, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1521, ! blockidx%x threadidx%x collapsed 1519, Generating default present(invrs_tau_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,69),invrs_tau_wp3_zt(:ngrdcol,:nzt),tau_zt(:ngrdcol,:nzt),tau_max_zt(:ngrdcol,:nzt)) 1577, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1578, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1579, ! blockidx%x threadidx%x collapsed 1577, Generating default present(clubb_params(:ngrdcol,37),kh_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt)) 1587, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1588, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1589, ! blockidx%x threadidx%x collapsed 1587, Generating default present(em(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,37)) 1650, Generating update self(exner(:,:),thlm(:,:),rtm(:,:),p_in_pa(:,:),rcm(:,:)) 1683, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1684, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1685, ! blockidx%x threadidx%x collapsed 1683, Generating default present(mixt_frac_zm(:ngrdcol,:nzm),pdf_params_zm,varnce_w_1_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_1(1:ngrdcol,1:nzm),pdf_params_zm%w_2(1:ngrdcol,1:nzm),pdf_params_zm%mixt_frac(1:ngrdcol,1:nzm),w_1_zm(:ngrdcol,:nzm),w_2_zm(:ngrdcol,:nzm),pdf_params_zm%w_1(1:ngrdcol,1:nzm),varnce_w_2_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_2(1:ngrdcol,1:nzm)) 1721, Generating update self(stability_correction(:,:)) 1732, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1733, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1734, ! blockidx%x threadidx%x collapsed 1732, Generating default present(invrs_tau_c1_zm(:ngrdcol,:nzm),invrs_tau_c6_zm(:ngrdcol,:nzm),stability_correction(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_n2_zm(:ngrdcol,:nzm)) 1742, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1743, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1744, ! blockidx%x threadidx%x collapsed 1742, Generating default present(invrs_tau_c6_zm(:ngrdcol,:nzm),invrs_tau_c1_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm)) 1754, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1755, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1756, ! blockidx%x threadidx%x collapsed 1754, Generating default present(invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_c14_zm(:ngrdcol,:nzm)) 1772, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1773, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1774, ! blockidx%x threadidx%x collapsed 1772, Generating default present(invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_c4_zm(:ngrdcol,:nzm)) 1791, Generating update self(brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_sqd_smth(:,:),invrs_tau_sfc(:,:),invrs_tau_no_n2_zm(:,:),brunt_vaisala_freq_sqd_splat(:,:),invrs_tau_bkgnd(:,:),invrs_tau_wp2_zm(:,:),ri_zm(:,:),invrs_tau_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_shear(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_xp2_zm(:,:)) 1869, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1870, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1871, ! blockidx%x threadidx%x collapsed 1869, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm)) 2188, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2189, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2190, ! blockidx%x threadidx%x collapsed 2188, Generating default present(kmh_zm(:ngrdcol,:nzm),km_zm(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,74:75)) 2199, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2200, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2201, ! blockidx%x threadidx%x collapsed 2199, Generating default present(edsclrm(:ngrdcol,:nzt,edsclr_dim-1:edsclr_dim),thlm(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt)) 2201, Generating implicit firstprivate(edsclr_dim) 2242, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2243, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2244, ! blockidx%x threadidx%x collapsed 2242, Generating default present(rtm(:ngrdcol,:nzt),edsclrm(:ngrdcol,:nzt,edsclr_dim-1:edsclr_dim),thlm700(:ngrdcol),thlm1000(:ngrdcol),thlm(:ngrdcol,:nzt)) 2244, Generating implicit firstprivate(edsclr_dim) 2566, Generating update self(cloud_frac_zm(:,:),cloudy_downdraft_frac(:,:),vpwp_zt(:,:),w_down_in_cloud(:,:),sigma_sqd_w_zt(:,:),wp3_on_wp2(:,:),wp3_on_wp2_zt(:,:),a3_coef(:,:),cloudy_updraft_frac(:,:),rcm_zm(:,:),rtp3(:,:),thlp3(:,:),ice_supersat_frac_zm(:,:),skw_velocity(:,:),wp3_zm(:,:),wp2up2(:,:),wp2thvp(:,:),wpup2(:,:),wpthvp(:,:),wprtp2(:,:),wpthlp2(:,:),sigma_sqd_w(:,:),wprtp_zt(:,:),wp2_zt(:,:),kh_zm(:,:),tau_zm(:,:),lscale(:,:),lscale_down(:,:),wp2rcp(:,:),wp2rtp(:,:),kh_zt(:,:),upwp_zt(:,:),thvm(:,:),thv_ds_zt(:,:),rtpthvp(:,:),rcm_in_layer(:,:),a3_coef_zt(:,:),rcm(:,:),ice_supersat_frac(:,:),cloud_frac(:,:),exner(:,:),cloud_cover(:,:),rcm_supersat_adj(:,:),pdf_params%w_2(:,:),rc_coef(:,:),wp4(:,:),rc_coef_zm(:,:),w_up_in_cloud(:,:),wm_zm(:,:),thv_ds_zm(:,:),thlpthvp(:,:),rho_ds_zm(:,:),rho(:,:),rho_ds_zt(:,:),rcp2(:,:),em(:,:),lscale_up(:,:),thlprcp(:,:),rtpthlp_zt(:,:),wp2thlp(:,:),wpthlp_zt(:,:),rtpthlp(:,:),rtprcp(:,:),thlp2_zt(:,:),thlp2(:,:),thlm_zm(:,:),rtp2_zt(:,:),rtp2(:,:),rtm_zm(:,:),wp3(:,:),wp2vp2(:,:),wp2(:,:),wm_zt(:,:),wpthlp(:,:),wprtpthlp(:,:),wprtp(:,:),wprcp(:,:),rtm(:,:),rho_zm(:,:),thlm(:,:),tau_zt(:,:),vp2(:,:),up2(:,:),vpwp(:,:),vp2_zt(:,:),upwp(:,:),up2_zt(:,:),vm(:,:),vg(:,:),um(:,:),ug(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),p_in_pa(:,:),pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),wpvp2(:,:)) 2613, Generating update self(pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_2(:,:)) 2638, Generating update self(wp2sclrp(:,:,:),wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wpsclrp(:,:,:),sclrpthvp(:,:,:),sclrp2(:,:,:),wpedsclrp(:,:,:),sclrpthlp(:,:,:),sclrm(:,:,:),sclrprtp(:,:,:),sclrprcp(:,:,:),sclrm_forcing(:,:,:),wpsclrpthlp(:,:,:)) 2643, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 2764, Generating update self(rtp2(:,:),thlm_forcing(:,:),rtm_forcing(:,:),wp2(:,:),wm_zt(:,:),wprtp_sfc(:),rtpthlp(:,:),wp3(:,:),rho_zm(:,:),vm_forcing(:,:),um_forcing(:,:),vp2(:,:),upwp_sfc(:),up2(:,:),thv_ds_zt(:,:),p_in_pa(:,:),vpwp(:,:),upwp(:,:),wprtp(:,:),wpthlp(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),p_sfc(:),rho_ds_zt(:,:),invrs_rho_ds_zt(:,:),wm_zm(:,:),vpwp_sfc(:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),wpthlp_sfc(:)) 2771, Generating update self(sclrm(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:),sclrm_forcing(:,:,:),wpedsclrp_sfc(:,:),sclrpthlp(:,:,:),wpsclrp(:,:,:),wpsclrp_sfc(:,:)) 2775, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 2807, Generating update self(thlm(:,:),rtm_forcing(:,:),rtm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),wprtp_sfc(:),wprtp(:,:),wm_zt(:,:),thlm_forcing(:,:),wm_zm(:,:)) 2879, Generating exit data delete(wpsclrp2(:,:,:),wpsclrprtp(:,:,:),wpsclrp_zt(:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:),sclrp2_zt(:,:),wpsclrpthlp(:,:,:)) 2883, Generating exit data delete(wpedsclrp(:,:,:)) 2886, Generating exit data delete(lhs_splat_wp2(:,:),kmh_zm(:,:),mixt_frac_zm(:,:),tau_max_zm(:,:),stability_correction(:,:),lscale_down(:,:),rcp2_zt(:,:),a3_coef_zt(:,:),brunt_vaisala_freq_sqd_splat(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_clipped(:,:),cloud_frac_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_xp2_zm(:,:),invrs_tau_no_n2_zm(:,:),invrs_tau_sfc(:,:),ice_supersat_frac_zm(:,:),invrs_tau_n2_zm(:,:),invrs_tau_wp2_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_shear(:,:),invrs_tau_bkgnd(:,:),invrs_tau_c1_zm(:,:),invrs_tau_c6_zm(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_n2_iso(:,:),sqrt_em_zt(:,:),rc_coef(:,:),thlm1000(:),tau_zt(:,:),rcm_supersat_adj(:,:),thlm700(:),ri_zm(:,:),gamma_skw_fnc(:,:),brunt_vaisala_freq_sqd_zt(:,:),rcp2(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_zt(:,:),w_1_zm(:,:),vpwp_zt(:,:),xp3_coef_fnc(:,:),wpthlp_zt(:,:),skw_zt(:,:),sigma_sqd_w(:,:),rtpthlp_zt(:,:),em(:,:),km_zm(:,:),invrs_tau_zt(:,:),mu(:),wp3_on_wp2(:,:),wp2rcp(:,:),a3_coef(:,:),sigma_sqd_w_zt(:,:),vp2_zt(:,:),up2_zt(:,:),varnce_w_2_zm(:,:),thvm_zm(:,:),rtprcp(:,:),rtm_zm(:,:),wprtp2(:,:),wpthlp2(:,:),thlm_zm(:,:),w_2_zm(:,:),ddzt_umvm_sqd(:,:),ddzt_um(:,:),ddzt_umvm_sqd_clipped(:,:),ddzm_thvm_zm(:,:),sigma_sqd_w_tmp(:,:),tau_zm(:,:),tau_max_zt(:,:),ddzt_vm(:,:),lhs_splat_wp3(:,:),lscale_up(:,:),lscale_max(:),wp3_on_wp2_zt(:,:),wp2_zt(:,:),wprtp_zt(:,:),wp3_zm(:,:),wprtpthlp(:,:),rcm_zm(:,:),rtp2_zt(:,:),cx_fnc_richardson(:,:),thvm(:,:),thlp2_zt(:,:),skw_zm(:,:),skw_velocity(:,:)) pdf_closure_driver: 3398, Generating enter data create(rtpthvp_zt(:,:),skw_zt(:,:),upwp_zt(:,:),thlpthvp_zt(:,:),gamma_skw_fnc_zt(:,:),rel_humidity(:,:),vp3_zm(:,:),up3_zm(:,:),thlp3_zm(:,:),rtp3_zm(:,:),wp4_zt(:,:),thlprcp_zt(:,:),rtpthlp_zt(:,:),wpthlp_zt(:,:),wp3_zm(:,:),wp2up2_zt(:,:),wp2_zt(:,:),sku_zt(:,:),skv_zm(:,:),skthl_zt(:,:),sku_zm(:,:),skrt_zt(:,:),skthl_zm(:,:),sigma_sqd_w_zt(:,:),skrt_zm(:,:),skv_zt(:,:),skw_zm(:,:),sigma_sqd_w_tmp(:,:),gamma_skw_fnc(:,:),vprcp_zt(:,:),uprcp_zt(:,:),vp2_zt(:,:),vm_zm(:,:),up2_zt(:,:),um_zm(:,:),rtprcp_zt(:,:),wprtp_zt(:,:),wprcp_zt(:,:),thlp2_zt(:,:),t_in_k(:,:),rtp2_zt(:,:),rsat(:,:),wp2vp2_zt(:,:),vpwp_zt(:,:),wpthvp_zt(:,:)) 3408, Generating enter data create(w_up_in_cloud_zm(:,:),wp2thlp_zm(:,:),wprtp2_zm(:,:),wp2rtp_zm(:,:),wprtpthlp_zm(:,:),wp2rcp_zm(:,:),wp2thvp_zm(:,:),cloudy_updraft_frac_zm(:,:),exner_zm(:,:),cloudy_downdraft_frac_zm(:,:),p_in_pa_zm(:,:),wpup2_zm(:,:),wpthlp2_zm(:,:),w_down_in_cloud_zm(:,:),wpvp2_zm(:,:)) 3415, Generating enter data create(sksclr_zt(:,:,:),wpsclrprtp_zm(:,:,:),wp2sclrp_zm(:,:,:),wpsclrp_zt(:,:,:),sclrp3_zm(:,:,:),sclrpthlp_zt(:,:,:),sclrpthvp_zt(:,:,:),sksclr_zm(:,:,:),sclrprtp_zt(:,:,:),sclrprcp_zt(:,:,:),sclrp2_zt(:,:,:),sclrm_zm(:,:,:),wpsclrp2_zm(:,:,:),wpsclrpthlp_zm(:,:,:)) 3420, Generating enter data create(rtphmp(:,:,:),thlphmp(:,:,:),wp2hmp_zm(:,:,:),wphydrometp_zt(:,:,:)) 3504, Generating update self(skrt_zt(:,:),skrt_zm(:,:),skthl_zm(:,:),skthl_zt(:,:),skw_zt(:,:),skw_zm(:,:)) 3529, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3530, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3531, ! blockidx%x threadidx%x collapsed 3529, Generating default present(skw_zm(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,57:59)) 3531, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 3553, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3554, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3555, ! blockidx%x threadidx%x collapsed 3553, Generating default present(skw_zt(:ngrdcol,:nzt),gamma_skw_fnc_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,57:59)) 3555, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 3598, Generating update self(gamma_skw_fnc(:,:)) 3642, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3643, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3644, ! blockidx%x threadidx%x collapsed 3642, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),skw_velocity(:ngrdcol,:nzm),wp3_zm(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 3721, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3722, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3723, ! blockidx%x threadidx%x collapsed 3721, Generating default present(rtm_ref(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),gr,gr%zt(1:ngrdcol,1:nzt)) 3723, Generating implicit firstprivate(dt,rtm_min,ts_nudge,rtm_nudge_max_altitude) 3750, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3751, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3750, Generating default present(p_sfc(:ngrdcol),p_in_pa_zm(:ngrdcol,:),p_in_pa(:ngrdcol,nzt)) 3751, Generating implicit firstprivate(nzt,nzm) 3760, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3761, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3762, ! blockidx%x threadidx%x collapsed 3760, Generating default present(p_in_pa_zm(:ngrdcol,:nzm),exner_zm(:ngrdcol,:nzm)) 3848, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3849, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3848, Generating default present(wp4(:ngrdcol,:)) 3849, Generating implicit firstprivate(nzm) 3868, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3869, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3868, Generating default present(rcp2(:ngrdcol,nzm)) 3869, Generating implicit firstprivate(nzm) 3888, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3889, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3888, Generating default present(wpthvp(:ngrdcol,nzm),wprcp(:ngrdcol,nzm),thlprcp(:ngrdcol,nzm),rtprcp(:ngrdcol,nzm),wp2vp2(:ngrdcol,nzm),rc_coef_zm(:ngrdcol,nzm),rtpthvp(:ngrdcol,nzm),thlpthvp(:ngrdcol,nzm),uprcp(:ngrdcol,nzm),vprcp(:ngrdcol,nzm),wp2up2(:ngrdcol,nzm)) 3889, Generating implicit firstprivate(nzm) 3905, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3906, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3907, ! blockidx%x threadidx%x collapsed 3905, Generating default present(thlm_zm(:ngrdcol,:nzm),rtm_zm(:ngrdcol,:nzm),rcm_zm(:ngrdcol,:nzm),ice_supersat_frac_zm(:ngrdcol,:nzm),cloud_frac_zm(:ngrdcol,:nzm)) 3922, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3923, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3922, Generating default present(sclrpthvp(:ngrdcol,nzm,sclr),sclrprcp(:ngrdcol,nzm,sclr)) 3923, Generating implicit firstprivate(sclr,nzm) 3934, Generating update self(vprcp(:,:),uprcp(:,:)) 3962, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3963, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3962, Generating default present(cloud_frac_zm(:ngrdcol,nzm)) 3963, Generating implicit firstprivate(nzm) 3999, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4000, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4001, ! blockidx%x threadidx%x collapsed 3999, Generating default present(cloud_frac(:ngrdcol,:nzt),rcm_in_layer(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),cloud_cover(:ngrdcol,:nzt)) 4009, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4010, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4011, ! blockidx%x threadidx%x collapsed 4009, Generating default present(ice_supersat_frac(:ngrdcol,:nzt),cloud_frac(:ngrdcol,:nzt)) 4023, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4024, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4025, ! blockidx%x threadidx%x collapsed 4023, Generating default present(rcm(:ngrdcol,:nzt),rcm_supersat_adj(:ngrdcol,:nzt),rel_humidity(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),rsat(:ngrdcol,:nzt)) 4040, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4041, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_spur_supersat) 4042, ! blockidx%x threadidx%x collapsed 4040, Generating default present(rtm(:ngrdcol,:nzt),rsat(:ngrdcol,:nzt),rel_humidity(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),rcm_supersat_adj(:ngrdcol,:nzt)) Generating implicit copy(l_spur_supersat) [if not already present] 4058, Generating exit data delete(rtpthvp_zt(:,:),skw_zt(:,:),upwp_zt(:,:),thlpthvp_zt(:,:),gamma_skw_fnc_zt(:,:),rel_humidity(:,:),vp3_zm(:,:),up3_zm(:,:),thlp3_zm(:,:),rtp3_zm(:,:),wp4_zt(:,:),thlprcp_zt(:,:),rtpthlp_zt(:,:),wpthlp_zt(:,:),wp3_zm(:,:),wp2up2_zt(:,:),wp2_zt(:,:),sku_zt(:,:),skv_zm(:,:),skthl_zt(:,:),sku_zm(:,:),skrt_zt(:,:),skthl_zm(:,:),sigma_sqd_w_zt(:,:),skrt_zm(:,:),skv_zt(:,:),skw_zm(:,:),sigma_sqd_w_tmp(:,:),gamma_skw_fnc(:,:),vprcp_zt(:,:),uprcp_zt(:,:),vp2_zt(:,:),vm_zm(:,:),up2_zt(:,:),um_zm(:,:),rtprcp_zt(:,:),wprtp_zt(:,:),wprcp_zt(:,:),thlp2_zt(:,:),t_in_k(:,:),rtp2_zt(:,:),rsat(:,:),wp2vp2_zt(:,:),vpwp_zt(:,:),wpthvp_zt(:,:)) 4068, Generating exit data delete(w_up_in_cloud_zm(:,:),wp2thlp_zm(:,:),wprtp2_zm(:,:),wp2rtp_zm(:,:),wprtpthlp_zm(:,:),wp2rcp_zm(:,:),wp2thvp_zm(:,:),cloudy_updraft_frac_zm(:,:),exner_zm(:,:),cloudy_downdraft_frac_zm(:,:),p_in_pa_zm(:,:),wpup2_zm(:,:),wpthlp2_zm(:,:),w_down_in_cloud_zm(:,:),wpvp2_zm(:,:)) 4075, Generating exit data delete(sksclr_zt(:,:,:),wpsclrprtp_zm(:,:,:),wp2sclrp_zm(:,:,:),wpsclrp_zt(:,:,:),sclrp3_zm(:,:,:),sclrpthlp_zt(:,:,:),sclrpthvp_zt(:,:,:),sksclr_zm(:,:,:),sclrprtp_zt(:,:,:),sclrprcp_zt(:,:,:),sclrp2_zt(:,:,:),sclrm_zm(:,:,:),wpsclrp2_zm(:,:,:),wpsclrpthlp_zm(:,:,:)) 4080, Generating exit data delete(rtphmp(:,:,:),thlphmp(:,:,:),wphydrometp_zt(:,:,:),wp2hmp_zm(:,:,:)) trapezoidal_rule_zt: 4805, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4806, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4805, Generating default present(wp2thvp_zm(:ngrdcol,nzm),wprtpthlp_zm(:ngrdcol,nzm),wpthlp2_zm(:ngrdcol,nzm),wprtp2_zm(:ngrdcol,nzm),cloud_frac_zm(:ngrdcol,nzm),ice_supersat_frac_zm(:ngrdcol,nzm),rcm_zm(:ngrdcol,nzm)) 4806, Generating implicit firstprivate(nzm) 4822, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4823, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4822, Generating default present(wpsclrp2_zm(:ngrdcol,nzm,sclr),wpsclrprtp_zm(:ngrdcol,nzm,sclr),wpsclrpthlp_zm(:ngrdcol,nzm,sclr)) 4823, Generating implicit firstprivate(sclr,nzm) calc_trapezoid_zt: 4996, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 4997, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4998, ! blockidx%x threadidx%x collapsed 4996, Generating default present(variable_zt(:ngrdcol,:nzt),variable_zm(:ngrdcol,:nzt+1),gr%zt(1:ngrdcol,1:nzt),gr%invrs_dzt(1:ngrdcol,1:nzt),gr%zm(1:ngrdcol,1:nzt+1),gr) calc_trapezoid_zm: 5054, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5055, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5056, ! blockidx%x threadidx%x collapsed 5054, Generating default present(gr%zt(1:ngrdcol,1:nzm-1),variable_zt(:ngrdcol,:nzm-1),variable_zm(:ngrdcol,2:nzm-1),gr%zm(1:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr) compute_cloud_cover: 5143, Generating enter data create(chi_mean(:,:),vert_cloud_frac(:,:),vert_cloud_frac_upper(:,:),vert_cloud_frac_lower(:,:)) 5146, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5147, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5148, ! blockidx%x threadidx%x collapsed 5146, Generating default present(chi_mean(:ngrdcol,:nzt),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nzt),pdf_params%chi_2(1:ngrdcol,1:nzt),pdf_params%chi_1(1:ngrdcol,1:nzt)) 5157, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5158, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 5159, ! blockidx%x threadidx%x collapsed 5157, Generating default present(rcm(:ngrdcol,:),chi_mean(:ngrdcol,:),cloud_cover(:ngrdcol,:nzt-1),gr%zt(1:ngrdcol,1:nzt-1),cloud_frac(:ngrdcol,:nzt-1),gr%zm(1:ngrdcol,:),gr%invrs_dzm(1:ngrdcol,:),gr,vert_cloud_frac_upper(:ngrdcol,:nzt-1),vert_cloud_frac_lower(:ngrdcol,:nzt-1),vert_cloud_frac(:ngrdcol,:nzt-1),rcm_in_layer(:ngrdcol,:nzt-1)) Generating implicit copy(err_code) [if not already present] 5159, Generating implicit firstprivate(kp1,km1) 5245, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5246, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5245, Generating default present(cloud_cover(:ngrdcol,nzt),cloud_frac(:ngrdcol,nzt),rcm_in_layer(:ngrdcol,nzt),rcm(:ngrdcol,nzt)) 5246, Generating implicit firstprivate(nzt) 5255, Generating update self(rcm(:,:),pdf_params%mixt_frac(:,:),pdf_params%chi_1(:,:),cloud_frac(:,:),pdf_params%chi_2(:,:)) 5269, Generating exit data delete(chi_mean(:,:),vert_cloud_frac(:,:),vert_cloud_frac_upper(:,:),vert_cloud_frac_lower(:,:)) clip_rcm: 5320, Generating copy(rcm(:,:)) [if not already present] Generating copyin(rtm(:,:)) [if not already present] 5325, Generating update self(rcm(:,:),rtm(:,:)) 5345, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5346, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5347, ! blockidx%x threadidx%x collapsed set_lscale_max: 5409, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5410, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5409, Generating default present(host_dx(:ngrdcol),lscale_max(:ngrdcol),host_dy(:ngrdcol)) 5415, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5416, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5415, Generating default present(lscale_max(:ngrdcol)) calculate_thlp2_rad: 5487, Generating enter data create(rcm_zm(:,:),radht_zm(:,:)) 5492, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5493, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5494, ! blockidx%x threadidx%x collapsed 5492, Generating default present(thlp2_forcing(:ngrdcol,:nzm),thlprcp(:ngrdcol,:nzm),clubb_params(:ngrdcol,76),rcm_zm(:ngrdcol,:nzm),radht_zm(:ngrdcol,:nzm)) 5507, Generating exit data delete(rcm_zm(:,:),radht_zm(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/clubb_api_module.F90 advance_clubb_core_api_single_col: 1209, Generating copyin(fcor_col(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present] Generating copyout(lscale_col(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present] Generating copy(rtpthvp_col(:,:)) [if not already present] Generating copyout(cloudy_updraft_frac_col(:,:)) [if not already present] Generating copy(exner_col(:,:)) [if not already present] Generating copyin(sclr_idx) [if not already present] Generating copy(thlm_col(:,:),rtm_col(:,:),um_col(:,:),vm_col(:,:),wprtp_col(:,:),wpthlp_col(:,:),rtp2_col(:,:),thlp2_col(:,:),rtpthlp_col(:,:)) [if not already present] Generating copyout(w_up_in_cloud_col(:,:)) [if not already present] Generating copyin(wm_zm_col(:,:),rho_ds_zt_col(:,:),rfrzm_col(:,:),rho_col(:,:),rho_ds_zm_col(:,:)) [if not already present] Generating copy(ice_supersat_frac_col(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm_col(:,:)) [if not already present] Generating copy(thlpthvp_col(:,:)) [if not already present] Generating copyin(thv_ds_zm_col(:,:)) [if not already present] Generating copyout(rcm_in_layer_col(:,:)) [if not already present] Generating copyin(wpthlp_forcing_col(:,:),wprtp_forcing_col(:,:)) [if not already present] Generating copy(upwp_pert_col(:,:),vpwp_pert_col(:,:),p_in_pa_col(:,:)) [if not already present] Generating copyin(upwp_sfc_col(:),vpwp_sfc_col(:),rtm_forcing_col(:,:),thlm_forcing_col(:,:)) [if not already present] Generating copy(um_pert_col(:,:),vm_pert_col(:,:)) [if not already present] Generating copyin(thv_ds_zt_col(:,:),upwp_sfc_pert_col(:),gr%zt(:,:),host_dx_col(:),p_sfc_col(:)) [if not already present] Generating copy(pdf_params%w_2(:,:)) [if not already present] Generating copyin(ug_col(:,:)) [if not already present] Generating copy(uprcp_col(:,:)) [if not already present] Generating copyin(vg_col(:,:)) [if not already present] Generating copy(vprcp_col(:,:)) [if not already present] Generating copyin(um_ref_col(:,:),vm_ref_col(:,:)) [if not already present] Generating copy(up2_col(:,:),vp2_col(:,:)) [if not already present] Generating copyin(rho_zm_col(:,:)) [if not already present] Generating copyout(wprcp_col(:,:)) [if not already present] Generating copyin(sfc_elevation_col(:),wprtp_sfc_col(:),rtm_ref_col(:,:),rtp2_forcing_col(:,:),thlm_ref_col(:,:),thlp2_forcing_col(:,:)) [if not already present] Generating copy(rtp3_col(:,:)) [if not already present] Generating copyin(wm_zt_col(:,:)) [if not already present] Generating copy(wp2vp2_col(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu9(:),clubb_params_col(:,:)) [if not already present] Generating copy(rc_coef_zm_col(:,:)) [if not already present] Generating copyout(cloud_cover_col(:,:)) [if not already present] Generating copyin(wpthlp_sfc_col(:)) [if not already present] Generating copy(wp2thlp_col(:,:)) [if not already present] Generating copyin(rtpthlp_forcing_col(:,:)) [if not already present] Generating copyout(thlprcp_col(:,:)) [if not already present] Generating copy(wp2_col(:,:),wp2rtp_col(:,:),up3_col(:,:),vp3_col(:,:),pdf_params_zm%w_2(:,:),wp3_col(:,:),wpthvp_col(:,:),wpup2_col(:,:),wp2thvp_col(:,:),wp2up2_col(:,:)) [if not already present] Generating copyin(host_dy_col(:),um_forcing_col(:,:),vm_forcing_col(:,:)) [if not already present] Generating copy(upwp_col(:,:),vpwp_col(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params) [if not already present] Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params_zm) [if not already present] Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm_col(:,:),wp4_col(:,:)) [if not already present] Generating copyout(w_down_in_cloud_col(:,:)) [if not already present] Generating copyin(vpwp_sfc_pert_col(:)) [if not already present] Generating copyout(cloudy_downdraft_frac_col(:,:)) [if not already present] Generating copy(cloud_frac_col(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zt_col(:,:)) [if not already present] Generating copyout(kh_zm_col(:,:),invrs_tau_zm_col(:,:)) [if not already present] Generating copy(thlp3_col(:,:)) [if not already present] Generating copyout(kh_zt_col(:,:)) [if not already present] Generating copy(wpvp2_col(:,:)) [if not already present] 1289, Generating copy(sclrm_col(:,:,:),wpsclrp_col(:,:,:)) [if not already present] Generating copyin(sclr_tol(:)) [if not already present] Generating copy(sclrpthvp_col(:,:,:)) [if not already present] Generating copyin(sclrm_forcing_col(:,:,:)) [if not already present] Generating copy(sclrp2_col(:,:,:),sclrp3_col(:,:,:),sclrprtp_col(:,:,:),sclrpthlp_col(:,:,:)) [if not already present] Generating copyin(wpsclrp_sfc_col(:,:)) [if not already present] 1294, Generating copyin(edsclrm_forcing_col(:,:,:)) [if not already present] Generating copy(edsclrm_col(:,:,:)) [if not already present] Generating copyin(wpedsclrp_sfc_col(:,:)) [if not already present] 1298, Generating copyin(wphydrometp_col(:,:,:),wp2hmp_col(:,:,:),thlphmp_zt_col(:,:,:),l_mix_rat_hm(:),rtphmp_zt_col(:,:,:)) [if not already present] advance_clubb_core_api_multi_col: 1808, Generating copyin(fcor(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present] Generating copyout(lscale(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present] Generating copy(rtpthvp(:,:)) [if not already present] Generating copyout(cloudy_updraft_frac(:,:)) [if not already present] Generating copy(exner(:,:)) [if not already present] Generating copyin(sclr_idx) [if not already present] Generating copy(thlm(:,:),rtm(:,:),um(:,:),vm(:,:),wprtp(:,:),wpthlp(:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:)) [if not already present] Generating copyout(w_up_in_cloud(:,:)) [if not already present] Generating copyin(wm_zm(:,:),rho_ds_zt(:,:),rfrzm(:,:),rho(:,:),rho_ds_zm(:,:)) [if not already present] Generating copy(ice_supersat_frac(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present] Generating copy(thlpthvp(:,:)) [if not already present] Generating copyin(thv_ds_zm(:,:)) [if not already present] Generating copyout(rcm_in_layer(:,:)) [if not already present] Generating copyin(wpthlp_forcing(:,:),wprtp_forcing(:,:)) [if not already present] Generating copy(upwp_pert(:,:),vpwp_pert(:,:),p_in_pa(:,:)) [if not already present] Generating copyin(upwp_sfc(:),vpwp_sfc(:),rtm_forcing(:,:),thlm_forcing(:,:)) [if not already present] Generating copy(um_pert(:,:),vm_pert(:,:)) [if not already present] Generating copyin(thv_ds_zt(:,:),upwp_sfc_pert(:),gr%zt(:,:),host_dx(:),p_sfc(:)) [if not already present] Generating copy(pdf_params%w_2(:,:)) [if not already present] Generating copyin(ug(:,:)) [if not already present] Generating copy(uprcp(:,:)) [if not already present] Generating copyin(vg(:,:)) [if not already present] Generating copy(vprcp(:,:)) [if not already present] Generating copyin(um_ref(:,:),vm_ref(:,:)) [if not already present] Generating copy(up2(:,:),vp2(:,:)) [if not already present] Generating copyin(rho_zm(:,:)) [if not already present] Generating copyout(wprcp(:,:)) [if not already present] Generating copyin(sfc_elevation(:),wprtp_sfc(:),rtm_ref(:,:),rtp2_forcing(:,:),thlm_ref(:,:),thlp2_forcing(:,:)) [if not already present] Generating copy(rtp3(:,:)) [if not already present] Generating copyin(wm_zt(:,:)) [if not already present] Generating copy(wp2vp2(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu9(:),clubb_params(:,:)) [if not already present] Generating copy(rc_coef_zm(:,:)) [if not already present] Generating copyout(cloud_cover(:,:)) [if not already present] Generating copyin(wpthlp_sfc(:)) [if not already present] Generating copy(wp2thlp(:,:)) [if not already present] Generating copyin(rtpthlp_forcing(:,:)) [if not already present] Generating copyout(thlprcp(:,:)) [if not already present] Generating copy(wp2(:,:),wp2rtp(:,:),up3(:,:),vp3(:,:),pdf_params_zm%w_2(:,:),wp3(:,:),wpthvp(:,:),wpup2(:,:),wp2thvp(:,:),wp2up2(:,:)) [if not already present] Generating copyin(host_dy(:),um_forcing(:,:),vm_forcing(:,:)) [if not already present] Generating copy(upwp(:,:),vpwp(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params) [if not already present] Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params_zm) [if not already present] Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm(:,:),wp4(:,:)) [if not already present] Generating copyout(w_down_in_cloud(:,:)) [if not already present] Generating copyin(vpwp_sfc_pert(:)) [if not already present] Generating copyout(cloudy_downdraft_frac(:,:)) [if not already present] Generating copy(cloud_frac(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zt(:,:)) [if not already present] Generating copyout(kh_zm(:,:),invrs_tau_zm(:,:)) [if not already present] Generating copy(thlp3(:,:)) [if not already present] Generating copyout(kh_zt(:,:)) [if not already present] Generating copy(wpvp2(:,:)) [if not already present] 1879, Generating copy(sclrm(:,:,:),wpsclrp(:,:,:)) [if not already present] Generating copyin(sclr_tol(:)) [if not already present] Generating copy(sclrpthvp(:,:,:)) [if not already present] Generating copyin(sclrm_forcing(:,:,:)) [if not already present] Generating copy(sclrp2(:,:,:),sclrp3(:,:,:),sclrprtp(:,:,:),sclrpthlp(:,:,:)) [if not already present] Generating copyin(wpsclrp_sfc(:,:)) [if not already present] 1883, Generating copyin(edsclrm_forcing(:,:,:)) [if not already present] Generating copy(edsclrm(:,:,:)) [if not already present] Generating copyin(wpedsclrp_sfc(:,:)) [if not already present] 1887, Generating copyin(wphydrometp(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:),l_mix_rat_hm(:),rtphmp_zt(:,:,:)) [if not already present] calculate_thlp2_rad_api: 2022, Generating copyin(radht(:,:),thlprcp(:,:)) [if not already present] Generating copy(thlp2_forcing(:,:)) [if not already present] Generating copyin(clubb_params(:,:),rcm(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/CLUBB_core/grid_adaptation.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_param.a corr_varnce_module.o T_in_K_module.o Skx_module.o sponge_layer_damping.o input_names.o interpolation.o endian.o stats_type.o error_code.o stats_lh_sfc_module.o index_mapping.o advance_xm_wpxp_module.o parameters_model.o advance_xp3_module.o stats_lh_zt_module.o new_pdf.o stats_variables.o advance_xp2_xpyp_module.o mono_flux_limiter.o stats_sfc_module.o calc_roots.o stats_clubb_utilities.o code_timer_module.o matrix_solver_wrapper.o pos_definite_module.o pdf_parameter_module.o clubb_precision.o constants_clubb.o adg1_adg2_3d_luhar_pdf.o advance_wp2_wp3_module.o mt95.o advance_windm_edsclrm_module.o parameter_indices.o output_grads.o lapack_wrap.o new_hybrid_pdf_main.o stats_rad_zt_module.o numerical_check.o new_tsdadg_pdf.o stats_zm_module.o lapack_interfaces.o fill_holes.o turbulent_adv_pdf.o input_reader.o diagnose_correlations_module.o calc_pressure.o new_pdf_main.o tridiag_lu_solver.o pdf_closure_module.o LY93_pdf.o mean_adv.o parameters_tunable.o clubb_api_module.o matrix_operations.o clip_explicit.o grid_class.o diffusion.o array_index.o sfc_varnce_module.o Nc_Ncn_eqns.o saturation.o stats_zt_module.o file_functions.o mixing_length.o precipitation_fraction.o output_netcdf.o advance_helper_module.o pdf_utilities.o new_hybrid_pdf.o stat_file_module.o grid_adaptation.o penta_lu_solver.o model_flags.o calendar.o setup_clubb_pdf_params.o hydromet_pdf_parameter_module.o stats_type_utilities.o stats_rad_zm_module.o sigma_sqd_w_module.o advance_clubb_core_module.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_param.a a - corr_varnce_module.o a - T_in_K_module.o a - Skx_module.o a - sponge_layer_damping.o a - input_names.o a - interpolation.o a - endian.o a - stats_type.o a - error_code.o a - stats_lh_sfc_module.o a - index_mapping.o a - advance_xm_wpxp_module.o a - parameters_model.o a - advance_xp3_module.o a - stats_lh_zt_module.o a - new_pdf.o a - stats_variables.o a - advance_xp2_xpyp_module.o a - mono_flux_limiter.o a - stats_sfc_module.o a - calc_roots.o a - stats_clubb_utilities.o a - code_timer_module.o a - matrix_solver_wrapper.o a - pos_definite_module.o a - pdf_parameter_module.o a - clubb_precision.o a - constants_clubb.o a - adg1_adg2_3d_luhar_pdf.o a - advance_wp2_wp3_module.o a - mt95.o a - advance_windm_edsclrm_module.o a - parameter_indices.o a - output_grads.o a - lapack_wrap.o a - new_hybrid_pdf_main.o a - stats_rad_zt_module.o a - numerical_check.o a - new_tsdadg_pdf.o a - stats_zm_module.o a - lapack_interfaces.o a - fill_holes.o a - turbulent_adv_pdf.o a - input_reader.o a - diagnose_correlations_module.o a - calc_pressure.o a - new_pdf_main.o a - tridiag_lu_solver.o a - pdf_closure_module.o a - LY93_pdf.o a - mean_adv.o a - parameters_tunable.o a - clubb_api_module.o a - matrix_operations.o a - clip_explicit.o a - grid_class.o a - diffusion.o a - array_index.o a - sfc_varnce_module.o a - Nc_Ncn_eqns.o a - saturation.o a - stats_zt_module.o a - file_functions.o a - mixing_length.o a - precipitation_fraction.o a - output_netcdf.o a - advance_helper_module.o a - pdf_utilities.o a - new_hybrid_pdf.o a - stat_file_module.o a - grid_adaptation.o a - penta_lu_solver.o a - model_flags.o a - calendar.o a - setup_clubb_pdf_params.o a - hydromet_pdf_parameter_module.o a - stats_type_utilities.o a - stats_rad_zm_module.o a - sigma_sqd_w_module.o a - advance_clubb_core_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_lapack make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/daxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/snrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/idamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/scopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ilaslr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iladlr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/stbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dnrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ieeeck.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/spoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/saxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iparmq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dpotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dcopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dtrmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/strmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ilaenv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlamch.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorg2l.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlamch.f: 109) nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slacn2.f 0 inform, 1 warnings, 0 severes, 0 fatal for dlamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_shared/xerbla.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/ddot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/drscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sdot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/iladlc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/isamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_shared/lsame.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slamch.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ilaslc.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slamch.f: 113) 0 inform, 1 warnings, 0 severes, 0 fatal for slamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/ssymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/disnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/srscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dsterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/slacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_double/dlassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Lapack/Lapack_single/sorg2r.f ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_lapack.a dlarf.o slapy2.o slaev2.o daxpy.o dsteqr.o dgbtrs.o dgbtrf.o spotrf.o sgbequ.o dpoequ.o dtrsm.o slaqsy.o sorgtr.o sgbsvx.o dsyev.o sgbrfs.o dlanst.o sorgqr.o slatrd.o dasum.o slagtm.o dsyrk.o dsyr2.o snrm2.o dtrmv.o strmm.o slaswp.o idamax.o scopy.o sgttrs.o dgbtf2.o sgttrf.o spotrf2.o sscal.o slarft.o slangb.o ilaslr.o iladlr.o dgtrfs.o dgtsvx.o dlantb.o stbsv.o dorgql.o dnrm2.o ssyrk.o ssyr2.o dlagtm.o sasum.o dlatrd.o dorgqr.o dgbrfs.o slanst.o ssyev.o dgbsvx.o ieeeck.o dorgtr.o dlaqsy.o strsm.o spoequ.o dgbequ.o dpotrf.o sgbtrf.o sgbtrs.o ssteqr.o saxpy.o dlaev2.o dlapy2.o slarf.o iparmq.o sorgql.o dtbsv.o slantb.o sgtsvx.o sgtrfs.o dlangb.o dlarft.o dscal.o dpotrf2.o sgbtf2.o dgttrs.o dgttrf.o dcopy.o dlaswp.o dtrmm.o strmv.o slaqgb.o dsymv.o sgbcon.o ilaenv.o dlartg.o ssyr2k.o dlamch.o sorg2l.o slacn2.o dlasrt.o dlaset.o xerbla.o dgtsv.o dlae2.o dgemv.o sgemm.o slabad.o dgbmv.o ddot.o slascl.o slarfg.o dsytd2.o dorg2r.o slassq.o slatbs.o slansy.o dlacpy.o slaisnan.o dgtcon.o slasr.o slangt.o slarfb.o ssterf.o drscl.o sgbsv.o dswap.o dgtts2.o sger.o ssytrd.o sisnan.o ssytd2.o dlarfg.o dlascl.o sdot.o iladlc.o sgbmv.o dlabad.o sgemv.o dgemm.o slae2.o sgtsv.o isamax.o slasrt.o slaset.o dlacn2.o lsame.o dorg2l.o slamch.o ilaslc.o slartg.o dsyr2k.o dgbcon.o ssymv.o dlaqgb.o disnan.o dger.o dsytrd.o sgtts2.o sswap.o dgbsv.o srscl.o dsterf.o dlarfb.o dlangt.o dlasr.o dlaisnan.o slacpy.o sgtcon.o dlansy.o dlatbs.o dlassq.o sorg2r.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_lapack.a a - dlarf.o a - slapy2.o a - slaev2.o a - daxpy.o a - dsteqr.o a - dgbtrs.o a - dgbtrf.o a - spotrf.o a - sgbequ.o a - dpoequ.o a - dtrsm.o a - slaqsy.o a - sorgtr.o a - sgbsvx.o a - dsyev.o a - sgbrfs.o a - dlanst.o a - sorgqr.o a - slatrd.o a - dasum.o a - slagtm.o a - dsyrk.o a - dsyr2.o a - snrm2.o a - dtrmv.o a - strmm.o a - slaswp.o a - idamax.o a - scopy.o a - sgttrs.o a - dgbtf2.o a - sgttrf.o a - spotrf2.o a - sscal.o a - slarft.o a - slangb.o a - ilaslr.o a - iladlr.o a - dgtrfs.o a - dgtsvx.o a - dlantb.o a - stbsv.o a - dorgql.o a - dnrm2.o a - ssyrk.o a - ssyr2.o a - dlagtm.o a - sasum.o a - dlatrd.o a - dorgqr.o a - dgbrfs.o a - slanst.o a - ssyev.o a - dgbsvx.o a - ieeeck.o a - dorgtr.o a - dlaqsy.o a - strsm.o a - spoequ.o a - dgbequ.o a - dpotrf.o a - sgbtrf.o a - sgbtrs.o a - ssteqr.o a - saxpy.o a - dlaev2.o a - dlapy2.o a - slarf.o a - iparmq.o a - sorgql.o a - dtbsv.o a - slantb.o a - sgtsvx.o a - sgtrfs.o a - dlangb.o a - dlarft.o a - dscal.o a - dpotrf2.o a - sgbtf2.o a - dgttrs.o a - dgttrf.o a - dcopy.o a - dlaswp.o a - dtrmm.o a - strmv.o a - slaqgb.o a - dsymv.o a - sgbcon.o a - ilaenv.o a - dlartg.o a - ssyr2k.o a - dlamch.o a - sorg2l.o a - slacn2.o a - dlasrt.o a - dlaset.o a - xerbla.o a - dgtsv.o a - dlae2.o a - dgemv.o a - sgemm.o a - slabad.o a - dgbmv.o a - ddot.o a - slascl.o a - slarfg.o a - dsytd2.o a - dorg2r.o a - slassq.o a - slatbs.o a - slansy.o a - dlacpy.o a - slaisnan.o a - dgtcon.o a - slasr.o a - slangt.o a - slarfb.o a - ssterf.o a - drscl.o a - sgbsv.o a - dswap.o a - dgtts2.o a - sger.o a - ssytrd.o a - sisnan.o a - ssytd2.o a - dlarfg.o a - dlascl.o a - sdot.o a - iladlc.o a - sgbmv.o a - dlabad.o a - sgemv.o a - dgemm.o a - slae2.o a - sgtsv.o a - isamax.o a - slasrt.o a - slaset.o a - dlacn2.o a - lsame.o a - dorg2l.o a - slamch.o a - ilaslc.o a - slartg.o a - dsyr2k.o a - dgbcon.o a - ssymv.o a - dlaqgb.o a - disnan.o a - dger.o a - dsytrd.o a - sgtts2.o a - sswap.o a - dgbsv.o a - srscl.o a - dsterf.o a - dlarfb.o a - dlangt.o a - dlasr.o a - dlaisnan.o a - slacpy.o a - sgtcon.o a - dlansy.o a - dlatbs.o a - dlassq.o a - sorg2r.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_bugsrad cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.microphys_utils cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_parabolic cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_coamps make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esati.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa8g.F make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Parabolic_constants.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa6.F make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/kinds.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Microphys_utils/microphys_stats_vars_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/qtadj.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/AiryFunction.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/variables_radiation_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa20g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa9.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa9g.F ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libmicrophys_utils.a microphys_stats_vars_module.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libmicrophys_utils.a a - microphys_stats_vars_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_morrison nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa10g.F make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Morrison_microphys/module_mp_graupel.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqi.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Parabolic.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa21.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/newexp.F90 NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 300) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/gamma.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa7.F 0 inform, 1 warnings, 0 severes, 0 fatal for module_mp_graupel nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/rayle.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esatv.F NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5894) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5905) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5928) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5976) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5980) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6066) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6073) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6079) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6204) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6210) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6248) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6253) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6257) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa7g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/qsatvi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa19.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa13g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_bs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/comscp1.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa22.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa18g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa12.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/cloudg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa17g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/conice.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa14g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/cloud_correlate.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/adjmlt.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/slope.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_sel.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmcol.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/adjtq.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/comscp2.F ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_parabolic.a AiryFunction.o Parabolic.o Parabolic_constants.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_parabolic.a a - AiryFunction.o a - Parabolic.o a - Parabolic_constants.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_KK_microphys make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa5g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa25.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/parameters_KK.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/esat_new.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_all_MM.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa15.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa27r.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_covar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/frzh.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugsrad_planck.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmtqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/text_writer.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa21g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa11g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugsrad_physconst.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa26.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_local_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa19g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/nrmtqw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa27.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa22g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa28.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_turbulent_sed.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa18.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/eqa12g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_variances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/COAMPS_microphys/tgqs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_covariances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_Nrm_tendencies.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_coamps.a esati.o eqa8g.o eqa6.o qtadj.o eqa20g.o eqa9.o tgqg.o tgqr.o eqa9g.o eqa10g.o tgqi.o eqa21.o gamma.o eqa7.o esatv.o eqa7g.o qsatvi.o eqa19.o eqa13g.o eqa22.o eqa18g.o eqa12.o eqa17g.o conice.o eqa14g.o adjmlt.o slope.o nrmcol.o adjtq.o eqa5g.o eqa25.o esat_new.o eqa15.o eqa27r.o frzh.o nrmtqi.o eqa21g.o eqa11g.o eqa26.o eqa19g.o nrmtqw.o eqa27.o eqa22g.o eqa28.o eqa18.o eqa12g.o tgqs.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_coamps.a a - esati.o a - eqa8g.o a - eqa6.o a - qtadj.o a - eqa20g.o a - eqa9.o a - tgqg.o a - tgqr.o a - eqa9g.o a - eqa10g.o a - tgqi.o a - eqa21.o a - gamma.o a - eqa7.o a - esatv.o a - eqa7g.o a - qsatvi.o a - eqa19.o a - eqa13g.o a - eqa22.o a - eqa18g.o a - eqa12.o a - eqa17g.o a - conice.o a - eqa14g.o a - adjmlt.o a - slope.o a - nrmcol.o a - adjtq.o a - eqa5g.o a - eqa25.o a - esat_new.o a - eqa15.o a - eqa27r.o a - frzh.o a - nrmtqi.o a - eqa21g.o a - eqa11g.o a - eqa26.o a - eqa19g.o a - nrmtqw.o a - eqa27.o a - eqa22g.o a - eqa28.o a - eqa18.o a - eqa12g.o a - tgqs.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_rad.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/gascon.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/BUGSrad ../src/BUGSrad/gases_ckd.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_KK_microphys.a KK_utilities.o KK_local_means.o PDF_integrals_all_MM.o PDF_integrals_covar.o KK_upscaled_means.o KK_upscaled_turbulent_sed.o parameters_KK.o KK_upscaled_variances.o PDF_integrals_means.o text_writer.o KK_upscaled_covariances.o KK_Nrm_tendencies.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_KK_microphys.a a - KK_utilities.o a - KK_local_means.o a - PDF_integrals_all_MM.o a - PDF_integrals_covar.o a - KK_upscaled_means.o a - KK_upscaled_turbulent_sed.o a - parameters_KK.o a - KK_upscaled_variances.o a - PDF_integrals_means.o a - text_writer.o a - KK_upscaled_covariances.o a - KK_Nrm_tendencies.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.silhs make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/math_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/output_2D_samples_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/latin_hypercube_arrays.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/transform_to_pdf_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/parameters_silhs.F90 transform_uniform_samples_to_pdf: 111, Generating create(std_normal(:,:,:,:)) [if not already present] 125, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 126, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 127, ! blockidx%x threadidx%x collapsed 128, ! blockidx%x threadidx%x collapsed 129, ! blockidx%x threadidx%x collapsed 125, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),hm_metadata) 137, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 138, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 139, ! blockidx%x threadidx%x collapsed 140, ! blockidx%x threadidx%x collapsed 141, ! blockidx%x threadidx%x collapsed 137, Generating default present(hm_metadata,l_in_precip_all_levs(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_ncn+1:pdf_dim)) 162, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 163, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 164, ! blockidx%x threadidx%x collapsed 165, ! blockidx%x threadidx%x collapsed 162, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_chi),hm_metadata,cloud_frac(:ngrdcol,:num_samples,:nzt)) cdfnorminv: 256, Generating implicit firstprivate(pdf_dim,nzt,num_samples,ngrdcol) Generating NVIDIA GPU code 257, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 258, ! blockidx%x threadidx%x collapsed 259, ! blockidx%x threadidx%x collapsed 260, ! blockidx%x threadidx%x collapsed 256, Generating implicit copy(std_normal(:pdf_dim,:ngrdcol,:nzt,:num_samples)) [if not already present] Generating implicit copyin(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim)) [if not already present] 260, Generating implicit firstprivate(x,w) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/generate_uniform_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/est_kessler_microphys_module.F90 multiply_cholesky: 546, Generating implicit firstprivate(num_samples,ngrdcol,nzt,pdf_dim) Generating NVIDIA GPU code 547, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 548, ! blockidx%x threadidx%x collapsed 549, ! blockidx%x threadidx%x collapsed 550, ! blockidx%x threadidx%x collapsed 560, !$acc loop seq 546, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),sigma_cholesky1(:,:ngrdcol,:nzt,:pdf_dim),sigma_cholesky2(:,:ngrdcol,:nzt,:pdf_dim),mu2(:ngrdcol,:nzt,:pdf_dim),mu1(:ngrdcol,:nzt,:pdf_dim),std_normal(:,:ngrdcol,:nzt,:num_samples)) 550, Generating implicit firstprivate(j,x_nl_k_sample_i_tmp,l_first_comp) 560, Loop carried scalar dependence for x_nl_k_sample_i_tmp at line 563,566 Scalar last value needed after loop for x_nl_k_sample_i_tmp at line 571 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/lh_microphys_var_covar_module.F90 chi_eta_2_rtthl: 647, Generating implicit firstprivate(nzt,num_samples,ngrdcol) Generating NVIDIA GPU code 648, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 649, ! blockidx%x threadidx%x collapsed 650, ! blockidx%x threadidx%x collapsed 647, Generating default present(lh_rt(:ngrdcol,:num_samples,:nzt),rt_2(:ngrdcol,:nzt),crt_2(:ngrdcol,:nzt),eta(:ngrdcol,:num_samples,:nzt),mu_chi_2(:ngrdcol,:nzt),lh_thl(:ngrdcol,:num_samples,:nzt),chi(:ngrdcol,:num_samples,:nzt),cthl_2(:ngrdcol,:nzt),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),thl_2(:ngrdcol,:nzt),thl_1(:ngrdcol,:nzt),cthl_1(:ngrdcol,:nzt),rt_1(:ngrdcol,:nzt),mu_chi_1(:ngrdcol,:nzt),crt_1(:ngrdcol,:nzt)) 650, Generating implicit firstprivate(lh_dev_thl_lim) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/silhs_importance_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_lwr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_swr.F ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_morrison.a module_mp_graupel.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_morrison.a a - module_mp_graupel.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_bugsrad.a bugs_lwr.o two_rt_sw_ocastrndm.o variables_radiation_module.o two_rt_sw.o rayle.o kinds.o newexp.o two_rt_sw_bs.o comscp1.o cloudg.o two_rt_lw_iter.o bugsrad_physconst.o bugsrad_planck.o gases_ckd.o cloud_correlate.o bugs_rad.o gascon.o two_rt_lw_sel.o two_rt_lw_ocastrndm.o comscp2.o two_rt_lw.o bugs_swr.o two_rt_sw_iter.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_bugsrad.a a - bugs_lwr.o a - two_rt_sw_ocastrndm.o a - variables_radiation_module.o a - two_rt_sw.o a - rayle.o a - kinds.o a - newexp.o a - two_rt_sw_bs.o a - comscp1.o a - cloudg.o a - two_rt_lw_iter.o a - bugsrad_physconst.o a - bugsrad_planck.o a - gases_ckd.o a - cloud_correlate.o a - bugs_rad.o a - gascon.o a - two_rt_lw_sel.o a - two_rt_lw_ocastrndm.o a - comscp2.o a - two_rt_lw.o a - bugs_swr.o a - two_rt_sw_iter.o nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/latin_hypercube_driver_module.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' generate_silhs_sample: 213, Generating enter data create(l_in_precip(:,:,:),x_u_all_levs(:,:,:,:),x_vert_corr(:,:),rand_pool(:,:,:,:),sigma_cholesky1(:,:,:,:),rcm_pdf(:,:),k_lh_start(:),cloud_frac(:,:,:),sigma_cholesky2(:,:,:,:)) 242, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 243, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 244, ! blockidx%x threadidx%x collapsed 242, Generating default present(pdf_params,rcm_pdf(:ngrdcol,:nzt)) 262, Generating implicit firstprivate(ngrdcol,nzt,pdf_dim) Generating NVIDIA GPU code 263, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 264, ! blockidx%x threadidx%x collapsed 265, ! blockidx%x threadidx%x collapsed 266, ! blockidx%x threadidx%x collapsed 262, Generating default present(sigma_cholesky2(:pdf_dim,:ngrdcol,:nzt,:pdf_dim),sigma_cholesky1(:pdf_dim,:ngrdcol,:nzt,:pdf_dim),corr_cholesky_mtx_1(:ngrdcol,:nzt,:pdf_dim,:pdf_dim),sigma1(:ngrdcol,:nzt,:pdf_dim),sigma2(:ngrdcol,:nzt,:pdf_dim),corr_cholesky_mtx_2(:ngrdcol,:nzt,:pdf_dim,:pdf_dim)) 279, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 280, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 281, ! blockidx%x threadidx%x collapsed 279, Generating default present(delta_zm(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt),rcm_pdf(:ngrdcol,:nzt),x_vert_corr(:ngrdcol,:nzt)) 281, Generating implicit firstprivate(vert_decorr_coef) 294, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 295, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 296, ! blockidx%x threadidx%x collapsed 294, Generating default present(x_vert_corr(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt),delta_zm(:ngrdcol,:nzt)) 296, Generating implicit firstprivate(vert_decorr_coef) 306, Generating update self(x_vert_corr(:,:)) 344, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 345, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 346, ! blockidx%x threadidx%x collapsed 347, ! blockidx%x threadidx%x collapsed 344, Generating default present(pdf_params%mixt_frac(1:ngrdcol,1:nzt),precip_fracs,l_in_precip(:ngrdcol,:num_samples,:nzt),pdf_params,precip_fracs%precip_frac_2(1:ngrdcol,1:nzt),x_u_all_levs(:ngrdcol,:num_samples,:nzt,pdf_dim+1:pdf_dim+2),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),pdf_params%cloud_frac_2(1:ngrdcol,1:nzt),cloud_frac(:ngrdcol,:num_samples,:nzt),precip_fracs%precip_frac_1(1:ngrdcol,1:nzt),pdf_params%cloud_frac_1(1:ngrdcol,1:nzt)) 347, Generating implicit firstprivate(pdf_dim) 400, Generating update self(lh_sample_point_weights(:,:,:),l_in_precip(:,:,:),x_u_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) 434, Generating update self(x_mixt_comp_all_levs(:,:,:),x_u_all_levs(:,:,:,:),x_nl_all_levs(:,:,:,:)) 472, Generating exit data delete(l_in_precip(:,:,:),x_vert_corr(:,:),x_u_all_levs(:,:,:,:),rand_pool(:,:,:,:),sigma_cholesky1(:,:,:,:),rcm_pdf(:,:),k_lh_start(:),cloud_frac(:,:,:),sigma_cholesky2(:,:,:,:)) generate_all_uniform_samples: 740, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 741, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 742, ! blockidx%x threadidx%x collapsed 743, ! blockidx%x threadidx%x collapsed 744, ! blockidx%x threadidx%x collapsed 740, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim)) 753, Generating implicit firstprivate(ngrdcol,num_samples,nzt) Generating NVIDIA GPU code 754, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 755, ! blockidx%x threadidx%x collapsed 756, ! blockidx%x threadidx%x collapsed 753, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt)) 836, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 837, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 838, ! blockidx%x threadidx%x collapsed 839, ! blockidx%x threadidx%x collapsed 840, ! blockidx%x threadidx%x collapsed 836, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim)) 849, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 850, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 851, ! blockidx%x threadidx%x collapsed 852, ! blockidx%x threadidx%x collapsed 849, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt)) compute_k_lh_start: 989, Generating enter data create(cloud_frac_pdf(:,:),k_lh_start_rcm(:),k_lh_start_rcm_in_cloud(:)) 993, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 994, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 995, ! blockidx%x threadidx%x collapsed 993, Generating default present(pdf_params,cloud_frac_pdf(:ngrdcol,:nzt)) 1002, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1003, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1011, !$acc loop seq 1002, Generating default present(cloud_frac_pdf(:ngrdcol,:nzt),rcm_pdf(:ngrdcol,:nzt),k_lh_start_rcm_in_cloud(:ngrdcol)) 1003, Generating implicit firstprivate(rcm_in_cloud_max) 1011, Loop carried scalar dependence for rcm_in_cloud_max at line 1015 Loop carried reuse of k_lh_start_rcm_in_cloud prevents parallelization Generating implicit firstprivate(rcm_in_cloud) Loop carried scalar dependence for rcm_in_cloud_max at line 1015 Loop carried reuse of k_lh_start_rcm_in_cloud prevents parallelization 1028, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1029, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1035, !$acc loop seq 1028, Generating default present(rcm_pdf(:ngrdcol,:nzt),k_lh_start_rcm(:ngrdcol)) 1029, Generating implicit firstprivate(rcm_max) 1035, Loop carried scalar dependence for rcm_max at line 1036 Loop carried reuse of k_lh_start_rcm prevents parallelization 1048, Generating update self(k_lh_start_rcm_in_cloud(:),k_lh_start_rcm(:)) 1064, Generating update device(k_lh_start(:)) 1068, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1069, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1068, Generating default present(k_lh_start_rcm_in_cloud(:ngrdcol),k_lh_start(:ngrdcol)) 1075, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1076, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1075, Generating default present(k_lh_start_rcm(:ngrdcol),k_lh_start(:ngrdcol)) 1082, Generating exit data delete(cloud_frac_pdf(:,:),k_lh_start_rcm_in_cloud(:),k_lh_start_rcm(:)) clip_transform_silhs_output: 1200, Generating implicit firstprivate(ngrdcol,num_samples,nzt) Generating NVIDIA GPU code 1201, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1202, ! blockidx%x threadidx%x collapsed 1203, ! blockidx%x threadidx%x collapsed 1200, Generating default present(lh_rc_clipped(:ngrdcol,:num_samples,:nzt),lh_nc_clipped(:ngrdcol,:num_samples,:nzt),lh_rt_clipped(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),lh_rv_clipped(:ngrdcol,:num_samples,:nzt),hm_metadata) 1203, Generating implicit firstprivate(l_use_ncn_to_nc) compute_arb_overlap: 1976, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples) Generating NVIDIA GPU code 1977, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1978, ! blockidx%x threadidx%x collapsed 1979, ! blockidx%x threadidx%x collapsed 1984, !$acc loop seq 1976, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim)) 1979, Generating implicit firstprivate(k,unbounded_point,nzt,k_lh_start_i) 1984, Loop carried scalar dependence for unbounded_point at line 1987 Generating implicit firstprivate(half_width,offset,min_val) Loop carried scalar dependence for unbounded_point at line 1987 2010, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples) Generating NVIDIA GPU code 2011, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2012, ! blockidx%x threadidx%x collapsed 2013, ! blockidx%x threadidx%x collapsed 2018, !$acc loop seq 2010, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim)) 2013, Generating implicit firstprivate(k,unbounded_point,k_lh_start_i) 2018, Loop carried scalar dependence for unbounded_point at line 2021 Generating implicit firstprivate(half_width,offset,min_val) Loop carried scalar dependence for unbounded_point at line 2021 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/SILHS/silhs_api_module.F90 generate_silhs_sample_api_single_col: 303, Generating copyin(mu2_col(:,:,:),precip_fracs,precip_fracs%precip_frac_1(:,:),corr_cholesky_mtx_2_col(:,:,:,:)) [if not already present] Generating copyout(lh_sample_point_weights(:,:)) [if not already present] Generating copyin(corr_cholesky_mtx_1_col(:,:,:,:),lscale_col(:,:),mu1_col(:,:,:),precip_fracs%precip_frac_2(:,:),sigma1_col(:,:,:)) [if not already present] Generating copyout(x_nl_all_levs(:,:,:),x_mixt_comp_all_levs(:,:)) [if not already present] Generating copyin(sigma2_col(:,:,:),delta_zm_col(:,:)) [if not already present] generate_silhs_sample_api_multi_col: 442, Generating copyin(mu2(:,:,:),precip_fracs,precip_fracs%precip_frac_1(:,:),corr_cholesky_mtx_2(:,:,:,:)) [if not already present] Generating copyout(lh_sample_point_weights(:,:,:)) [if not already present] Generating copyin(corr_cholesky_mtx_1(:,:,:,:),lscale(:,:),mu1(:,:,:),precip_fracs%precip_frac_2(:,:),sigma1(:,:,:)) [if not already present] Generating copyout(x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) [if not already present] Generating copyin(sigma2(:,:,:),delta_zm(:,:)) [if not already present] clip_transform_silhs_output_api_single_col: 617, Generating copyout(lh_thl_clipped_col(:,:,:)) [if not already present] Generating copyin(pdf_params%cthl_2(:,:),pdf_params%rt_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_1(:,:),pdf_params%chi_2(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cthl_1(:,:),pdf_params,pdf_params%chi_1(:,:),pdf_params%thl_2(:,:),x_mixt_comp_all_levs_col(:,:,:),x_nl_all_levs_col(:,:,:,:)) [if not already present] Generating copyout(lh_rc_clipped_col(:,:,:),lh_rv_clipped_col(:,:,:),lh_nc_clipped_col(:,:,:),lh_rt_clipped_col(:,:,:)) [if not already present] Generating copyin(hm_metadata) [if not already present] clip_transform_silhs_output_api_multi_col: 697, Generating copyout(lh_thl_clipped(:,:,:)) [if not already present] Generating copyin(pdf_params%cthl_2(:,:),pdf_params%rt_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_1(:,:),pdf_params%chi_2(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cthl_1(:,:),pdf_params,pdf_params%chi_1(:,:),pdf_params%thl_2(:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) [if not already present] Generating copyout(lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_rt_clipped(:,:,:)) [if not already present] Generating copyin(hm_metadata) [if not already present] ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libsilhs.a math_utilities.o output_2D_samples_module.o latin_hypercube_arrays.o latin_hypercube_driver_module.o est_kessler_microphys_module.o transform_to_pdf_module.o parameters_silhs.o lh_microphys_var_covar_module.o generate_uniform_sample_module.o silhs_importance_sample_module.o silhs_api_module.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libsilhs.a a - math_utilities.o a - output_2D_samples_module.o a - latin_hypercube_arrays.o a - latin_hypercube_driver_module.o a - est_kessler_microphys_module.o a - transform_to_pdf_module.o a - parameters_silhs.o a - lh_microphys_var_covar_module.o a - generate_uniform_sample_module.o a - silhs_importance_sample_module.o a - silhs_api_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_other make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/time_dependent_input.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_microphys.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_radiation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/hydrostatic_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_sed_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/silhs_category_variance_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/ice_dfsn_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/gfdl_activation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/diag_ustar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_model_settings.F90 diag_ustar: 36, Generating acc routine seq Generating NVIDIA GPU code nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/input_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extrapolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rad_lwsw_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/soil_vegetation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/mixed_moment_PDF_integrals.F90 apply_time_dependent_forcings_from_array: 643, Generating create(temp_array(:)) [if not already present] 657, Generating update device(temp_array(:)) 665, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 666, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 667, ! blockidx%x threadidx%x collapsed 665, Generating default present(thlm_f(:ngrdcol,:nzt),exner(:ngrdcol,:nzt)) 674, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 675, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 676, ! blockidx%x threadidx%x collapsed 674, Generating default present(thlm_f(:ngrdcol,:nzt)) 683, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 684, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 685, ! blockidx%x threadidx%x collapsed 683, Generating default present(thlm_f(:ngrdcol,:nzt)) 694, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 695, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 696, ! blockidx%x threadidx%x collapsed 694, Generating default present(sclr_idx,thlm_f(:ngrdcol,:nzt),sclrm_forcing(:ngrdcol,:nzt,sclr_idx%iisclr_thl)) 705, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 706, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 707, ! blockidx%x threadidx%x collapsed 705, Generating default present(edsclrm_forcing(:ngrdcol,:nzt,sclr_idx%iiedsclr_thl),thlm_f(:ngrdcol,:nzt),sclr_idx) 719, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 720, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 721, ! blockidx%x threadidx%x collapsed 719, Generating default present(rtm_f(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt)) 728, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 729, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 730, ! blockidx%x threadidx%x collapsed 728, Generating default present(rtm_f(:ngrdcol,:nzt)) 739, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 740, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 741, ! blockidx%x threadidx%x collapsed 739, Generating default present(sclrm_forcing(:ngrdcol,:nzt,sclr_idx%iisclr_rt),sclr_idx,rtm_f(:ngrdcol,:nzt)) 750, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 751, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 752, ! blockidx%x threadidx%x collapsed 750, Generating default present(sclr_idx,rtm_f(:ngrdcol,:nzt),edsclrm_forcing(:ngrdcol,:nzt,sclr_idx%iiedsclr_rt)) 761, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 762, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 763, ! blockidx%x threadidx%x collapsed 761, Generating default present(um_ref(:ngrdcol,:nzt)) 770, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 771, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 772, ! blockidx%x threadidx%x collapsed 770, Generating default present(vm_ref(:ngrdcol,:nzt)) 779, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 780, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 781, ! blockidx%x threadidx%x collapsed 779, Generating default present(um_f(:ngrdcol,:nzt)) 788, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 789, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 790, ! blockidx%x threadidx%x collapsed 788, Generating default present(vm_f(:ngrdcol,:nzt)) 800, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 801, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 802, ! blockidx%x threadidx%x collapsed 800, Generating default present(wm_zt(:ngrdcol,:nzt)) 809, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 810, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 811, ! blockidx%x threadidx%x collapsed 809, Generating default present(wm_zt(:ngrdcol,:nzt),rho(:ngrdcol,:nzt)) 818, Generating implicit firstprivate(nzt) Generating NVIDIA GPU code 819, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 823, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 824, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 825, ! blockidx%x threadidx%x collapsed 823, Generating default present(wm_zt(:ngrdcol,:nzt),rho(:ngrdcol,:nzt)) 838, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 839, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 840, ! blockidx%x threadidx%x collapsed 838, Generating default present(ug(:ngrdcol,:nzt)) 847, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 848, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 849, ! blockidx%x threadidx%x collapsed 847, Generating default present(vg(:ngrdcol,:nzt)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/spec_hum_to_mixing_ratio.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/wangara.F90 flux_spec_hum_to_mixing_ratio: 62, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 63, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 62, Generating default present(rtm_zm(:ngrdcol),wprtp(:ngrdcol),wpqtp(:ngrdcol)) force_spec_hum_to_mixing_ratio: 106, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 107, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 108, ! blockidx%x threadidx%x collapsed 106, Generating default present(rtm_forcing(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),qtm_forcing(:ngrdcol,:nzt)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/cos_solar_zen_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/quicksort.F90 wangara_tndcy: 68, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 69, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 70, ! blockidx%x threadidx%x collapsed 68, Generating default present(wm_zm(:ngrdcol,:gr%nzm),gr) 75, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 76, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 77, ! blockidx%x threadidx%x collapsed 75, Generating default present(wm_zt(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr,rtm_forcing(:ngrdcol,:gr%nzt)) 90, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 91, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 92, ! blockidx%x threadidx%x collapsed 90, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 101, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 102, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 103, ! blockidx%x threadidx%x collapsed 101, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) wangara_sfclyr: 171, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 172, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 171, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol)) 172, Generating implicit firstprivate(time_est) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/advance_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_interpret.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/morrison_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/coamps_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_init_cleanup.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/simple_rad_module.F90 microphys_lhs: 1858, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present] Generating copyout(lhs_ta(:,:,:)) [if not already present] Generating copyin(gr%invrs_dzt(:,:),rho_ds_zm_col(:,:),nu_col(:),kh_zt(:,:)) [if not already present] 1888, Generating copyin(gr%invrs_dzt(:,:),gr%invrs_dzm(:,:),gr,wm_zt_col(:,:)) [if not already present] Generating copyout(lhs_ma(:,:)) [if not already present] Generating copyin(gr%weights_zt2zm(:,:,:)) [if not already present] microphys_rhs: 2174, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present] Generating copyout(lhs_ta(:,:)) [if not already present] Generating copyin(gr%invrs_dzt(:,:),nu_col(:),rho_ds_zm_col(:,:),kh_zt(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_a.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/bomex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_nov02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_oct14.F90 bomex_tndcy: 82, Generating enter data create(qtm_forcing(:,:)) 87, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 88, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 89, ! blockidx%x threadidx%x collapsed 87, Generating default present(gr%zt(1:ngrdcol,1:gr%nzt),gr,qtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt)) 114, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 115, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 116, ! blockidx%x threadidx%x collapsed 114, Generating default present(sclrm_forcing(:ngrdcol,:gr%nzt,:),thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 124, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 125, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 126, ! blockidx%x threadidx%x collapsed 124, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) 133, Generating exit data delete(qtm_forcing(:,:)) bomex_sfclyr: 193, Generating enter data copyin(wpqtp_sfc(:)) 208, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 209, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 208, Generating default present(wpqtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol)) 209, Generating implicit firstprivate(wpqtp_sfc_calc,wpthlp_sfc_calc) 224, Generating exit data delete(wpqtp_sfc(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/jun25.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/nov11.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/sfc_flux.F90 nov11_altocu_rtm_adjust: 91, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 92, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 93, ! blockidx%x threadidx%x collapsed 91, Generating default present(gr,gr%zm(1:ngrdcol,1),gr%zt(1:ngrdcol,1:gr%nzt),rtm(:ngrdcol,:gr%nzt)) compute_momentum_flux: 57, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 58, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 57, Generating default present(upwp_sfc(:ngrdcol),ubar(:ngrdcol),um_sfc(:ngrdcol),ustar(:ngrdcol),vpwp_sfc(:ngrdcol),vm_sfc(:ngrdcol)) compute_ubar: 102, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 103, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 102, Generating default present(vm_sfc(:ngrdcol),um_sfc(:ngrdcol),ubar(:ngrdcol)) compute_wpthlp_sfc: 216, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 217, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 216, Generating default present(t_sfc(:ngrdcol),exner_sfc(:ngrdcol),cd(:ngrdcol),thlm_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ubar(:ngrdcol)) compute_wprtp_sfc: 258, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 259, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 258, Generating default present(cd(:ngrdcol),rtm_sfc(:ngrdcol),adjustment(:ngrdcol),wprtp_sfc(:ngrdcol),ubar(:ngrdcol)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extended_atmosphere_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/stat_file_utils.F90 set_sclr_sfc_rtm_thlm: 314, Generating implicit firstprivate(ngrdcol,sclr_dim) Generating NVIDIA GPU code 315, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 316, !$acc loop seq 314, Generating default present(wpsclrp_sfc(:ngrdcol,:sclr_dim)) 315, Generating implicit firstprivate(i) 316, Loop is parallelizable 321, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 322, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 321, Generating default present(wpthlp_sfc(:ngrdcol),wpsclrp_sfc(:ngrdcol,:),wprtp_sfc(:ngrdcol),wpedsclrp_sfc(:ngrdcol,:),sclr_idx) 334, Generating implicit firstprivate(ngrdcol,edsclr_dim) Generating NVIDIA GPU code 335, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 336, !$acc loop seq 334, Generating default present(wpedsclrp_sfc(:ngrdcol,:edsclr_dim)) 336, Loop is parallelizable convert_sens_ht_to_km_s: 348, Generating acc routine seq Generating NVIDIA GPU code convert_latent_ht_to_m_s: 375, Generating acc routine seq Generating NVIDIA GPU code nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/sounding.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/bugsrad_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_b.F90 mpace_b_tndcy: 106, Generating enter data create(t_tendency,velocity_omega) 109, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 110, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 111, ! blockidx%x threadidx%x collapsed 109, Generating default present(gr,p_in_pa(:ngrdcol,:gr%nzt),wm_zt(:ngrdcol,:gr%nzt),thvm(:ngrdcol,:gr%nzt)) 111, Generating implicit firstprivate(velocity_omega) 121, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 122, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 121, Generating default present(wm_zm(:ngrdcol,:),gr) 128, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 129, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 130, ! blockidx%x threadidx%x collapsed 128, Generating default present(gr,thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),p_in_pa(:ngrdcol,:gr%nzt)) 130, Generating implicit firstprivate(t_tendency) 143, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 144, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 145, ! blockidx%x threadidx%x collapsed 143, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 154, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 155, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 156, ! blockidx%x threadidx%x collapsed 154, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) 163, Generating exit data delete(velocity_omega,t_tendency) mpace_b_sfclyr: 232, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 233, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 232, Generating default present(rho_sfc(:),wprtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol)) 233, Generating implicit firstprivate(latent_heat_flx,sensible_heat_flx) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/twp_ice.F90 gabls3_sfclyr: 98, Generating enter data create(c_10(:),offset(:)) 101, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 102, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 101, Generating default present(c_10(:ngrdcol),offset(:ngrdcol)) 114, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 115, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 114, Generating default present(veg_t_in_k(:ngrdcol),ustar(:ngrdcol),wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),lowest_level(:),exner_sfc(:ngrdcol),ubar(:)) 115, Generating implicit firstprivate(veg_theta_in_k,bflx) 122, Generating exit data delete(offset(:),c_10(:)) twp_ice_sfclyr: 96, Generating enter data create(ch(:),rsat(:),cq(:)) 106, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 107, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 106, Generating default present(t_sfc(:),z(:ngrdcol),ustar(:ngrdcol),ch(:ngrdcol),rsat(:ngrdcol),cq(:ngrdcol),p_sfc(:)) 107, Generating implicit firstprivate(t_sfc_interp,saturation_formula) 138, Generating exit data delete(ch(:),rsat(:),cq(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_3year.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_feedback.F90 arm_3year_sfclyr: 79, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 80, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 79, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:)) 80, Generating implicit firstprivate(bflx,moisture_flx,heat_flx) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3_night.F90 cloud_feedback_sfclyr: 103, Generating enter data create(cq(:),ch(:),exner_sfc(:),rsat(:)) 115, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 116, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 115, Generating default present(cq(:ngrdcol),ustar(:ngrdcol),t_sfc(:),exner_sfc(:ngrdcol),ch(:ngrdcol),rsat(:ngrdcol),lowest_level(:ngrdcol),p_sfc(:)) 116, Generating implicit firstprivate(saturation_formula,t_sfc_interp) 164, Generating exit data delete(cq(:),ch(:),rsat(:),exner_sfc(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_fields.F90 gabls3_night_sfclyr: 97, Generating enter data create(ubar(:)) 113, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 114, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 113, Generating default present(um_sfc(:),thlm_sfc(:),vm_sfc(:),wpthlp_sfc(:),wprtp_sfc(:),ustar(:),ubar(:),lowest_level(:),rtm_sfc(:)) 114, Generating implicit firstprivate(ts,qs) 129, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 130, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 129, Generating default present(vpwp_sfc(:ngrdcol),upwp_sfc(:ngrdcol)) 130, Generating implicit firstprivate(vpwp_sfc_interp,upwp_sfc_interp) 143, Generating exit data delete(ubar(:)) psi_h: 150, Generating implicit acc routine seq Generating acc routine seq Generating NVIDIA GPU code gm1: 163, Generating implicit acc routine seq Generating acc routine seq Generating NVIDIA GPU code gh1: 175, Generating implicit acc routine seq Generating acc routine seq Generating NVIDIA GPU code fm1: 188, Generating implicit acc routine seq Generating acc routine seq Generating NVIDIA GPU code fh1: 206, Generating implicit acc routine seq Generating acc routine seq Generating NVIDIA GPU code landflx: 220, Generating acc routine seq Generating NVIDIA GPU code nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm.F90 arm_sfclyr: 98, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 99, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 98, Generating default present(thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:),wprtp_sfc(:ngrdcol),ustar(:ngrdcol)) 99, Generating implicit firstprivate(bflx,moisture_flx2,heat_flx2) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_0003.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/astex_a209.F90 arm_0003_sfclyr: 91, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 92, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 91, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:)) 92, Generating implicit firstprivate(bflx,moisture_flx,heat_flx) astex_a209_sfclyr: 193, Generating enter data create(ch(:),cq(:),rsat(:)) 207, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 208, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 207, Generating default present(ustar(:ngrdcol),t_sfc(:),rsat(:ngrdcol),lowestlevel(:ngrdcol),p_sfc(:),cq(:ngrdcol),ch(:ngrdcol)) 208, Generating implicit firstprivate(t_sfc_interp,saturation_formula) 238, Generating exit data delete(ch(:),rsat(:),cq(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/atex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_97.F90 arm_97_sfclyr: 96, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 97, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 96, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:)) 97, Generating implicit firstprivate(bflx,moisture_flx,heat_flx) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cobra.F90 calc_forcings: 42, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 43, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 44, ! blockidx%x threadidx%x collapsed 42, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),gr,z_inversion(:ngrdcol),thlm_forcing(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf01.F90 cobra_sfclyr: 144, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 145, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 144, Generating default present(rho_sfc(:),t_sfc(:ngrdcol),thlm_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),z(:),ubar(:),wprtp_sfc(:ngrdcol),ustar(:ngrdcol)) 145, Generating implicit firstprivate(t_sfc_calc,moisture_flx2,co2_flx2,heat_flx,heat_flx2,moisture_flx,bflx,co2_flx) 176, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 177, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 176, Generating default present(wpthlp_sfc(:ngrdcol),wpsclrp_sfc(:ngrdcol,:),wprtp_sfc(:ngrdcol),sclr_idx) 177, Generating implicit firstprivate(co2_flx2) 185, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 186, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 185, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),sclr_idx,wpedsclrp_sfc(:ngrdcol,:)) 186, Generating implicit firstprivate(co2_flx2) atex_tndcy: 194, Generating enter data create(z_lev(:),z_inversion(:)) 200, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 201, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 200, Generating default present(z_lev(:ngrdcol),rtm(:ngrdcol,:),gr) 203, Complex loop carried dependence of z_lev prevents parallelization Loop carried reuse of z_lev prevents parallelization 210, Generating update self(rtm(:,:),z_lev(:)) 224, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 225, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 224, Generating default present(z_lev(:ngrdcol),z_inversion(:ngrdcol),gr,gr%zt(1:ngrdcol,:)) 230, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 231, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 232, ! blockidx%x threadidx%x collapsed 230, Generating default present(z_inversion(:ngrdcol),wm_zt(:ngrdcol,:gr%nzt),gr,gr%zt(1:ngrdcol,1:gr%nzt)) 250, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 251, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 250, Generating default present(wm_zm(:ngrdcol,:),gr) 266, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 267, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 266, Generating default present(z_lev_dycore(:ngrdcol),rtm_dycore(:ngrdcol,:),gr_dycore) 269, Complex loop carried dependence of z_lev_dycore prevents parallelization Loop carried reuse of z_lev_dycore prevents parallelization 290, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 291, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 290, Generating default present(z_lev_dycore(:ngrdcol),z_inversion_dycore(:ngrdcol),gr_dycore,gr_dycore%zt(1:ngrdcol,:)) 354, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 355, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 356, ! blockidx%x threadidx%x collapsed 354, Generating default present(wm_zt(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr) 364, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 365, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 366, ! blockidx%x threadidx%x collapsed 364, Generating default present(thlm_forcing_dycore(:ngrdcol,:gr_dycore%nzt),rtm_forcing_dycore(:ngrdcol,:gr_dycore%nzt),gr_dycore) 373, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 374, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 375, ! blockidx%x threadidx%x collapsed 373, Generating default present(wm_zm(:ngrdcol,:gr%nzm),gr) 383, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 384, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 385, ! blockidx%x threadidx%x collapsed 383, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 394, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 395, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 396, ! blockidx%x threadidx%x collapsed 394, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) 405, Generating exit data delete(z_lev(:),z_inversion(:)) atex_sfclyr: 471, Generating enter data create(c_10(:),adjustment(:)) 481, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 482, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 481, Generating default present(adjustment(:ngrdcol),ustar(:ngrdcol),t_sfc(:ngrdcol),c_10(:ngrdcol)) 482, Generating implicit firstprivate(t_sfc_interp) 496, Generating exit data delete(c_10(:),adjustment(:)) dycoms2_rf01_tndcy: 66, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 67, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 68, ! blockidx%x threadidx%x collapsed 66, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr) 77, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 78, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 79, ! blockidx%x threadidx%x collapsed 77, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 88, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 89, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 90, ! blockidx%x threadidx%x collapsed 88, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) dycoms2_rf01_sfclyr: 176, Generating enter data create(rsat(:),cd(:)) 192, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 193, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 192, Generating default present(t_sfc(:ngrdcol),rho_sfc(:),wprtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol)) 193, Generating implicit firstprivate(t_sfc_interp,sens_ht,latent_ht) 202, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 203, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 202, Generating default present(ustar(:ngrdcol),t_sfc(:),rsat(:ngrdcol),cd(:ngrdcol),p_sfc(:)) 203, Generating implicit firstprivate(t_sfc_interp,saturation_formula) 223, Generating exit data delete(rsat(:),cd(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/fire.F90 dycoms2_rf02_tndcy: 90, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 91, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 90, Generating default present(wm_zt(:ngrdcol,gr%nzt),wm_zm(:ngrdcol,gr%nzm),gr) 96, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 97, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 98, ! blockidx%x threadidx%x collapsed 96, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr) 107, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 109, ! blockidx%x threadidx%x collapsed 107, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 118, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 120, ! blockidx%x threadidx%x collapsed 118, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) dycoms2_rf02_sfclyr: 194, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 195, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 194, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol)) 195, Generating implicit firstprivate(sens_ht,latent_ht) fire_sfclyr: 92, Generating enter data create(cz(:),rsat(:)) 102, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 103, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 102, Generating default present(t_sfc(:),ustar(:ngrdcol),rsat(:ngrdcol),cz(:ngrdcol),p_sfc(:)) 103, Generating implicit firstprivate(t_sfc_interp,saturation_formula) 118, Generating exit data delete(rsat(:),cz(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls2.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/lba.F90 gabls2_tndcy: 91, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 92, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 93, ! blockidx%x threadidx%x collapsed 91, Generating default present(wm_zt(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt),gr) 106, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 107, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 108, ! blockidx%x threadidx%x collapsed 106, Generating default present(wm_zt(:ngrdcol,:gr%nzt),gr) 118, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 119, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 118, Generating default present(wm_zm(:ngrdcol,:),gr) 124, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 125, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 126, ! blockidx%x threadidx%x collapsed 124, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr) 138, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 139, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 140, ! blockidx%x threadidx%x collapsed 138, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 149, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 150, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 151, ! blockidx%x threadidx%x collapsed 149, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) gabls2_sfclyr: 241, Generating enter data create(rsat(:),cz(:)) 276, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 277, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 276, Generating default present(cz(:ngrdcol),t_sfc(:),rsat(:ngrdcol),lowest_level(:ngrdcol),p_sfc(:)) 277, Generating implicit firstprivate(t_sfc_calc,saturation_formula) 293, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 294, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 293, Generating default present(ustar(:ngrdcol),lowest_level(:),p_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),t_sfc(:ngrdcol),ubar(:)) 294, Generating implicit firstprivate(sstheta,bflx) 305, Generating exit data delete(rsat(:),cz(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rico.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/neutral_case.F90 lba_tndcy: 68, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 69, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 70, ! blockidx%x threadidx%x collapsed 68, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr) 82, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 83, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 84, ! blockidx%x threadidx%x collapsed 82, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 93, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 94, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 95, ! blockidx%x threadidx%x collapsed 93, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) lba_sfclyr: 172, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 173, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 172, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:)) 173, Generating implicit firstprivate(ft,bflx) neutral_case_sfclyr: 76, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 77, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 76, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol)) 77, Generating implicit firstprivate(time) rico_tndcy: 88, Generating enter data create(qtm_forcing(:,:)) 93, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 94, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 95, ! blockidx%x threadidx%x collapsed 93, Generating default present(exner(:ngrdcol,:gr%nzt),gr,gr%zt(1:ngrdcol,1:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt)) 95, Generating implicit firstprivate(t_tendency) 116, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 117, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 118, ! blockidx%x threadidx%x collapsed 116, Generating default present(qtm_forcing(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt),gr) 145, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 146, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 147, ! blockidx%x threadidx%x collapsed 145, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr) 156, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 157, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 158, ! blockidx%x threadidx%x collapsed 156, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:)) 165, Generating exit data delete(qtm_forcing(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/estimate_scm_microphys_module.F90 rico_sfclyr: 270, Generating enter data create(cm(:),ch(:),cq(:),ubar(:),rsat(:),cz(:)) 287, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 288, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 287, Generating default present(t_sfc(:),ustar(:ngrdcol),rsat(:ngrdcol),p_sfc(:)) 288, Generating implicit firstprivate(t_sfc_interp,saturation_formula) 318, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 319, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 318, Generating default present(z_bot(:ngrdcol),cq(:ngrdcol),ch(:ngrdcol),cm(:ngrdcol)) 344, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 345, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 344, Generating default present(cm(:ngrdcol),ubar(:ngrdcol),um_sfc(:ngrdcol),upwp_sfc(:ngrdcol),vpwp_sfc(:ngrdcol),vm_sfc(:ngrdcol)) 352, Generating exit data delete(cm(:),ch(:),cq(:),ubar(:),rsat(:),cz(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/lh_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_driver.F90 run_clubb: 2416, Generating copyin(fcor(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:),mu_x_2_n(:,:,:),nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:),p_sfc(:),pdf_params%w_2(:,:),rvm_mc(:,:),cloudy_updraft_frac(:,:),gr%zt(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:),pdf_params,pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:),pdf_params_zm,pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rho_zm(:,:),wm_zm(:,:),thvm(:,:),veg_t_in_k(:),um_pert(:,:),vm_pert(:,:),thlm(:,:),rtm(:,:),um(:,:),vm(:,:),w_up_in_cloud(:,:),wprtp(:,:),wpthlp(:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:),wpthlp_mc(:,:),wprtp_mc(:,:),upwp_pert(:,:),vpwp_pert(:,:),sigma_x_2_n(:,:,:),p_in_pa(:,:),corr_cholesky_mtx_2(:,:,:,:),sfc_elevation(:),upwp_sfc_pert(:),rcm_in_layer(:,:),rtpthvp(:,:),thlm_forcing(:,:),pdf_params_zm%w_2(:,:),wprtp_forcing(:,:),wpthlp_forcing(:,:),rtp2_forcing(:,:),thlp2_forcing(:,:),rtpthlp_forcing(:,:),thlp3(:,:),wprcp(:,:),wprtp_sfc(:),rtm_ref(:,:),thlm_ref(:,:),rtp3(:,:),wm_zt(:,:),wp2vp2(:,:),wp2thlp(:,:),rtpthlp_mc(:,:),thlprcp(:,:),exner(:,:),sclr_idx,rho_ds_zt(:,:),rfrzm(:,:),rho(:,:),rho_ds_zm(:,:),ice_supersat_frac(:,:),invrs_rho_ds_zm(:,:),thlpthvp(:,:),thv_ds_zm(:,:),upwp_sfc(:),vpwp_sfc(:),rtm_forcing(:,:),thlm_mc(:,:),deep_soil_t_in_k(:),dummy_dx(:),ug(:,:),uprcp(:,:),vg(:,:),vprcp(:,:),um_ref(:,:),vm_ref(:,:),up2(:,:),vp2(:,:),t_sfc(:),rtp2_mc(:,:),thlp2_mc(:,:),nu_vert_res_dep%nu9(:),dummy_dy(:),rc_coef_zm(:,:),cloud_cover(:,:),wpthlp_sfc(:),wp2(:,:),wp2rtp(:,:),up3(:,:),vp3(:,:),radht(:,:),wp3(:,:),wpthvp(:,:),wpup2(:,:),wp2thvp(:,:),wp2up2(:,:),hm_metadata,um_forcing(:,:),vm_forcing(:,:),upwp(:,:),vpwp(:,:),rcm(:,:),wp4(:,:),w_down_in_cloud(:,:),vpwp_sfc_pert(:),cloudy_downdraft_frac(:,:),cloud_frac(:,:),invrs_rho_ds_zt(:,:),kh_zm(:,:),invrs_tau_zm(:,:),lh_thl_clipped(:,:,:),x_mixt_comp_all_levs(:,:,:),wpvp2(:,:),lh_rv_clipped(:,:,:),lh_rc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_nc_clipped(:,:,:),lh_rt_clipped(:,:,:),kh_zt(:,:),lscale(:,:),mu_x_1_n(:,:,:),sfc_soil_t_in_k(:),sigma_x_1_n(:,:,:),clubb_params(:,:),corr_array_1_n(:,:,:,:),corr_array_2_n(:,:,:,:),corr_cholesky_mtx_1(:,:,:,:),rcm_mc(:,:),thv_ds_zt(:,:),x_nl_all_levs(:,:,:,:)) [if not already present] 2478, Generating copyin(sclrm(:,:,:),wpsclrp(:,:,:),sclr_tol(:),sclrpthvp(:,:,:),sclrm_forcing(:,:,:),sclrp2(:,:,:),sclrp3(:,:,:),sclrprtp(:,:,:),sclrpthlp(:,:,:),wpsclrp_sfc(:,:)) [if not already present] 2482, Generating copyin(edsclrm_forcing(:,:,:),edsclrm(:,:,:),wpedsclrp_sfc(:,:)) [if not already present] 2485, Generating copyin(wphydrometp(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:),hm_metadata%l_mix_rat_hm(:),rtphmp_zt(:,:,:)) [if not already present] 2560, Generating update self(thlp2(:,:),rtpthlp(:,:),wp2(:,:),wp2thvp(:,:),vm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),wprtp(:,:),rtpthvp(:,:),wp3(:,:),um(:,:),thlpthvp(:,:),wpthlp(:,:)) 2563, Generating update self(sclrm(:,:,:)) 2564, Generating update self(edsclrm(:,:,:)) 2628, Generating update self(rho_zm(:,:),wpthlp_sfc(:),wprtp_sfc(:),p_sfc(:)) 2639, Generating update device(veg_t_in_k(:),sfc_soil_t_in_k(:),deep_soil_t_in_k(:)) 2643, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2644, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2645, ! blockidx%x threadidx%x collapsed 2661, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2662, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2663, ! blockidx%x threadidx%x collapsed 2674, Generating update self(rfrzm(:,:)) 2684, Generating update device(rfrzm(:,:)) 2760, Generating update self(cloud_frac(:,:),ice_supersat_frac(:,:),kh_zm(:,:)) 2762, Generating update self(wphydrometp(:,:,:)) 2811, Generating update device(corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:),sigma_x_1_n(:,:,:),mu_x_2_n(:,:,:),mu_x_1_n(:,:,:),corr_cholesky_mtx_2(:,:,:,:),sigma_x_2_n(:,:,:)) 2814, Generating update device(rtphmp_zt(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:)) 2897, Generating update self(lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),x_nl_all_levs(:,:,:,:),rho_ds_zt(:,:),lh_rv_clipped(:,:,:),lh_thl_clipped(:,:,:)) 2928, Generating update self(pdf_params%varnce_w_1(:,:),pdf_params%thl_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rt_1(:,:),pdf_params%rc_2(:,:),pdf_params%chi_1(:,:),p_in_pa(:,:),pdf_params%cthl_2(:,:),kh_zm(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),corr_array_1_n(:,:,:,:),cloud_frac(:,:),sigma_x_1_n(:,:,:),rtm(:,:),mu_x_1_n(:,:,:),lh_thl_clipped(:,:,:),lh_rv_clipped(:,:,:),wp3(:,:),x_mixt_comp_all_levs(:,:,:),x_nl_all_levs(:,:,:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),invrs_rho_ds_zt(:,:),wp2(:,:),wm_zt(:,:),thlm(:,:),wm_zm(:,:),pdf_params%w_2(:,:),rho_zm(:,:),rho_ds_zt(:,:),rcm(:,:),corr_array_2_n(:,:,:,:),mu_x_2_n(:,:,:),sigma_x_2_n(:,:,:)) 2943, Generating copyout(skw_zm(:,:)) [if not already present] Generating copyin(wp3_zm(:,:),wp2(:,:),clubb_params(:,:)) [if not already present] 3017, Generating update device(rtp2_mc(:,:),thlm_mc(:,:),rcm_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:),rvm_mc(:,:),rtpthlp_mc(:,:),wpthlp_mc(:,:)) 3019, Generating update device(wphydrometp(:,:,:)) 3038, Generating update self(cloud_frac(:,:)) 3054, Generating update device(thlm_mc(:,:),rcm_mc(:,:)) 3060, Generating update self(cloud_frac(:,:)) 3122, Generating update self(p_in_pa(:,:),rho_zm(:,:),thlm(:,:),rtm(:,:),exner(:,:),cloud_frac(:,:),ice_supersat_frac(:,:),rho(:,:),rcm(:,:)) 3137, Generating update device(radht(:,:)) prescribe_forcings: 5777, Generating enter data create(thlm_bot(:),um_bot(:),vm_bot(:),z_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:)) 5792, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5793, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5794, ! blockidx%x threadidx%x collapsed 5792, Generating default present(thlm_forcing(:ngrdcol,:nzt),rtm_forcing(:ngrdcol,:nzt)) 5800, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5801, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5802, ! blockidx%x threadidx%x collapsed 5800, Generating default present(rtp2_forcing(:ngrdcol,:nzm),rtpthlp_forcing(:ngrdcol,:nzm),wpthlp_forcing(:ngrdcol,:nzm),wprtp_forcing(:ngrdcol,:nzm),thlp2_forcing(:ngrdcol,:nzm)) 5847, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5848, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5847, Generating default present(thlm_forcing(:ngrdcol,nzt),rtm_forcing(:ngrdcol,nzt)) 5848, Generating implicit firstprivate(nzt) 5900, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5901, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5902, ! blockidx%x threadidx%x collapsed 5900, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr) 5924, Generating update self(p_in_pa(:,:)) 5930, Generating update device(rtm_forcing(:,:),um_ref(:,:),thlm_forcing(:,:),edsclrm_forcing(:,:,:),sclrm_forcing(:,:,:),vm_ref(:,:),wm_zt(:,:),wm_zm(:,:)) 5948, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5949, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5950, ! blockidx%x threadidx%x collapsed 5948, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr) 5957, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 5958, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5959, ! blockidx%x threadidx%x collapsed 5960, !$acc loop seq 5957, Generating default present(sclrm_forcing(:ngrdcol,:gr%nzt,:sclr_dim),gr) 5960, Loop is parallelizable 5968, Generating implicit firstprivate(ngrdcol,edsclr_dim) Generating NVIDIA GPU code 5969, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5970, ! blockidx%x threadidx%x collapsed 5971, !$acc loop seq 5968, Generating default present(gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:edsclr_dim)) 5971, Loop is parallelizable 6049, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6050, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6049, Generating default present(ustar(:ngrdcol)) 6073, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6074, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6073, Generating default present(ustar(:ngrdcol)) 6087, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6088, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6087, Generating default present(ustar(:ngrdcol)) 6109, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6110, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6109, Generating default present(ustar(:ngrdcol)) 6239, Generating update self(rho_bot(:)) 6242, Generating update device(ustar(:),wpthlp_sfc(:),wprtp_sfc(:)) 6300, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6301, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6300, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol)) 6301, Generating implicit firstprivate(sens_ht,latent_ht) 6307, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 6308, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 6309, ! blockidx%x threadidx%x collapsed 6307, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_thl),sclr_idx) 6309, Generating implicit firstprivate(sens_ht) 6316, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 6317, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 6318, ! blockidx%x threadidx%x collapsed 6316, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_rt),sclr_idx) 6318, Generating implicit firstprivate(latent_ht) 6329, Generating update self(rho_zm(:,:),upwp_sfc(:),ustar(:),t_sfc(:),vpwp_sfc(:),wpthlp_sfc(:),wprtp_sfc(:)) 6359, Generating exit data delete(thlm_bot(:),um_bot(:),z_bot(:),vm_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:)) read_surface_var_for_bc: 6464, Generating create(thlm_zm(:,:),um_zm(:,:),vm_zm(:,:),k_min(:),rtm_zm(:,:),exner_zm(:,:)) [if not already present] 6469, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6470, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6469, Generating default present(exner_bot(:ngrdcol),gr,z_bot(:ngrdcol),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um(:ngrdcol,:1),um_bot(:ngrdcol),vm(:ngrdcol,:1),rho_zm(:ngrdcol,:1),rtm(:ngrdcol,:1),rtm_bot(:ngrdcol),thlm(:ngrdcol,:1),rho_bot(:ngrdcol),p_sfc(:ngrdcol),gr%zt(1:ngrdcol,1)) 6489, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6490, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6497, !$acc loop seq 6489, Generating default present(gr,z_bot(:ngrdcol),gr%zt(1:ngrdcol,:)) 6490, Generating implicit firstprivate(k,min_val) 6497, Loop carried scalar dependence for min_val at line 6498 Loop carried reuse of k_min prevents parallelization 6507, Generating update self(k_min(:)) 6540, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6541, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6540, Generating default present(gr,rho_bot(:ngrdcol),p_sfc(:ngrdcol),exner_bot(:ngrdcol),z_bot(:),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um_bot(:ngrdcol),rtm_bot(:ngrdcol),rho_zm(:ngrdcol,:)) 6541, Generating implicit firstprivate(k00,km1,kp2,kp1) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/error.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/enhanced_simann.F90 ar rv /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_other.a mpace_b.o KK_microphys_module.o sounding.o microphys_driver.o gabls3.o twp_ice.o extended_atmosphere_module.o parameters_radiation.o silhs_category_variance_module.o input_netcdf.o arm_3year.o cloud_feedback.o gabls3_night.o gfdl_activation.o microphys_init_cleanup.o enhanced_simann.o extrapolation.o advance_microphys_module.o morrison_microphys_module.o neutral_case.o mpace_a.o nov11.o clex9_oct14.o dycoms2_rf02.o wangara.o mixed_moment_PDF_integrals.o error.o clex9_nov02.o soil_vegetation.o atex.o parameters_microphys.o hydrostatic_module.o time_dependent_input.o stat_file_utils.o arm_97.o ice_dfsn_module.o astex_a209.o input_interpret.o input_grads.o lba.o fire.o simple_rad_module.o quicksort.o coamps_microphys_driver_module.o lh_microphys_driver_module.o rad_lwsw_module.o jun25.o rico.o clubb_model_settings.o cos_solar_zen_module.o arm_0003.o cloud_sed_module.o spec_hum_to_mixing_ratio.o clubb_driver.o estimate_scm_microphys_module.o diag_ustar_module.o bugsrad_driver.o gabls2.o sfc_flux.o cobra.o dycoms2_rf01.o bomex.o input_fields.o arm.o ar: creating /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib/libclubb_other.a a - mpace_b.o a - KK_microphys_module.o a - sounding.o a - microphys_driver.o a - gabls3.o a - twp_ice.o a - extended_atmosphere_module.o a - parameters_radiation.o a - silhs_category_variance_module.o a - input_netcdf.o a - arm_3year.o a - cloud_feedback.o a - gabls3_night.o a - gfdl_activation.o a - microphys_init_cleanup.o a - enhanced_simann.o a - extrapolation.o a - advance_microphys_module.o a - morrison_microphys_module.o a - neutral_case.o a - mpace_a.o a - nov11.o a - clex9_oct14.o a - dycoms2_rf02.o a - wangara.o a - mixed_moment_PDF_integrals.o a - error.o a - clex9_nov02.o a - soil_vegetation.o a - atex.o a - parameters_microphys.o a - hydrostatic_module.o a - time_dependent_input.o a - stat_file_utils.o a - arm_97.o a - ice_dfsn_module.o a - astex_a209.o a - input_interpret.o a - input_grads.o a - lba.o a - fire.o a - simple_rad_module.o a - quicksort.o a - coamps_microphys_driver_module.o a - lh_microphys_driver_module.o a - rad_lwsw_module.o a - jun25.o a - rico.o a - clubb_model_settings.o a - cos_solar_zen_module.o a - arm_0003.o a - cloud_sed_module.o a - spec_hum_to_mixing_ratio.o a - clubb_driver.o a - estimate_scm_microphys_module.o a - diag_ustar_module.o a - bugsrad_driver.o a - gabls2.o a - sfc_flux.o a - cobra.o a - dycoms2_rf01.o a - bomex.o a - input_fields.o a - arm.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_standalone cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_tuner cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.jacobian cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.G_unit_tests cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.int2txt cd /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../obj; make -f Make.clubb_thread_test make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/jacobian.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_standalone.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/int2txt.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/tuner_tests.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nrtype.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_thread_test.F90 nvfortran int2txt.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/int2txt -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nrutil.f90 nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran clubb_thread_test.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_thread_test -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran clubb_standalone.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_standalone -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/w_up_in_cloud_tests.F90 nvfortran jacobian.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/jacobian -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/mu_sigma_hm_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_heaviside_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/nr.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_min_max_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_tuner.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/read_corr_mtx_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/spurious_source_test.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/hole_filling_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/Nc_Ncn_test.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 218) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 222) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 275) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 278) make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/silhs_category_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/corr_cholesky_mtx_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/KK_integrals_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/pdf_parameter_tests.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/pdf_parameter_tests.F90: 413) nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/amoeba.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran_state.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/amebsa.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran1_v.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../src/Numerical_recipes/ran1_s.f90 nvfortran amoeba.o ran1_v.o nrtype.o nrutil.o clubb_tuner.o nr.o ran1_s.o amebsa.o ran_state.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/clubb_tuner -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_tests.F90 nvfortran tuner_tests.o w_up_in_cloud_tests.o pdf_parameter_tests.o smooth_heaviside_tests.o smooth_min_max_tests.o read_corr_mtx_test.o spurious_source_test.o hole_filling_tests.o Nc_Ncn_test.o silhs_category_test.o corr_cholesky_mtx_tests.o mu_sigma_hm_tests.o G_unit_tests.o KK_integrals_tests.o -o /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../bin/G_unit_tests -L/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-4jp2ujpzfvvhktuooajkk32l4eysemmt/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' make[1]: Leaving directory '/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/obj' python ../utilities/check_for_missing_threadprivate.py ../src/CLUBB_core/ ../src/SILHS/ check_for_missing_threadprivate.py has begun. [91mcheck_for_missing_threadprivate.py did not pass.[0m [91mfailedFiles = ['../src/CLUBB_core/sponge_layer_damping.F90', '../src/CLUBB_core/parameters_model.F90', '../src/CLUBB_core/grid_adaptation.F90', '../src/CLUBB_core/error_code.F90', '../src/CLUBB_core/corr_varnce_module.F90'][0m perl ../utilities/CLUBBStandardsCheck.pl ../src/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 174 : call stat_update_var_pt( stats_metadata%isfc_soil_T_in_K, 1, sfc_soil_T_in_K(i), stats_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 175 : call stat_update_var_pt( stats_metadata%ideep_soil_T_in_K, 1, deep_soil_T_in_K(i), stats_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 212 : call stat_update_var_pt( stats_metadata%isoil_heat_flux, 1, soil_heat_flux(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 213 : stats_sfc(i) ) ! intent(inout) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/soil_vegetation.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 381 : um(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 383 : vm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 385 : ugm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 387 : vgm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 389 : thlm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 391 : rtm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 393 : press(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 396 : wm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 413 : edsclr_snd(km1,edsclr), edsclr_snd(k00,edsclr), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 414 : edsclr_snd(kp1,edsclr), edsclr_snd(kp2,edsclr) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 438 : um(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), u(k_above), u(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 439 : vm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), v(k_above), v(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 440 : ugm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), ug(k_above), ug(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 441 : vgm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), vg(k_above), vg(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 442 : thlm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), theta(k_above), theta(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 443 : rtm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), rt(k_above), rt(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 444 : press(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), p_in_Pa(k_above), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 446 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 450 : sclrm(i,k,sclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 456 : edsclrm(i,k,edsclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 485 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 511 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/sounding.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Expected read_random_seed for end function. CLUBBStandardsCheck.pl WARNING: Endings of either program, module, subroutine, or function blocks to not match the beginning ../src/error.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1776 : allocate( um_ref(ngrdcol, gr%nzt) ) ! Reference u wind for nudging; Michael Falk, 17 Oct 2007 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1777 : allocate( vm_ref(ngrdcol, gr%nzt) ) ! Reference v wind for nudging; Michael Falk, 17 Oct 2007 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2428 : !$acc pdf_params%corr_w_thl_2, pdf_params%corr_rt_thl_1, pdf_params%corr_rt_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2429 : !$acc pdf_params%alpha_thl, pdf_params%alpha_rt, pdf_params%crt_1, pdf_params%crt_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2432 : !$acc pdf_params%stdev_eta_2, pdf_params%covar_chi_eta_1, pdf_params%covar_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2434 : !$acc pdf_params%corr_w_eta_2, pdf_params%corr_chi_eta_1, pdf_params%corr_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2441 : !$acc pdf_params_zm%thl_2, pdf_params_zm%varnce_thl_1, pdf_params_zm%varnce_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2442 : !$acc pdf_params_zm%corr_w_rt_1, pdf_params_zm%corr_w_rt_2, pdf_params_zm%corr_w_thl_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2443 : !$acc pdf_params_zm%corr_w_thl_2, pdf_params_zm%corr_rt_thl_1, pdf_params_zm%corr_rt_thl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2444 : !$acc pdf_params_zm%alpha_thl, pdf_params_zm%alpha_rt, pdf_params_zm%crt_1, pdf_params_zm%crt_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2445 : !$acc pdf_params_zm%cthl_1, pdf_params_zm%cthl_2, pdf_params_zm%chi_1, pdf_params_zm%chi_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2446 : !$acc pdf_params_zm%stdev_chi_1, pdf_params_zm%stdev_chi_2, pdf_params_zm%stdev_eta_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2447 : !$acc pdf_params_zm%stdev_eta_2, pdf_params_zm%covar_chi_eta_1, pdf_params_zm%covar_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2448 : !$acc pdf_params_zm%corr_w_chi_1, pdf_params_zm%corr_w_chi_2, pdf_params_zm%corr_w_eta_1, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2449 : !$acc pdf_params_zm%corr_w_eta_2, pdf_params_zm%corr_chi_eta_1, pdf_params_zm%corr_chi_eta_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2450 : !$acc pdf_params_zm%rsatl_1, pdf_params_zm%rsatl_2, pdf_params_zm%rc_1, pdf_params_zm%rc_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2451 : !$acc pdf_params_zm%cloud_frac_1, pdf_params_zm%cloud_frac_2, pdf_params_zm%mixt_frac, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2470 : !$acc rcm_in_layer, cloud_cover, wprcp, w_up_in_cloud, w_down_in_cloud, cloudy_updraft_frac, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2571 : um(i,:), vm(i,:), rtm(i,:), wprtp(i,:), thlm(i,:), wpthlp(i,:), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2765 : call setup_pdf_parameters( gr, gr%nzm, gr%nzt, ngrdcol, pdf_dim, hydromet_dim, dt_main, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2766 : Nc_in_cloud, cloud_frac, Kh_zm, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2767 : ice_supersat_frac, hydromet, wphydrometp, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2768 : corr_array_n_cloud, corr_array_n_below, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2769 : hm_metadata, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2770 : pdf_params, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2771 : clubb_params, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2772 : clubb_config_flags%iiPDF_type, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2773 : l_use_precip_frac, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2774 : clubb_config_flags%l_predict_upwp_vpwp, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2775 : clubb_config_flags%l_diagnose_correlations, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2776 : clubb_config_flags%l_calc_w_corr, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2777 : clubb_config_flags%l_const_Nc_in_cloud, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2778 : clubb_config_flags%l_fix_w_chi_eta_correlations, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2779 : stats_metadata, & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2780 : stats_zt, stats_zm, stats_sfc, err_code, & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2781 : hydrometp2, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2782 : mu_x_1_n, mu_x_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2783 : sigma_x_1_n, sigma_x_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2784 : corr_array_1_n, corr_array_2_n, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2785 : corr_cholesky_mtx_1, corr_cholesky_mtx_2, & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2786 : precip_fracs, & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2787 : hydromet_pdf_params ) ! Optional(out) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2807 : stats_zt(i), stats_zm(i), & ! In/Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2811 : !$acc update device( mu_x_1_n, mu_x_2_n, sigma_x_1_n, sigma_x_2_n, corr_array_1_n, corr_array_2_n, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2898 : !$acc lh_rt_clipped, lh_thl_clipped, lh_rc_clipped, lh_rv_clipped, lh_Nc_clipped ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2930 : !$acc X_nl_all_levs, X_mixt_comp_all_levs, lh_sample_point_weights, mu_x_1_n, mu_x_2_n, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2932 : !$acc lh_rt_clipped, lh_thl_clipped, lh_rc_clipped, lh_rv_clipped, lh_Nc_clipped, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2936 : !$acc pdf_params%cloud_frac_1, pdf_params%cloud_frac_2, pdf_params%cthl_1, pdf_params%cthl_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2937 : !$acc pdf_params%crt_1, pdf_params%crt_2, pdf_params%stdev_chi_1, pdf_params%stdev_chi_2, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2960 : thlm(i,:), p_in_Pa(i,:), exner(i,:), rho(i,:), rho_zm(i,:), rtm(i,:), &! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2961 : rcm(i,:), cloud_frac(i,:), wm_zt(i,:), wm_zm(i,:), wp2_zt(i,:), & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2962 : hydromet(i,:,:), Nc_in_cloud(i,:), & ! In CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2978 : stats_zt(i), stats_zm(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2979 : stats_sfc(i), stats_lh_zt(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2980 : Nccnm(i,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2981 : hydromet_mc(i,:,:), Ncm_mc(i,:), rcm_mc(i,:), rvm_mc(i,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2982 : thlm_mc(i,:), hydromet_vel_zt(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2983 : hydromet_vel_covar_zt_impc(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2984 : hydromet_vel_covar_zt_expc(i,:,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2985 : wprtp_mc(i,:), wpthlp_mc(i,:), rtp2_mc(i,:), & ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2986 : thlp2_mc(i,:), rtpthlp_mc(i,:) ) ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3010 : stats_zt(i), stats_zm(i), stats_sfc(i), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3011 : hydromet(i,:,:), hydromet_vel_zt(i,:,:), hydrometp2(i,:,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3012 : K_hm(i,:,:), Ncm(i,:), Nc_in_cloud(i,:), rvm_mc(i,:), & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3013 : thlm_mc(i,:), err_code, & ! Inout CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3014 : wphydrometp(i,:,:), wpNcp(i,:) ) ! Out CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3017 : !$acc update device( rcm_mc, rvm_mc, thlm_mc, wprtp_mc, wpthlp_mc, rtp2_mc, thlp2_mc, rtpthlp_mc ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3079 : call stat_update_var( stats_metadata%irtm_mc, rvm_mc(i,:)+rcm_mc(i,:), stats_zt(i) ) ! kg/kg/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3081 : call stat_update_var( stats_metadata%iwprtp_mc, wprtp_mc(i,:), stats_zm(i) ) ! m*(kg/kg)/s^2 CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3083 : call stat_update_var( stats_metadata%irtp2_mc, rtp2_mc(i,:), stats_zm(i) ) ! (kg/kg)^2/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3085 : call stat_update_var( stats_metadata%irtpthlp_mc, rtpthlp_mc(i,:), stats_zm(i) ) ! K*(kg/kg)/s CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3102 : !$acc update host( rho, rho_zm, p_in_Pa, exner, cloud_frac, ice_supersat_frac, X_nl_all_levs, & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3122 : !$acc update host( rho, rho_zm, p_in_Pa, exner, cloud_frac, ice_supersat_frac, thlm, rtm, rcm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3151 : call update_radiation_variables( gr%nzm, gr%nzt, radht(i,:), Frad_SW_up(i,:), Frad_LW_up(i,:), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3180 : if ( ( stats_metadata%l_stats_last .or. stats_metadata%l_stats .or. l_output_multi_col ) .and. l_stdout ) then CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 5777 : !$acc enter data create( um_bot, vm_bot, rtm_bot, thlm_bot, rho_bot, exner_bot, z_bot, ustar, ubar ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 5930 : !$acc update device( wm_zt, wm_zm, thlm_forcing, rtm_forcing, um_ref, vm_ref, sclrm_forcing, edsclrm_forcing ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6332 : call stat_update_var_pt( stats_metadata%ish, 1, wpthlp_sfc(i)*rho_zm(i,1)*Cp,& ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6335 : call stat_update_var_pt( stats_metadata%ilh, 1, wprtp_sfc(i)*rho_zm(i,1)*Lv, & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6338 : call stat_update_var_pt( stats_metadata%iwpthlp_sfc, 1, wpthlp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6341 : call stat_update_var_pt( stats_metadata%iwprtp_sfc, 1, wprtp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6344 : call stat_update_var_pt( stats_metadata%iupwp_sfc, 1, upwp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6347 : call stat_update_var_pt( stats_metadata%ivpwp_sfc, 1, vpwp_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6350 : call stat_update_var_pt( stats_metadata%iustar, 1, ustar(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6353 : call stat_update_var_pt( stats_metadata%iT_sfc, 1, T_sfc(i), & ! intent(in) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6359 : !$acc exit data delete( um_bot, vm_bot, rtm_bot, thlm_bot, rho_bot, exner_bot, z_bot, ustar, ubar ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6561 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6565 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6569 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6570 : exner_zm(i,km1), exner_zm(i,k00), exner_zm(i,kp1), exner_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6573 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6574 : thlm_zm(i,km1), thlm_zm(i,k00), thlm_zm(i,kp1), thlm_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6577 : gr%zm(i,km1), gr%zm(i,k00), gr%zm(i,kp1), gr%zm(i,kp2), & CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 6578 : rtm_zm(i,km1), rtm_zm(i,k00), rtm_zm(i,kp1), rtm_zm(i,kp2) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/clubb_driver.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/CLUBB_core/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3354 : if ( err_code_api == clubb_fatal_error ) error stop "Error in CLUBB calling setup_pdf_parameters" CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 3557 : if ( err_code_api == clubb_fatal_error ) error stop "Error in CLUBB calling setup_pdf_parameters" CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/clubb_api_module.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Missing 'implicit none' statements. 'Implicit None' check FAILED! CLUBBStandardsCheck.pl Add a line containing 'implicit none' to each program, module, subroutine, and function. ../src/CLUBB_core/mt95.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 689 : !$acc parallel loop gang vector collapse(2) default(present) reduction(.or.:l_any_adjustment_needed) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 805 : ! MONOFLUX TEST COMMENT DO NOT REMOVE if( any(wpxp_net_adjust /= 0.0) ) write(fstderr,*) "MONOFLUX: wpxp adjusted " CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/mono_flux_limiter.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1308 : status = nf90_def_var( ncid_zm, "columns", NF90_INT, (/column_id_zm/), column_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1309 : status = nf90_def_var( ncid_zm, "altitude", NF90_PREC, (/vertical_id_zm/), vertical_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1310 : status = nf90_def_var( ncid_zm, "time", NF90_PREC, (/time_id_zm/), time_var_id_zm ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1362 : status = nf90_def_var( ncid_zt, "columns", NF90_INT, (/column_id_zt/), column_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1363 : status = nf90_def_var( ncid_zt, "altitude", NF90_PREC, (/vertical_id_zt/), vertical_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1364 : status = nf90_def_var( ncid_zt, "time", NF90_PREC, (/time_id_zt/), time_var_id_zt ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1410 : status = nf90_put_var( ncid_zm, column_var_id_zm, column_list, start=(/1/), count=(/ngrdcol/) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1411 : status = nf90_put_var( ncid_zt, column_var_id_zt, column_list, start=(/1/), count=(/ngrdcol/) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1413 : !=================================== Allocate Output Arrays =================================== CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 1540 : !$acc upwp_out, vpwp_out, up2_out, vp2_out, wp3_out, rcm_out, cloud_frac_out, rtm_out, thlm_out ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/output_netcdf.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 2026 : ! calculate p_in_Pa instead of remapping directly since it can run into problems if for example CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/CLUBB_core/grid_adaptation.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/Benchmark_cases/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 127 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 128 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/bomex.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 91 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 92 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/dycoms2_rf01.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 121 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 122 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/dycoms2_rf02.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 96 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 97 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 176 : wpthlp_sfc(i) = convert_sens_ht_to_km_s( ( 270._core_rknd * ft**1.5_core_rknd ), rho_sfc(i) ) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 177 : wprtp_sfc(i) = convert_latent_ht_to_m_s( ( 554._core_rknd * ft**1.3_core_rknd ), rho_sfc(i) ) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/lba.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 152 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 153 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/gabls2.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 157 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 158 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/mpace_b.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 272 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 273 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/mpace_a.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 159 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 160 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/rico.F90 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 104 : if ( sclr_idx%iiedsclr_thl > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_thl) = thlm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters. 105 : if ( sclr_idx%iiedsclr_rt > 0 ) edsclrm_forcing(i,k,sclr_idx%iiedsclr_rt) = rtm_forcing(i,k) CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters. ../src/Benchmark_cases/wangara.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/KK_microphys/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/SILHS/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/G_unit_test_types/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run GPU_ACC) [Pipeline] lock Trying to acquire lock on [Resource: GPU_nelson] Resource [GPU_nelson] did not exist. Created. Lock acquired on [Resource: GPU_nelson] [Pipeline] { [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-qorv6nkkjzyzntx6wbjupmoxrot26t6r/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + run_scripts/run_scm_all.bash -i Performing priority-cases run Running arm Running arm_97 Running atex Running bomex Running cgils_s6 Running cgils_s11 Running cgils_s12 Running dycoms2_rf01 Running dycoms2_rf01_fixed_sst Running dycoms2_rf02_ds Running dycoms2_rf02_nd Running gabls3_night Running lba Running mpace_b Running rico Running twp_ice Running wangara All cases ran to completion. + mv output gpu_97516ee + mkdir output [Pipeline] } Lock released on resource [Resource: GPU_nelson] [Pipeline] // lock [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Plot) [Pipeline] sh + scp -r carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master/cur_out . [Pipeline] sh ++ cat cur_out/commit + python postprocessing/pyplotgen/pyplotgen.py -l -c cpu_97516ee gpu_97516ee cur_out/cpu_1fcbf04 cur_out/gpu_1fcbf04 -o 97516ee_vs_master_1fcbf04 ******************************************* Welcome to PyPlotGen. ******************************************* Checking for model benchmark output... Benchmark output found in /home/pub/les_and_clubb_benchmark_runs/. ------------------------------------------- Running... ---------- NOTE: If processing multiple cases (ARM, BOMEX, etc.) with multithreading, the total number of panels to be processed may increase as threads complete and begin processing new cases. ---------- Progress: 0 of ? total .png panels complete Progress: 6 of 98 total .png panels complete Progress: 8 of 98 total .png panels complete Progress: 10 of 166 total .png panels complete Progress: 13 of 166 total .png panels complete Progress: 16 of 166 total .png panels complete Progress: 19 of 224 total .png panels complete Progress: 22 of 224 total .png panels complete Progress: 25 of 224 total .png panels complete Progress: 29 of 224 total .png panels complete Progress: 33 of 282 total .png panels complete Progress: 37 of 282 total .png panels complete Progress: 41 of 282 total .png panels complete Progress: 46 of 282 total .png panels complete Progress: 51 of 282 total .png panels complete Progress: 56 of 282 total .png panels complete Progress: 61 of 282 total .png panels complete Progress: 69 of 282 total .png panels complete Progress: 74 of 282 total .png panels complete Progress: 79 of 365 total .png panels complete Progress: 83 of 365 total .png panels complete Progress: 87 of 365 total .png panels complete Progress: 94 of 365 total .png panels complete Progress: 99 of 365 total .png panels complete Progress: 106 of 365 total .png panels complete Progress: 114 of 365 total .png panels complete Progress: 123 of 441 total .png panels complete Progress: 127 of 441 total .png panels complete Progress: 134 of 441 total .png panels complete Progress: 141 of 441 total .png panels complete Progress: 145 of 441 total .png panels complete Progress: 150 of 441 total .png panels complete Progress: 157 of 441 total .png panels complete Progress: 164 of 441 total .png panels complete Progress: 169 of 441 total .png panels complete Progress: 175 of 441 total .png panels complete Progress: 180 of 441 total .png panels complete Progress: 186 of 441 total .png panels complete Progress: 194 of 498 total .png panels complete Progress: 202 of 498 total .png panels complete Progress: 209 of 498 total .png panels complete Progress: 215 of 498 total .png panels complete Progress: 222 of 498 total .png panels complete Progress: 228 of 498 total .png panels complete Progress: 234 of 498 total .png panels complete Progress: 240 of 498 total .png panels complete Progress: 246 of 498 total .png panels complete Progress: 251 of 498 total .png panels complete Progress: 259 of 498 total .png panels complete Progress: 266 of 498 total .png panels complete Progress: 270 of 498 total .png panels complete Progress: 277 of 498 total .png panels complete Progress: 287 of 498 total .png panels complete Progress: 294 of 498 total .png panels complete Progress: 300 of 498 total .png panels complete Progress: 402 of 552 total .png panels complete Progress: 407 of 552 total .png panels complete Progress: 411 of 552 total .png panels complete Progress: 415 of 552 total .png panels complete Progress: 419 of 552 total .png panels complete Progress: 423 of 552 total .png panels complete Progress: 428 of 625 total .png panels complete Progress: 436 of 625 total .png panels complete Progress: 441 of 625 total .png panels complete Progress: 446 of 625 total .png panels complete Progress: 451 of 625 total .png panels complete Progress: 457 of 625 total .png panels complete Progress: 463 of 625 total .png panels complete Progress: 468 of 625 total .png panels complete Progress: 473 of 678 total .png panels complete Progress: 479 of 678 total .png panels complete Progress: 487 of 678 total .png panels complete Progress: 493 of 678 total .png panels complete Progress: 502 of 678 total .png panels complete Progress: 506 of 717 total .png panels complete Progress: 514 of 717 total .png panels complete Progress: 520 of 717 total .png panels complete Progress: 528 of 717 total .png panels complete Progress: 536 of 717 total .png panels complete Progress: 551 of 717 total .png panels complete Progress: 562 of 717 total .png panels complete Progress: 568 of 717 total .png panels complete Progress: 574 of 717 total .png panels complete Progress: 579 of 717 total .png panels complete Progress: 585 of 717 total .png panels complete Progress: 588 of 717 total .png panels complete Progress: 592 of 717 total .png panels complete Progress: 597 of 717 total .png panels complete Progress: 600 of 717 total .png panels complete Progress: 604 of 717 total .png panels complete Progress: 607 of 717 total .png panels complete Progress: 610 of 717 total .png panels complete Progress: 613 of 717 total .png panels complete Progress: 617 of 717 total .png panels complete Progress: 621 of 717 total .png panels complete Progress: 625 of 717 total .png panels complete Progress: 627 of 717 total .png panels complete Progress: 632 of 777 total .png panels complete Progress: 638 of 777 total .png panels complete Progress: 644 of 777 total .png panels complete Progress: 647 of 846 total .png panels complete Progress: 652 of 846 total .png panels complete Progress: 657 of 846 total .png panels complete Progress: 663 of 846 total .png panels complete Progress: 669 of 846 total .png panels complete Progress: 675 of 846 total .png panels complete Progress: 681 of 846 total .png panels complete Progress: 687 of 846 total .png panels complete Progress: 696 of 846 total .png panels complete Progress: 785 of 904 total .png panels complete Progress: 787 of 904 total .png panels complete Progress: 791 of 904 total .png panels complete Progress: 793 of 904 total .png panels complete Progress: 796 of 904 total .png panels complete Progress: 798 of 904 total .png panels complete Progress: 801 of 904 total .png panels complete Progress: 805 of 904 total .png panels complete Progress: 808 of 904 total .png panels complete Progress: 811 of 904 total .png panels complete Progress: 816 of 904 total .png panels complete Progress: 819 of 904 total .png panels complete Progress: 822 of 904 total .png panels complete Progress: 827 of 904 total .png panels complete Progress: 829 of 904 total .png panels complete Progress: 832 of 904 total .png panels complete Progress: 836 of 904 total .png panels complete Progress: 838 of 904 total .png panels complete Progress: 840 of 904 total .png panels complete Progress: 843 of 904 total .png panels complete Progress: 845 of 904 total .png panels complete Progress: 849 of 904 total .png panels complete Progress: 851 of 904 total .png panels complete Progress: 853 of 904 total .png panels complete Progress: 855 of 904 total .png panels complete Progress: 857 of 904 total .png panels complete Progress: 860 of 987 total .png panels complete Progress: 866 of 987 total .png panels complete Progress: 871 of 987 total .png panels complete Progress: 876 of 987 total .png panels complete Progress: 881 of 987 total .png panels complete Progress: 884 of 987 total .png panels complete Progress: 890 of 987 total .png panels complete Progress: 895 of 987 total .png panels complete Progress: 897 of 987 total .png panels complete Progress: 900 of 987 total .png panels complete Progress: 902 of 987 total .png panels complete Progress: 904 of 987 total .png panels complete Progress: 906 of 987 total .png panels complete Progress: 908 of 987 total .png panels complete Progress: 910 of 987 total .png panels complete Progress: 912 of 987 total .png panels complete Progress: 914 of 987 total .png panels complete Progress: 916 of 987 total .png panels complete Progress: 918 of 987 total .png panels complete Progress: 919 of 987 total .png panels complete Progress: 921 of 987 total .png panels complete Progress: 924 of 987 total .png panels complete Progress: 926 of 987 total .png panels complete Progress: 928 of 987 total .png panels complete Progress: 930 of 987 total .png panels complete Progress: 932 of 987 total .png panels complete Progress: 934 of 987 total .png panels complete Progress: 936 of 987 total .png panels complete Progress: 939 of 987 total .png panels complete Progress: 44 of 282 total .png panels complete Progress: 50 of 282 total .png panels complete Progress: 55 of 282 total .png panels complete Progress: 60 of 282 total .png panels complete Progress: 65 of 282 total .png panels complete Progress: 70 of 282 total .png panels complete Progress: 75 of 365 total .png panels complete Progress: 81 of 365 total .png panels complete Progress: 85 of 365 total .png panels complete Progress: 91 of 365 total .png panels complete Progress: 95 of 365 total .png panels complete Progress: 100 of 365 total .png panels complete Progress: 107 of 365 total .png panels complete Progress: 110 of 365 total .png panels complete Progress: 116 of 365 total .png panels complete Progress: 121 of 441 total .png panels complete Progress: 129 of 441 total .png panels complete Progress: 135 of 441 total .png panels complete Progress: 142 of 441 total .png panels complete Progress: 148 of 441 total .png panels complete Progress: 155 of 441 total .png panels complete Progress: 160 of 441 total .png panels complete Progress: 171 of 441 total .png panels complete Progress: 177 of 441 total .png panels complete Progress: 183 of 441 total .png panels complete Progress: 189 of 441 total .png panels complete Progress: 199 of 498 total .png panels complete Progress: 213 of 498 total .png panels complete Progress: 219 of 498 total .png panels complete Progress: 226 of 498 total .png panels complete Progress: 233 of 498 total .png panels complete Progress: 239 of 498 total .png panels complete Progress: 245 of 498 total .png panels complete Progress: 250 of 498 total .png panels complete Progress: 257 of 498 total .png panels complete Progress: 267 of 498 total .png panels complete Progress: 272 of 498 total .png panels complete Progress: 280 of 498 total .png panels complete Progress: 286 of 498 total .png panels complete Progress: 292 of 498 total .png panels complete Progress: 302 of 498 total .png panels complete Progress: 310 of 498 total .png panels complete Progress: 315 of 498 total .png panels complete Progress: 318 of 498 total .png panels complete Progress: 325 of 498 total .png panels complete Progress: 331 of 498 total .png panels complete Progress: 336 of 498 total .png panels complete Progress: 342 of 498 total .png panels complete Progress: 347 of 498 total .png panels complete Progress: 353 of 498 total .png panels complete Progress: 359 of 498 total .png panels complete Progress: 370 of 498 total .png panels complete Progress: 375 of 498 total .png panels complete Progress: 380 of 498 total .png panels complete Progress: 385 of 498 total .png panels complete Progress: 390 of 498 total .png panels complete Progress: 395 of 498 total .png panels complete Progress: 397 of 552 total .png panels complete Progress: 511 of 717 total .png panels complete Progress: 517 of 717 total .png panels complete Progress: 524 of 717 total .png panels complete Progress: 534 of 717 total .png panels complete Progress: 539 of 717 total .png panels complete Progress: 545 of 717 total .png panels complete Progress: 556 of 717 total .png panels complete Progress: 563 of 717 total .png panels complete Progress: 571 of 717 total .png panels complete Progress: 576 of 717 total .png panels complete Progress: 580 of 717 total .png panels complete Progress: 584 of 717 total .png panels complete Progress: 587 of 717 total .png panels complete Progress: 591 of 717 total .png panels complete Progress: 595 of 717 total .png panels complete Progress: 601 of 717 total .png panels complete Progress: 605 of 717 total .png panels complete Progress: 609 of 717 total .png panels complete Progress: 612 of 717 total .png panels complete Progress: 615 of 717 total .png panels complete Progress: 620 of 717 total .png panels complete Progress: 624 of 717 total .png panels complete Progress: 630 of 717 total .png panels complete Progress: 635 of 777 total .png panels complete Progress: 641 of 777 total .png panels complete Progress: 645 of 777 total .png panels complete Progress: 654 of 846 total .png panels complete Progress: 659 of 846 total .png panels complete Progress: 665 of 846 total .png panels complete Progress: 671 of 846 total .png panels complete Progress: 677 of 846 total .png panels complete Progress: 684 of 846 total .png panels complete Progress: 690 of 846 total .png panels complete Progress: 693 of 846 total .png panels complete Progress: 699 of 846 total .png panels complete Progress: 704 of 846 total .png panels complete Progress: 709 of 846 total .png panels complete Progress: 714 of 846 total .png panels complete Progress: 719 of 846 total .png panels complete Progress: 26 of 224 total .png panels complete Progress: 30 of 224 total .png panels complete Progress: 34 of 282 total .png panels complete Progress: 38 of 282 total .png panels complete Progress: 42 of 282 total .png panels complete Progress: 49 of 282 total .png panels complete Progress: 53 of 282 total .png panels complete Progress: 58 of 282 total .png panels complete Progress: 62 of 282 total .png panels complete Progress: 66 of 282 total .png panels complete Progress: 71 of 282 total .png panels complete Progress: 77 of 365 total .png panels complete Progress: 82 of 365 total .png panels complete Progress: 90 of 365 total .png panels complete Progress: 96 of 365 total .png panels complete Progress: 103 of 365 total .png panels complete Progress: 112 of 365 total .png panels complete Progress: 120 of 441 total .png panels complete Progress: 126 of 441 total .png panels complete Progress: 132 of 441 total .png panels complete Progress: 138 of 441 total .png panels complete Progress: 147 of 441 total .png panels complete Progress: 153 of 441 total .png panels complete Progress: 161 of 441 total .png panels complete Progress: 166 of 441 total .png panels complete Progress: 173 of 441 total .png panels complete Progress: 184 of 441 total .png panels complete Progress: 195 of 498 total .png panels complete Progress: 201 of 498 total .png panels complete Progress: 206 of 498 total .png panels complete Progress: 212 of 498 total .png panels complete Progress: 218 of 498 total .png panels complete Progress: 225 of 498 total .png panels complete Progress: 232 of 498 total .png panels complete Progress: 238 of 498 total .png panels complete Progress: 247 of 498 total .png panels complete Progress: 254 of 498 total .png panels complete Progress: 258 of 498 total .png panels complete Progress: 264 of 498 total .png panels complete Progress: 273 of 498 total .png panels complete Progress: 279 of 498 total .png panels complete Progress: 285 of 498 total .png panels complete Progress: 293 of 498 total .png panels complete Progress: 299 of 498 total .png panels complete Progress: 306 of 498 total .png panels complete Progress: 311 of 498 total .png panels complete Progress: 317 of 498 total .png panels complete Progress: 323 of 498 total .png panels complete Progress: 326 of 498 total .png panels complete Progress: 337 of 498 total .png panels complete Progress: 343 of 498 total .png panels complete Progress: 349 of 498 total .png panels complete Progress: 357 of 498 total .png panels complete Progress: 363 of 498 total .png panels complete Progress: 367 of 498 total .png panels complete Progress: 376 of 498 total .png panels complete Progress: 382 of 498 total .png panels complete Progress: 387 of 498 total .png panels complete Progress: 475 of 678 total .png panels complete Progress: 480 of 678 total .png panels complete Progress: 489 of 678 total .png panels complete Progress: 495 of 678 total .png panels complete Progress: 501 of 678 total .png panels complete Progress: 505 of 717 total .png panels complete Progress: 512 of 717 total .png panels complete Progress: 518 of 717 total .png panels complete Progress: 525 of 717 total .png panels complete Progress: 530 of 717 total .png panels complete Progress: 537 of 717 total .png panels complete Progress: 543 of 717 total .png panels complete Progress: 550 of 717 total .png panels complete Progress: 558 of 717 total .png panels complete Progress: 567 of 717 total .png panels complete Progress: 573 of 717 total .png panels complete Progress: 578 of 717 total .png panels complete Progress: 583 of 717 total .png panels complete Progress: 586 of 717 total .png panels complete Progress: 589 of 717 total .png panels complete Progress: 594 of 717 total .png panels complete Progress: 598 of 717 total .png panels complete Progress: 602 of 717 total .png panels complete Progress: 608 of 717 total .png panels complete Progress: 616 of 717 total .png panels complete Progress: 619 of 717 total .png panels complete Progress: 623 of 717 total .png panels complete Progress: 628 of 717 total .png panels complete Progress: 631 of 777 total .png panels complete Progress: 636 of 777 total .png panels complete Progress: 640 of 777 total .png panels complete Progress: 646 of 846 total .png panels complete Progress: 649 of 846 total .png panels complete Progress: 656 of 846 total .png panels complete Progress: 662 of 846 total .png panels complete Progress: 666 of 846 total .png panels complete Progress: 674 of 846 total .png panels complete Progress: 680 of 846 total .png panels complete Progress: 686 of 846 total .png panels complete Progress: 692 of 846 total .png panels complete Progress: 695 of 846 total .png panels complete Progress: 701 of 846 total .png panels complete Progress: 706 of 846 total .png panels complete Progress: 711 of 846 total .png panels complete Progress: 716 of 846 total .png panels complete Progress: 721 of 846 total .png panels complete Progress: 724 of 846 total .png panels complete Progress: 728 of 846 total .png panels complete Progress: 734 of 846 total .png panels complete Progress: 738 of 846 total .png panels complete Progress: 742 of 846 total .png panels complete Progress: 745 of 846 total .png panels complete Progress: 748 of 846 total .png panels complete Progress: 14 of 166 total .png panels complete Progress: 17 of 166 total .png panels complete Progress: 20 of 224 total .png panels complete Progress: 23 of 224 total .png panels complete Progress: 27 of 224 total .png panels complete Progress: 32 of 282 total .png panels complete Progress: 36 of 282 total .png panels complete Progress: 39 of 282 total .png panels complete Progress: 43 of 282 total .png panels complete Progress: 47 of 282 total .png panels complete Progress: 52 of 282 total .png panels complete Progress: 57 of 282 total .png panels complete Progress: 64 of 282 total .png panels complete Progress: 68 of 282 total .png panels complete Progress: 73 of 282 total .png panels complete Progress: 78 of 365 total .png panels complete Progress: 84 of 365 total .png panels complete Progress: 88 of 365 total .png panels complete Progress: 93 of 365 total .png panels complete Progress: 98 of 365 total .png panels complete Progress: 104 of 365 total .png panels complete Progress: 109 of 365 total .png panels complete Progress: 113 of 365 total .png panels complete Progress: 118 of 441 total .png panels complete Progress: 124 of 441 total .png panels complete Progress: 130 of 441 total .png panels complete Progress: 140 of 441 total .png panels complete Progress: 151 of 441 total .png panels complete Progress: 158 of 441 total .png panels complete Progress: 167 of 441 total .png panels complete Progress: 172 of 441 total .png panels complete Progress: 179 of 441 total .png panels complete Progress: 187 of 441 total .png panels complete Progress: 193 of 498 total .png panels complete Progress: 200 of 498 total .png panels complete Progress: 205 of 498 total .png panels complete Progress: 211 of 498 total .png panels complete Progress: 220 of 498 total .png panels complete Progress: 229 of 498 total .png panels complete Progress: 242 of 498 total .png panels complete Progress: 249 of 498 total .png panels complete Progress: 255 of 498 total .png panels complete Progress: 262 of 498 total .png panels complete Progress: 268 of 498 total .png panels complete Progress: 275 of 498 total .png panels complete Progress: 281 of 498 total .png panels complete Progress: 291 of 498 total .png panels complete Progress: 295 of 498 total .png panels complete Progress: 301 of 498 total .png panels complete Progress: 307 of 498 total .png panels complete Progress: 316 of 498 total .png panels complete Progress: 322 of 498 total .png panels complete Progress: 329 of 498 total .png panels complete Progress: 335 of 498 total .png panels complete Progress: 339 of 498 total .png panels complete Progress: 345 of 498 total .png panels complete Progress: 351 of 498 total .png panels complete Progress: 355 of 498 total .png panels complete Progress: 360 of 498 total .png panels complete Progress: 366 of 498 total .png panels complete Progress: 372 of 498 total .png panels complete Progress: 381 of 498 total .png panels complete Progress: 386 of 498 total .png panels complete Progress: 391 of 498 total .png panels complete Progress: 396 of 498 total .png panels complete Progress: 400 of 552 total .png panels complete Progress: 405 of 552 total .png panels complete Progress: 408 of 552 total .png panels complete Progress: 634 of 777 total .png panels complete Progress: 639 of 777 total .png panels complete Progress: 643 of 777 total .png panels complete Progress: 650 of 846 total .png panels complete Progress: 655 of 846 total .png panels complete Progress: 661 of 846 total .png panels complete Progress: 668 of 846 total .png panels complete Progress: 672 of 846 total .png panels complete Progress: 679 of 846 total .png panels complete Progress: 685 of 846 total .png panels complete Progress: 691 of 846 total .png panels complete Progress: 698 of 846 total .png panels complete Progress: 703 of 846 total .png panels complete Progress: 707 of 846 total .png panels complete Progress: 712 of 846 total .png panels complete Progress: 718 of 846 total .png panels complete Progress: 723 of 846 total .png panels complete Progress: 726 of 846 total .png panels complete Progress: 729 of 846 total .png panels complete Progress: 732 of 846 total .png panels complete Progress: 736 of 846 total .png panels complete Progress: 740 of 846 total .png panels complete Progress: 744 of 846 total .png panels complete Progress: 747 of 846 total .png panels complete Progress: 751 of 846 total .png panels complete Progress: 754 of 846 total .png panels complete Progress: 759 of 846 total .png panels complete Progress: 763 of 846 total .png panels complete Progress: 765 of 846 total .png panels complete Progress: 767 of 846 total .png panels complete Progress: 769 of 846 total .png panels complete Progress: 771 of 846 total .png panels complete Progress: 774 of 846 total .png panels complete Progress: 776 of 846 total .png panels complete Progress: 780 of 846 total .png panels complete Progress: 783 of 846 total .png panels complete Progress: 786 of 904 total .png panels complete Progress: 788 of 904 total .png panels complete Progress: 790 of 904 total .png panels complete Progress: 794 of 904 total .png panels complete Progress: 797 of 904 total .png panels complete Progress: 800 of 904 total .png panels complete Progress: 802 of 904 total .png panels complete Progress: 804 of 904 total .png panels complete Progress: 806 of 904 total .png panels complete Progress: 809 of 904 total .png panels complete Progress: 812 of 904 total .png panels complete Progress: 814 of 904 total .png panels complete Progress: 818 of 904 total .png panels complete Progress: 821 of 904 total .png panels complete Progress: 824 of 904 total .png panels complete Progress: 826 of 904 total .png panels complete Progress: 831 of 904 total .png panels complete Progress: 833 of 904 total .png panels complete Progress: 834 of 904 total .png panels complete Progress: 837 of 904 total .png panels complete Progress: 839 of 904 total .png panels complete Progress: 842 of 904 total .png panels complete Progress: 844 of 904 total .png panels complete Progress: 847 of 904 total .png panels complete Progress: 1 of 44 total .png panels complete Progress: 2 of 44 total .png panels complete Progress: 3 of 44 total .png panels complete Progress: 4 of 98 total .png panels complete Progress: 5 of 98 total .png panels complete Progress: 7 of 98 total .png panels complete Progress: 9 of 98 total .png panels complete Progress: 11 of 166 total .png panels complete Progress: 12 of 166 total .png panels complete Progress: 15 of 166 total .png panels complete Progress: 18 of 166 total .png panels complete Progress: 21 of 224 total .png panels complete Progress: 24 of 224 total .png panels complete Progress: 28 of 224 total .png panels complete Progress: 31 of 224 total .png panels complete Progress: 35 of 282 total .png panels complete Progress: 40 of 282 total .png panels complete Progress: 45 of 282 total .png panels complete Progress: 48 of 282 total .png panels complete Progress: 54 of 282 total .png panels complete Progress: 59 of 282 total .png panels complete Progress: 63 of 282 total .png panels complete Progress: 67 of 282 total .png panels complete Progress: 72 of 282 total .png panels complete Progress: 76 of 365 total .png panels complete Progress: 80 of 365 total .png panels complete Progress: 89 of 365 total .png panels complete Progress: 101 of 365 total .png panels complete Progress: 105 of 365 total .png panels complete Progress: 111 of 365 total .png panels complete Progress: 117 of 365 total .png panels complete Progress: 122 of 441 total .png panels complete Progress: 128 of 441 total .png panels complete Progress: 133 of 441 total .png panels complete Progress: 139 of 441 total .png panels complete Progress: 146 of 441 total .png panels complete Progress: 152 of 441 total .png panels complete Progress: 159 of 441 total .png panels complete Progress: 170 of 441 total .png panels complete Progress: 178 of 441 total .png panels complete Progress: 185 of 441 total .png panels complete Progress: 191 of 441 total .png panels complete Progress: 197 of 498 total .png panels complete Progress: 203 of 498 total .png panels complete Progress: 429 of 625 total .png panels complete Progress: 434 of 625 total .png panels complete Progress: 440 of 625 total .png panels complete Progress: 444 of 625 total .png panels complete Progress: 449 of 625 total .png panels complete Progress: 455 of 625 total .png panels complete Progress: 460 of 625 total .png panels complete Progress: 467 of 625 total .png panels complete Progress: 472 of 678 total .png panels complete Progress: 478 of 678 total .png panels complete Progress: 484 of 678 total .png panels complete Progress: 491 of 678 total .png panels complete Progress: 496 of 678 total .png panels complete Progress: 500 of 678 total .png panels complete Progress: 508 of 717 total .png panels complete Progress: 515 of 717 total .png panels complete Progress: 523 of 717 total .png panels complete Progress: 529 of 717 total .png panels complete Progress: 535 of 717 total .png panels complete Progress: 541 of 717 total .png panels complete Progress: 546 of 717 total .png panels complete Progress: 552 of 717 total .png panels complete Progress: 557 of 717 total .png panels complete Progress: 564 of 717 total .png panels complete Progress: 569 of 717 total .png panels complete Progress: 575 of 717 total .png panels complete Progress: 582 of 717 total .png panels complete Progress: 590 of 717 total .png panels complete Progress: 593 of 717 total .png panels complete Progress: 596 of 717 total .png panels complete Progress: 599 of 717 total .png panels complete Progress: 603 of 717 total .png panels complete Progress: 606 of 717 total .png panels complete Progress: 611 of 717 total .png panels complete Progress: 614 of 717 total .png panels complete Progress: 618 of 717 total .png panels complete Progress: 622 of 717 total .png panels complete Progress: 626 of 717 total .png panels complete Progress: 629 of 717 total .png panels complete Progress: 633 of 777 total .png panels complete Progress: 637 of 777 total .png panels complete Progress: 642 of 777 total .png panels complete Progress: 648 of 846 total .png panels complete Progress: 653 of 846 total .png panels complete Progress: 658 of 846 total .png panels complete Progress: 664 of 846 total .png panels complete Progress: 670 of 846 total .png panels complete Progress: 676 of 846 total .png panels complete Progress: 682 of 846 total .png panels complete Progress: 688 of 846 total .png panels complete Progress: 697 of 846 total .png panels complete Progress: 702 of 846 total .png panels complete Progress: 708 of 846 total .png panels complete Progress: 713 of 846 total .png panels complete Progress: 717 of 846 total .png panels complete Progress: 722 of 846 total .png panels complete Progress: 725 of 846 total .png panels complete Progress: 730 of 846 total .png panels complete Progress: 733 of 846 total .png panels complete Progress: 737 of 846 total .png panels complete Progress: 741 of 846 total .png panels complete Progress: 749 of 846 total .png panels complete Progress: 752 of 846 total .png panels complete Progress: 755 of 846 total .png panels complete Progress: 757 of 846 total .png panels complete Progress: 760 of 846 total .png panels complete Progress: 762 of 846 total .png panels complete Progress: 764 of 846 total .png panels complete Progress: 768 of 846 total .png panels complete Progress: 772 of 846 total .png panels complete Progress: 775 of 846 total .png panels complete Progress: 777 of 846 total .png panels complete Progress: 781 of 846 total .png panels complete Progress: 941 of 987 total .png panels complete Progress: 944 of 987 total .png panels complete Progress: 946 of 987 total .png panels complete Progress: 86 of 365 total .png panels complete Progress: 92 of 365 total .png panels complete Progress: 97 of 365 total .png panels complete Progress: 102 of 365 total .png panels complete Progress: 108 of 365 total .png panels complete Progress: 115 of 365 total .png panels complete Progress: 119 of 441 total .png panels complete Progress: 125 of 441 total .png panels complete Progress: 131 of 441 total .png panels complete Progress: 137 of 441 total .png panels complete Progress: 143 of 441 total .png panels complete Progress: 149 of 441 total .png panels complete Progress: 156 of 441 total .png panels complete Progress: 162 of 441 total .png panels complete Progress: 168 of 441 total .png panels complete Progress: 174 of 441 total .png panels complete Progress: 182 of 441 total .png panels complete Progress: 190 of 441 total .png panels complete Progress: 196 of 498 total .png panels complete Progress: 207 of 498 total .png panels complete Progress: 214 of 498 total .png panels complete Progress: 221 of 498 total .png panels complete Progress: 227 of 498 total .png panels complete Progress: 235 of 498 total .png panels complete Progress: 241 of 498 total .png panels complete Progress: 248 of 498 total .png panels complete Progress: 261 of 498 total .png panels complete Progress: 271 of 498 total .png panels complete Progress: 278 of 498 total .png panels complete Progress: 284 of 498 total .png panels complete Progress: 289 of 498 total .png panels complete Progress: 298 of 498 total .png panels complete Progress: 305 of 498 total .png panels complete Progress: 309 of 498 total .png panels complete Progress: 314 of 498 total .png panels complete Progress: 319 of 498 total .png panels complete Progress: 324 of 498 total .png panels complete Progress: 329 of 498 total .png panels complete Progress: 332 of 498 total .png panels complete Progress: 341 of 498 total .png panels complete Progress: 346 of 498 total .png panels complete Progress: 352 of 498 total .png panels complete Progress: 358 of 498 total .png panels complete Progress: 362 of 498 total .png panels complete Progress: 365 of 498 total .png panels complete Progress: 371 of 498 total .png panels complete Progress: 377 of 498 total .png panels complete Progress: 383 of 498 total .png panels complete Progress: 388 of 498 total .png panels complete Progress: 393 of 498 total .png panels complete Progress: 399 of 552 total .png panels complete Progress: 404 of 552 total .png panels complete Progress: 409 of 552 total .png panels complete Progress: 414 of 552 total .png panels complete Progress: 418 of 552 total .png panels complete Progress: 422 of 552 total .png panels complete Progress: 426 of 625 total .png panels complete Progress: 430 of 625 total .png panels complete Progress: 433 of 625 total .png panels complete Progress: 438 of 625 total .png panels complete Progress: 443 of 625 total .png panels complete Progress: 447 of 625 total .png panels complete Progress: 454 of 625 total .png panels complete Progress: 459 of 625 total .png panels complete Progress: 464 of 625 total .png panels complete Progress: 469 of 625 total .png panels complete Progress: 474 of 678 total .png panels complete Progress: 481 of 678 total .png panels complete Progress: 486 of 678 total .png panels complete Progress: 492 of 678 total .png panels complete Progress: 498 of 678 total .png panels complete Progress: 503 of 717 total .png panels complete Progress: 509 of 717 total .png panels complete Progress: 519 of 717 total .png panels complete Progress: 527 of 717 total .png panels complete Progress: 533 of 717 total .png panels complete Progress: 540 of 717 total .png panels complete Progress: 547 of 717 total .png panels complete Progress: 554 of 717 total .png panels complete Progress: 561 of 717 total .png panels complete Progress: 570 of 717 total .png panels complete Progress: 577 of 717 total .png panels complete Progress: 581 of 717 total .png panels complete Progress: 651 of 846 total .png panels complete Progress: 660 of 846 total .png panels complete Progress: 667 of 846 total .png panels complete Progress: 673 of 846 total .png panels complete Progress: 678 of 846 total .png panels complete Progress: 683 of 846 total .png panels complete Progress: 689 of 846 total .png panels complete Progress: 694 of 846 total .png panels complete Progress: 700 of 846 total .png panels complete Progress: 705 of 846 total .png panels complete Progress: 710 of 846 total .png panels complete Progress: 715 of 846 total .png panels complete Progress: 720 of 846 total .png panels complete Progress: 727 of 846 total .png panels complete Progress: 731 of 846 total .png panels complete Progress: 735 of 846 total .png panels complete Progress: 739 of 846 total .png panels complete Progress: 743 of 846 total .png panels complete Progress: 746 of 846 total .png panels complete Progress: 750 of 846 total .png panels complete Progress: 753 of 846 total .png panels complete Progress: 756 of 846 total .png panels complete Progress: 758 of 846 total .png panels complete Progress: 761 of 846 total .png panels complete Progress: 766 of 846 total .png panels complete Progress: 770 of 846 total .png panels complete Progress: 773 of 846 total .png panels complete Progress: 778 of 846 total .png panels complete Progress: 779 of 846 total .png panels complete Progress: 782 of 846 total .png panels complete Progress: 784 of 904 total .png panels complete Progress: 789 of 904 total .png panels complete Progress: 792 of 904 total .png panels complete Progress: 795 of 904 total .png panels complete Progress: 799 of 904 total .png panels complete Progress: 803 of 904 total .png panels complete Progress: 807 of 904 total .png panels complete Progress: 810 of 904 total .png panels complete Progress: 813 of 904 total .png panels complete Progress: 815 of 904 total .png panels complete Progress: 817 of 904 total .png panels complete Progress: 820 of 904 total .png panels complete Progress: 823 of 904 total .png panels complete Progress: 825 of 904 total .png panels complete Progress: 828 of 904 total .png panels complete Progress: 830 of 904 total .png panels complete Progress: 835 of 904 total .png panels complete Progress: 841 of 904 total .png panels complete Progress: 846 of 904 total .png panels complete Progress: 848 of 904 total .png panels complete Progress: 850 of 904 total .png panels complete Progress: 852 of 904 total .png panels complete Progress: 854 of 904 total .png panels complete Progress: 856 of 904 total .png panels complete Progress: 858 of 904 total .png panels complete Progress: 859 of 904 total .png panels complete Progress: 862 of 987 total .png panels complete Progress: 864 of 987 total .png panels complete Progress: 867 of 987 total .png panels complete Progress: 869 of 987 total .png panels complete Progress: 873 of 987 total .png panels complete Progress: 875 of 987 total .png panels complete Progress: 878 of 987 total .png panels complete Progress: 880 of 987 total .png panels complete Progress: 883 of 987 total .png panels complete Progress: 886 of 987 total .png panels complete Progress: 888 of 987 total .png panels complete Progress: 891 of 987 total .png panels complete Progress: 893 of 987 total .png panels complete Progress: 136 of 441 total .png panels complete Progress: 144 of 441 total .png panels complete Progress: 154 of 441 total .png panels complete Progress: 163 of 441 total .png panels complete Progress: 165 of 441 total .png panels complete Progress: 176 of 441 total .png panels complete Progress: 181 of 441 total .png panels complete Progress: 188 of 441 total .png panels complete Progress: 192 of 441 total .png panels complete Progress: 198 of 498 total .png panels complete Progress: 204 of 498 total .png panels complete Progress: 210 of 498 total .png panels complete Progress: 217 of 498 total .png panels complete Progress: 224 of 498 total .png panels complete Progress: 230 of 498 total .png panels complete Progress: 236 of 498 total .png panels complete Progress: 243 of 498 total .png panels complete Progress: 253 of 498 total .png panels complete Progress: 256 of 498 total .png panels complete Progress: 263 of 498 total .png panels complete Progress: 269 of 498 total .png panels complete Progress: 276 of 498 total .png panels complete Progress: 282 of 498 total .png panels complete Progress: 288 of 498 total .png panels complete Progress: 297 of 498 total .png panels complete Progress: 304 of 498 total .png panels complete Progress: 312 of 498 total .png panels complete Progress: 320 of 498 total .png panels complete Progress: 330 of 498 total .png panels complete Progress: 333 of 498 total .png panels complete Progress: 338 of 498 total .png panels complete Progress: 344 of 498 total .png panels complete Progress: 350 of 498 total .png panels complete Progress: 356 of 498 total .png panels complete Progress: 364 of 498 total .png panels complete Progress: 369 of 498 total .png panels complete Progress: 374 of 498 total .png panels complete Progress: 379 of 498 total .png panels complete Progress: 384 of 498 total .png panels complete Progress: 389 of 498 total .png panels complete Progress: 394 of 498 total .png panels complete Progress: 401 of 552 total .png panels complete Progress: 406 of 552 total .png panels complete Progress: 412 of 552 total .png panels complete Progress: 416 of 552 total .png panels complete Progress: 420 of 552 total .png panels complete Progress: 424 of 625 total .png panels complete Progress: 427 of 625 total .png panels complete Progress: 432 of 625 total .png panels complete Progress: 437 of 625 total .png panels complete Progress: 442 of 625 total .png panels complete Progress: 448 of 625 total .png panels complete Progress: 452 of 625 total .png panels complete Progress: 456 of 625 total .png panels complete Progress: 461 of 625 total .png panels complete Progress: 466 of 625 total .png panels complete Progress: 470 of 678 total .png panels complete Progress: 476 of 678 total .png panels complete Progress: 482 of 678 total .png panels complete Progress: 485 of 678 total .png panels complete Progress: 490 of 678 total .png panels complete Progress: 494 of 678 total .png panels complete Progress: 499 of 678 total .png panels complete Progress: 507 of 717 total .png panels complete Progress: 510 of 717 total .png panels complete Progress: 516 of 717 total .png panels complete Progress: 521 of 717 total .png panels complete Progress: 526 of 717 total .png panels complete Progress: 532 of 717 total .png panels complete Progress: 538 of 717 total .png panels complete Progress: 544 of 717 total .png panels complete Progress: 548 of 717 total .png panels complete Progress: 553 of 717 total .png panels complete Progress: 559 of 717 total .png panels complete Progress: 565 of 717 total .png panels complete Progress: 572 of 717 total .png panels complete Progress: 861 of 987 total .png panels complete Progress: 863 of 987 total .png panels complete Progress: 865 of 987 total .png panels complete Progress: 868 of 987 total .png panels complete Progress: 870 of 987 total .png panels complete Progress: 872 of 987 total .png panels complete Progress: 874 of 987 total .png panels complete Progress: 877 of 987 total .png panels complete Progress: 879 of 987 total .png panels complete Progress: 882 of 987 total .png panels complete Progress: 885 of 987 total .png panels complete Progress: 887 of 987 total .png panels complete Progress: 889 of 987 total .png panels complete Progress: 892 of 987 total .png panels complete Progress: 894 of 987 total .png panels complete Progress: 896 of 987 total .png panels complete Progress: 898 of 987 total .png panels complete Progress: 899 of 987 total .png panels complete Progress: 901 of 987 total .png panels complete Progress: 903 of 987 total .png panels complete Progress: 905 of 987 total .png panels complete Progress: 907 of 987 total .png panels complete Progress: 909 of 987 total .png panels complete Progress: 911 of 987 total .png panels complete Progress: 913 of 987 total .png panels complete Progress: 915 of 987 total .png panels complete Progress: 917 of 987 total .png panels complete Progress: 920 of 987 total .png panels complete Progress: 922 of 987 total .png panels complete Progress: 923 of 987 total .png panels complete Progress: 925 of 987 total .png panels complete Progress: 927 of 987 total .png panels complete Progress: 929 of 987 total .png panels complete Progress: 931 of 987 total .png panels complete Progress: 933 of 987 total .png panels complete Progress: 935 of 987 total .png panels complete Progress: 937 of 987 total .png panels complete Progress: 938 of 987 total .png panels complete Progress: 940 of 987 total .png panels complete Progress: 942 of 987 total .png panels complete Progress: 943 of 987 total .png panels complete Progress: 945 of 987 total .png panels complete Progress: 947 of 987 total .png panels complete Progress: 948 of 987 total .png panels complete Progress: 949 of 987 total .png panels complete Progress: 950 of 987 total .png panels complete Progress: 951 of 987 total .png panels complete Progress: 952 of 987 total .png panels complete Progress: 953 of 987 total .png panels complete Progress: 954 of 987 total .png panels complete Progress: 955 of 987 total .png panels complete Progress: 956 of 987 total .png panels complete Progress: 957 of 987 total .png panels complete Progress: 958 of 987 total .png panels complete Progress: 959 of 987 total .png panels complete Progress: 960 of 987 total .png panels complete Progress: 961 of 987 total .png panels complete Progress: 962 of 987 total .png panels complete Progress: 963 of 987 total .png panels complete Progress: 964 of 987 total .png panels complete Progress: 965 of 987 total .png panels complete Progress: 966 of 987 total .png panels complete Progress: 967 of 987 total .png panels complete Progress: 968 of 987 total .png panels complete Progress: 969 of 987 total .png panels complete Progress: 970 of 987 total .png panels complete Progress: 971 of 987 total .png panels complete Progress: 972 of 987 total .png panels complete Progress: 973 of 987 total .png panels complete Progress: 974 of 987 total .png panels complete Progress: 975 of 987 total .png panels complete Progress: 976 of 987 total .png panels complete Progress: 977 of 987 total .png panels complete Progress: 978 of 987 total .png panels complete Progress: 979 of 987 total .png panels complete Progress: 980 of 987 total .png panels complete Progress: 981 of 987 total .png panels complete Progress: 982 of 987 total .png panels complete Progress: 983 of 987 total .png panels complete Progress: 984 of 987 total .png panels complete Progress: 985 of 987 total .png panels complete Progress: 986 of 987 total .png panels complete Progress: 987 of 987 total .png panels complete Progress: 208 of 498 total .png panels complete Progress: 216 of 498 total .png panels complete Progress: 223 of 498 total .png panels complete Progress: 231 of 498 total .png panels complete Progress: 237 of 498 total .png panels complete Progress: 244 of 498 total .png panels complete Progress: 252 of 498 total .png panels complete Progress: 260 of 498 total .png panels complete Progress: 265 of 498 total .png panels complete Progress: 274 of 498 total .png panels complete Progress: 283 of 498 total .png panels complete Progress: 290 of 498 total .png panels complete Progress: 296 of 498 total .png panels complete Progress: 303 of 498 total .png panels complete Progress: 308 of 498 total .png panels complete Progress: 313 of 498 total .png panels complete Progress: 321 of 498 total .png panels complete Progress: 327 of 498 total .png panels complete Progress: 334 of 498 total .png panels complete Progress: 340 of 498 total .png panels complete Progress: 348 of 498 total .png panels complete Progress: 354 of 498 total .png panels complete Progress: 361 of 498 total .png panels complete Progress: 368 of 498 total .png panels complete Progress: 373 of 498 total .png panels complete Progress: 378 of 498 total .png panels complete Progress: 392 of 498 total .png panels complete Progress: 398 of 552 total .png panels complete Progress: 403 of 552 total .png panels complete Progress: 410 of 552 total .png panels complete Progress: 413 of 552 total .png panels complete Progress: 417 of 552 total .png panels complete Progress: 421 of 552 total .png panels complete Progress: 426 of 625 total .png panels complete Progress: 431 of 625 total .png panels complete Progress: 435 of 625 total .png panels complete Progress: 439 of 625 total .png panels complete Progress: 445 of 625 total .png panels complete Progress: 450 of 625 total .png panels complete Progress: 453 of 625 total .png panels complete Progress: 458 of 625 total .png panels complete Progress: 462 of 625 total .png panels complete Progress: 465 of 625 total .png panels complete Progress: 471 of 678 total .png panels complete Progress: 477 of 678 total .png panels complete Progress: 483 of 678 total .png panels complete Progress: 488 of 678 total .png panels complete Progress: 497 of 678 total .png panels complete Progress: 504 of 717 total .png panels complete Progress: 513 of 717 total .png panels complete Progress: 522 of 717 total .png panels complete Progress: 531 of 717 total .png panels complete Progress: 542 of 717 total .png panels complete Progress: 549 of 717 total .png panels complete Progress: 555 of 717 total .png panels complete Progress: 560 of 717 total .png panels complete Progress: 566 of 717 total .png panels complete Progress: 988 of 1057 total .png panels complete Progress: 989 of 1057 total .png panels complete Progress: 990 of 1057 total .png panels complete Progress: 991 of 1057 total .png panels complete Progress: 992 of 1057 total .png panels complete Progress: 993 of 1057 total .png panels complete Progress: 994 of 1057 total .png panels complete Progress: 995 of 1057 total .png panels complete Progress: 996 of 1057 total .png panels complete Progress: 997 of 1057 total .png panels complete Progress: 998 of 1057 total .png panels complete Progress: 999 of 1057 total .png panels complete Progress: 1000 of 1057 total .png panels complete Progress: 1001 of 1057 total .png panels complete Progress: 1002 of 1057 total .png panels complete Progress: 1003 of 1057 total .png panels complete Progress: 1004 of 1057 total .png panels complete Progress: 1005 of 1057 total .png panels complete Progress: 1006 of 1057 total .png panels complete Progress: 1007 of 1057 total .png panels complete Progress: 1008 of 1057 total .png panels complete Progress: 1009 of 1057 total .png panels complete Progress: 1010 of 1057 total .png panels complete Progress: 1011 of 1057 total .png panels complete Progress: 1012 of 1057 total .png panels complete Progress: 1013 of 1057 total .png panels complete Progress: 1014 of 1057 total .png panels complete Progress: 1015 of 1057 total .png panels complete Progress: 1016 of 1057 total .png panels complete Progress: 1017 of 1057 total .png panels complete Progress: 1018 of 1057 total .png panels complete Progress: 1019 of 1057 total .png panels complete Progress: 1020 of 1057 total .png panels complete Progress: 1021 of 1057 total .png panels complete Progress: 1022 of 1057 total .png panels complete Progress: 1023 of 1057 total .png panels complete Progress: 1024 of 1057 total .png panels complete Progress: 1025 of 1057 total .png panels complete Progress: 1026 of 1057 total .png panels complete Progress: 1027 of 1057 total .png panels complete Progress: 1028 of 1057 total .png panels complete Progress: 1029 of 1057 total .png panels complete Progress: 1030 of 1057 total .png panels complete Progress: 1031 of 1057 total .png panels complete Progress: 1032 of 1057 total .png panels complete Progress: 1033 of 1057 total .png panels complete Progress: 1034 of 1057 total .png panels complete Progress: 1035 of 1057 total .png panels complete Progress: 1036 of 1057 total .png panels complete Progress: 1037 of 1057 total .png panels complete Progress: 1038 of 1057 total .png panels complete Progress: 1039 of 1057 total .png panels complete Progress: 1040 of 1057 total .png panels complete Progress: 1041 of 1057 total .png panels complete Progress: 1042 of 1057 total .png panels complete Progress: 1043 of 1057 total .png panels complete Progress: 1044 of 1057 total .png panels complete Progress: 1045 of 1057 total .png panels complete Progress: 1046 of 1057 total .png panels complete Progress: 1047 of 1057 total .png panels complete Progress: 1048 of 1057 total .png panels complete Progress: 1049 of 1057 total .png panels complete Progress: 1050 of 1057 total .png panels complete Progress: 1051 of 1057 total .png panels complete Progress: 1052 of 1057 total .png panels complete Progress: 1053 of 1057 total .png panels complete Progress: 1054 of 1057 total .png panels complete Progress: 1055 of 1057 total .png panels complete Progress: 1056 of 1057 total .png panels complete Progress: 1057 of 1057 total .png panels complete ------------------------------------------- ARM: SUCCESS --> Images found. ARM_97: SUCCESS --> Images found. ATEX: SUCCESS --> Images found. BOMEX: SUCCESS --> Images found. CGILS_S11: SUCCESS --> Images found. CGILS_S12: SUCCESS --> Images found. CGILS_S6: SUCCESS --> Images found. DYCOMS2_RF01: SUCCESS --> Images found. DYCOMS2_RF01_FIXED_SST: SUCCESS --> Images found. DYCOMS2_RF02_DS: SUCCESS --> Images found. DYCOMS2_RF02_ND: SUCCESS --> Images found. GABLS3_NIGHT: SUCCESS --> Images found. LBA: SUCCESS --> Images found. MPACE_B: SUCCESS --> Images found. RICO: SUCCESS --> Images found. TWP_ICE: SUCCESS --> Images found. WANGARA: SUCCESS --> Images found. ------------------------------------------- Output can be viewed at file:///home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/97516ee_vs_master_1fcbf04/index.html with a web browser Pyplotgen ran in 95 seconds. See error.log in the output folder for detailed info including warnings. error.log messages include: 25-02-28 03:35:25.768 proc_id: 2612193 Warning! Averaging over heights is not yet implemented. [Pipeline] sh + ssh carson 'mkdir -p /home/pub/web_plots/clubb_nvhpc_gpu_plots/master' [Pipeline] sh + scp -r 97516ee_vs_master_1fcbf04 carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master [Pipeline] sh + ssh carson '/home/pub/web_plots/generate_plot_directory_page.py /home/pub/web_plots/clubb_nvhpc_gpu_plots/' /home/pub/web_plots/clubb_nvhpc_gpu_plots/ updated successfully. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Update Master Output) [Pipeline] sh + rm -rf cur_out [Pipeline] sh + mkdir cur_out [Pipeline] sh + mv cpu_97516ee gpu_97516ee cur_out [Pipeline] sh + echo 97516ee [Pipeline] sh + ssh carson 'rm -rf /home/pub/web_plots/clubb_nvhpc_gpu_plots/master/cur_out' [Pipeline] sh + scp -r cur_out carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master/ [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline Finished: SUCCESS