![[Jenkins]](/jenkins/static/57c8a776/images/svgs/logo.svg){kind=logo}
Started by an SCM change Obtained jenkins_tests/clubb_nvhpc_gpu_vs_cpu_plot/Jenkinsfile from git https://github.com/larson-group/clubb.git [Pipeline] Start of Pipeline [Pipeline] node Running on mitch in /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git Cloning the remote Git repository Cloning repository https://github.com/larson-group/clubb.git > git init /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot # timeout=10 Fetching upstream changes from https://github.com/larson-group/clubb.git > git --version # timeout=10 > git --version # 'git version 2.34.1' > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch Checking out Revision 1632cf12730e5062a99c07d6718a0ceee5d48c0a (refs/remotes/origin/master) Commit message: "Initializing total_mismatches to zero." > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 > git config core.sparsecheckout # timeout=10 > git checkout -f 1632cf12730e5062a99c07d6718a0ceee5d48c0a # timeout=10 > git rev-list --no-walk 8bbf5db087f49e4d6a4a1aaef2b825b3716276f8 # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Modify Config Flags) [Pipeline] sh + sed -i 's:penta_solve_method.*:penta_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:tridiag_solve_method.*:tridiag_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:lh_straight_mc.*:lh_straight_mc = true:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile CPU) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + compile/compile.bash -c config/linux_x86_64_nvhpc.bash ......................................................................................................................................................................... Make.clubb_lapack is ready. ................................................................................. Make.clubb_param is ready. ......................... Make.clubb_bugsrad is ready. ... Make.microphys_utils is ready. ..... Make.clubb_parabolic is ready. .............. Make.clubb_KK_microphys is ready. ................................................. Make.clubb_coamps is ready. ... Make.clubb_morrison is ready. ... Make.clubb_gfdlact is ready. ............. Make.silhs is ready. .................................................................. Make.clubb_other is ready. ... Make.clubb_standalone is ready. ... Make.clubb_thread_test is ready. ............ Make.clubb_tuner is ready. ... Make.jacobian is ready. ................ Make.G_unit_tests is ready. ... Make.int2txt is ready. cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_param cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_gfdlact make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SCM_Activation/aer_ccn_act_k.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/lapack_interfaces.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clubb_precision.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/model_flags.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/error_code.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mt95.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameter_indices.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stat_file_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_variables.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameters_model.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/array_index.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/penta_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/tridiag_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/input_names.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/endian.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/code_timer_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/constants_clubb.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_type.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/interpolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/saturation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_hybrid_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_parameter_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/file_functions.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_gfdlact.a aer_ccn_act_k.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_gfdlact.a a - aer_ccn_act_k.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_type_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/T_in_K_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/lapack_wrap.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/input_reader.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/matrix_operations.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/hydromet_pdf_parameter_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/precipitation_fraction.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/Nc_Ncn_eqns.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/diagnose_correlations_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_tsdadg_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calc_roots.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calendar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_rad_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_rad_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/Skx_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sigma_sqd_w_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/output_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_lh_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_lh_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/adg1_adg2_3d_luhar_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/LY93_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/grid_class.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/matrix_solver_wrapper.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/corr_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameters_tunable.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_helper_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sponge_layer_damping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mean_adv.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/diffusion.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/turbulent_adv_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/index_mapping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calc_pressure.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mono_flux_limiter.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pos_definite_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/output_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clip_explicit.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/fill_holes.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_windm_edsclrm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_hybrid_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xp2_xpyp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/setup_clubb_pdf_params.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xm_wpxp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/numerical_check.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_wp2_wp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_clubb_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sfc_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mixing_length.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_closure_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_clubb_core_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clubb_api_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_param.a lapack_interfaces.o interpolation.o saturation.o new_hybrid_pdf_main.o mt95.o advance_xp2_xpyp_module.o calc_pressure.o lapack_wrap.o setup_clubb_pdf_params.o advance_xm_wpxp_module.o mono_flux_limiter.o model_flags.o stats_zt_module.o new_tsdadg_pdf.o matrix_solver_wrapper.o parameters_tunable.o new_pdf.o error_code.o calendar.o pdf_parameter_module.o clubb_api_module.o new_pdf_main.o advance_xp3_module.o Nc_Ncn_eqns.o stats_rad_zt_module.o adg1_adg2_3d_luhar_pdf.o calc_roots.o stats_lh_zt_module.o stats_lh_sfc_module.o diagnose_correlations_module.o numerical_check.o output_netcdf.o corr_varnce_module.o sfc_varnce_module.o advance_wp2_wp3_module.o pdf_utilities.o stats_clubb_utilities.o advance_windm_edsclrm_module.o Skx_module.o tridiag_lu_solver.o grid_class.o fill_holes.o input_reader.o hydromet_pdf_parameter_module.o precipitation_fraction.o mixing_length.o mean_adv.o matrix_operations.o stats_sfc_module.o endian.o T_in_K_module.o penta_lu_solver.o index_mapping.o pdf_closure_module.o stats_type.o constants_clubb.o clubb_precision.o stats_rad_zm_module.o turbulent_adv_pdf.o sigma_sqd_w_module.o stat_file_module.o clip_explicit.o output_grads.o sponge_layer_damping.o new_hybrid_pdf.o diffusion.o stats_zm_module.o advance_helper_module.o stats_type_utilities.o parameter_indices.o code_timer_module.o LY93_pdf.o parameters_model.o file_functions.o stats_variables.o advance_clubb_core_module.o array_index.o input_names.o pos_definite_module.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_param.a a - lapack_interfaces.o a - interpolation.o a - saturation.o a - new_hybrid_pdf_main.o a - mt95.o a - advance_xp2_xpyp_module.o a - calc_pressure.o a - lapack_wrap.o a - setup_clubb_pdf_params.o a - advance_xm_wpxp_module.o a - mono_flux_limiter.o a - model_flags.o a - stats_zt_module.o a - new_tsdadg_pdf.o a - matrix_solver_wrapper.o a - parameters_tunable.o a - new_pdf.o a - error_code.o a - calendar.o a - pdf_parameter_module.o a - clubb_api_module.o a - new_pdf_main.o a - advance_xp3_module.o a - Nc_Ncn_eqns.o a - stats_rad_zt_module.o a - adg1_adg2_3d_luhar_pdf.o a - calc_roots.o a - stats_lh_zt_module.o a - stats_lh_sfc_module.o a - diagnose_correlations_module.o a - numerical_check.o a - output_netcdf.o a - corr_varnce_module.o a - sfc_varnce_module.o a - advance_wp2_wp3_module.o a - pdf_utilities.o a - stats_clubb_utilities.o a - advance_windm_edsclrm_module.o a - Skx_module.o a - tridiag_lu_solver.o a - grid_class.o a - fill_holes.o a - input_reader.o a - hydromet_pdf_parameter_module.o a - precipitation_fraction.o a - mixing_length.o a - mean_adv.o a - matrix_operations.o a - stats_sfc_module.o a - endian.o a - T_in_K_module.o a - penta_lu_solver.o a - index_mapping.o a - pdf_closure_module.o a - stats_type.o a - constants_clubb.o a - clubb_precision.o a - stats_rad_zm_module.o a - turbulent_adv_pdf.o a - sigma_sqd_w_module.o a - stat_file_module.o a - clip_explicit.o a - output_grads.o a - sponge_layer_damping.o a - new_hybrid_pdf.o a - diffusion.o a - stats_zm_module.o a - advance_helper_module.o a - stats_type_utilities.o a - parameter_indices.o a - code_timer_module.o a - LY93_pdf.o a - parameters_model.o a - file_functions.o a - stats_variables.o a - advance_clubb_core_module.o a - array_index.o a - input_names.o a - pos_definite_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_lapack make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ilaslc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dnrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/daxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sdot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ieeeck.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/saxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/snrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ddot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iladlr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/idamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ilaenv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slamch.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slamch.f: 113) 0 inform, 1 warnings, 0 severes, 0 fatal for slamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlamch.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlamch.f: 109) 0 inform, 1 warnings, 0 severes, 0 fatal for dlamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dcopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/stbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/disnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/isamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iparmq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/scopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_shared/lsame.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_shared/xerbla.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/srscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ilaslr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/drscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iladlc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slagtm.f ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_lapack.a slabad.o sscal.o ilaslc.o dswap.o slaset.o slantb.o dlarf.o dnrm2.o dsyrk.o daxpy.o sgbsv.o sdot.o dsymv.o dlacn2.o sorgql.o dorgqr.o ieeeck.o slaev2.o dlangt.o ssyr2.o slae2.o sgbtrf.o dlacpy.o saxpy.o snrm2.o ssyrk.o slarf.o dlantb.o dlaset.o sswap.o dscal.o dlabad.o slacpy.o dgbtrf.o dlae2.o dsyr2.o slangt.o dlaev2.o sorgqr.o slacn2.o dorgql.o ssymv.o ddot.o iladlr.o dgbsv.o ssytd2.o idamax.o spoequ.o ilaenv.o sgtts2.o slatrd.o sgttrs.o sgtcon.o dorg2l.o sgtsvx.o sorg2r.o slasr.o dlassq.o slarfb.o slascl.o dlaisnan.o ssterf.o slamch.o sgtrfs.o dgemm.o dtrmm.o spotrf2.o dorg2r.o sorg2l.o dgtsvx.o dgtcon.o dgttrs.o dlatrd.o dgtts2.o dpoequ.o dsytd2.o dpotrf2.o strmm.o sgemm.o dlamch.o dgtrfs.o dsterf.o slaisnan.o dlascl.o dlarfb.o slassq.o dlasr.o spotrf.o slarfg.o slaqgb.o dgemv.o dcopy.o stbsv.o dtrmv.o dlansy.o dgbsvx.o disnan.o dlaqsy.o dsytrd.o dgbtf2.o sgbmv.o dsyr2k.o slangb.o dgbtrs.o dgbcon.o sasum.o slaswp.o slatbs.o slasrt.o ssyev.o dgbrfs.o sgbcon.o dlangb.o sgbtrs.o isamax.o dgbmv.o ssyr2k.o sgbtf2.o ssytrd.o slaqsy.o sisnan.o sgbsvx.o iparmq.o slansy.o dtbsv.o strmv.o sgemv.o dlaqgb.o scopy.o dlarfg.o dpotrf.o sgbrfs.o dsyev.o lsame.o dlasrt.o dlaswp.o dlatbs.o dasum.o dlanst.o dtrsm.o slapy2.o dlarft.o xerbla.o srscl.o sorgtr.o sger.o dlagtm.o ilaslr.o slartg.o dgtsv.o dgttrf.o sgbequ.o ssteqr.o dorgtr.o drscl.o slarft.o strsm.o dlapy2.o slanst.o iladlc.o dsteqr.o dgbequ.o sgttrf.o sgtsv.o dlartg.o dger.o slagtm.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_lapack.a a - slabad.o a - sscal.o a - ilaslc.o a - dswap.o a - slaset.o a - slantb.o a - dlarf.o a - dnrm2.o a - dsyrk.o a - daxpy.o a - sgbsv.o a - sdot.o a - dsymv.o a - dlacn2.o a - sorgql.o a - dorgqr.o a - ieeeck.o a - slaev2.o a - dlangt.o a - ssyr2.o a - slae2.o a - sgbtrf.o a - dlacpy.o a - saxpy.o a - snrm2.o a - ssyrk.o a - slarf.o a - dlantb.o a - dlaset.o a - sswap.o a - dscal.o a - dlabad.o a - slacpy.o a - dgbtrf.o a - dlae2.o a - dsyr2.o a - slangt.o a - dlaev2.o a - sorgqr.o a - slacn2.o a - dorgql.o a - ssymv.o a - ddot.o a - iladlr.o a - dgbsv.o a - ssytd2.o a - idamax.o a - spoequ.o a - ilaenv.o a - sgtts2.o a - slatrd.o a - sgttrs.o a - sgtcon.o a - dorg2l.o a - sgtsvx.o a - sorg2r.o a - slasr.o a - dlassq.o a - slarfb.o a - slascl.o a - dlaisnan.o a - ssterf.o a - slamch.o a - sgtrfs.o a - dgemm.o a - dtrmm.o a - spotrf2.o a - dorg2r.o a - sorg2l.o a - dgtsvx.o a - dgtcon.o a - dgttrs.o a - dlatrd.o a - dgtts2.o a - dpoequ.o a - dsytd2.o a - dpotrf2.o a - strmm.o a - sgemm.o a - dlamch.o a - dgtrfs.o a - dsterf.o a - slaisnan.o a - dlascl.o a - dlarfb.o a - slassq.o a - dlasr.o a - spotrf.o a - slarfg.o a - slaqgb.o a - dgemv.o a - dcopy.o a - stbsv.o a - dtrmv.o a - dlansy.o a - dgbsvx.o a - disnan.o a - dlaqsy.o a - dsytrd.o a - dgbtf2.o a - sgbmv.o a - dsyr2k.o a - slangb.o a - dgbtrs.o a - dgbcon.o a - sasum.o a - slaswp.o a - slatbs.o a - slasrt.o a - ssyev.o a - dgbrfs.o a - sgbcon.o a - dlangb.o a - sgbtrs.o a - isamax.o a - dgbmv.o a - ssyr2k.o a - sgbtf2.o a - ssytrd.o a - slaqsy.o a - sisnan.o a - sgbsvx.o a - iparmq.o a - slansy.o a - dtbsv.o a - strmv.o a - sgemv.o a - dlaqgb.o a - scopy.o a - dlarfg.o a - dpotrf.o a - sgbrfs.o a - dsyev.o a - lsame.o a - dlasrt.o a - dlaswp.o a - dlatbs.o a - dasum.o a - dlanst.o a - dtrsm.o a - slapy2.o a - dlarft.o a - xerbla.o a - srscl.o a - sorgtr.o a - sger.o a - dlagtm.o a - ilaslr.o a - slartg.o a - dgtsv.o a - dgttrf.o a - sgbequ.o a - ssteqr.o a - dorgtr.o a - drscl.o a - slarft.o a - strsm.o a - dlapy2.o a - slanst.o a - iladlc.o a - dsteqr.o a - dgbequ.o a - sgttrf.o a - sgtsv.o a - dlartg.o a - dger.o a - slagtm.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_bugsrad cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.microphys_utils cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_parabolic cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_coamps make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/kinds.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Microphys_utils/microphys_stats_vars_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/variables_radiation_module.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Parabolic_constants.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/adjtq.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa6.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/AiryFunction.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/cloudg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa20g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa18.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa28.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/comscp1.F ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libmicrophys_utils.a microphys_stats_vars_module.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libmicrophys_utils.a a - microphys_stats_vars_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa10g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa11g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/comscp2.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa21g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa19g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmtqw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/newexp.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/cloud_correlate.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugsrad_planck.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/slope.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/adjmlt.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/frzh.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Parabolic.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugsrad_physconst.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa7.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esatv.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa12.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/gamma.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/qtadj.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa17g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/rayle.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa22.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa15.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa7g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa25.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa8g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/gascon.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/qsatvi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa19.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa9.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa27r.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esati.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa13g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa14g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmtqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa26.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa9g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/conice.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa18g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa21.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmcol.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa5g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esat_new.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa22g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa27.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa12g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_sw_bs.F cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_morrison make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Morrison_microphys/module_mp_graupel.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/two_rt_lw_sel.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_rad.F ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a adjtq.o eqa6.o eqa20g.o eqa18.o eqa28.o eqa10g.o eqa11g.o eqa21g.o eqa19g.o nrmtqw.o slope.o adjmlt.o frzh.o eqa7.o esatv.o eqa12.o gamma.o qtadj.o tgqs.o eqa17g.o eqa22.o eqa15.o eqa7g.o eqa25.o eqa8g.o qsatvi.o eqa19.o eqa9.o eqa27r.o tgqr.o esati.o eqa13g.o eqa14g.o nrmtqi.o eqa26.o eqa9g.o conice.o eqa18g.o eqa21.o nrmcol.o tgqg.o eqa5g.o esat_new.o tgqi.o eqa22g.o eqa27.o eqa12g.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a a - adjtq.o a - eqa6.o a - eqa20g.o a - eqa18.o a - eqa28.o a - eqa10g.o a - eqa11g.o a - eqa21g.o a - eqa19g.o a - nrmtqw.o a - slope.o a - adjmlt.o a - frzh.o a - eqa7.o a - esatv.o a - eqa12.o a - gamma.o a - qtadj.o a - tgqs.o a - eqa17g.o a - eqa22.o a - eqa15.o a - eqa7g.o a - eqa25.o a - eqa8g.o a - qsatvi.o a - eqa19.o a - eqa9.o a - eqa27r.o a - tgqr.o a - esati.o a - eqa13g.o a - eqa14g.o a - nrmtqi.o a - eqa26.o a - eqa9g.o a - conice.o a - eqa18g.o a - eqa21.o a - nrmcol.o a - tgqg.o a - eqa5g.o a - esat_new.o a - tgqi.o a - eqa22g.o a - eqa27.o a - eqa12g.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/BUGSrad ../src/BUGSrad/gases_ckd.F90 NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 300) 0 inform, 1 warnings, 0 severes, 0 fatal for module_mp_graupel NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5894) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5905) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5928) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5976) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5980) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6066) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6073) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6079) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6204) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6210) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6248) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6253) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6257) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_lwr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/BUGSrad/bugs_swr.F ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_parabolic.a Parabolic_constants.o AiryFunction.o Parabolic.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_parabolic.a a - Parabolic_constants.o a - AiryFunction.o a - Parabolic.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_KK_microphys make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/parameters_KK.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/text_writer.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_local_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_covar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/PDF_integrals_all_MM.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_bugsrad.a cloudg.o two_rt_lw_ocastrndm.o comscp1.o comscp2.o two_rt_lw_sel.o variables_radiation_module.o newexp.o bugs_rad.o bugsrad_planck.o bugs_lwr.o cloud_correlate.o gases_ckd.o kinds.o two_rt_lw.o two_rt_lw_iter.o bugs_swr.o two_rt_sw_ocastrndm.o bugsrad_physconst.o rayle.o gascon.o two_rt_sw_iter.o two_rt_sw.o two_rt_sw_bs.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_bugsrad.a a - cloudg.o a - two_rt_lw_ocastrndm.o a - comscp1.o a - comscp2.o a - two_rt_lw_sel.o a - variables_radiation_module.o a - newexp.o a - bugs_rad.o a - bugsrad_planck.o a - bugs_lwr.o a - cloud_correlate.o a - gases_ckd.o a - kinds.o a - two_rt_lw.o a - two_rt_lw_iter.o a - bugs_swr.o a - two_rt_sw_ocastrndm.o a - bugsrad_physconst.o a - rayle.o a - gascon.o a - two_rt_sw_iter.o a - two_rt_sw.o a - two_rt_sw_bs.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_covariances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_variances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_upscaled_turbulent_sed.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys/KK_Nrm_tendencies.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_KK_microphys.a KK_upscaled_covariances.o text_writer.o parameters_KK.o PDF_integrals_covar.o KK_upscaled_variances.o KK_upscaled_turbulent_sed.o KK_local_means.o PDF_integrals_means.o KK_Nrm_tendencies.o KK_upscaled_means.o PDF_integrals_all_MM.o KK_utilities.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_KK_microphys.a a - KK_upscaled_covariances.o a - text_writer.o a - parameters_KK.o a - PDF_integrals_covar.o a - KK_upscaled_variances.o a - KK_upscaled_turbulent_sed.o a - KK_local_means.o a - PDF_integrals_means.o a - KK_Nrm_tendencies.o a - KK_upscaled_means.o a - PDF_integrals_all_MM.o a - KK_utilities.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.silhs make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/math_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_arrays.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/transform_to_pdf_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/output_2D_samples_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/parameters_silhs.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/est_kessler_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/generate_uniform_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/lh_microphys_var_covar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_importance_sample_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a module_mp_graupel.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a a - module_mp_graupel.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_api_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a math_utilities.o lh_microphys_var_covar_module.o latin_hypercube_arrays.o latin_hypercube_driver_module.o generate_uniform_sample_module.o parameters_silhs.o silhs_api_module.o silhs_importance_sample_module.o output_2D_samples_module.o est_kessler_microphys_module.o transform_to_pdf_module.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a a - math_utilities.o a - lh_microphys_var_covar_module.o a - latin_hypercube_arrays.o a - latin_hypercube_driver_module.o a - generate_uniform_sample_module.o a - parameters_silhs.o a - silhs_api_module.o a - silhs_importance_sample_module.o a - output_2D_samples_module.o a - est_kessler_microphys_module.o a - transform_to_pdf_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_other make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/parameters_radiation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/spec_hum_to_mixing_ratio.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/time_dependent_input.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/diag_ustar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/parameters_microphys.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/cos_solar_zen_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/CLUBB_core ../src/input_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/quicksort.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/silhs_category_variance_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/hydrostatic_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_model_settings.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/extrapolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/soil_vegetation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cloud_sed_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/morrison_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/coamps_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/ice_dfsn_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/gfdl_activation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/rad_lwsw_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/mixed_moment_PDF_integrals.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/mpace_a.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/clex9_nov02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/clex9_oct14.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/jun25.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/wangara.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/sfc_flux.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/advance_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/bomex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_interpret.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/dycoms2_rf01.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/lba.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/nov11.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/microphys_init_cleanup.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/simple_rad_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_0003.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_3year.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/astex_a209.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/atex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm_97.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/dycoms2_rf02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls3.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/mpace_b.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/neutral_case.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/rico.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cobra.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/fire.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/twp_ice.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/arm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls3_night.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/cloud_feedback.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/Benchmark_cases/gabls2.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/extended_atmosphere_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/stat_file_utils.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/bugsrad_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/sounding.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/KK_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/input_fields.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/estimate_scm_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/lh_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/microphys_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_driver.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/clubb_driver.F90: 419) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/error.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src ../src/enhanced_simann.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a parameters_radiation.o rico.o cobra.o advance_microphys_module.o fire.o twp_ice.o cos_solar_zen_module.o bomex.o arm.o input_grads.o quicksort.o gabls3_night.o cloud_feedback.o gabls2.o diag_ustar_module.o estimate_scm_microphys_module.o bugsrad_driver.o lh_microphys_driver_module.o input_interpret.o stat_file_utils.o KK_microphys_module.o dycoms2_rf01.o lba.o nov11.o enhanced_simann.o jun25.o parameters_microphys.o arm_3year.o clubb_driver.o atex.o coamps_microphys_driver_module.o microphys_driver.o rad_lwsw_module.o ice_dfsn_module.o astex_a209.o arm_0003.o morrison_microphys_module.o wangara.o mpace_b.o extrapolation.o sfc_flux.o clubb_model_settings.o cloud_sed_module.o silhs_category_variance_module.o gfdl_activation.o soil_vegetation.o input_fields.o arm_97.o gabls3.o mixed_moment_PDF_integrals.o sounding.o hydrostatic_module.o microphys_init_cleanup.o error.o simple_rad_module.o mpace_a.o spec_hum_to_mixing_ratio.o neutral_case.o extended_atmosphere_module.o clex9_nov02.o time_dependent_input.o dycoms2_rf02.o input_netcdf.o clex9_oct14.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a a - parameters_radiation.o a - rico.o a - cobra.o a - advance_microphys_module.o a - fire.o a - twp_ice.o a - cos_solar_zen_module.o a - bomex.o a - arm.o a - input_grads.o a - quicksort.o a - gabls3_night.o a - cloud_feedback.o a - gabls2.o a - diag_ustar_module.o a - estimate_scm_microphys_module.o a - bugsrad_driver.o a - lh_microphys_driver_module.o a - input_interpret.o a - stat_file_utils.o a - KK_microphys_module.o a - dycoms2_rf01.o a - lba.o a - nov11.o a - enhanced_simann.o a - jun25.o a - parameters_microphys.o a - arm_3year.o a - clubb_driver.o a - atex.o a - coamps_microphys_driver_module.o a - microphys_driver.o a - rad_lwsw_module.o a - ice_dfsn_module.o a - astex_a209.o a - arm_0003.o a - morrison_microphys_module.o a - wangara.o a - mpace_b.o a - extrapolation.o a - sfc_flux.o a - clubb_model_settings.o a - cloud_sed_module.o a - silhs_category_variance_module.o a - gfdl_activation.o a - soil_vegetation.o a - input_fields.o a - arm_97.o a - gabls3.o a - mixed_moment_PDF_integrals.o a - sounding.o a - hydrostatic_module.o a - microphys_init_cleanup.o a - error.o a - simple_rad_module.o a - mpace_a.o a - spec_hum_to_mixing_ratio.o a - neutral_case.o a - extended_atmosphere_module.o a - clex9_nov02.o a - time_dependent_input.o a - dycoms2_rf02.o a - input_netcdf.o a - clex9_oct14.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_standalone cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_tuner cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.jacobian cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.G_unit_tests cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.int2txt cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_thread_test make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_standalone.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/jacobian.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrtype.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/corr_cholesky_mtx_tests.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c -I../src/CLUBB_core ../src/int2txt.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_thread_test.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nr.f90 nvfortran int2txt.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/int2txt -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrutil.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/Nc_Ncn_test.F90 nvfortran clubb_standalone.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_standalone -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/smooth_heaviside_tests.F90 nvfortran clubb_thread_test.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_thread_test -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/KK_integrals_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/hole_filling_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/read_corr_mtx_test.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/silhs_category_test.F90 nvfortran jacobian.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/jacobian -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/mu_sigma_hm_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/spurious_source_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/tuner_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/w_up_in_cloud_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/clubb_tuner.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 218) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 222) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 275) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 278) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/smooth_min_max_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_test_types/pdf_parameter_tests.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/pdf_parameter_tests.F90: 416) nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amebsa.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran_state.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amoeba.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_v.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_s.f90 nvfortran nr.o amebsa.o ran_state.o nrutil.o clubb_tuner.o ran1_v.o nrtype.o amoeba.o ran1_s.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_tuner -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -c ../src/G_unit_tests.F90 nvfortran corr_cholesky_mtx_tests.o Nc_Ncn_test.o smooth_heaviside_tests.o G_unit_tests.o pdf_parameter_tests.o hole_filling_tests.o mu_sigma_hm_tests.o spurious_source_test.o silhs_category_test.o read_corr_mtx_test.o smooth_min_max_tests.o w_up_in_cloud_tests.o KK_integrals_tests.o tuner_tests.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/G_unit_tests -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' python ../utilities/check_for_missing_threadprivate.py ../src/CLUBB_core/ ../src/SILHS/ check_for_missing_threadprivate.py has begun. [91mcheck_for_missing_threadprivate.py did not pass.[0m [91mfailedFiles = ['../src/CLUBB_core/parameters_model.F90', '../src/CLUBB_core/error_code.F90', '../src/CLUBB_core/sponge_layer_damping.F90', '../src/CLUBB_core/corr_varnce_module.F90'][0m perl ../utilities/CLUBBStandardsCheck.pl ../src/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Expected read_random_seed for end function. CLUBBStandardsCheck.pl WARNING: Endings of either program, module, subroutine, or function blocks to not match the beginning ../src/error.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/CLUBB_core/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Missing 'implicit none' statements. 'Implicit None' check FAILED! CLUBBStandardsCheck.pl Add a line containing 'implicit none' to each program, module, subroutine, and function. ../src/CLUBB_core/mt95.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/Benchmark_cases/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/KK_microphys/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/SILHS/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/G_unit_test_types/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run CPU) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + run_scripts/run_scm_all.bash -i Performing priority-cases run Running arm Running arm_97 Running atex Running bomex Running cgils_s6 Running cgils_s11 Running cgils_s12 Running dycoms2_rf01 Running dycoms2_rf01_fixed_sst Running dycoms2_rf02_ds Running dycoms2_rf02_nd Running gabls3_night Running lba Running mpace_b Running rico Running twp_ice Running wangara All cases ran to completion. + mv output cpu_1632cf1 + mkdir output [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile GPU_ACC) [Pipeline] sh + compile/clean_all.bash rm -f /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj/*.* /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj/.cppdefs /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/lib* /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_standalone /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_tuner /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_thread_test /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/int2txt /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/jacobian /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/G_unit_tests /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/mkmf_template /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/Makefile + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + compile/compile.bash -c config/linux_x86_64_nvhpc_gpu_openacc.bash ......................................................................................................................................................................... Make.clubb_lapack is ready. ................................................................................. Make.clubb_param is ready. ......................... Make.clubb_bugsrad is ready. ... Make.microphys_utils is ready. ..... Make.clubb_parabolic is ready. .............. Make.clubb_KK_microphys is ready. ................................................. Make.clubb_coamps is ready. ... Make.clubb_morrison is ready. ... Make.clubb_gfdlact is ready. ............. Make.silhs is ready. .................................................................. Make.clubb_other is ready. ... Make.clubb_standalone is ready. ... Make.clubb_thread_test is ready. ............ Make.clubb_tuner is ready. ... Make.jacobian is ready. ................ Make.G_unit_tests is ready. ... Make.int2txt is ready. cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_param cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_gfdlact make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SCM_Activation/aer_ccn_act_k.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clubb_precision.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/error_code.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mt95.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/input_names.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/model_flags.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/lapack_interfaces.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameter_indices.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stat_file_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_variables.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameters_model.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/penta_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/tridiag_lu_solver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/endian.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/code_timer_module.F90 penta_lu_solve_single_rhs_multiple_lhs: 146, Generating copyout(soln(:,:)) [if not already present] Generating create(upper_2(:,:),upper_1(:,:)) [if not already present] Generating copyin(lhs(:,:,:)) [if not already present] Generating create(lower_1(:,:),lower_2(:,:),lower_diag_invrs(:,:)) [if not already present] Generating copyin(rhs(:,:)) [if not already present] 150, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 151, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 163, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 164, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 165, !$acc loop seq 164, Generating implicit firstprivate(k) 165, Loop carried dependence of upper_1 prevents parallelization Loop carried backward dependence of upper_1 prevents vectorization Loop carried dependence of upper_2 prevents parallelization Loop carried backward dependence of upper_2 prevents vectorization 178, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 179, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 179, Generating implicit firstprivate(ndim) 199, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 200, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 206, !$acc loop seq 200, Generating implicit firstprivate(k) 206, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 213, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 214, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 217, !$acc loop seq 214, Generating implicit firstprivate(k) 217, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization tridiag_lu_solve_single_rhs_lhs: 117, Generating copyout(soln(:)) [if not already present] Generating create(upper(:)) [if not already present] Generating copyin(lhs(:,:)) [if not already present] Generating create(lower_diag_invrs(:)) [if not already present] Generating copyin(rhs(:)) [if not already present] 121, Accelerator serial kernel generated Generating NVIDIA GPU code 126, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 126, !$acc loop seq 126, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 129, Accelerator serial kernel generated Generating NVIDIA GPU code 135, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 135, !$acc loop seq 135, Loop carried backward dependence of soln prevents vectorization 139, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization Accelerator serial kernel generated Generating NVIDIA GPU code 139, !$acc loop seq 139, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/constants_clubb.F90 tridiag_lu_solve_single_rhs_multiple_lhs: 184, Generating create(upper(:,:)) [if not already present] Generating copyout(soln(:,:)) [if not already present] Generating copyin(lhs(:,:,:)) [if not already present] Generating create(lower_diag_invrs(:,:)) [if not already present] Generating copyin(rhs(:,:)) [if not already present] 188, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 189, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 195, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 196, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 197, !$acc loop seq 196, Generating implicit firstprivate(k) 197, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 204, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 205, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 205, Generating implicit firstprivate(ndim) 211, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 212, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 216, !$acc loop seq 212, Generating implicit firstprivate(k) 216, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 222, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 223, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 224, !$acc loop seq 223, Generating implicit firstprivate(k) 224, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization penta_lu_solve_multiple_rhs_lhs: 268, Generating copyout(soln(:,:,:)) [if not already present] Generating create(upper_2(:,:),upper_1(:,:)) [if not already present] Generating copyin(lhs(:,:,:)) [if not already present] Generating create(lower_1(:,:),lower_2(:,:),lower_diag_invrs(:,:)) [if not already present] Generating copyin(rhs(:,:,:)) [if not already present] 272, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 273, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 285, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 286, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 287, !$acc loop seq 286, Generating implicit firstprivate(k) 287, Loop carried dependence of upper_1 prevents parallelization Loop carried backward dependence of upper_1 prevents vectorization Loop carried dependence of upper_2 prevents parallelization Loop carried backward dependence of upper_2 prevents vectorization 300, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 301, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 301, Generating implicit firstprivate(ndim) 321, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 322, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 323, ! blockidx%x threadidx%x collapsed 329, !$acc loop seq 323, Generating implicit firstprivate(k) 329, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 337, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 338, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 339, ! blockidx%x threadidx%x collapsed 342, !$acc loop seq 339, Generating implicit firstprivate(k) 342, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/array_index.F90 tridiag_lu_solve_multiple_rhs_lhs: 272, Generating create(upper(:,:)) [if not already present] Generating copyout(soln(:,:,:)) [if not already present] Generating copyin(lhs(:,:,:)) [if not already present] Generating create(lower_diag_invrs(:,:)) [if not already present] Generating copyin(rhs(:,:,:)) [if not already present] 276, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 277, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 283, Generating implicit firstprivate(ndim,ngrdcol) Generating NVIDIA GPU code 284, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 285, !$acc loop seq 284, Generating implicit firstprivate(k) 285, Loop carried dependence of upper prevents parallelization Loop carried backward dependence of upper prevents vectorization 292, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 293, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 293, Generating implicit firstprivate(ndim) 299, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 300, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 301, ! blockidx%x threadidx%x collapsed 305, !$acc loop seq 301, Generating implicit firstprivate(k) 305, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization 312, Generating implicit firstprivate(ndim,nrhs,ngrdcol) Generating NVIDIA GPU code 313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 314, ! blockidx%x threadidx%x collapsed 315, !$acc loop seq 314, Generating implicit firstprivate(k) 315, Loop carried dependence of soln prevents parallelization Loop carried backward dependence of soln prevents vectorization nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_type.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/saturation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/T_in_K_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_gfdlact.a aer_ccn_act_k.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_gfdlact.a a - aer_ccn_act_k.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/lapack_wrap.F90 thlm2t_in_k_2d: 140, Generating copyin(rcm(:,:),thlm(:,:),exner(:,:)) [if not already present] 143, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 144, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 145, ! blockidx%x threadidx%x collapsed sat_mixrat_liq_k: 90, Generating acc routine seq Generating NVIDIA GPU code sat_mixrat_liq_2d: 367, Generating create(esat(:,:)) [if not already present] Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present] 382, Generating implicit firstprivate(ngrdcol,nz,start_index) Generating NVIDIA GPU code 383, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 384, ! blockidx%x threadidx%x collapsed 384, Generating implicit firstprivate(t_in_c_sqd,t_in_c) 437, Generating implicit firstprivate(ngrdcol,nz,start_index) Generating NVIDIA GPU code 438, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 439, ! blockidx%x threadidx%x collapsed 451, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 452, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 453, ! blockidx%x threadidx%x collapsed 453, Generating implicit firstprivate(t_in_k_clipped) 478, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 479, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 480, ! blockidx%x threadidx%x collapsed 480, Generating implicit firstprivate(t_in_k_int) 500, Generating implicit firstprivate(ngrdcol,start_index,nz) Generating NVIDIA GPU code 501, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 502, ! blockidx%x threadidx%x collapsed sat_mixrat_ice_2d: 954, Generating create(esat_ice(:,:)) [if not already present] Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present] 963, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 964, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 965, ! blockidx%x threadidx%x collapsed 978, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 979, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 980, ! blockidx%x threadidx%x collapsed 980, Generating implicit firstprivate(t_in_c) 1007, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1008, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1009, ! blockidx%x threadidx%x collapsed 1009, Generating implicit firstprivate(t_in_k_clipped) 1037, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1038, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1039, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/Skx_module.F90 skx_func: 73, Generating create(skx_denom_tol(:)) [if not already present] Generating copyin(xp2(:,:),xp3(:,:)) [if not already present] Generating copyout(skx(:,:)) [if not already present] Generating copyin(clubb_params(:,:)) [if not already present] 77, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 78, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 78, Generating implicit firstprivate(x_tol) 86, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 87, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 88, ! blockidx%x threadidx%x collapsed lg_2005_ansatz: 173, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 174, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 175, ! blockidx%x threadidx%x collapsed 173, Generating default present(skw(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),beta(:ngrdcol),skx(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),xp2(:ngrdcol,:nz),wp2(:ngrdcol,:nz)) 175, Generating implicit firstprivate(x_tol,nrmlzd_skw,nrmlzd_corr_wx) xp3_lg_2005_ansatz: 249, Generating copyin(sigma_sqd_w_zt(:,:),wp2_zt(:,:)) [if not already present] Generating create(skx_zt(:,:)) [if not already present] Generating copyin(wpxp_zt(:,:)) [if not already present] Generating create(skx_denom_tol(:)) [if not already present] Generating copyin(skw_zt(:,:),xp2_zt(:,:)) [if not already present] Generating copyout(xp3(:,:)) [if not already present] 258, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 259, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 258, Generating default present(clubb_params(:ngrdcol,73)) 259, Generating implicit firstprivate(x_tol) 266, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 267, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 268, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sigma_sqd_w_module.F90 compute_sigma_sqd_w: 97, Generating enter data create(max_corr_w_x_sqd(:,:)) 108, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 109, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 110, ! blockidx%x threadidx%x collapsed 108, Generating default present(rtp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 120, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 121, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 122, ! blockidx%x threadidx%x collapsed 120, Generating default present(max_corr_w_x_sqd(:ngrdcol,:nzm),up2(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm)) 134, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 135, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 136, ! blockidx%x threadidx%x collapsed 134, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm)) 142, Generating exit data delete(max_corr_w_x_sqd(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calendar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calc_roots.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_hybrid_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_tsdadg_pdf.F90 calc_comp_corrs_binormal: 868, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 869, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 870, ! blockidx%x threadidx%x collapsed 868, Generating default present(corr_x_y_1(:ngrdcol,:nz),mu_y_2(:ngrdcol,:nz),sigma_x_2_sqd(:ngrdcol,:nz),sigma_x_1_sqd(:ngrdcol,:nz),sigma_y_1_sqd(:ngrdcol,:nz),xm(:ngrdcol,:nz),mu_x_2(:ngrdcol,:nz),ym(:ngrdcol,:nz),xpyp(:ngrdcol,:nz),corr_x_y_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),sigma_y_2_sqd(:ngrdcol,:nz),mu_y_1(:ngrdcol,:nz),mu_x_1(:ngrdcol,:nz)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/LY93_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/Nc_Ncn_eqns.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/diagnose_correlations_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/interpolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/matrix_operations.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/hydromet_pdf_parameter_module.F90 pvertinterp: 544, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 545, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 544, Generating default present(p_mid(:ngrdcol,:),interp_var(:ngrdcol),input_var(:ngrdcol,:)) 545, Generating implicit firstprivate(p_out,l_found,k_upper,k,dpu,dpl) 564, Accelerator restriction: induction variable live-out from loop: k 569, Accelerator restriction: induction variable live-out from loop: k nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/file_functions.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_parameter_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_type_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/output_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/adg1_adg2_3d_luhar_pdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/input_reader.F90 adg1_pdf_driver: 152, Generating enter data create(w_1_n(:,:),w_2_n(:,:)) 209, Generating exit data delete(w_2_n(:,:),w_1_n(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/grid_class.F90 adg1_w_closure: 660, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 661, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 662, ! blockidx%x threadidx%x collapsed 660, Generating default present(wp2(:ngrdcol,:nz),wm(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),w_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),skw(:ngrdcol,:nz),w_2_n(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) 662, Generating implicit firstprivate(mixt_frac_max_mag) adg1_adg2_responder_params: 1116, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1117, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1118, ! blockidx%x threadidx%x collapsed 1116, Generating default present(wp2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),alpha_x(:ngrdcol,:nz),beta(:ngrdcol),w_2_n(:ngrdcol,:nz),xm(:ngrdcol,:nz),xp2(:ngrdcol,:nz),x_2(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),x_1(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz)) 1118, Generating implicit firstprivate(x_tol,width_factor_1) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_rad_zm_module.F90 linear_interpolated_azm_2d: 1544, Generating copyin(azt(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:)) [if not already present] Generating copyout(linear_interpolated_azm(:,:)) [if not already present] Generating copyin(gr%zt(:,:)) [if not already present] 1547, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1548, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1556, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1557, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1558, ! blockidx%x threadidx%x collapsed 1565, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1566, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1566, Generating implicit firstprivate(nzt,nzm) 1591, Generating copyin(zm_min) [if not already present] Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1592, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1593, ! blockidx%x threadidx%x collapsed zt2zm2zt: 1648, Generating create(azt_zm(:,:)) [if not already present] Generating copyin(azt(:,:)) [if not already present] zm2zt2zm: 1706, Generating create(azm_zt(:,:)) [if not already present] Generating copyin(azm(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_rad_zt_module.F90 linear_interpolated_azt_2d: 2118, Generating copyin(azm(:,:),gr,gr%zm(:,:),gr%weights_zm2zt(:,:,:)) [if not already present] Generating copyout(linear_interpolated_azt(:,:)) [if not already present] Generating copyin(gr%zt(:,:)) [if not already present] 2124, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2125, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2126, ! blockidx%x threadidx%x collapsed 2134, Generating copyin(zt_min) [if not already present] Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2135, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2136, ! blockidx%x threadidx%x collapsed gradzm_2d: 2420, Generating copyin(azm(:,:),gr%invrs_dzt(:,:),gr) [if not already present] 2424, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2425, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2426, ! blockidx%x threadidx%x collapsed gradzt_2d: 2518, Generating copyin(azt(:,:),gr%invrs_dzm(:,:),gr) [if not already present] 2522, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2523, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2524, ! blockidx%x threadidx%x collapsed 2536, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2537, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2537, Generating implicit firstprivate(nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_zm_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/matrix_solver_wrapper.F90 band_solve_single_rhs_multiple_lhs: 108, Generating update self(lhs(:,:,:),rhs(:,:)) 121, Generating update device(rcond(:)) 128, Generating update self(rhs(:,:),lhs(:,:,:)) 136, Generating update device(soln(:,:)) band_solve_multiple_rhs_lhs: 220, Generating update self(lhs(:,:,:),rhs(:,:,:)) 233, Generating update device(rcond(:)) 240, Generating update self(rhs(:,:,:),lhs(:,:,:)) 248, Generating update device(soln(:,:,:)) tridiag_solve_single_rhs_multiple_lhs: 432, Generating update self(lhs(:,:,:),rhs(:,:)) 443, Generating update device(rcond(:)) 450, Generating update self(rhs(:,:),lhs(:,:,:)) 457, Generating update device(soln(:,:)) tridiag_solve_multiple_rhs_lhs: 538, Generating update self(lhs(:,:,:),rhs(:,:,:)) 549, Generating update device(rcond(:)) 556, Generating update self(rhs(:,:,:),lhs(:,:,:)) 563, Generating update device(soln(:,:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_lh_zt_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_lh_sfc_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/precipitation_fraction.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/corr_varnce_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/parameters_tunable.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sponge_layer_damping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_helper_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mean_adv.F90 term_ma_zt_lhs: 191, Generating copyin(wm_zt(:,:),weights_zt2zm(:,:,:),invrs_dzm(:,:)) [if not already present] Generating copyout(lhs_ma(:,:,:)) [if not already present] Generating copyin(invrs_dzt(:,:)) [if not already present] 197, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 198, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 199, ! blockidx%x threadidx%x collapsed 220, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 221, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 221, Generating implicit firstprivate(nzt,nzm) 240, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 241, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 259, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 260, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 261, ! blockidx%x threadidx%x collapsed 291, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 292, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 292, Generating implicit firstprivate(nzt,nzm) 320, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 321, !$acc loop gang, vector(128) ! blockidx%x threadidx%x term_ma_zm_lhs: 455, Generating copyin(wm_zm(:,:),weights_zm2zt(:,:,:)) [if not already present] Generating copyout(lhs_ma(:,:,:)) [if not already present] Generating copyin(invrs_dzm(:,:)) [if not already present] 459, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 460, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 461, ! blockidx%x threadidx%x collapsed 468, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 469, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 470, ! blockidx%x threadidx%x collapsed 487, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 488, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 489, ! blockidx%x threadidx%x collapsed 489, Generating implicit firstprivate(nzm) calc_stability_correction: 309, Generating enter data create(brunt_vaisala_freq_sqd_smth(:,:),lambda0_stability(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:)) 327, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 328, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 329, ! blockidx%x threadidx%x collapsed 327, Generating default present(lambda0_stability_coef(:ngrdcol),lambda0_stability(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm)) 339, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 340, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 341, ! blockidx%x threadidx%x collapsed 339, Generating default present(stability_correction(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm),em(:ngrdcol,:nzm),lambda0_stability(:ngrdcol,:nzm)) 349, Generating exit data delete(lambda0_stability(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:)) calc_brunt_vaisala_freq_sqd: 473, Generating copyin(exner(:,:),gr) [if not already present] Generating create(t_in_k_zm(:,:),ddzt_thvm(:,:),rsat_zm(:,:)) [if not already present] Generating copyin(p_in_pa(:,:)) [if not already present] Generating create(ice_supersat_frac_zm(:,:),thm_zm(:,:)) [if not already present] Generating copyin(gr%zt(:,:)) [if not already present] Generating copyout(brunt_vaisala_freq_sqd_smth(:,:)) [if not already present] Generating create(brunt_vaisala_freq_clipped(:,:)) [if not already present] Generating copyout(brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_moist(:,:)) [if not already present] Generating copyin(rtm(:,:)) [if not already present] Generating create(t_in_k(:,:)) [if not already present] Generating copyin(rcm(:,:)) [if not already present] Generating create(rsat(:,:)) [if not already present] Generating copyin(thlm(:,:)) [if not already present] Generating create(thm(:,:),ddzt_rtm(:,:),ddzt_thlm(:,:)) [if not already present] Generating copyin(bv_efold(:)) [if not already present] Generating create(ddzt_rsat(:,:),thvm_zm(:,:)) [if not already present] Generating copyin(thvm(:,:)) [if not already present] Generating create(ddzt_thm(:,:)) [if not already present] Generating copyin(ice_supersat_frac(:,:)) [if not already present] 482, Generating enter data create(tmp_calc(:,:)) 492, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 493, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 494, ! blockidx%x threadidx%x collapsed 502, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 503, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 504, ! blockidx%x threadidx%x collapsed 504, Generating implicit firstprivate(t0) 518, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 519, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 520, ! blockidx%x threadidx%x collapsed 530, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 531, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 532, ! blockidx%x threadidx%x collapsed 538, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 539, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 540, ! blockidx%x threadidx%x collapsed 554, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 555, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 556, ! blockidx%x threadidx%x collapsed 592, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 593, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 594, ! blockidx%x threadidx%x collapsed 613, Generating exit data delete(tmp_calc(:,:)) compute_cx_fnc_richardson: 742, Generating enter data create(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm(:,:),fnc_richardson_smooth(:,:)) 758, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 759, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 760, ! blockidx%x threadidx%x collapsed 758, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm),ri_zm(:ngrdcol,:nzm)) 773, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 774, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 775, ! blockidx%x threadidx%x collapsed 773, Generating default present(clubb_params(:ngrdcol,96:97),fnc_richardson(:ngrdcol,:nzm),ri_zm(:ngrdcol,:nzm)) 775, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max) 795, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 796, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 797, ! blockidx%x threadidx%x collapsed 795, Generating default present(clubb_params(:ngrdcol,94:95),fnc_richardson_smooth(:ngrdcol,:nzm),cx_fnc_interp(:ngrdcol,:nzm)) 797, Generating implicit firstprivate(cx_min,cx_max) 810, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 811, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 812, ! blockidx%x threadidx%x collapsed 810, Generating default present(clubb_params(:ngrdcol,94:97),ri_zm(:ngrdcol,:nzm),cx_fnc_richardson(:ngrdcol,:nzm)) 812, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max,cx_max,cx_min) 846, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 847, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 848, ! blockidx%x threadidx%x collapsed 846, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm)) 854, Generating exit data delete(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm(:,:),fnc_richardson_smooth(:,:)) calc_ri_zm: 899, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 900, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 901, ! blockidx%x threadidx%x collapsed 899, Generating default present(bv_freq_sqd(:ngrdcol,:nzm),shear(:ngrdcol,:nzm),ri_zm(:ngrdcol,:nzm)) 901, Generating implicit firstprivate(lim_shear,lim_bv) lscale_width_vert_avg: 973, Generating enter data create(denom_terms(:,:),numer_terms(:,:),one_half_avg_width(:,:)) 976, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 977, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 978, ! blockidx%x threadidx%x collapsed 976, Generating default present(lscale_zm(:ngrdcol,:nzm),one_half_avg_width(:ngrdcol,:nzm)) 983, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 984, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 985, ! blockidx%x threadidx%x collapsed 983, Generating default present(one_half_avg_width(:ngrdcol,:nzm)) 992, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 993, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 994, ! blockidx%x threadidx%x collapsed 992, Generating default present(gr%dzm(1:ngrdcol,1:nzm),numer_terms(:ngrdcol,:nzm),denom_terms(:ngrdcol,:nzm),gr,var_profile(:ngrdcol,:nzm),rho_ds_zm(:ngrdcol,:nzm)) 1001, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1002, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1003, ! blockidx%x threadidx%x collapsed 1061, !$acc loop seq Generating implicit reduction(+:numer_integral,denom_integral) 1001, Generating default present(gr%zm(1:ngrdcol,:),denom_terms(:ngrdcol,:),gr,one_half_avg_width(:ngrdcol,:nzm),numer_terms(:ngrdcol,:)) 1003, Generating implicit firstprivate(k_avg_lower,k_avg,n_below_ground_levels,k_avg_upper,var_below_ground_value,numer_integral,denom_integral) 1023, Accelerator restriction: induction variable live-out from loop: k_avg_upper 1026, Accelerator restriction: induction variable live-out from loop: k_avg_upper 1030, Accelerator restriction: induction variable live-out from loop: k_avg_lower 1033, Accelerator restriction: induction variable live-out from loop: k_avg_lower 1061, Loop is parallelizable 1073, Generating exit data delete(denom_terms(:,:),one_half_avg_width(:,:),numer_terms(:,:)) wp2_term_splat_lhs: 1131, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_smooth(:,:)) 1133, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1134, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1135, ! blockidx%x threadidx%x collapsed 1133, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm)) 1145, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1146, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1147, ! blockidx%x threadidx%x collapsed 1145, Generating default present(lhs_splat_wp2(:ngrdcol,:nzm),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_smooth(:ngrdcol,:nzm)) 1153, Generating exit data delete(brunt_vaisala_freq_splat_smooth(:,:),brunt_vaisala_freq_splat_clipped(:,:)) wp3_term_splat_lhs: 1214, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_clipped_zt(:,:)) 1216, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1217, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1218, ! blockidx%x threadidx%x collapsed 1216, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm)) 1228, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1229, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1230, ! blockidx%x threadidx%x collapsed 1228, Generating default present(lhs_splat_wp3(:ngrdcol,:nzt),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_clipped_zt(:ngrdcol,:nzt)) 1237, Generating exit data delete(brunt_vaisala_freq_splat_clipped_zt(:,:),brunt_vaisala_freq_splat_clipped(:,:)) smooth_min_sclr_idx: 1285, Generating copyin(input_var2(:,:)) [if not already present] 1288, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1289, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1290, ! blockidx%x threadidx%x collapsed 1290, Generating implicit firstprivate(smth_coef,input_var1) smooth_min_array_scalar: 1345, Generating copyin(input_var1(:,:)) [if not already present] 1348, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1349, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1350, ! blockidx%x threadidx%x collapsed 1350, Generating implicit firstprivate(smth_coef,input_var2) smooth_min_arrays: 1405, Generating copyin(input_var1(:,:),input_var2(:,:)) [if not already present] 1408, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1409, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1410, ! blockidx%x threadidx%x collapsed 1410, Generating implicit firstprivate(smth_coef) smooth_max_sclr_idx: 1504, Generating copyin(input_var2(:,:)) [if not already present] 1507, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1508, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1509, ! blockidx%x threadidx%x collapsed 1509, Generating implicit firstprivate(smth_coef,input_var1) smooth_max_array_scalar: 1564, Generating copyin(input_var1(:,:)) [if not already present] 1567, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1568, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1569, ! blockidx%x threadidx%x collapsed 1569, Generating implicit firstprivate(smth_coef,input_var2) smooth_max_array_1d_scalar: 1623, Generating copyin(input_var1(:)) [if not already present] 1626, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1627, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1627, Generating implicit firstprivate(smth_coef,input_var2) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/turbulent_adv_pdf.F90 smooth_max_arrays: 1681, Generating copyin(input_var1(:,:),input_var2(:,:)) [if not already present] 1684, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1685, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1686, ! blockidx%x threadidx%x collapsed 1686, Generating implicit firstprivate(smth_coef) smooth_heaviside_peskin: 1782, Generating copyin(input(:,:)) [if not already present] 1785, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1786, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1787, ! blockidx%x threadidx%x collapsed 1787, Generating implicit firstprivate(smth_range,input_over_smth_range) calc_xpwp_2d: 1898, Generating copyin(gr,gr%invrs_dzm(:,:),km_zm(:,:)) [if not already present] Generating copyout(xpwp(:,:)) [if not already present] Generating copyin(xm(:,:)) [if not already present] 1902, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1903, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1904, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/diffusion.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pos_definite_module.F90 xpyp_term_ta_pdf_lhs: 371, Generating copyin(coef_wpxpyp_implicit_zm(:,:),gr%invrs_dzt(:,:),gr,gr%invrs_dzm(:,:),rho_ds_zm(:,:),gr%weights_zm2zt(:,:,:),sgn_turbulent_vel(:,:),rho_ds_zt(:,:),coef_wpxpyp_implicit(:,:)) [if not already present] Generating copyout(lhs_ta(:,:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present] 378, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 379, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 380, ! blockidx%x threadidx%x collapsed 389, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 390, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 391, ! blockidx%x threadidx%x collapsed 420, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 421, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 422, ! blockidx%x threadidx%x collapsed 467, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 468, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 469, ! blockidx%x threadidx%x collapsed 469, Generating implicit firstprivate(nzm) xpyp_term_ta_pdf_lhs_godunov: 543, Generating copyin(coef_wpxpyp_implicit(:,:),gr,gr%invrs_dzm(:,:),rho_ds_zm(:,:)) [if not already present] Generating copyout(lhs_ta(:,:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present] 548, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 549, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 550, ! blockidx%x threadidx%x collapsed 557, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 558, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 559, ! blockidx%x threadidx%x collapsed 581, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 582, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 583, ! blockidx%x threadidx%x collapsed 583, Generating implicit firstprivate(nzm) diffusion_zt_lhs: 310, Generating create(drhokdz_zt(:,:)) [if not already present] Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt(:,:)) [if not already present] Generating create(k_zm_nu(:,:)) [if not already present] Generating copyin(nu(:),gr%invrs_dzt(:,:)) [if not already present] Generating create(lhs_upwind(:,:,:)) [if not already present] Generating copyin(k_zt(:,:)) [if not already present] Generating copyout(lhs(:,:,:)) [if not already present] Generating create(ddzm_rho_k_zm_nu(:,:)) [if not already present] Generating copyin(k_zm(:,:)) [if not already present] Generating create(rho_k_zm_nu(:,:)) [if not already present] Generating copyin(rho_ds_zm(:,:)) [if not already present] 315, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 316, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 317, ! blockidx%x threadidx%x collapsed 394, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 395, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 435, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 436, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 437, ! blockidx%x threadidx%x collapsed 491, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 492, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 492, Generating implicit firstprivate(nzt,nzm) xpyp_term_ta_pdf_rhs: 893, Generating copyin(gr,gr%invrs_dzm(:,:),sgn_turbulent_vel(:,:),rho_ds_zm(:,:),gr%invrs_dzt(:,:)) [if not already present] Generating copyout(rhs_ta(:,:)) [if not already present] Generating copyin(term_wpxpyp_explicit_zm(:,:),term_wpxpyp_explicit(:,:),invrs_rho_ds_zm(:,:),rho_ds_zt(:,:)) [if not already present] 900, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 901, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 909, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 910, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 911, ! blockidx%x threadidx%x collapsed 925, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 926, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 927, ! blockidx%x threadidx%x collapsed 956, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 957, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 957, Generating implicit firstprivate(nzm) xpyp_term_ta_pdf_rhs_godunov: 1026, Generating copyin(gr,sgn_turbulent_vel(:,:),term_wpxpyp_explicit_zm(:,:),gr%invrs_dzm(:,:)) [if not already present] Generating copyout(rhs_ta(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:),rho_ds_zm(:,:)) [if not already present] 1032, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1033, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1038, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1039, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1040, ! blockidx%x threadidx%x collapsed 1056, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1057, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1057, Generating implicit firstprivate(nzm) diffusion_zm_lhs: 816, Generating create(drhokdz_zm(:,:)) [if not already present] Generating copyin(gr%invrs_dzm(:,:),gr,invrs_rho_ds_zm(:,:),k_zm(:,:),nu(:),gr%invrs_dzt(:,:)) [if not already present] Generating create(lhs_upwind(:,:,:)) [if not already present] Generating copyin(k_zt(:,:)) [if not already present] Generating copyout(lhs(:,:,:)) [if not already present] Generating create(ddzt_rho_k_zt_nu(:,:)) [if not already present] Generating copyin(rho_ds_zt(:,:)) [if not already present] Generating create(rho_k_zt_nu(:,:)) [if not already present] 821, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 822, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 823, ! blockidx%x threadidx%x collapsed 832, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 833, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 834, ! blockidx%x threadidx%x collapsed 842, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 843, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 851, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 852, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 853, ! blockidx%x threadidx%x collapsed 867, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 868, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 868, Generating implicit firstprivate(nzt,nzm) 883, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 884, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 924, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 925, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 926, ! blockidx%x threadidx%x collapsed 980, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 981, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 981, Generating implicit firstprivate(nzt,nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/index_mapping.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/calc_pressure.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/output_netcdf.F90 calculate_thvm: 232, Generating copyin(rtm(:,:),rcm(:,:),exner(:,:),thlm(:,:)) [if not already present] Generating copyout(thvm(:,:)) [if not already present] Generating copyin(thv_ds_zt(:,:)) [if not already present] 236, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 237, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 238, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/fill_holes.F90 fill_holes_vertical: 127, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 129, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_field_below_threshold) 130, ! blockidx%x threadidx%x collapsed 127, Generating default present(field(:ngrdcol,:nz)) Generating implicit copy(l_field_below_threshold) [if not already present] 130, Generating implicit firstprivate(threshold) 143, Generating enter data create(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),numer_integral_global(:),rho_ds_dz(:,:),field_avg_global(:),field_clipped(:,:)) 147, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 148, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 149, ! blockidx%x threadidx%x collapsed 147, Generating default present(rho_ds(:ngrdcol,:nz),rho_ds_dz(:ngrdcol,:nz),dz(:ngrdcol,:nz)) 158, Generating implicit firstprivate(ngrdcol,upper_hf_level,lower_hf_level) Generating NVIDIA GPU code 159, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 160, ! blockidx%x threadidx%x collapsed 170, !$acc loop seq Generating implicit reduction(+:rho_k_sum) 158, Generating default present(rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2)) 160, Generating implicit firstprivate(j,rho_k_sum) 170, Loop is parallelizable 179, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 180, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 189, !$acc loop seq 198, !$acc loop seq Generating implicit reduction(+:field$r1) 204, !$acc loop seq 208, !$acc loop seq 214, !$acc loop seq Generating implicit reduction(+:rho_ds_dz$r) 225, !$acc loop seq 179, Generating default present(field(:ngrdcol,:),field_clipped(:ngrdcol,:),rho_ds_dz(:ngrdcol,:),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2)) 189, Loop carried dependence of field,field_clipped prevents parallelization Loop carried backward dependence of field_clipped,field prevents vectorization Generating implicit firstprivate(k_end,field_clipped_avg,threshold,mass_fraction,field_avg,k_start) Loop carried dependence of field,field_clipped prevents parallelization Loop carried backward dependence of field_clipped prevents vectorization Loop carried dependence of field_clipped prevents parallelization 198, Loop is parallelizable 204, Loop is parallelizable 208, Loop is parallelizable 214, Loop is parallelizable 225, Loop is parallelizable 238, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 240, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_field_below_threshold) 241, ! blockidx%x threadidx%x collapsed 238, Generating default present(field(:ngrdcol,:nz)) Generating implicit copy(l_field_below_threshold) [if not already present] 241, Generating implicit firstprivate(threshold) 251, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:)) 264, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 265, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 264, Generating default present(numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol)) 271, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 272, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 273, !$acc loop seq 271, Generating default present(field(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol)) 273, Complex loop carried dependence of numer_integral_global prevents parallelization Loop carried dependence of numer_integral_global prevents parallelization Loop carried backward dependence of numer_integral_global prevents vectorization Complex loop carried dependence of denom_integral_global prevents parallelization Loop carried dependence of denom_integral_global prevents parallelization Loop carried backward dependence of denom_integral_global prevents vectorization 282, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level) Generating NVIDIA GPU code 283, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 292, !$acc loop seq 297, !$acc loop seq 282, Generating default present(field_avg_global(:ngrdcol),denom_integral_global(:ngrdcol),field(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level)) 283, Generating implicit firstprivate(threshold) 292, Loop is parallelizable 297, Loop is parallelizable 305, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level) Generating NVIDIA GPU code 306, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 308, !$acc loop seq 305, Generating default present(field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol)) 308, Complex loop carried dependence of numer_integral_global prevents parallelization Loop carried reuse of numer_integral_global prevents parallelization 314, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level) Generating NVIDIA GPU code 315, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 334, !$acc loop seq 314, Generating default present(denom_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),field(:ngrdcol,lower_hf_level:upper_hf_level),field_avg_global(:ngrdcol),numer_integral_global(:ngrdcol),mass_fraction_global(:ngrdcol)) 315, Generating implicit firstprivate(threshold,field_clipped_avg) 334, Loop is parallelizable 343, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:)) fill_holes_driver: 848, Generating copyin(gr,rho_ds_zt(:)) [if not already present] Generating copy(hydromet(:,i)) [if not already present] Generating copyin(gr%dzt(:,:)) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mono_flux_limiter.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clip_explicit.F90 clip_covars_denom: 156, Generating enter data create(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:)) 157, Generating enter data create(wpsclrp_chnge(:,:,:)) 414, Generating exit data delete(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:)) 415, Generating exit data delete(wpsclrp_chnge(:,:,:)) clip_covar: 566, Generating update self(xpyp(:,:)) 599, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 600, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 601, ! blockidx%x threadidx%x collapsed 599, Generating default present(xp2(:ngrdcol,2:nzm-1),yp2(:ngrdcol,2:nzm-1),xpyp_chnge(:ngrdcol,2:nzm-1),xpyp(:ngrdcol,2:nzm-1)) 601, Generating implicit firstprivate(xpyp_bound,max_mag_corr) 629, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 630, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 629, Generating default present(xpyp_chnge(:ngrdcol,:)) 630, Generating implicit firstprivate(nzm) 638, Generating update self(xpyp(:,:)) clip_variance: 929, Generating copy(xp2(:,:)) [if not already present] Generating copyin(threshold(:,:)) [if not already present] 949, Generating update self(xp2(:,:)) 967, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 968, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 969, ! blockidx%x threadidx%x collapsed 978, Generating update self(xp2(:,:)) clip_skewness: 1093, Generating copyin(gr,gr%zt(:,:),sfc_elevation(:)) [if not already present] Generating copy(wp3(:,:)) [if not already present] Generating copyin(wp2_zt(:,:)) [if not already present] 1099, Generating update self(wp3(:,:)) 1114, Generating update self(wp3(:,:)) clip_skewness_core: 1184, Generating enter data create(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:)) 1203, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1204, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1205, ! blockidx%x threadidx%x collapsed 1203, Generating default present(wp2_zt(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt)) 1214, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1215, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1216, ! blockidx%x threadidx%x collapsed 1214, Generating default present(sfc_elevation(:ngrdcol),zagl_thresh(:ngrdcol,:nzt),gr%zt(1:ngrdcol,1:nzt),gr) 1226, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1227, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1228, ! blockidx%x threadidx%x collapsed 1226, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt),skw_max_mag(:ngrdcol),h_zagl(:ngrdcol,:nzt)) 1239, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1240, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1241, ! blockidx%x threadidx%x collapsed 1239, Generating default present(gr%zt(1:ngrdcol,1:nzt),gr,skw_max_mag(:ngrdcol),sfc_elevation(:ngrdcol),wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt)) 1259, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1260, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1261, ! blockidx%x threadidx%x collapsed 1259, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1272, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1273, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1274, ! blockidx%x threadidx%x collapsed 1272, Generating default present(wp3(:ngrdcol,:nzt)) 1282, Generating exit data delete(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:)) monotonic_turbulent_flux_limit: 456, Generating enter data create(xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_adjustment_needed(:),wpxp_mfl_max(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min(:,:),xm_mfl(:,:),wpxp_net_adjust(:,:),xp2_zt(:,:),xm_without_ta(:,:)) 486, Generating update self(wpxp(:,:),xm(:,:)) 495, Generating update self(xm(:,:),xm_old(:,:),wpxp(:,:)) 505, Generating update self(xm(:,:),xm_old(:,:),wpxp(:,:)) 517, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 518, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 519, ! blockidx%x threadidx%x collapsed 517, Generating default present(wpxp_net_adjust(:ngrdcol,:nzm)) 526, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 527, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 528, ! blockidx%x threadidx%x collapsed 526, Generating default present(xm_enter_mfl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt)) 544, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 545, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 546, ! blockidx%x threadidx%x collapsed 544, Generating default present(xp2_zt(:ngrdcol,:nzt)) 546, Generating implicit firstprivate(xp2_threshold,max_xp2) 555, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 556, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 557, ! blockidx%x threadidx%x collapsed 555, Generating default present(xp2_zt(:ngrdcol,:nzt),xm_without_ta(:ngrdcol,:nzt),min_x_allowable_lev(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt),xm_old(:ngrdcol,:nzt),max_x_allowable_lev(:ngrdcol,:nzt)) 557, Generating implicit firstprivate(xm_tol,solve_type,dt,max_dev) 620, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 621, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 622, ! blockidx%x threadidx%x collapsed 630, !$acc loop seq Generating implicit reduction(min:min_tmp) Generating implicit reduction(max:max_tmp) 620, Generating default present(low_lev_effect(:ngrdcol,:nzt-1),max_x_allowable_lev(:ngrdcol,:),min_x_allowable_lev(:ngrdcol,:),min_x_allowable(:ngrdcol,:nzt-1),max_x_allowable(:ngrdcol,:nzt-1),high_lev_effect(:ngrdcol,:nzt-1)) 622, Generating implicit firstprivate(j,min_tmp,max_tmp,low_lev,high_lev) 630, Loop is parallelizable 642, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 643, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 644, ! blockidx%x threadidx%x collapsed 642, Generating default present(wpxp_mfl_max(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),min_x_allowable(:ngrdcol,:nzm-2),rho_ds_zm(:ngrdcol,:nzm-2),gr%invrs_dzt(1:ngrdcol,1:nzm-2),gr,max_x_allowable(:ngrdcol,:nzm-2),xm_without_ta(:ngrdcol,:nzm-2),wpxp_net_adjust(:ngrdcol,2:nzm-1),rho_ds_zt(:ngrdcol,:nzm-2),wpxp(:ngrdcol,:nzm-1),wpxp_mfl_min(:ngrdcol,2:nzm-1)) 644, Generating implicit firstprivate(solve_type,l_mono_flux_lim_spikefix,dt) 696, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 697, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 696, Generating default present(max_x_allowable(:ngrdcol,nzt),wpxp_mfl_min(:ngrdcol,:),wpxp_mfl_max(:ngrdcol,:),min_x_allowable(:ngrdcol,nzt)) 697, Generating implicit firstprivate(nzt,nzm) 712, Generating update self(min_x_allowable(:,:),wpxp_mfl_max(:,:),max_x_allowable(:,:),xm_without_ta(:,:),wpxp_mfl_min(:,:)) 727, Generating update self(min_x_allowable(:,:),wpxp_mfl_max(:,:),max_x_allowable(:,:),xm_without_ta(:,:),wpxp_mfl_min(:,:)) 745, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 746, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 745, Generating default present(l_adjustment_needed(:ngrdcol)) 751, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 753, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_any_adjustment_needed) 754, ! blockidx%x threadidx%x collapsed 751, Generating default present(wpxp_net_adjust(:ngrdcol,:nzm),l_adjustment_needed(:ngrdcol)) Generating implicit copy(l_any_adjustment_needed) [if not already present] 789, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 790, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 791, ! blockidx%x threadidx%x collapsed 789, Generating default present(xm_mfl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),l_adjustment_needed(:ngrdcol)) 836, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 837, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 846, !$acc loop seq Generating implicit reduction(+:rho_ds_zt$r) 871, !$acc loop seq 836, Generating default present(xm_enter_mfl(:ngrdcol,nzt),xm(:ngrdcol,:),rho_ds_zt(:ngrdcol,:nzt),gr,gr%dzt(1:ngrdcol,1:nzt-1),gr%zm(1:ngrdcol,nzm-1:nzm)) 837, Generating implicit firstprivate(xm_density_weighted,dz,xm_adj_coef,xm_vert_integral,xm_tol,nzm) 846, Loop is parallelizable 871, Loop is parallelizable 899, Generating update self(xm(:,:),wpxp(:,:)) 922, Generating exit data delete(xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_adjustment_needed(:),wpxp_mfl_max(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min(:,:),xm_mfl(:,:),wpxp_net_adjust(:,:),xp2_zt(:,:),xm_without_ta(:,:)) mfl_xm_lhs: 1014, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1015, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1016, ! blockidx%x threadidx%x collapsed 1017, ! blockidx%x threadidx%x collapsed 1014, Generating default present(lhs(:,:ngrdcol,:nzt)) 1026, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1027, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1028, ! blockidx%x threadidx%x collapsed 1026, Generating default present(lhs(2,:ngrdcol,:nzt)) 1028, Generating implicit firstprivate(dt) mfl_xm_rhs: 1089, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1090, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1091, ! blockidx%x threadidx%x collapsed 1089, Generating default present(wpxp(:ngrdcol,:nzt+1),invrs_dzt(:ngrdcol,:nzt),invrs_rho_ds_zt(:ngrdcol,:nzt),rhs(:ngrdcol,:nzt),rho_ds_zm(:ngrdcol,:nzt+1),xm_old(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt)) 1091, Generating implicit firstprivate(dt) calc_turb_adv_range: 1312, Generating enter data create(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:)) 1415, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1416, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1417, ! blockidx%x threadidx%x collapsed 1415, Generating default present(w_min(:ngrdcol,:nzm),gr%dzm(1:ngrdcol,1:nzm),gr) 1417, Generating implicit firstprivate(invrs_dt) 1436, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1437, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1438, ! blockidx%x threadidx%x collapsed 1436, Generating default present(gr,gr%dzm(1:ngrdcol,:),low_lev_effect(:ngrdcol,2:nzt-2),vert_vel_up_zm(:ngrdcol,:)) 1438, Generating implicit firstprivate(j,dt_all_grid_levs) 1449, Loop carried reuse of low_lev_effect prevents parallelization Loop carried scalar dependence for dt_all_grid_levs at line 1462 Generating implicit firstprivate(dt_one_grid_lev,dt) Loop carried reuse of low_lev_effect prevents parallelization 1451, Accelerator restriction: induction variable live-out from loop: j 1454, Accelerator restriction: induction variable live-out from loop: j 1458, Accelerator restriction: induction variable live-out from loop: j 1485, Accelerator restriction: induction variable live-out from loop: j 1496, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1497, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1498, ! blockidx%x threadidx%x collapsed 1496, Generating default present(gr,gr%dzm(1:ngrdcol,:),vert_vel_down_zm(:ngrdcol,:),high_lev_effect(:ngrdcol,2:nzt-2)) 1498, Generating implicit firstprivate(j,dt_all_grid_levs) 1505, Loop carried reuse of high_lev_effect prevents parallelization Loop carried scalar dependence for dt_all_grid_levs at line 1522 Generating implicit firstprivate(dt_one_grid_lev,dt) Loop carried reuse of high_lev_effect prevents parallelization 1507, Accelerator restriction: induction variable live-out from loop: j 1510, Accelerator restriction: induction variable live-out from loop: j 1518, Accelerator restriction: induction variable live-out from loop: j 1545, Accelerator restriction: induction variable live-out from loop: j 1557, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1558, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1557, Generating default present(low_lev_effect(:ngrdcol,:),high_lev_effect(:ngrdcol,:)) 1558, Generating implicit firstprivate(nzt) 1568, Generating exit data delete(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:)) mean_vert_vel_up_down: 1824, Generating enter data create(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:)) 1837, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1838, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1839, ! blockidx%x threadidx%x collapsed 1837, Generating default present(mean_w_down(:ngrdcol,:nzm),mean_w_down_2nd(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_down_1st(:ngrdcol,:nzm)) 1847, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1848, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1849, ! blockidx%x threadidx%x collapsed 1847, Generating default present(mean_w_up(:ngrdcol,:nzm),mean_w_up_1st(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_up_2nd(:ngrdcol,:nzm)) 1857, Generating update self(mean_w_up(:,:),mean_w_down(:,:)) 1867, Generating exit data delete(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:)) calc_mean_w_up_down_component: 1949, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1950, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1951, ! blockidx%x threadidx%x collapsed 1949, Generating default present(w_min(:ngrdcol,2:nzm-1),w_i_zm(:ngrdcol,2:nzm-1),varnce_w_i_zm(:ngrdcol,2:nzm-1),mean_w_up_i(:ngrdcol,2:nzm-1),mean_w_down_i(:ngrdcol,2:nzm-1)) 1951, Generating implicit firstprivate(exp_cache,w_ref,sigma_w_i_zm,erf_cache) 1995, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1996, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1995, Generating default present(mean_w_up_i(:ngrdcol,:),mean_w_down_i(:ngrdcol,:)) 1996, Generating implicit firstprivate(nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_windm_edsclrm_module.F90 advance_windm_edsclrm: 281, Generating enter data create(wind_speed_pert(:,:),km_zt(:,:),km_zm_p_nu10(:,:),lhs_diff(:,:,:),lhs(:,:,:),lhs_ma_zt(:,:,:),u_star_sqd(:),solution(:,:,:),wind_speed(:,:),vpwp_chnge(:,:),rhs(:,:,:),nu_zero(:),kmh_zt(:,:),vm_tndcy(:,:),um_tndcy(:,:),vm_old(:,:),um_old(:,:),upwp_chnge(:,:),u_star_sqd_pert(:),xpwp(:,:)) 287, Generating enter data create(edsclrm_old(:,:,:)) 289, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 290, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 289, Generating default present(nu_zero(:ngrdcol)) 295, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 296, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 297, ! blockidx%x threadidx%x collapsed 295, Generating default present(km_zm(:ngrdcol,:nzm),km_zm_p_nu10(:ngrdcol,:nzm),nu_vert_res_dep%nu10(1:ngrdcol),nu_vert_res_dep) 311, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 312, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 313, ! blockidx%x threadidx%x collapsed 314, ! blockidx%x threadidx%x collapsed 311, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt)) 332, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 333, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 334, ! blockidx%x threadidx%x collapsed 332, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 369, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 370, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 371, ! blockidx%x threadidx%x collapsed 369, Generating default present(wind_speed(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 378, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 379, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 378, Generating default present(upwp(:ngrdcol,:1),vpwp(:ngrdcol,:1),u_star_sqd(:ngrdcol)) 416, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 417, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 418, ! blockidx%x threadidx%x collapsed 416, Generating default present(upwp(:ngrdcol,2:nzm-1),xpwp(:ngrdcol,2:nzm-1)) 428, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 429, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 430, ! blockidx%x threadidx%x collapsed 428, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1)) 439, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 440, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 439, Generating default present(vpwp(:ngrdcol,nzm),upwp(:ngrdcol,nzm)) 440, Generating implicit firstprivate(nzm) 476, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 477, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 478, ! blockidx%x threadidx%x collapsed 476, Generating default present(solution(:ngrdcol,:nzt,:1),um(:ngrdcol,:nzt)) 487, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 488, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 489, ! blockidx%x threadidx%x collapsed 487, Generating default present(vm(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,2)) 497, Generating update self(um(:,:),wind_speed(:,:),vm(:,:),lhs_ma_zt(:,:,:),rho_ds_zm(:,:),lhs_diff(:,:,:),invrs_rho_ds_zt(:,:),u_star_sqd(:)) 523, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 524, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 525, ! blockidx%x threadidx%x collapsed 523, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 535, Generating update self(vm_ref(:,:),vm(:,:),um(:,:),um_ref(:,:)) 576, Generating update device(vm(:,:),um(:,:)) 588, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 589, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 590, ! blockidx%x threadidx%x collapsed 588, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp(:ngrdcol,2:nzm-1)) 600, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 601, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 602, ! blockidx%x threadidx%x collapsed 600, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1)) 613, Generating update self(vm(:,:),um(:,:)) 622, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 623, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 624, ! blockidx%x threadidx%x collapsed 622, Generating default present(vm_ref(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_ref(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 624, Generating implicit firstprivate(ts_nudge,dt) 632, Generating update self(vm(:,:),um(:,:)) 644, Generating update self(vm_ref(:,:),um_ref(:,:)) 747, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 748, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 749, ! blockidx%x threadidx%x collapsed 747, Generating default present(wind_speed_pert(:ngrdcol,:nzt),vm_pert(:ngrdcol,:nzt),um_pert(:ngrdcol,:nzt)) 756, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 757, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 756, Generating default present(vpwp_pert(:ngrdcol,:1),upwp_pert(:ngrdcol,:1),u_star_sqd_pert(:ngrdcol)) 794, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 795, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 796, ! blockidx%x threadidx%x collapsed 794, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp_pert(:ngrdcol,2:nzm-1)) 806, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 807, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 808, ! blockidx%x threadidx%x collapsed 806, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp_pert(:ngrdcol,2:nzm-1)) 817, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 818, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 817, Generating default present(vpwp_pert(:ngrdcol,nzm),upwp_pert(:ngrdcol,nzm)) 818, Generating implicit firstprivate(nzm) 854, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 855, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 856, ! blockidx%x threadidx%x collapsed 854, Generating default present(um_pert(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,:1)) 865, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 866, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 867, ! blockidx%x threadidx%x collapsed 865, Generating default present(vm_pert(:ngrdcol,:nzt),solution(:ngrdcol,:nzt,2)) 881, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 882, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 883, ! blockidx%x threadidx%x collapsed 881, Generating default present(xpwp(:ngrdcol,2:nzm-1),upwp_pert(:ngrdcol,2:nzm-1)) 893, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 894, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 895, ! blockidx%x threadidx%x collapsed 893, Generating default present(xpwp(:ngrdcol,2:nzm-1),vpwp_pert(:ngrdcol,2:nzm-1)) 982, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 983, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 984, ! blockidx%x threadidx%x collapsed 985, ! blockidx%x threadidx%x collapsed 982, Generating default present(edsclrm_old(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1026, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1027, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1028, ! blockidx%x threadidx%x collapsed 1026, Generating default present(xpwp(:ngrdcol,2:nzm-1),wpedsclrp(:ngrdcol,2:nzm-1,edsclr)) 1038, Generating implicit firstprivate(edsclr_dim,ngrdcol) Generating NVIDIA GPU code 1039, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1040, ! blockidx%x threadidx%x collapsed 1038, Generating default present(wpedsclrp(:ngrdcol,nzm,:edsclr_dim)) 1040, Generating implicit firstprivate(nzm) 1073, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 1074, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1075, ! blockidx%x threadidx%x collapsed 1076, ! blockidx%x threadidx%x collapsed 1073, Generating default present(solution(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1084, Generating implicit firstprivate(edsclr_dim,nzt,ngrdcol) Generating NVIDIA GPU code 1085, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1086, ! blockidx%x threadidx%x collapsed 1087, ! blockidx%x threadidx%x collapsed 1084, Generating default present(edsclrm_old(:ngrdcol,:nzt,:edsclr_dim),edsclrm(:ngrdcol,:nzt,:edsclr_dim)) 1105, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1106, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1107, ! blockidx%x threadidx%x collapsed 1105, Generating default present(xpwp(:ngrdcol,2:nzm-1),wpedsclrp(:ngrdcol,2:nzm-1,edsclr)) 1122, Generating update self(wpedsclrp(:,:,:),wp2(:,:),vp2(:,:),up2(:,:),edsclrm_forcing(:,:,:),vg(:,:),vm_forcing(:,:),ug(:,:),um_forcing(:,:),edsclrm_old(:,:,:),edsclrm(:,:,:),vm(:,:),um(:,:),vm_ref(:,:),um_ref(:,:),wm_zt(:,:),vm_old(:,:),um_old(:,:),upwp(:,:),km_zm(:,:),fcor(:),vpwp(:,:)) 1170, Generating exit data delete(wind_speed_pert(:,:),km_zt(:,:),km_zm_p_nu10(:,:),lhs_diff(:,:,:),lhs(:,:,:),lhs_ma_zt(:,:,:),u_star_sqd(:),solution(:,:,:),wind_speed(:,:),vpwp_chnge(:,:),rhs(:,:,:),nu_zero(:),kmh_zt(:,:),vm_tndcy(:,:),um_tndcy(:,:),vm_old(:,:),um_old(:,:),upwp_chnge(:,:),u_star_sqd_pert(:),xpwp(:,:)) 1176, Generating exit data delete(edsclrm_old(:,:,:)) compute_uv_tndcy: 2004, Generating enter data create(xm_gf(:,:),xm_cf(:,:)) 2018, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2019, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2020, ! blockidx%x threadidx%x collapsed 2018, Generating default present(perp_wind_g(:ngrdcol,:nzt),xm_gf(:ngrdcol,:nzt),fcor(:ngrdcol)) 2026, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2027, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2028, ! blockidx%x threadidx%x collapsed 2026, Generating default present(xm_cf(:ngrdcol,:nzt),perp_wind_m(:ngrdcol,:nzt),fcor(:ngrdcol)) 2040, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2041, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2042, ! blockidx%x threadidx%x collapsed 2040, Generating default present(xm_gf(:ngrdcol,:nzt),perp_wind_g(:ngrdcol,:nzt),fcor(:ngrdcol)) 2048, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2049, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2050, ! blockidx%x threadidx%x collapsed 2048, Generating default present(perp_wind_m(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt),fcor(:ngrdcol)) 2062, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2063, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2064, ! blockidx%x threadidx%x collapsed 2062, Generating default present(xm_gf(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt)) 2073, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2074, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2075, ! blockidx%x threadidx%x collapsed 2073, Generating default present(xm_tndcy(:ngrdcol,:nzt),xm_gf(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt),xm_cf(:ngrdcol,:nzt)) 2083, Generating update self(xm_cf(:,:),xm_gf(:,:),xm_forcing(:,:)) 2102, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2103, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2104, ! blockidx%x threadidx%x collapsed 2102, Generating default present(xm_tndcy(:ngrdcol,:nzt)) 2112, Generating exit data delete(xm_gf(:,:),xm_cf(:,:)) windm_edsclrm_lhs: 2188, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2189, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2190, ! blockidx%x threadidx%x collapsed 2188, Generating default present(lhs(:,:ngrdcol,:nzt),lhs_diff(:,:ngrdcol,:nzt)) 2190, Generating implicit firstprivate(invrs_dt) 2205, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2206, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2207, ! blockidx%x threadidx%x collapsed 2208, !$acc loop seq 2205, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt-1),lhs(:,:ngrdcol,:nzt-1)) 2208, Loop is parallelizable 2218, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2219, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2218, Generating default present(rho_ds_zm(:ngrdcol,:1),wind_speed(:ngrdcol,:1),u_star_sqd(:ngrdcol),lhs(2,:ngrdcol,:1),gr,gr%invrs_dzt(1:ngrdcol,1),invrs_rho_ds_zt(:ngrdcol,:1)) windm_edsclrm_rhs: 2335, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2336, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2335, Generating default present(rhs(:ngrdcol,:1),xm_tndcy(:ngrdcol,:1),xm(:ngrdcol,:2),lhs_diff(:2,:ngrdcol,:1)) 2336, Generating implicit firstprivate(invrs_dt) 2346, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2347, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2348, ! blockidx%x threadidx%x collapsed 2346, Generating default present(lhs_diff(:,:ngrdcol,2:nzt-1),xm_tndcy(:ngrdcol,2:nzt-1),xm(:ngrdcol,:nzt),rhs(:ngrdcol,2:nzt-1)) 2348, Generating implicit firstprivate(invrs_dt) 2360, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2361, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2360, Generating default present(rhs(:ngrdcol,nzt),xm_tndcy(:ngrdcol,nzt),xm(:ngrdcol,nzt-1:nzt),lhs_diff(2:,:ngrdcol,nzt)) 2361, Generating implicit firstprivate(nzt,invrs_dt) 2372, Generating update self(xm(:,:),lhs_diff(:,:,:)) 2412, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2413, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2412, Generating default present(xpwp_sfc(:ngrdcol),rhs(:ngrdcol,:1),invrs_rho_ds_zt(:ngrdcol,:1),gr,gr%invrs_dzt(1:ngrdcol,1),rho_ds_zm(:ngrdcol,:1)) 2422, Generating update self(xpwp_sfc(:),rho_ds_zm(:,:),invrs_rho_ds_zt(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/numerical_check.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xm_wpxp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_xp2_xpyp_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_wp2_wp3_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/stats_clubb_utilities.F90 advance_wp2_wp3: 425, Generating enter data create(dvm_dz(:,:),wp2_old(:,:),kw8(:,:),kw1(:,:),kw1_zm(:,:),em_smth(:,:),lhs_tp_wp3(:,:,:),kw8_zt(:,:),dum_dz(:,:),coef_wp4_implicit_zt(:,:),a1_coef(:,:),c_wp3_pr_tp(:),coef_wp4_implicit(:,:),lhs_ac_pr2_wp2(:,:),lhs(:,:,:),lhs_ma_zm(:,:,:),lhs_dp1_wp2(:,:),lhs_diff_zt(:,:,:),lhs_diff_zm(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_adv_tp_wp3(:,:,:),rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr3_wp2(:,:),rhs_pr1_wp3(:,:),rhs(:,:),rhs_pr3_wp3(:,:),rhs_bp1_pr2_wp3(:,:),rhs_pr1_wp2(:,:),lhs_pr1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_ma_zt(:,:,:),rhs_bp_pr2_wp2(:,:),lhs_diff_zt_crank(:,:,:),lhs_ta_wp2(:,:,:),lhs_pr1_wp3(:,:),lhs_ac_pr2_wp3(:,:),lhs_ta_wp3(:,:,:),lhs_pr_tp_wp3(:,:,:),wp3_old(:,:),wp3_pr3_lhs(:,:,:),wp3_term_ta_lhs_result(:,:,:),c1_skw_fnc(:,:),c11_skw_fnc(:,:),a1_coef_zt(:,:),c16_fnc(:,:),wp2_smth(:,:),rhs_ta_wp3(:,:)) 474, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 475, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 476, ! blockidx%x threadidx%x collapsed 474, Generating default present(cx_fnc_richardson(:ngrdcol,2:nzt+1),c11_skw_fnc(:ngrdcol,:nzt)) 483, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 484, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 485, ! blockidx%x threadidx%x collapsed 483, Generating default present(c11_skw_fnc(:ngrdcol,:nzt),skw_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,22:24)) 485, Generating implicit firstprivate(c11,c11c,c11b) 505, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 506, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 507, ! blockidx%x threadidx%x collapsed 505, Generating default present(c1_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,:3)) 507, Generating implicit firstprivate(c1,c1b,c1c) 528, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 530, ! blockidx%x threadidx%x collapsed 528, Generating default present(c1_skw_fnc(:ngrdcol,:nzm)) 538, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 539, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 540, ! blockidx%x threadidx%x collapsed 538, Generating default present(cx_fnc_richardson(:ngrdcol,:nzt),c16_fnc(:ngrdcol,:nzt)) 548, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 549, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 550, ! blockidx%x threadidx%x collapsed 548, Generating default present(c11_skw_fnc(:ngrdcol,:nzt)) Generating implicit copy(err_code) [if not already present] 560, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 561, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 562, ! blockidx%x threadidx%x collapsed 560, Generating default present(c16_fnc(:ngrdcol,:nzt)) Generating implicit copy(err_code) [if not already present] 580, Generating update self(c1_skw_fnc(:,:),c11_skw_fnc(:,:)) 591, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 592, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 593, ! blockidx%x threadidx%x collapsed 591, Generating default present(kw1(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,38)) 601, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 603, ! blockidx%x threadidx%x collapsed 601, Generating default present(kw8(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,44)) 621, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 622, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 623, ! blockidx%x threadidx%x collapsed 621, Generating default present(coef_wp4_implicit_zt(:ngrdcol,:nzt),pdf_implicit_coefs_terms%coef_wp4_implicit(1:ngrdcol,1:nzt),pdf_implicit_coefs_terms) 655, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 656, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 657, ! blockidx%x threadidx%x collapsed 655, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm)) 673, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 674, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 675, ! blockidx%x threadidx%x collapsed 673, Generating default present(rhs_pr3_wp3(:ngrdcol,:nzt)) 682, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 683, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 684, ! blockidx%x threadidx%x collapsed 685, ! blockidx%x threadidx%x collapsed 682, Generating default present(wp3_term_ta_lhs_result(:,:ngrdcol,:nzt),wp3_pr3_lhs(:,:ngrdcol,:nzt)) 778, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 779, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 778, Generating default present(c_wp3_pr_tp(:ngrdcol)) 789, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 790, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 789, Generating default present(clubb_params(:ngrdcol,29),c_wp3_pr_tp(:ngrdcol)) 801, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 802, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 803, ! blockidx%x threadidx%x collapsed 804, ! blockidx%x threadidx%x collapsed 801, Generating default present(lhs_adv_tp_wp3(:,:ngrdcol,:nzt),lhs_tp_wp3(:,:ngrdcol,:nzt),lhs_pr_tp_wp3(:,:ngrdcol,:nzt)) 940, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 941, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 942, ! blockidx%x threadidx%x collapsed 943, ! blockidx%x threadidx%x collapsed 940, Generating default present(lhs_diff_zt(:,:ngrdcol,:nzt),clubb_params(:ngrdcol,25)) 1002, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1003, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1004, ! blockidx%x threadidx%x collapsed 1002, Generating default present(wp2_old(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1009, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1010, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1011, ! blockidx%x threadidx%x collapsed 1009, Generating default present(wp3_old(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1040, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1041, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1042, ! blockidx%x threadidx%x collapsed 1040, Generating default present(wp2_old(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1047, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1048, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1049, ! blockidx%x threadidx%x collapsed 1047, Generating default present(wp3_old(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt)) 1059, Generating update self(wp2(:,:)) 1080, Generating update device(wp2(:,:)) 1086, Generating update self(wp3(:,:)) 1107, Generating update device(wp3(:,:)) 1114, Generating update self(wp2vp2(:,:),wp3(:,:),wm_zt(:,:),wp2(:,:),wp3_on_wp2(:,:),wp2_old(:,:),skw_zt(:,:),rho_ds_zt(:,:),wprtp(:,:),wp4(:,:),lhs_splat_wp2(:,:),kh_zt(:,:),a3_coef_zt(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),em(:,:),rho_ds_zm(:,:),mixt_frac(:,:),invrs_rho_ds_zt(:,:),wp3_old(:,:),a3_coef(:,:),lhs_splat_wp3(:,:),skw_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_c1_zm(:,:),kh_zm(:,:),invrs_tau_wp3_zt(:,:),cx_fnc_richardson(:,:),vm(:,:),um(:,:),vp2(:,:),up2(:,:),upwp(:,:),thv_ds_zt(:,:),wp2_zt(:,:),wpthlp(:,:),wp3_zm(:,:),wp2up2(:,:),wp2thvp(:,:),wpvp2(:,:),wpup2(:,:),wpthvp(:,:),wm_zm(:,:),vpwp(:,:),sigma_sqd_w(:,:),sfc_elevation(:),rtp2(:,:)) 1191, Generating exit data delete(dvm_dz(:,:),wp2_old(:,:),kw8(:,:),kw1(:,:),kw1_zm(:,:),em_smth(:,:),lhs_tp_wp3(:,:,:),kw8_zt(:,:),dum_dz(:,:),coef_wp4_implicit_zt(:,:),a1_coef(:,:),c_wp3_pr_tp(:),coef_wp4_implicit(:,:),lhs_ac_pr2_wp2(:,:),lhs(:,:,:),lhs_ma_zm(:,:,:),lhs_dp1_wp2(:,:),lhs_diff_zt(:,:,:),lhs_diff_zm(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_adv_tp_wp3(:,:,:),rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr3_wp2(:,:),rhs_pr1_wp3(:,:),rhs(:,:),rhs_pr3_wp3(:,:),rhs_bp1_pr2_wp3(:,:),rhs_pr1_wp2(:,:),lhs_pr1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_ma_zt(:,:,:),rhs_bp_pr2_wp2(:,:),lhs_diff_zt_crank(:,:,:),lhs_ta_wp2(:,:,:),lhs_pr1_wp3(:,:),lhs_ac_pr2_wp3(:,:),lhs_ta_wp3(:,:,:),lhs_pr_tp_wp3(:,:,:),wp3_old(:,:),wp3_term_ta_lhs_result(:,:,:),wp3_pr3_lhs(:,:,:),c1_skw_fnc(:,:),c11_skw_fnc(:,:),a1_coef_zt(:,:),c16_fnc(:,:),wp2_smth(:,:),rhs_ta_wp3(:,:)) wp23_solve: 1423, Generating enter data create(solut(:,:),threshold_array(:,:),old_solut(:,:),rhs_save(:,:),rcond(:)) 1427, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1428, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1429, ! blockidx%x threadidx%x collapsed 1427, Generating default present(rhs_save(:ngrdcol,:nzm*2-1),rhs(:ngrdcol,:nzm*2-1)) 1460, Generating update self(rcond(:)) 1479, Generating update self(lhs(:,:,:),rhs_save(:,:)) 1516, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1517, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1518, ! blockidx%x threadidx%x collapsed 1516, Generating default present(wp2(:ngrdcol,:nzm),solut(:ngrdcol,:)) 1518, Generating implicit firstprivate(k_wp2) 1525, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1526, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1527, ! blockidx%x threadidx%x collapsed 1525, Generating default present(wp3(:ngrdcol,:nzt),solut(:ngrdcol,:)) 1527, Generating implicit firstprivate(k_wp3) 1536, Generating update self(c11_skw_fnc(:,:),lhs_ta_wp2(:,:,:),lhs_ma_zm(:,:,:),wp3(:,:),lhs_pr1_wp3(:,:),clubb_params(:,:),wp3_term_ta_lhs_result(:,:,:),wp3_pr3_lhs(:,:,:),lhs_diff_zm(:,:,:),lhs_pr1_wp2(:,:),lhs_ma_zt(:,:,:),lhs_dp1_wp2(:,:),wp2(:,:),lhs_pr_tp_wp3(:,:,:),lhs_adv_tp_wp3(:,:,:),wm_zt(:,:),lhs_diff_zt(:,:,:),wm_zm(:,:)) 1738, Generating update self(wp2(:,:)) 1761, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1762, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1763, ! blockidx%x threadidx%x collapsed 1761, Generating default present(wp2(:ngrdcol,:nzm)) 1774, Generating update self(wp2(:,:)) 1813, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1814, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1815, ! blockidx%x threadidx%x collapsed 1813, Generating default present(thlp2(:ngrdcol,:nzm),threshold_array(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm)) 1832, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1833, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1834, ! blockidx%x threadidx%x collapsed 1832, Generating default present(threshold_array(:ngrdcol,:nzm)) 1862, Generating exit data delete(threshold_array(:,:),solut(:,:),old_solut(:,:),rhs_save(:,:),rcond(:)) wp23_lhs: 1970, Generating copyin(lhs_tp_wp3(:,:,:),wp3_term_ta_lhs_result(:,:,:),lhs_ac_pr2_wp3(:,:),lhs_diff_zm(:,:,:),lhs_dp1_wp2(:,:),lhs_ma_zm(:,:,:),lhs_splat_wp3(:,:),lhs_ta_wp2(:,:,:)) [if not already present] Generating copyout(lhs(:,:,:)) [if not already present] Generating copyin(lhs_ac_pr2_wp2(:,:),lhs_diff_zt(:,:,:),lhs_pr1_wp2(:,:),lhs_ma_zt(:,:,:),lhs_pr1_wp3(:,:),lhs_splat_wp2(:,:)) [if not already present] 1979, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1980, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1981, ! blockidx%x threadidx%x collapsed 1982, ! blockidx%x threadidx%x collapsed 1990, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1991, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1992, ! blockidx%x threadidx%x collapsed 2003, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2004, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2005, ! blockidx%x threadidx%x collapsed 2016, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2017, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2018, ! blockidx%x threadidx%x collapsed 2018, Generating implicit firstprivate(k_wp2,invrs_dt) 2056, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2057, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2058, ! blockidx%x threadidx%x collapsed 2058, Generating implicit firstprivate(k_wp3,invrs_dt) 2099, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2100, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2101, ! blockidx%x threadidx%x collapsed 2101, Generating implicit firstprivate(nzm) 2112, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2113, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2114, ! blockidx%x threadidx%x collapsed 2114, Generating implicit firstprivate(nzm) 2135, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2136, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2137, ! blockidx%x threadidx%x collapsed 2137, Generating implicit firstprivate(k_wp2) 2150, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2151, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2152, ! blockidx%x threadidx%x collapsed 2152, Generating implicit firstprivate(k_wp2) 2180, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2181, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2182, ! blockidx%x threadidx%x collapsed 2183, ! blockidx%x threadidx%x collapsed 2183, Generating implicit firstprivate(k_wp3) advance_xp2_xpyp: 426, Generating enter data create(lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),vp2_old(:,:)) 436, Generating enter data create(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrpthlp_old(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:)) 444, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 445, !$acc loop gang, vector(128) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 444, Generating default present(clubb_params(:ngrdcol,8:9)) Generating implicit copy(err_code) [if not already present] 475, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 476, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 477, ! blockidx%x threadidx%x collapsed 475, Generating default present(c2thl_1d(:ngrdcol,:nzm),cloud_frac_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6),c2rtthl_1d(:ngrdcol,:nzm),c2rt_1d(:ngrdcol,:nzm)) 496, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 497, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 498, ! blockidx%x threadidx%x collapsed 496, Generating default present(c2rt_1d(:ngrdcol,:nzm),c2rtthl_1d(:ngrdcol,:nzm),c2thl_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:6)) 507, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 508, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 509, ! blockidx%x threadidx%x collapsed 507, Generating default present(c2sclr_1d(:ngrdcol,:nzm),c14_1d(:ngrdcol,:nzm),clubb_params(:ngrdcol,4:27),c4_1d(:ngrdcol,:nzm)) 526, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 527, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 528, ! blockidx%x threadidx%x collapsed 526, Generating default present(kw2(:ngrdcol,:nzt),kw9(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,40:46)) 548, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 549, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 550, ! blockidx%x threadidx%x collapsed 548, Generating default present(rtpthlp(:ngrdcol,:nzm),rtp2_old(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm),thlp2_old(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),rtpthlp_old(:ngrdcol,:nzm)) 559, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 560, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 561, ! blockidx%x threadidx%x collapsed 562, ! blockidx%x threadidx%x collapsed 559, Generating default present(sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrp2_old(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrprtp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp_old(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 611, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 612, !$acc loop gang, vector(128) ! blockidx%x threadidx%x Generating reduction(.and.:l_single_solve_possible) 611, Generating default present(clubb_params(:ngrdcol,4:6)) Generating implicit copy(l_single_solve_possible) [if not already present] 612, Generating implicit firstprivate(c2thl,c2rtthl,c2rt) 686, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 687, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 688, ! blockidx%x threadidx%x collapsed 686, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm)) 706, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 707, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 708, ! blockidx%x threadidx%x collapsed 706, Generating default present(lhs_dp1_c4(:ngrdcol,2:nzm-1),lhs_dp1_c14(:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1)) 850, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 851, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 852, ! blockidx%x threadidx%x collapsed 850, Generating default present(vp2(:ngrdcol,:nzm),uv_solution(:ngrdcol,:nzm,:),up2(:ngrdcol,:nzm)) 860, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 861, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 862, ! blockidx%x threadidx%x collapsed 860, Generating default present(vp2_old(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),up2_old(:ngrdcol,:nzm),up2(:ngrdcol,:nzm)) 872, Generating update self(lhs_diff_uv(:,:,:),lhs_dp1_c14(:,:),vp2(:,:),up2(:,:),lhs_dp1_c4(:,:),lhs_ma(:,:,:),lhs_ta_wpup2(:,:,:)) 949, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 950, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 951, ! blockidx%x threadidx%x collapsed 949, Generating default present(threshold_array(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 967, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 968, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 969, ! blockidx%x threadidx%x collapsed 967, Generating default present(threshold_array(:ngrdcol,:nzm)) 992, Generating update self(rtp2(:,:)) 1002, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1003, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1004, ! blockidx%x threadidx%x collapsed 1002, Generating default present(clubb_params(:ngrdcol,93),rtp2(:ngrdcol,:nzm),rtm_zm(:ngrdcol,:nzm)) 1004, Generating implicit firstprivate(threshold) 1015, Generating update self(rtp2(:,:)) 1053, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1054, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1055, ! blockidx%x threadidx%x collapsed 1053, Generating default present(threshold_array(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 1071, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1072, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1073, ! blockidx%x threadidx%x collapsed 1071, Generating default present(threshold_array(:ngrdcol,:nzm)) 1090, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1091, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1092, ! blockidx%x threadidx%x collapsed 1090, Generating default present(threshold_array(:ngrdcol,:nzm)) 1106, Generating update self(up2(:,:)) 1115, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1116, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1117, ! blockidx%x threadidx%x collapsed 1115, Generating default present(up2(:ngrdcol,:nzm)) 1125, Generating update self(up2(:,:)) 1137, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1138, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1139, ! blockidx%x threadidx%x collapsed 1137, Generating default present(threshold_array(:ngrdcol,:nzm)) 1152, Generating update self(vp2(:,:)) 1161, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1162, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1163, ! blockidx%x threadidx%x collapsed 1161, Generating default present(vp2(:ngrdcol,:nzm)) 1171, Generating update self(vp2(:,:)) 1183, Generating update self(vp2(:,:),up2(:,:)) 1213, Generating update device(vp2(:,:),up2(:,:)) 1270, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1271, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1272, ! blockidx%x threadidx%x collapsed 1270, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1297, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1298, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1299, ! blockidx%x threadidx%x collapsed 1297, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1332, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1333, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1334, ! blockidx%x threadidx%x collapsed 1332, Generating default present(threshold_array(:ngrdcol,:nzm),sclr_tol(sclr)) 1362, Generating update self(sclrprtp_old(:,:,:),sclrpthlp(:,:,:),sclrp2_old(:,:,:),sclrprtp(:,:,:),sclrm(:,:,:),sclrp2(:,:,:),vm(:,:),vp2(:,:),um(:,:),up2(:,:),rtp2_old(:,:),rtpthlp_forcing(:,:),thlm(:,:),thlp2_forcing(:,:),rtm(:,:),rtp2_forcing(:,:),wprtp(:,:),rtpthlp_old(:,:),wp2(:,:),thlp2_old(:,:),rho_ds_zm(:,:),kh_zt(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),invrs_tau_xp2_zm(:,:),sclrpthlp_old(:,:,:),vp2_old(:,:),up2_old(:,:),wp2_zt(:,:),wm_zm(:,:),upwp(:,:),thv_ds_zm(:,:),wpthvp(:,:),wpthlp(:,:),wpsclrp(:,:,:),sigma_sqd_w(:,:),wp3(:,:),rho_ds_zt(:,:),vpwp(:,:),invrs_rho_ds_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:)) 1439, Generating exit data delete(lhs_dp1(:,:),lhs_dp1_c14(:,:),rhs_ta_wpvp2(:,:),lhs_diff_uv(:,:,:),lhs_dp1_c4(:,:),lhs_diff(:,:,:),lhs(:,:,:),rhs_ta_wpup2(:,:),rhs_ta_wpthlp2(:,:),rhs_ta_wprtp2(:,:),rhs_ta_wprtpthlp(:,:),lhs_ta_wpvp2(:,:,:),lhs_ta_wpup2(:,:,:),lhs_ta_wpthlp2(:,:,:),lhs_ta_wprtp2(:,:,:),lhs_ta_wprtpthlp(:,:,:),lhs_ma(:,:,:),rtp2_old(:,:),kw9(:,:),kw2(:,:),kw2_zm(:,:),c4_1d(:,:),uv_rhs(:,:,:),up2_old(:,:),kw9_zm(:,:),thlp2_old(:,:),c2thl_1d(:,:),c2rt_1d(:,:),c2sclr_1d(:,:),c14_1d(:,:),c2rtthl_1d(:,:),uv_solution(:,:,:),threshold_array(:,:),rtpthlp_chnge(:,:),rtpthlp_old(:,:),rtm_zm(:,:),vp2_old(:,:)) 1449, Generating exit data delete(sclrprtp_old(:,:,:),rhs_ta_wpsclrp2(:,:,:),lhs_ta_wpthlpsclrp(:,:,:,:),rhs_ta_wprtpsclrp(:,:,:),lhs_ta_wpsclrp2(:,:,:,:),lhs_ta_wprtpsclrp(:,:,:,:),sclrp2_old(:,:,:),sclrpthlp_old(:,:,:),sclrpthlp_chnge(:,:,:),sclrprtp_chnge(:,:,:),rhs_ta_wpthlpsclrp(:,:,:)) wp23_rhs: 2389, Generating copyin(wp3(:,:),lhs_adv_tp_wp3(:,:,:),lhs_diff_zm_crank(:,:,:),lhs_diff_zm(:,:,:),lhs_diff_zt(:,:,:),lhs_ta_wp3(:,:,:),c11_skw_fnc(:,:),lhs_pr1_wp3(:,:),lhs_splat_wp3(:,:),lhs_diff_zt_crank(:,:,:),rhs_bp_pr2_wp2(:,:),lhs_dp1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_pr1_wp2(:,:),rhs_pr1_wp2(:,:),rhs_bp1_pr2_wp3(:,:),rhs_pr3_wp3(:,:)) [if not already present] Generating copyout(rhs(:,:)) [if not already present] Generating copyin(rhs_pr1_wp3(:,:),rhs_pr3_wp2(:,:),rhs_pr_turb_wp3(:,:),rhs_pr_dfsn_wp3(:,:),rhs_pr_dfsn_wp2(:,:),vp2(:,:),wp2thvp(:,:),wpthvp(:,:),wpvp2(:,:),wpup2(:,:),wp3_term_ta_lhs_result(:,:,:),wp2(:,:),thv_ds_zt(:,:),up2(:,:),rhs_ta_wp3(:,:),thv_ds_zm(:,:),lhs_pr_tp_wp3(:,:,:),lhs_splat_wp2(:,:),lhs_tp_wp3(:,:,:)) [if not already present] 2404, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2405, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2406, ! blockidx%x threadidx%x collapsed 2413, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2414, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2415, ! blockidx%x threadidx%x collapsed 2415, Generating implicit firstprivate(k_wp3) 2422, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2423, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2424, ! blockidx%x threadidx%x collapsed 2424, Generating implicit firstprivate(k_wp2) 2471, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2472, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2473, ! blockidx%x threadidx%x collapsed 2473, Generating implicit firstprivate(k_wp2) 2483, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2484, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2485, ! blockidx%x threadidx%x collapsed 2485, Generating implicit firstprivate(k_wp3) 2499, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2500, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2501, ! blockidx%x threadidx%x collapsed 2501, Generating implicit firstprivate(k_wp2) 2519, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2520, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2521, ! blockidx%x threadidx%x collapsed 2521, Generating implicit firstprivate(k_wp3,invrs_dt) 2549, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2550, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2551, ! blockidx%x threadidx%x collapsed 2551, Generating implicit firstprivate(k_wp2,invrs_dt) 2601, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2603, ! blockidx%x threadidx%x collapsed 2603, Generating implicit firstprivate(k_wp3) 2657, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2658, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2658, Generating implicit firstprivate(nzt,nzm) 2671, Generating update self(rhs_pr_dfsn_wp2(:,:),rhs_pr_dfsn_wp3(:,:),wpvp2(:,:),wpup2(:,:),wpthvp(:,:),lhs_diff_zm_crank(:,:,:),lhs_splat_wp2(:,:),lhs_pr1_wp2(:,:),rhs_pr1_wp2(:,:),rhs_pr3_wp2(:,:),lhs_pr1_wp3(:,:),clubb_params(:,:),lhs_splat_wp3(:,:),wp2thvp(:,:),wp3(:,:),rhs_pr_turb_wp3(:,:),rhs_pr1_wp3(:,:),lhs_diff_zt(:,:,:),lhs_ta_wp3(:,:,:),lhs_dp1_wp2(:,:),rhs_dp1_wp2(:,:),lhs_pr_tp_wp3(:,:,:),rhs_pr3_wp3(:,:),lhs_adv_tp_wp3(:,:,:),up2(:,:),thv_ds_zt(:,:),lhs_diff_zm(:,:,:),vp2(:,:),wp2(:,:),thv_ds_zm(:,:),wp3_term_ta_lhs_result(:,:,:),rhs_ta_wp3(:,:)) wp2_term_ta_lhs: 3066, Generating copyin(gr%invrs_dzm(:,:),gr,rho_ds_zt(:,:)) [if not already present] Generating copyout(lhs_ta_wp2(:,:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present] 3070, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3071, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3072, ! blockidx%x threadidx%x collapsed 3081, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3082, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3083, ! blockidx%x threadidx%x collapsed wp2_terms_ac_pr2_lhs: 3195, Generating copyin(c_uu_shr(:),gr,wm_zt(:,:)) [if not already present] Generating copyout(lhs_ac_pr2_wp2(:,:)) [if not already present] Generating copyin(gr%invrs_dzm(:,:)) [if not already present] 3199, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3200, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3200, Generating implicit firstprivate(nzm) 3208, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3209, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3210, ! blockidx%x threadidx%x collapsed wp2_term_dp1_lhs: 3289, Generating copyin(c1_skw_fnc(:,:)) [if not already present] Generating copyout(lhs_dp1_wp2(:,:)) [if not already present] Generating copyin(invrs_tau1m(:,:)) [if not already present] 3293, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3294, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3294, Generating implicit firstprivate(nzm) 3302, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3303, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3304, ! blockidx%x threadidx%x collapsed wp2_term_pr1_lhs: 3389, Generating copyout(lhs_pr1_wp2(:,:)) [if not already present] Generating copyin(invrs_tau_c4_zm(:,:)) [if not already present] 3393, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3394, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3394, Generating implicit firstprivate(nzm) 3403, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3404, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3405, ! blockidx%x threadidx%x collapsed 3403, Generating default present(c4(:ngrdcol)) wp2_terms_bp_pr2_rhs: 3484, Generating copyout(rhs_bp_pr2_wp2(:,:)) [if not already present] Generating copyin(thv_ds_zm(:,:),wpthvp(:,:),c_uu_buoy(:)) [if not already present] 3488, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3489, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3489, Generating implicit firstprivate(nzm) 3497, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3498, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3499, ! blockidx%x threadidx%x collapsed wp2_term_dp1_rhs: 3587, Generating copyin(c1_skw_fnc(:,:)) [if not already present] Generating copyout(rhs_dp1_wp2(:,:)) [if not already present] Generating copyin(up2(:,:),vp2(:,:),invrs_tau1m(:,:)) [if not already present] 3591, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3592, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3592, Generating implicit firstprivate(nzm) 3601, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3603, ! blockidx%x threadidx%x collapsed 3609, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3610, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3611, ! blockidx%x threadidx%x collapsed 3611, Generating implicit firstprivate(threshold) solve_xp2_xpyp_with_single_lhs: 1620, Generating enter data create(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:)) 1622, Generating enter data create(sclrprtp_forcing(:,:),sclrpthlp_forcing(:,:),sclrp2_forcing(:,:)) 1629, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1630, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1631, ! blockidx%x threadidx%x collapsed 1629, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 1675, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1676, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1677, ! blockidx%x threadidx%x collapsed 1675, Generating default present(sclrp2_forcing(:ngrdcol,:nzm)) 1699, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1700, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1701, ! blockidx%x threadidx%x collapsed 1699, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm)) 1709, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1710, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1711, ! blockidx%x threadidx%x collapsed 1709, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm)) 1734, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1735, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1736, ! blockidx%x threadidx%x collapsed 1734, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm)) 1744, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1745, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1746, ! blockidx%x threadidx%x collapsed 1744, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm)) 1778, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1779, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1780, ! blockidx%x threadidx%x collapsed 1778, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm)) 1789, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 1790, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1791, ! blockidx%x threadidx%x collapsed 1792, ! blockidx%x threadidx%x collapsed 1789, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 1807, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1808, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1809, ! blockidx%x threadidx%x collapsed 1807, Generating default present(rtp2(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),solution(:ngrdcol,:nzm,:3),rtpthlp(:ngrdcol,:nzm)) 1818, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 1819, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1820, ! blockidx%x threadidx%x collapsed 1821, ! blockidx%x threadidx%x collapsed 1818, Generating default present(sclrprtp(:ngrdcol,:nzm,:sclr_dim),sclrp2(:ngrdcol,:nzm,:sclr_dim),solution(:ngrdcol,:nzm,:),sclrpthlp(:ngrdcol,:nzm,:sclr_dim)) 1835, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:),lhs_ta(:,:,:)) 1859, Generating exit data delete(lhs(:,:,:),rhs(:,:,:),lhs_dp1(:,:),solution(:,:,:)) 1861, Generating exit data delete(sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:),sclrp2_forcing(:,:)) wp2_term_pr3_rhs: 3712, Generating copyin(c_uu_shr(:),gr) [if not already present] Generating copyout(rhs_pr3_wp2(:,:)) [if not already present] Generating copyin(vpwp(:,:),wpthvp(:,:),um(:,:),thv_ds_zm(:,:),vm(:,:),upwp(:,:),c_uu_buoy(:),gr%invrs_dzm(:,:)) [if not already present] 3717, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3718, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3718, Generating implicit firstprivate(nzm) 3726, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3727, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3728, ! blockidx%x threadidx%x collapsed wp2_term_pr1_rhs: 3833, Generating copyout(rhs_pr1_wp2(:,:)) [if not already present] Generating copyin(up2(:,:),vp2(:,:),c4(:),invrs_tau_c4_zm(:,:)) [if not already present] 3837, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3838, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3838, Generating implicit firstprivate(nzm) 3846, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3847, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3848, ! blockidx%x threadidx%x collapsed wp2_term_pr_dfsn_rhs: 3934, Generating copyin(c_wp2_pr_dfsn(:),gr%invrs_dzm(:,:),gr,invrs_rho_ds_zm(:,:)) [if not already present] Generating create(wpuip2(:,:)) [if not already present] Generating copyin(wpvp2(:,:),wpup2(:,:)) [if not already present] Generating copyout(rhs_pr_dfsn_wp2(:,:)) [if not already present] Generating copyin(rho_ds_zt(:,:),wp3(:,:)) [if not already present] 3939, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3940, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3941, ! blockidx%x threadidx%x collapsed 3947, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3948, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3949, ! blockidx%x threadidx%x collapsed 3957, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3958, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3958, Generating implicit firstprivate(nzm) wp3_term_ta_new_pdf_lhs: 4095, Generating copyin(coef_wp4_implicit(:,:),gr,gr%invrs_dzt(:,:)) [if not already present] Generating copyout(lhs_ta_wp3(:,:,:)) [if not already present] Generating copyin(rho_ds_zm(:,:),wp2(:,:),invrs_rho_ds_zt(:,:)) [if not already present] 4100, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4101, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4103, !$acc loop seq 4103, Loop is parallelizable Generating implicit firstprivate(nzt) 4110, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4111, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4112, ! blockidx%x threadidx%x collapsed nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_pdf_main.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/new_hybrid_pdf_main.F90 wp3_term_ta_adg1_lhs: 4296, Generating copyin(a3_coef_zt(:,:),gr,gr%invrs_dzt(:,:),rho_ds_zt(:,:),a1_coef(:,:),a1_coef_zt(:,:),a3_coef(:,:),wp2(:,:),wp3_on_wp2(:,:)) [if not already present] Generating copyout(lhs_ta_wp3(:,:,:)) [if not already present] Generating copyin(rho_ds_zm(:,:),gr%weights_zt2zm(:,:,:),invrs_rho_ds_zt(:,:)) [if not already present] 4303, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4304, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4305, ! blockidx%x threadidx%x collapsed 4305, Generating implicit firstprivate(nzt) 4326, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4327, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4328, ! blockidx%x threadidx%x collapsed 4374, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4375, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4413, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4414, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4415, ! blockidx%x threadidx%x collapsed 4457, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4458, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4504, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4505, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4506, ! blockidx%x threadidx%x collapsed 4552, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4553, !$acc loop gang, vector(128) ! blockidx%x threadidx%x wp3_term_tp_lhs: 4704, Generating copyin(gr%invrs_dzt(:,:),gr) [if not already present] Generating copyout(lhs_tp_wp3(:,:,:)) [if not already present] Generating copyin(wp2(:,:),rho_ds_zm(:,:),invrs_rho_ds_zt(:,:)) [if not already present] 4709, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4710, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4711, !$acc loop seq 4710, Generating implicit firstprivate(i) 4711, Loop is parallelizable Generating implicit firstprivate(nzt) 4721, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4722, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4723, ! blockidx%x threadidx%x collapsed 4721, Generating default present(coef_wp3_tp(:ngrdcol)) solve_xp2_xpyp_with_multiple_lhs: 2056, Generating enter data create(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold) 2059, Generating enter data create(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_forcing(:,:),sclrpthlp_solution(:,:,:),sclrprtp_forcing(:,:)) 2069, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2070, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2071, ! blockidx%x threadidx%x collapsed 2069, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2099, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2100, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2101, ! blockidx%x threadidx%x collapsed 2099, Generating default present(rtp2_solution(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm)) 2107, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2109, ! blockidx%x threadidx%x collapsed 2107, Generating default present(rtp2_solution(:ngrdcol,:nzm),rtp2(:ngrdcol,:nzm)) 2118, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtp2(:,:),lhs_ta_wprtp2(:,:,:)) 2135, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2136, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2137, ! blockidx%x threadidx%x collapsed 2135, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2166, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2167, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2168, ! blockidx%x threadidx%x collapsed 2166, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm)) 2174, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2175, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2176, ! blockidx%x threadidx%x collapsed 2174, Generating default present(thlp2_solution(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm)) 2185, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),thlp2(:,:),lhs_ta_wpthlp2(:,:,:)) 2201, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2202, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2203, ! blockidx%x threadidx%x collapsed 2201, Generating default present(lhs_dp1(:ngrdcol,2:nzm-1)) 2232, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2233, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2234, ! blockidx%x threadidx%x collapsed 2232, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm)) 2240, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2241, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2242, ! blockidx%x threadidx%x collapsed 2240, Generating default present(rtpthlp_solution(:ngrdcol,:nzm),rtpthlp(:ngrdcol,:nzm)) 2251, Generating update self(lhs_dp1(:,:),lhs_ma(:,:,:),lhs_diff(:,:,:),rtpthlp(:,:),lhs_ta_wprtpthlp(:,:,:)) 2268, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2269, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2270, ! blockidx%x threadidx%x collapsed 2268, Generating default present(lhs_dp1(:ngrdcol,:nzm)) 2411, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2412, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2413, ! blockidx%x threadidx%x collapsed 2411, Generating default present(sclrp2_forcing(:ngrdcol,:nzm)) 2435, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2436, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2437, ! blockidx%x threadidx%x collapsed 2435, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm),rtp2_forcing(:ngrdcol,:nzm)) 2445, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2446, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2447, ! blockidx%x threadidx%x collapsed 2445, Generating default present(sclrprtp_forcing(:ngrdcol,:nzm)) 2471, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2472, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2473, ! blockidx%x threadidx%x collapsed 2471, Generating default present(thlp2_forcing(:ngrdcol,:nzm),sclrpthlp_forcing(:ngrdcol,:nzm)) 2481, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2482, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2483, ! blockidx%x threadidx%x collapsed 2481, Generating default present(sclrpthlp_forcing(:ngrdcol,:nzm)) 2513, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2514, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2515, ! blockidx%x threadidx%x collapsed 2516, ! blockidx%x threadidx%x collapsed 2513, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim)) 2530, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2531, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2532, ! blockidx%x threadidx%x collapsed 2533, ! blockidx%x threadidx%x collapsed 2530, Generating default present(sclr_solution(:ngrdcol,:nzm,:),sclrp2(:ngrdcol,:nzm,:sclr_dim),sclrpthlp(:ngrdcol,:nzm,:sclr_dim),sclrprtp(:ngrdcol,:nzm,:sclr_dim)) 2548, Generating exit data delete(rtp2_solution(:,:),rtpthlp_solution(:,:),rhs(:,:),lhs(:,:,:),thlp2_solution(:,:),lhs_dp1(:,:),threshold) 2551, Generating exit data delete(sclrp2_forcing(:,:),sclrprtp_solution(:,:,:),sclrp2_solution(:,:,:),sclr_solution(:,:,:),sclr_rhs(:,:,:),sclrpthlp_solution(:,:,:),sclrpthlp_forcing(:,:),sclrprtp_forcing(:,:)) wp3_terms_ac_pr2_lhs: 4836, Generating copyin(c11_skw_fnc(:,:),gr%invrs_dzt(:,:),gr,wm_zm(:,:)) [if not already present] Generating copyout(lhs_ac_pr2_wp3(:,:)) [if not already present] 4840, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4841, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4841, Generating implicit firstprivate(nzt) 4850, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4851, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4852, ! blockidx%x threadidx%x collapsed wp3_term_pr1_lhs: 4957, Generating copyin(c8b(:),skw_zt(:,:)) [if not already present] Generating copyout(lhs_pr1_wp3(:,:)) [if not already present] Generating copyin(c8(:),invrs_tau_wp3_zt(:,:)) [if not already present] 4961, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4962, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4962, Generating implicit firstprivate(nzt) 4972, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4973, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4974, ! blockidx%x threadidx%x collapsed 4983, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4984, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4985, ! blockidx%x threadidx%x collapsed xp2_xpyp_lhs: 2628, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2629, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2630, ! blockidx%x threadidx%x collapsed 2628, Generating default present(lhs_diff(:,:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,2:nzm-1),lhs_dp1(:ngrdcol,2:nzm-1),lhs_ma(:,:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1)) 2642, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2643, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2644, ! blockidx%x threadidx%x collapsed 2642, Generating default present(lhs(2,:ngrdcol,2:nzm-1)) 2644, Generating implicit firstprivate(dt) 2657, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 2658, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 2657, Generating default present(lhs(:,:ngrdcol,:)) 2658, Generating implicit firstprivate(nzm) wp3_term_ta_explicit_rhs: 5087, Generating copyin(wp4(:,:)) [if not already present] Generating copyout(rhs_ta_wp3(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zt(:,:),gr%invrs_dzt(:,:),gr,rho_ds_zm(:,:)) [if not already present] 5091, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5092, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5092, Generating implicit firstprivate(nzt) 5101, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5102, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5103, ! blockidx%x threadidx%x collapsed wp3_terms_bp1_pr2_rhs: 5176, Generating copyout(rhs_bp1_pr2_wp3(:,:)) [if not already present] Generating copyin(thv_ds_zt(:,:),wp2thvp(:,:),c11_skw_fnc(:,:)) [if not already present] 5180, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5181, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5181, Generating implicit firstprivate(nzt) 5190, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5191, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5192, ! blockidx%x threadidx%x collapsed wp3_term_pr_turb_rhs: 5280, Generating copyin(wp2(:,:),wpthvp(:,:),dum_dz(:,:),thv_ds_zt(:,:),upwp(:,:)) [if not already present] Generating copyout(rhs_pr_turb_wp3(:,:)) [if not already present] Generating copyin(kh_zt(:,:),invrs_rho_ds_zt(:,:),gr%invrs_dzt(:,:),vpwp(:,:),dvm_dz(:,:),em(:,:),gr,rho_ds_zm(:,:)) [if not already present] 5286, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5287, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5287, Generating implicit firstprivate(nzt) 5297, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5298, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5299, ! blockidx%x threadidx%x collapsed 5297, Generating default present(c_wp3_pr_turb(:ngrdcol)) 5311, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5312, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5313, ! blockidx%x threadidx%x collapsed 5311, Generating default present(c_wp3_pr_turb(:ngrdcol)) xp2_xpyp_uv_rhs: 3147, Generating enter data create(rhs_pr2(:,:),rhs_term_tp(:,:),rhs_pr1(:,:)) 3175, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3176, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3177, ! blockidx%x threadidx%x collapsed 3175, Generating default present(lhs_splat_wp2(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1)) 3202, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3203, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3204, ! blockidx%x threadidx%x collapsed 3202, Generating default present(rhs_pr1(:ngrdcol,2:nzm-1),c_uu_shr(:ngrdcol),lhs_dp1_c14(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1),lhs_dp1_c4(:ngrdcol,2:nzm-1),xap2(:ngrdcol,:nzm),rhs_term_tp(:ngrdcol,2:nzm-1)) 3231, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3232, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3233, ! blockidx%x threadidx%x collapsed 3231, Generating default present(rhs(:ngrdcol,2:nzm-1),xap2(:ngrdcol,2:nzm-1)) 3233, Generating implicit firstprivate(dt) 3241, Generating update self(lhs_dp1_c14(:,:),invrs_tau_c4_zm(:,:),rhs_ta(:,:),lhs_dp1_c4(:,:),lhs_ta(:,:,:),invrs_tau_c14_zm(:,:),rhs_term_tp(:,:),xbp2(:,:),xap2(:,:),wp2(:,:),lhs_splat_wp2(:,:),rhs_pr2(:,:)) 3326, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3327, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3326, Generating default present(xap2(:ngrdcol,:1),rhs(:ngrdcol,:)) 3327, Generating implicit firstprivate(nzm) 3335, Generating exit data delete(rhs_term_tp(:,:),rhs_pr2(:,:),rhs_pr1(:,:)) advance_xm_wpxp: 494, Generating enter data create(lhs_pr1_wprtp(:,:),lhs_ma_zt(:,:,:),kw6(:,:),lhs_ta_wpvp(:,:,:),lhs_ta_xm(:,:,:),rhs_ta_wpup(:,:),rhs_ta_wpthlp(:,:),rhs_ta_wprtp(:,:),low_lev_effect(:,:),lhs_ta_wpup(:,:,:),lhs_ta_wpthlp(:,:,:),lhs_ta_wprtp(:,:,:),lhs_pr1_wpthlp(:,:),lhs_diff_zt(:,:,:),lhs_ma_zm(:,:,:),lhs_diff_zm(:,:,:),lhs_ac_pr2(:,:),vm_old(:,:),upwp_old(:,:),um_old(:,:),thlm_old(:,:),wprtp_old(:,:),rtm_old(:,:),vpwp_old(:,:),rhs_ta_wpvp(:,:),c7_skw_fnc(:,:),lhs_tp(:,:,:),high_lev_effect(:,:),c6thl_skw_fnc(:,:),c6rt_skw_fnc(:,:),c6_term(:,:),wpthlp_old(:,:)) 503, Generating enter data create(lhs_ta_wpsclrp(:,:,:,:),lhs_pr1_wpsclrp(:,:),sclrm_old(:,:,:),wpsclrp_old(:,:,:),rhs_ta_wpsclrp(:,:,:)) 541, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 542, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 543, ! blockidx%x threadidx%x collapsed 541, Generating default present(thlm_old(:ngrdcol,:nzt),thlm(:ngrdcol,:nzt),rtm_old(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt)) 550, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 551, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 552, ! blockidx%x threadidx%x collapsed 550, Generating default present(wpthlp_old(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp_old(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm)) 560, Generating implicit firstprivate(ngrdcol,sclr_dim,nzt) Generating NVIDIA GPU code 561, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 562, ! blockidx%x threadidx%x collapsed 563, ! blockidx%x threadidx%x collapsed 560, Generating default present(sclrm_old(:ngrdcol,:nzt,:sclr_dim),sclrm(:ngrdcol,:nzt,:sclr_dim)) 570, Generating implicit firstprivate(ngrdcol,nzm,sclr_dim) Generating NVIDIA GPU code 571, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 572, ! blockidx%x threadidx%x collapsed 573, ! blockidx%x threadidx%x collapsed 570, Generating default present(wpsclrp(:ngrdcol,:nzm,:sclr_dim),wpsclrp_old(:ngrdcol,:nzm,:sclr_dim)) 582, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 583, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 584, ! blockidx%x threadidx%x collapsed 582, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 591, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 592, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 593, ! blockidx%x threadidx%x collapsed 591, Generating default present(vpwp(:ngrdcol,:nzm),vpwp_old(:ngrdcol,:nzm),upwp_old(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm)) 605, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 606, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 607, ! blockidx%x threadidx%x collapsed 605, Generating default present(c6rt_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,10:12)) 607, Generating implicit firstprivate(c6rt,c6rtc,c6rtb) 626, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 627, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 628, ! blockidx%x threadidx%x collapsed 626, Generating default present(c6thl_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,13:15),skw_zm(:ngrdcol,:nzm)) 628, Generating implicit firstprivate(c6thl,c6thlc,c6thlb) 659, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 660, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 661, ! blockidx%x threadidx%x collapsed 659, Generating default present(c6rt_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,10:13),c6thl_skw_fnc(:ngrdcol,:nzm)) 673, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 674, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 675, ! blockidx%x threadidx%x collapsed 673, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm),c7_skw_fnc(:ngrdcol,:nzm)) 683, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 684, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 685, ! blockidx%x threadidx%x collapsed 683, Generating default present(c7_skw_fnc(:ngrdcol,:nzm),skw_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,16:18)) 685, Generating implicit firstprivate(c7,c7b,c7c) 715, Generating update self(c6rt_skw_fnc(:,:),c7_skw_fnc(:,:),c6thl_skw_fnc(:,:)) 733, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 734, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 735, ! blockidx%x threadidx%x collapsed 733, Generating default present(c7_skw_fnc(:ngrdcol,:nzm)) Generating implicit copy(err_code) [if not already present] 753, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 754, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 755, ! blockidx%x threadidx%x collapsed 753, Generating default present(kw6(:ngrdcol,:nzt),kh_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,42)) 777, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 778, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 779, ! blockidx%x threadidx%x collapsed 777, Generating default present(c6_term(:ngrdcol,:nzm),invrs_tau_c6_zm(:ngrdcol,:nzm),c6rt_skw_fnc(:ngrdcol,:nzm)) 786, Generating update self(c6_term(:,:)) 900, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 901, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 902, ! blockidx%x threadidx%x collapsed 900, Generating default present(rtm(:ngrdcol,:nzt),thlm_old(:ngrdcol,:nzt),thlm(:ngrdcol,:nzt),rtm_old(:ngrdcol,:nzt)) 909, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 910, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 911, ! blockidx%x threadidx%x collapsed 909, Generating default present(wprtp(:ngrdcol,:nzm),wpthlp_old(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wprtp_old(:ngrdcol,:nzm)) 919, Generating implicit firstprivate(ngrdcol,sclr_dim,nzt) Generating NVIDIA GPU code 920, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 921, ! blockidx%x threadidx%x collapsed 922, ! blockidx%x threadidx%x collapsed 919, Generating default present(sclrm_old(:ngrdcol,:nzt,:sclr_dim),sclrm(:ngrdcol,:nzt,:sclr_dim)) 929, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 930, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 931, ! blockidx%x threadidx%x collapsed 932, ! blockidx%x threadidx%x collapsed 929, Generating default present(wpsclrp_old(:ngrdcol,:nzm,:sclr_dim),wpsclrp(:ngrdcol,:nzm,:sclr_dim)) 942, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 943, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 944, ! blockidx%x threadidx%x collapsed 942, Generating default present(vm_old(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_old(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 951, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 952, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 953, ! blockidx%x threadidx%x collapsed 951, Generating default present(vpwp_old(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm),upwp_old(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm)) 967, Generating update self(vpwp(:,:),vm_forcing(:,:),upwp(:,:),um_forcing(:,:),wpsclrp(:,:,:),sclrm_forcing(:,:,:),wpthlp_forcing(:,:),thlm_forcing(:,:),wprtp_forcing(:,:),rtm_forcing(:,:),vprcp(:,:),vg(:,:),uprcp(:,:),ug(:,:),wprtp_old(:,:),rtpthvp(:,:),wpsclrp_old(:,:,:),skw_zm(:,:),wp3_on_wp2_zt(:,:),rho_ds_zt(:,:),mixt_frac_zm(:,:),vp2(:,:),up2(:,:),vm_ref(:,:),um_ref(:,:),vm_old(:,:),um_old(:,:),em(:,:),wpthvp(:,:),wpthlp_old(:,:),varnce_w_2_zm(:,:),thv_ds_zm(:,:),vm(:,:),um(:,:),sclrm_old(:,:,:),sclrm(:,:,:),sclrp2(:,:,:),wp2rtp(:,:),cx_fnc_richardson(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_old(:,:),w_1_zm(:,:),vpwp_old(:,:),thlm_ref(:,:),rtm_ref(:,:),thlpthvp(:,:),invrs_rho_ds_zm(:,:),fcor(:),rho_ds_zm(:,:),rc_coef_zm(:,:),thlm_old(:,:),wpthlp(:,:),thlm(:,:),thlp2(:,:),wp2sclrp(:,:,:),rtm_old(:,:),wprtp(:,:),rtm(:,:),rtp2(:,:),wp2(:,:),sigma_sqd_w(:,:),invrs_rho_ds_zt(:,:),invrs_tau_c6_zm(:,:),kh_zm(:,:),wp3_on_wp2(:,:),wp2thlp(:,:),kh_zt(:,:),wm_zt(:,:),wm_zm(:,:),w_2_zm(:,:),sclrpthvp(:,:,:)) 1025, Generating update self(rtm_ref(:,:),rtm(:,:)) 1046, Generating update device(rtm(:,:)) 1052, Generating update self(thlm_ref(:,:),thlm(:,:)) 1073, Generating update device(thlm(:,:)) 1081, Generating update self(vm_ref(:,:),vm(:,:),um(:,:),um_ref(:,:)) 1111, Generating update device(vm(:,:),um(:,:)) 1120, Generating update self(vm(:,:),um(:,:)) 1129, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1130, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1131, ! blockidx%x threadidx%x collapsed 1129, Generating default present(vm_ref(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),um_ref(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 1131, Generating implicit firstprivate(ts_nudge,dt) 1140, Generating update self(vm(:,:),um(:,:)) 1152, Generating update self(vm_ref(:,:),um_ref(:,:)) 1165, Generating exit data delete(lhs_pr1_wprtp(:,:),lhs_ma_zt(:,:,:),kw6(:,:),lhs_ta_wpvp(:,:,:),lhs_ta_xm(:,:,:),rhs_ta_wpup(:,:),rhs_ta_wpthlp(:,:),rhs_ta_wprtp(:,:),low_lev_effect(:,:),lhs_ta_wpup(:,:,:),lhs_ta_wpthlp(:,:,:),lhs_ta_wprtp(:,:,:),lhs_pr1_wpthlp(:,:),lhs_diff_zt(:,:,:),lhs_ma_zm(:,:,:),lhs_diff_zm(:,:,:),lhs_ac_pr2(:,:),vm_old(:,:),upwp_old(:,:),um_old(:,:),thlm_old(:,:),wprtp_old(:,:),rtm_old(:,:),vpwp_old(:,:),rhs_ta_wpvp(:,:),c7_skw_fnc(:,:),lhs_tp(:,:,:),high_lev_effect(:,:),c6thl_skw_fnc(:,:),c6rt_skw_fnc(:,:),c6_term(:,:),wpthlp_old(:,:)) 1174, Generating exit data delete(lhs_ta_wpsclrp(:,:,:,:),lhs_pr1_wpsclrp(:,:),wpsclrp_old(:,:,:),sclrm_old(:,:,:),rhs_ta_wpsclrp(:,:,:)) wp3_term_pr_dfsn_rhs: 5405, Generating copyin(gr%invrs_dzt(:,:),invrs_rho_ds_zt(:,:)) [if not already present] Generating create(wp2uip2(:,:)) [if not already present] Generating copyin(wp2up2(:,:),wp4(:,:),wp2vp2(:,:)) [if not already present] Generating copyout(rhs_pr_dfsn_wp3(:,:)) [if not already present] Generating copyin(up2(:,:),vp2(:,:),gr,rho_ds_zm(:,:)) [if not already present] Generating create(wp2_uip2(:,:)) [if not already present] Generating copyin(wp2(:,:)) [if not already present] 5411, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5412, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5413, ! blockidx%x threadidx%x collapsed 5420, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5421, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5421, Generating implicit firstprivate(nzt) 5429, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5430, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5431, ! blockidx%x threadidx%x collapsed 5429, Generating default present(c_wp3_pr_dfsn(:ngrdcol)) wp3_term_pr1_rhs: 5531, Generating copyout(rhs_pr1_wp3(:,:)) [if not already present] Generating copyin(wp3(:,:),skw_zt(:,:),invrs_tau_wp3_zt(:,:)) [if not already present] 5535, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5536, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5536, Generating implicit firstprivate(nzt) 5546, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5547, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5548, ! blockidx%x threadidx%x collapsed 5546, Generating default present(c8b(:ngrdcol),c8(:ngrdcol)) 5555, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5556, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5557, ! blockidx%x threadidx%x collapsed 5555, Generating default present(c8b(:ngrdcol),c8(:ngrdcol)) xp2_xpyp_rhs: 3495, Generating enter data create(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:)) 3546, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3547, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3548, ! blockidx%x threadidx%x collapsed 3546, Generating default present(lhs_ta(:,:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1),rhs_term_dp1(:ngrdcol,2:nzm-1),lhs_term_dp1(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1),xapxbp(:ngrdcol,:nzm),rhs_term_tp(:ngrdcol,2:nzm-1)) 3601, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3602, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3603, ! blockidx%x threadidx%x collapsed 3601, Generating default present(xpyp_forcing(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1)) 3610, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3611, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3612, ! blockidx%x threadidx%x collapsed 3610, Generating default present(xapxbp(:ngrdcol,2:nzm-1),rhs(:ngrdcol,2:nzm-1)) 3612, Generating implicit firstprivate(dt) 3620, Generating update self(lhs_ta(:,:,:),rhs_ta(:,:),xpyp_forcing(:,:),xbm(:,:),rhs_term_tp(:,:),wpxap(:,:),xapxbp(:,:),rhs_term_dp1(:,:),wpxbp(:,:),cn(:,:),xam(:,:),invrs_tau_zm(:,:),lhs_term_dp1(:,:)) 3722, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3723, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3722, Generating default present(xapxbp(:ngrdcol,:1),rhs(:ngrdcol,:)) 3723, Generating implicit firstprivate(threshold,nzm) 3729, Generating exit data delete(lhs_term_dp1(:,:),rhs_term_tp(:,:),rhs_term_dp1(:,:)) xm_wpxp_lhs: 1323, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1324, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1323, Generating default present(lhs(:,:ngrdcol,:1)) 1334, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1335, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1336, ! blockidx%x threadidx%x collapsed 1334, Generating default present(lhs(:,:ngrdcol,:),lhs_ta_xm(:,:ngrdcol,:nzt)) 1336, Generating implicit firstprivate(k_xm,invrs_dt) 1356, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1357, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1358, ! blockidx%x threadidx%x collapsed 1356, Generating default present(lhs(:,:ngrdcol,:),lhs_ma_zm(:,:ngrdcol,2:nzm-1),lhs_tp(:,:ngrdcol,2:nzm-1),lhs_ta_wpxp(:,:ngrdcol,2:nzm-1),lhs_diff_zm(:,:ngrdcol,2:nzm-1),lhs_ac_pr2(:ngrdcol,2:nzm-1),lhs_pr1(:ngrdcol,2:nzm-1)) 1358, Generating implicit firstprivate(k_wpxp) 1383, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1384, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1383, Generating default present(lhs(:,:ngrdcol,nzm*2-1)) 1384, Generating implicit firstprivate(nzm) 1395, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1396, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1397, ! blockidx%x threadidx%x collapsed 1395, Generating default present(lhs(3,:ngrdcol,:)) 1397, Generating implicit firstprivate(k_wpxp,invrs_dt) 1407, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1408, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1409, ! blockidx%x threadidx%x collapsed 1407, Generating default present(lhs_diff_zt(:,:ngrdcol,:nzt),lhs(:,:ngrdcol,:)) 1409, Generating implicit firstprivate(k_xm) 1421, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1422, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1423, ! blockidx%x threadidx%x collapsed 1421, Generating default present(lhs_ma_zt(:,:ngrdcol,:nzt),lhs(:,:ngrdcol,:)) 1423, Generating implicit firstprivate(k_xm) calc_xm_wpxp_lhs_terms: 1562, Generating enter data create(zeros_array(:),kw6_zm(:,:),kh_n2_zm(:,:),k_zm(:,:),k_zt(:,:)) 1598, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1599, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1600, ! blockidx%x threadidx%x collapsed 1598, Generating default present(kh_zm(:ngrdcol,:nzm),stability_correction(:ngrdcol,:nzm),kh_n2_zm(:ngrdcol,:nzm)) 1607, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1608, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1609, ! blockidx%x threadidx%x collapsed 1607, Generating default present(kh_zm(:ngrdcol,:nzm),kh_n2_zm(:ngrdcol,:nzm)) 1616, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1617, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1618, ! blockidx%x threadidx%x collapsed 1616, Generating default present(kh_n2_zm(:ngrdcol,:nzm),k_zm(:ngrdcol,:nzm)) 1626, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1627, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1626, Generating default present(zeros_array(:ngrdcol)) 1646, Generating exit data delete(zeros_array(:),kw6_zm(:,:),kh_n2_zm(:,:),k_zm(:,:),k_zt(:,:)) xm_wpxp_rhs: 1792, Generating enter data create(rhs_bp_pr3(:,:)) 1801, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1802, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1801, Generating default present(wpxp(:ngrdcol,:1),rhs(:ngrdcol,:1)) 1809, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1810, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1811, ! blockidx%x threadidx%x collapsed 1809, Generating default present(rhs(:ngrdcol,:),xm_forcing(:ngrdcol,:nzt),xm(:ngrdcol,:nzt)) 1811, Generating implicit firstprivate(k_xm,invrs_dt) 1825, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1826, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1827, ! blockidx%x threadidx%x collapsed 1825, Generating default present(lhs_ta_wpxp(:,:ngrdcol,2:nzm-1),rhs(:ngrdcol,:),wpxp_forcing(:ngrdcol,2:nzm-1),wpxp(:ngrdcol,:nzm),rhs_bp_pr3(:ngrdcol,2:nzm-1),lhs_pr1(:ngrdcol,2:nzm-1),rhs_ta(:ngrdcol,2:nzm-1)) 1827, Generating implicit firstprivate(k_wpxp) 1842, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1843, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1842, Generating default present(rhs(:ngrdcol,nzm*2-1)) 1843, Generating implicit firstprivate(nzm) 1851, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1852, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1853, ! blockidx%x threadidx%x collapsed 1851, Generating default present(wpxp(:ngrdcol,2:nzm-1),rhs(:ngrdcol,:)) 1853, Generating implicit firstprivate(k_wpxp,invrs_dt) 1864, Generating update self(lhs_ta_wpxp(:,:,:),rhs(:,:),c7_skw_fnc(:,:),rhs_ta(:,:),xpthvp(:,:),xm_forcing(:,:),wpxp(:,:),xm(:,:),thv_ds_zm(:,:),wpxp_forcing(:,:),lhs_pr1(:,:)) 1992, Generating exit data delete(rhs_bp_pr3(:,:)) calc_xm_wpxp_ta_terms: 2182, Generating enter data create(a1_coef(:,:),sgn_t_vel_wprtp(:,:),coef_wp2thlp_implicit_zm(:,:),term_wp2thlp_explicit(:,:),coef_wp2thlp_implicit(:,:),term_wp2rtp_explicit_zm(:,:),coef_wp2rtp_implicit_zm(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),sgn_t_vel_wpthlp(:,:),a1_coef_zt(:,:),term_wp2thlp_explicit_zm(:,:)) 2188, Generating enter data create(term_wp2sclrp_explicit(:,:),term_wp2sclrp_explicit_zm(:,:),sgn_t_vel_wpsclrp(:,:)) 2211, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 2212, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2213, ! blockidx%x threadidx%x collapsed 2214, ! blockidx%x threadidx%x collapsed 2211, Generating default present(lhs_ta_wpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2223, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2224, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 2225, ! blockidx%x threadidx%x collapsed 2226, ! blockidx%x threadidx%x collapsed 2227, ! blockidx%x threadidx%x collapsed 2223, Generating default present(lhs_ta_wpsclrp(:,:ngrdcol,:nzm,sclr_dim)) 2236, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2237, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2238, ! blockidx%x threadidx%x collapsed 2236, Generating default present(term_wp2rtp_explicit(:ngrdcol,:nzt),wp2rtp(:ngrdcol,:nzt),wp2thlp(:ngrdcol,:nzt),term_wp2thlp_explicit(:ngrdcol,:nzt)) 2265, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2266, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2267, ! blockidx%x threadidx%x collapsed 2265, Generating default present(wp2sclrp(:ngrdcol,:nzt,sclr),term_wp2sclrp_explicit(:ngrdcol,:nzt)) 2299, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2300, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2301, ! blockidx%x threadidx%x collapsed 2299, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a1_coef(:ngrdcol,:nzm)) 2312, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 2313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2314, ! blockidx%x threadidx%x collapsed 2312, Generating default present(coef_wp2rtp_implicit(:ngrdcol,:nzt),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wp2thlp_implicit(:ngrdcol,:nzt)) 2335, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2336, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2337, ! blockidx%x threadidx%x collapsed 2335, Generating default present(coef_wp2rtp_implicit(:ngrdcol,:nzt),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wp2thlp_implicit(:ngrdcol,:nzt)) 2353, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2354, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2355, ! blockidx%x threadidx%x collapsed 2356, ! blockidx%x threadidx%x collapsed 2353, Generating default present(lhs_ta_wpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2364, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2365, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 2366, ! blockidx%x threadidx%x collapsed 2367, ! blockidx%x threadidx%x collapsed 2368, ! blockidx%x threadidx%x collapsed 2364, Generating default present(lhs_ta_wpsclrp(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wprtp(:,:ngrdcol,:nzm)) 2378, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2379, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2380, ! blockidx%x threadidx%x collapsed 2378, Generating default present(term_wp2thlp_explicit(:ngrdcol,:nzt),term_wp2rtp_explicit(:ngrdcol,:nzt)) 2390, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2391, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2392, ! blockidx%x threadidx%x collapsed 2390, Generating default present(rhs_ta_wpthlp(:ngrdcol,:nzm),rhs_ta_wprtp(:ngrdcol,:nzm)) 2400, Generating implicit firstprivate(ngrdcol,sclr_dim,nzm) Generating NVIDIA GPU code 2401, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2402, ! blockidx%x threadidx%x collapsed 2403, ! blockidx%x threadidx%x collapsed 2400, Generating default present(rhs_ta_wpsclrp(:ngrdcol,:nzm,:sclr_dim)) 2415, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2416, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 2417, ! blockidx%x threadidx%x collapsed 2418, ! blockidx%x threadidx%x collapsed 2415, Generating default present(lhs_ta_wprtp(:,:ngrdcol,:nzm),lhs_ta_wpvp(:,:ngrdcol,:nzm),lhs_ta_wpup(:,:ngrdcol,:nzm)) 2428, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2429, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2430, ! blockidx%x threadidx%x collapsed 2428, Generating default present(rhs_ta_wpvp(:ngrdcol,:nzm),rhs_ta_wpup(:ngrdcol,:nzm)) 2562, Generating update self(term_wp2thlp_explicit(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),coef_wp2thlp_implicit(:,:)) 2580, Generating exit data delete(a1_coef(:,:),sgn_t_vel_wprtp(:,:),coef_wp2thlp_implicit_zm(:,:),term_wp2thlp_explicit(:,:),coef_wp2thlp_implicit(:,:),term_wp2rtp_explicit_zm(:,:),coef_wp2rtp_implicit_zm(:,:),term_wp2rtp_explicit(:,:),coef_wp2rtp_implicit(:,:),sgn_t_vel_wpthlp(:,:),a1_coef_zt(:,:),term_wp2thlp_explicit_zm(:,:)) 2586, Generating exit data delete(term_wp2sclrp_explicit_zm(:,:),term_wp2sclrp_explicit(:,:),sgn_t_vel_wpsclrp(:,:)) solve_xm_wpxp_with_single_lhs: 2934, Generating enter data create(upwp_forcing_pert(:,:),tau_c6_zm(:,:),vpthvp_pert(:,:),upthvp_pert(:,:),ddzt_vm(:,:),ddzt_um(:,:),ddzt_um_pert(:,:),vpwp_forcing_pert(:,:),old_solution(:,:,:),lhs(:,:,:),rhs_save(:,:,:),rhs(:,:,:),rcond(:),vprtp(:,:),uprtp(:,:),vpthlp(:,:),upthlp(:,:),vpthvp(:,:),upthvp(:,:),vpwp_forcing(:,:),upwp_forcing(:,:),solution(:,:,:),vm_tndcy(:,:),um_tndcy(:,:),vprtp_pert(:,:),uprtp_pert(:,:),vpthlp_pert(:,:),upthlp_pert(:,:),vpthvp_tmp(:,:),upthvp_tmp(:,:),vm_smth(:,:),um_smth(:,:),ddzt_vm_pert(:,:),zeros_vector(:,:)) 2942, Generating enter data create(wpsclrp_forcing(:,:,:)) 2946, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 2999, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3000, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3001, ! blockidx%x threadidx%x collapsed 2999, Generating default present(wpsclrp_forcing(:ngrdcol,:nzm,sclr)) 3001, Generating implicit firstprivate(sclr) 3031, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3032, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3033, ! blockidx%x threadidx%x collapsed 3031, Generating default present(vm_tndcy(:ngrdcol,:nzt),vm_forcing(:ngrdcol,:nzt),vm(:ngrdcol,:nzt),ug(:ngrdcol,:nzt),fcor(:ngrdcol),um_forcing(:ngrdcol,:nzt),vg(:ngrdcol,:nzt),um_tndcy(:ngrdcol,:nzt),um(:ngrdcol,:nzt)) 3042, Generating update self(ug(:,:),vg(:,:),fcor(:),um_forcing(:,:),vm_forcing(:,:),vm(:,:),um(:,:)) 3072, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3073, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3074, ! blockidx%x threadidx%x collapsed 3072, Generating default present(vm_tndcy(:ngrdcol,:nzt),um_tndcy(:ngrdcol,:nzt)) 3087, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3088, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3089, ! blockidx%x threadidx%x collapsed 3087, Generating default present(upwp_forcing(:ngrdcol,:nzm),ddzt_um(:ngrdcol,:nzm),ddzt_vm(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vpwp_forcing(:ngrdcol,:nzm),c_uu_shr(:ngrdcol)) 3101, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 3102, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3103, ! blockidx%x threadidx%x collapsed 3101, Generating default present(upwp_forcing_pert(:ngrdcol,:nzm),ddzt_um_pert(:ngrdcol,:nzm),ddzt_vm_pert(:ngrdcol,:nzm),c_uu_shr(:ngrdcol),wp2(:ngrdcol,:nzm),vpwp_forcing_pert(:ngrdcol,:nzm)) 3114, Generating update self(ddzt_um(:,:),c_uu_shr(:),wp2(:,:),ddzt_vm(:,:)) 3127, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3128, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3129, ! blockidx%x threadidx%x collapsed 3127, Generating default present(invrs_tau_c6_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm),tau_c6_zm(:ngrdcol,:nzm)) 3181, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3182, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3183, ! blockidx%x threadidx%x collapsed 3181, Generating default present(vpthvp_tmp(:ngrdcol,:nzm),vpthlp(:ngrdcol,:nzm),vprtp(:ngrdcol,:nzm),vprcp(:ngrdcol,:nzm),upthvp_tmp(:ngrdcol,:nzm),upthlp(:ngrdcol,:nzm),uprtp(:ngrdcol,:nzm),rc_coef_zm(:ngrdcol,:nzm),uprcp(:ngrdcol,:nzm),thv_ds_zm(:ngrdcol,:nzm)) 3198, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3199, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3200, ! blockidx%x threadidx%x collapsed 3198, Generating default present(vpthvp_pert(:ngrdcol,:nzm),vpthlp_pert(:ngrdcol,:nzm),vprtp_pert(:ngrdcol,:nzm),vprcp(:ngrdcol,:nzm),upthvp_pert(:ngrdcol,:nzm),upthlp_pert(:ngrdcol,:nzm),uprtp_pert(:ngrdcol,:nzm),uprcp(:ngrdcol,:nzm),rc_coef_zm(:ngrdcol,:nzm),thv_ds_zm(:ngrdcol,:nzm)) 3215, Generating update self(vpthvp(:,:),vpthlp(:,:),upthlp(:,:),upthvp(:,:),vprtp(:,:),uprtp(:,:)) 3283, Generating implicit firstprivate(nzm,nrhs,ngrdcol) Generating NVIDIA GPU code 3284, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 3285, ! blockidx%x threadidx%x collapsed 3286, ! blockidx%x threadidx%x collapsed 3283, Generating default present(rhs_save(:ngrdcol,:nzm*2-1,:nrhs),rhs(:ngrdcol,:nzm*2-1,:nrhs)) 3296, Generating implicit firstprivate(nzt) Generating NVIDIA GPU code 3305, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 3314, Generating implicit firstprivate(sclr_dim,nzt) Generating NVIDIA GPU code 3315, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3316, ! blockidx%x threadidx%x collapsed 3324, Generating implicit firstprivate(sclr_dim,nzm) Generating NVIDIA GPU code 3325, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3326, ! blockidx%x threadidx%x collapsed 3335, Generating implicit firstprivate(nzt) Generating NVIDIA GPU code 3344, Generating implicit firstprivate(nzm) Generating NVIDIA GPU code 3374, Generating update self(rhs_save(:,:,:),lhs(:,:,:),gr%zt(:,:),gr%zm(:,:)) 3685, Generating exit data delete(upwp_forcing_pert(:,:),tau_c6_zm(:,:),vpthvp_pert(:,:),upthvp_pert(:,:),ddzt_vm(:,:),ddzt_um(:,:),ddzt_um_pert(:,:),vpwp_forcing_pert(:,:),old_solution(:,:,:),lhs(:,:,:),rhs_save(:,:,:),rhs(:,:,:),rcond(:),vprtp(:,:),uprtp(:,:),vpthlp(:,:),upthlp(:,:),vpthvp(:,:),upthvp(:,:),vpwp_forcing(:,:),upwp_forcing(:,:),solution(:,:,:),vm_tndcy(:,:),um_tndcy(:,:),vprtp_pert(:,:),uprtp_pert(:,:),vpthlp_pert(:,:),upthlp_pert(:,:),vpthvp_tmp(:,:),upthvp_tmp(:,:),vm_smth(:,:),um_smth(:,:),ddzt_vm_pert(:,:),zeros_vector(:,:)) 3693, Generating exit data delete(wpsclrp_forcing(:,:,:)) calc_xp2_xpyp_ta_terms: 4036, Generating enter data create(wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),sgn_t_vel_rtpthlp(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:)) 4049, Generating enter data create(term_wpthlpsclrp_explicit_zm(:,:),wpsclrp_zt(:,:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:)) 4064, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4065, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4066, ! blockidx%x threadidx%x collapsed 4064, Generating default present(a1_coef(:ngrdcol,:nzm),sigma_sqd_w(:ngrdcol,:nzm)) 4075, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 4076, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4077, ! blockidx%x threadidx%x collapsed 4075, Generating default present(wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 4084, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4085, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4086, ! blockidx%x threadidx%x collapsed 4084, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp2_zt(:ngrdcol,:nzt)) 4349, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4350, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4351, ! blockidx%x threadidx%x collapsed 4349, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt)) 4364, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4365, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4366, ! blockidx%x threadidx%x collapsed 4364, Generating default present(coef_wprtp2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm)) 4388, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4389, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4390, ! blockidx%x threadidx%x collapsed 4388, Generating default present(coef_wprtp2_implicit(:ngrdcol,:nzt),coef_wprtpthlp_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),coef_wpthlp2_implicit(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt)) 4408, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 4409, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 4410, ! blockidx%x threadidx%x collapsed 4411, ! blockidx%x threadidx%x collapsed 4408, Generating default present(lhs_ta_wpthlp2(:,:ngrdcol,:nzm),lhs_ta_wprtpthlp(:,:ngrdcol,:nzm),lhs_ta_wprtp2(:,:ngrdcol,:nzm)) 4420, Generating implicit firstprivate(ngrdcol,nzm,sclr_dim) Generating NVIDIA GPU code 4421, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 4422, ! blockidx%x threadidx%x collapsed 4423, ! blockidx%x threadidx%x collapsed 4424, ! blockidx%x threadidx%x collapsed 4420, Generating default present(lhs_ta_wpthlpsclrp(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wpsclrp2(:,:ngrdcol,:nzm,:sclr_dim),lhs_ta_wprtp2(:,:ngrdcol,:nzm),lhs_ta_wprtpsclrp(:,:ngrdcol,:nzm,:sclr_dim)) 4444, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4445, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4446, ! blockidx%x threadidx%x collapsed 4444, Generating default present(term_wprtp2_explicit(:ngrdcol,:nzt),term_wprtpthlp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wprtp_zt(:ngrdcol,:nzt),term_wpthlp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt)) 4458, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4459, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4460, ! blockidx%x threadidx%x collapsed 4458, Generating default present(term_wprtp2_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_rtp2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm)) 4486, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4487, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4488, ! blockidx%x threadidx%x collapsed 4486, Generating default present(wprtp(:ngrdcol,:nzm),term_wprtp2_explicit_zm(:ngrdcol,:nzm)) 4493, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4494, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4495, ! blockidx%x threadidx%x collapsed 4493, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_rtp2_zt(:ngrdcol,:nzt)) 4513, Generating implicit firstprxm_wpxp_clipping_and_stats: i va 4619, tGee(nnzme,ngrdcolr)a t i nGge nenter data createe(rxm_pd(:,:)a,xp2_relaxed(:,:),xm_old(:,:),wpxp_chnge(:,:)ting NVIDIA GPU code ,wpxp_pd(:,:) ) 4514, !$acc loop 4709, Ggang, vector(128) collapse(2) ! blockidx%x threadidx%xe n e r 4515, a t ! blockidx%x threadidx%x collapsedi n g 4513, Giemnpelriactiitn gf defaulti rpresents(twpthlp(:ngrdcol,:nzm)p,wp_coef(:ngrdcol,:nzm)r,term_wpthlp2_explicit_zm(:ngrdcol,:nzm)i)v a t 4520, eG(enztn,ngrdcole)r a t iGnegn eirmaptliincgi tNVIDIA GPU fciordset p r i 4710, v!$acc loopa tgang, vector(128) collapse(2) ! blockidx%x threadidx%xe ( nzt ,ngrdcol 4711, ) ! blockidx%x threadidx%x collapsed G 4709, eGneenreartaitnign gNVIDIA GPU default cpresento(dxm_old(:ngrdcol,:nzt)e,xm(:ngrdcol,:nzt) ,solution(:ngrdcol,:) ) 4521, !$acc loop 4711, Ggang, vector(128) collapse(2) ! blockidx%x threadidx%xe n e r 4522, a t ! blockidx%x threadidx%x collapsedi n g 4520, Giemnpelriactiitn gf defaulti rpresents(twp3_on_wp2(:ngrdcol,:nzt)p,sgn_t_vel_thlp2(:ngrdcol,:nzt)r)i v a 4544, tGee(nk_xme)r a t 4720, iGnegn eirmaptliincgi ti mfpilrisctiptr ifviartset(pnzmr,ngrdcoli)v a t eG(engrdcoln,nzme)r a t iGnegn eNVIDIA GPUr actoidneg NVIDIA GPU 4545, c!$acc loopo dgang, vector(128) collapse(2) ! blockidx%x threadidx%xe 4546, 4721, !$acc loop ! blockidx%x threadidx%x collapsed gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4544, G e 4722, n e ! blockidx%x threadidx%x collapsedr a t 4720, iGnegn defaulte rpresenta(twpthlp(:ngrdcol,:nzm)i,term_wpthlp2_explicit_zm(:ngrdcol,:nzm)n)g default 4551, presentG(esolution(:ngrdcol,:)n,wpxp(:ngrdcol,:nzm)e)r a t 4722, iGnegn eirmaptliincgi ti mfpilrisctiptr ifviartset(pnztr,ngrdcoli)v a t eG(ek_wpxpn)e ra t 4731, iGnegn eNVIDIA GPUr actoidneg u p 4552, d!$acc loopa tgang, vector(128) collapse(2) ! blockidx%x threadidx%xe self ( 4553, wm_zt(:,:) ,xm(:,:) ! blockidx%x threadidx%x collapsed,wpxp(:,:) ,lhs_ma_zt(:,:,:) ,lhs_ta_wpxp(:,:,:) 4551, ,lhs_ta_xm(:,:,:)G,lhs_pr1(:,:)e,lhs_diff_zm(:,:,:)n,lhs_ma_zm(:,:,:)e,c7_skw_fnc(:,:)r,lhs_tp(:,:,:)a,rcond(:)t)i ng default 4901, Gpresente(nwp_coef_zt(:ngrdcol,:nzt)e,sgn_t_vel_thlp2_zt(:ngrdcol,:nzt)r)a t i 4571, nGge nueprdaattien gself (ixm(:,:)m)p li c 4922, iGte nfeirrasttipnrgi vuaptdea(tnzme,ngrdcol )self ( xm(:,:) )G e n 4955, eGreanteirnagt iNVIDIA GPUn gc oudped a t e 4572, !$acc loopself (gang, vector(128) collapse(2) ! blockidx%x threadidx%xxm(:,:) ) 4573, 4980, G ! blockidx%x threadidx%x collapsede ne r 4571, aGteinnegr aitmipnlgi defaultc ipresentt( term_wprtpthlp_explicit_zm(:ngrdcol,:nzm)f,sgn_t_vel_rtpthlp(:ngrdcol,:nzm)i,wp3_on_wp2(:ngrdcol,:nzm)r,wp_coef(:ngrdcol,:nzm)s,wpthlp(:ngrdcol,:nzm)t,wprtp(:ngrdcol,:nzm)p)r i v 4597, aGteen(enzmr,ngrdcola)t i n gG einmeprlaitciintg fNVIDIA GPUi rcsotdper i v a 4981, t!$acc loope (gang, vector(128) collapse(2) ! blockidx%x threadidx%xnzm ,ngrdcol ) 4982, ! blockidx%x threadidx%x collapsedG e n 4980, eGreanteirnagt iNVIDIA GPUn gc defaulto dpresente( xp2_relaxed(:ngrdcol,:nzm) ,xp2(:ngrdcol,:nzm) ) 4598, !$acc loop 4990, gang, vector(128) collapse(2) ! blockidx%x threadidx%xG e n e 4599, r a ! blockidx%x threadidx%x collapsedt i n 4597, gG einmeprlaitciintg defaultf ipresentr(swpthlp(:ngrdcol,:nzm)t,wprtp(:ngrdcol,:nzm)p,term_wprtpthlp_explicit_zm(:ngrdcol,:nzm)r)i v a 4604, tGee(nnzme,ngrdcolr)a t i nGge niemrpaltiicnigt NVIDIA GPUf icrosdtep r i v 4991, a!$acc loopt egang, vector(128) collapse(2) ! blockidx%x threadidx%x( nzt ,ngrdcol ) 4992, ! blockidx%x threadidx%x collapsed G e 4990, nGeernaetriantgi nNVIDIA GPUg defaultc opresentd(exp2_relaxed(:ngrdcol,:nzm) ,xp2(:ngrdcol,:nzm) ) 4605, !$acc loop 5000, Ggang, vector(128) collapse(2) ! blockidx%x threadidx%xe n e r 4606, a t ! blockidx%x threadidx%x collapsedi n g 4604, Giemnpelriactiitn gf defaulti rpresents(twp_coef_zt(:ngrdcol,:nzt)p,sgn_t_vel_rtpthlp_zt(:ngrdcol,:nzt)r)i v a 4636, tGee(nnzme,ngrdcolr)a t i nGge niemrpaltiicnigt NVIDIA GPUf icrosdtep r i v 5001, a!$acc loopt egang, vector(128) collapse(2) ! blockidx%x threadidx%x( nzm ,ngrdcol ) 5002, ! blockidx%x threadidx%x collapsed G e 5000, nGeernaetriantgi nNVIDIA GPUg defaultc opresentd(exp2_relaxed(:ngrdcol,:nzm) ,xp2(:ngrdcol,:nzm) ) 4637, !$acc loop 5012, Ggang, vector(128) collapse(2) ! blockidx%x threadidx%xe n e r 4638, a t ! blockidx%x threadidx%x collapsedi ng 4636, iGmepnleircaitti nfgi defaultr spresentt(pterm_wpsclrp2_explicit_zm(:ngrdcol,:nzm)r,sgn_t_vel_sclrp2(:ngrdcol,:nzm)i,wpsclrp(:ngrdcol,:nzm,sclr)v,wp_coef(:ngrdcol,:nzm)a,wp3_on_wp2(:ngrdcol,:nzm)t)e ( nzm 4645, ,ngrdcolG)e n e rGaetnienrga tiimnpgl iNVIDIA GPUc icto dfei r s t 5013, p!$acc loopr igang, vector(128) collapse(2) ! blockidx%x threadidx%xv a t e 5014, ( nzt ! blockidx%x threadidx%x collapsed,ngrdcol ) 5012, G eGneenreartaitnign defaultg presentNVIDIA GPU( xp2_relaxed(:ngrdcol,:nzm)c,xp2(:ngrdcol,:nzm)o)d e 5083, G 4646, e!$acc loopn egang, vector(128) collapse(2) ! blockidx%x threadidx%xr a t i 4647, n g ! blockidx%x threadidx%x collapsed exit data delete ( 4645, xp2_relaxed(:,:)G,xm_pd(:,:)e,xm_old(:,:)n,wpxp_chnge(:,:)e,wpxp_pd(:,:)r)a ting default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wp_coef_zt(:ngrdcol,:nzt),term_wpsclrp2_explicit(:ngrdcol,:nzt)) 4670, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4671, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4672, ! blockidx%x threadidx%x collapsed 4670, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),term_wpsclrp2_explicit_zm(:ngrdcol,:nzm)) 4677, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4678, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4679, ! blockidx%x threadidx%x collapsed 4677, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrp2_zt(:ngrdcol,:nzt)) 4700, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4701, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4702, ! blockidx%x threadidx%x collapsed 4700, Generating default present(term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrprtp(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr),wp3_on_wp2(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm)) 4709, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4710, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4711, ! blockidx%x threadidx%x collapsed 4709, Generating default present(wpsclrp_zt(:ngrdcol,:nzt,sclr),wprtp_zt(:ngrdcol,:nzt),term_wprtpsclrp_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt)) 4734, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4735, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4736, ! blockidx%x threadidx%x collapsed 4734, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr),wprtp(:ngrdcol,:nzm),term_wprtpsclrp_explicit_zm(:ngrdcol,:nzm)) 4741, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4742, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4743, ! blockidx%x threadidx%x collapsed 4741, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrprtp_zt(:ngrdcol,:nzt)) 4764, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4765, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4766, ! blockidx%x threadidx%x collapsed 4764, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),sgn_t_vel_sclrpthlp(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr)) 4773, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4774, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4775, ! blockidx%x threadidx%x collapsed 4773, Generating default present(wp_coef_zt(:ngrdcol,:nzt),term_wpthlpsclrp_explicit(:ngrdcol,:nzt),wpthlp_zt(:ngrdcol,:nzt),wpsclrp_zt(:ngrdcol,:nzt,sclr)) 4798, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4799, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4800, ! blockidx%x threadidx%x collapsed 4798, Generating default present(term_wpthlpsclrp_explicit_zm(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),wpsclrp(:ngrdcol,:nzm,sclr)) 4805, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4806, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4807, ! blockidx%x threadidx%x collapsed 4805, Generating default present(wp_coef_zt(:ngrdcol,:nzt),sgn_t_vel_sclrpthlp_zt(:ngrdcol,:nzt)) 5241, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5242, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5243, ! blockidx%x threadidx%x collapsed 5241, Generating default present(term_wpup2_explicit_zm(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),coef_wpvp2_implicit_zm(:ngrdcol,:nzm),term_wpvp2_explicit_zm(:ngrdcol,:nzm),wp_coef(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),coef_wpup2_implicit_zm(:ngrdcol,:nzm),beta(:ngrdcol),a1_coef(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm)) 5255, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5256, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5257, ! blockidx%x threadidx%x collapsed 5255, Generating default present(sgn_t_vel_up2(:ngrdcol,:nzm),wp3_on_wp2(:ngrdcol,:nzm),sgn_t_vel_vp2(:ngrdcol,:nzm)) 5273, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5274, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5275, ! blockidx%x threadidx%x collapsed 5273, Generating default present(coef_wpup2_implicit(:ngrdcol,:nzt),beta(:ngrdcol),a1_coef_zt(:ngrdcol,:nzt),wp3_on_wp2_zt(:ngrdcol,:nzt),coef_wpvp2_implicit(:ngrdcol,:nzt)) 5283, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5284, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5285, ! blockidx%x threadidx%x collapsed 5283, Generating default present(term_wpup2_explicit(:ngrdcol,:nzt),upwp_zt(:ngrdcol,:nzt),term_wpvp2_explicit(:ngrdcol,:nzt),wp_coef_zt(:ngrdcol,:nzt),vpwp_zt(:ngrdcol,:nzt)) 5305, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5306, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 5307, ! blockidx%x threadidx%x collapsed 5308, ! blockidx%x threadidx%x collapsed 5305, Generating default present(lhs_ta_wpvp2(:,:ngrdcol,:nzm),lhs_ta_wpup2(:,:ngrdcol,:nzm)) 5339, Generating update self(term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit(:,:),coef_wprtpthlp_implicit(:,:),coef_wpthlp2_implicit(:,:)) 5364, Generating exit data delete(wp_coef(:,:),vpwp_zt(:,:),wprtp_zt(:,:),wp_coef_zt(:,:),upwp_zt(:,:),term_wpvp2_explicit_zm(:,:),a1_coef(:,:),sgn_t_vel_up2(:,:),sgn_t_vel_thlp2(:,:),sgn_t_vel_rtp2(:,:),sgn_t_vel_rtpthlp(:,:),coef_wpvp2_implicit_zm(:,:),term_wpvp2_explicit(:,:),term_wpup2_explicit(:,:),coef_wpup2_implicit(:,:),term_wpup2_explicit_zm(:,:),coef_wpup2_implicit_zm(:,:),term_wpthlp2_explicit_zm(:,:),coef_wpthlp2_implicit(:,:),term_wprtpthlp_explicit(:,:),coef_wpvp2_implicit(:,:),term_wprtp2_explicit_zm(:,:),coef_wprtp2_implicit_zm(:,:),term_wpthlp2_explicit(:,:),term_wprtpthlp_explicit_zm(:,:),coef_wprtpthlp_implicit(:,:),term_wprtp2_explicit(:,:),coef_wprtp2_implicit(:,:),sgn_t_vel_vp2(:,:),a1_coef_zt(:,:),wpthlp_zt(:,:)) 5377, Generating exit data delete(wpsclrp_zt(:,:,:),term_wpthlpsclrp_explicit_zm(:,:),sgn_t_vel_sclrprtp(:,:),sgn_t_vel_sclrp2(:,:),coef_wpthlpsclrp_implicit_zm(:,:),term_wpsclrp2_explicit_zm(:,:),coef_wpthlpsclrp_implicit(:,:),coef_wpsclrp2_implicit_zm(:,:),term_wprtpsclrp_explicit(:,:),coef_wprtpsclrp_implicit(:,:),sgn_t_vel_sclrpthlp(:,:),term_wpsclrp2_explicit(:,:),coef_wpsclrp2_implicit(:,:),term_wprtpsclrp_explicit_zm(:,:),coef_wprtpsclrp_implicit_zm(:,:)) term_tp_rhs: 5454, Generating copyin(wpxbp(:,:),xbm(:,:),xam(:,:),wpxap(:,:)) [if not already present] Generating copyout(rhs(:,:)) [if not already present] Generating copyin(invrs_dzm(:,:)) [if not already present] 5457, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5458, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5459, ! blockidx%x threadidx%x collapsed xm_term_ta_lhs: 5174, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5175, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5176, ! blockidx%x threadidx%x collapsed 5174, Generating default present(invrs_rho_ds_zt(:ngrdcol,:nzt),gr%invrs_dzt(1:ngrdcol,1:nzt),gr,rho_ds_zm(:ngrdcol,:nzt+1),lhs_ta_xm(:,:ngrdcol,:nzt)) term_dp1_lhs: 5549, Generating copyin(cn(:,:)) [if not already present] Generating copyout(lhs(:,:)) [if not already present] Generating copyin(invrs_tau_zm(:,:)) [if not already present] 5552, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5553, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5553, Generating implicit firstprivate(nzm) 5560, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5561, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5562, ! blockidx%x threadidx%x collapsed wpxp_term_tp_lhs: 5273, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5274, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5273, Generating default present(lhs_tp(:,:ngrdcol,:1)) 5281, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5282, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5283, ! blockidx%x threadidx%x collapsed 5281, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),wp2(:ngrdcol,2:nzm-1),lhs_tp(:,:ngrdcol,2:nzm-1),gr) 5296, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5297, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5296, Generating default present(lhs_tp(:,:ngrdcol,nzm)) 5297, Generating implicit firstprivate(nzm) term_dp1_rhs: 5643, Generating copyin(cn(:,:)) [if not already present] Generating copyout(rhs(:,:)) [if not already present] Generating copyin(invrs_tau_zm(:,:)) [if not already present] 5646, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5647, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5648, ! blockidx%x threadidx%x collapsed 5648, Generating implicit firstprivate(threshold) term_pr1: 5776, Generating copyin(xbp2(:,:),wp2(:,:)) [if not already present] Generating copyout(rhs(:,:)) [if not already present] Generating copyin(invrs_tau_c14_zm(:,:),c4(:),c14(:),invrs_tau_c4_zm(:,:)) [if not already present] 5779, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5780, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5781, ! blockidx%x threadidx%x collapsed wpxp_terms_ac_pr2_lhs: 5391, Generating copyout(lhs_ac_pr2(:,:)) [if not already present] Generating copyin(wm_zt(:,:),c7_skw_fnc(:,:),invrs_dzm(:,:)) [if not already present] 5395, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5396, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5402, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5403, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5404, ! blockidx%x threadidx%x collapsed 5413, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5414, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5414, Generating implicit firstprivate(nzm) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/setup_clubb_pdf_params.F90 term_pr2: 5897, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5898, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5899, ! blockidx%x threadidx%x collapsed 5897, Generating default present(gr%invrs_dzm(1:ngrdcol,2:nzm-1),rhs_pr2(:ngrdcol,2:nzm-1),vpwp(:ngrdcol,2:nzm-1),wpthvp(:ngrdcol,2:nzm-1),c_uu_buoy(:ngrdcol),vm(:ngrdcol,:nzm-1),upwp(:ngrdcol,2:nzm-1),um(:ngrdcol,:nzm-1),c_uu_shr(:ngrdcol),gr,thv_ds_zm(:ngrdcol,2:nzm-1)) wpxp_term_pr1_lhs: 5492, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5493, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5494, ! blockidx%x threadidx%x collapsed 5492, Generating default present(lhs_pr1_wprtp(:ngrdcol,2:nzm-1),lhs_pr1_wpthlp(:ngrdcol,2:nzm-1),c6rt_skw_fnc(:ngrdcol,2:nzm-1),invrs_tau_c6_zm(:ngrdcol,2:nzm-1),c6thl_skw_fnc(:ngrdcol,2:nzm-1)) 5506, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5507, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5506, Generating default present(lhs_pr1_wpthlp(:ngrdcol,:),lhs_pr1_wprtp(:ngrdcol,:)) 5507, Generating implicit firstprivate(nzm) 5526, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5527, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5528, ! blockidx%x threadidx%x collapsed 5526, Generating default present(lhs_pr1_wpsclrp(:ngrdcol,2:nzm-1),invrs_tau_c6_zm(:ngrdcol,2:nzm-1),c7_skw_fnc(:ngrdcol,2:nzm-1)) 5537, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5538, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5537, Generating default present(lhs_pr1_wpsclrp(:ngrdcol,:)) 5538, Generating implicit firstprivate(nzm) pos_definite_variances: 6000, Generating update self(xp2_np1(:,:)) 6019, Generating update self(xp2_np1(:,:)) wpxp_terms_bp_pr3_rhs: 5609, Generating copyout(rhs_bp_pr3(:,:)) [if not already present] Generating copyin(thv_ds_zm(:,:),xpthvp(:,:),c7_skw_fnc(:,:)) [if not already present] 5613, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5614, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5619, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5620, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5621, ! blockidx%x threadidx%x collapsed 5627, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5628, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5628, Generating implicit firstprivate(nzm) xm_correction_wpxp_cl: 5815, Generating enter data create(l_any_clipping_needed,xm_tndcy_wpxp_cl(:,:),l_clipping_needed(:)) 5819, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 5820, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5821, ! blockidx%x threadidx%x collapsed 5819, Generating default present(l_clipping_needed(:ngrdcol),wpxp_chnge(:ngrdcol,:nzm)) 5821, Generating implicit firstprivate(l_any_clipping_needed) 5830, Generating update self(l_any_clipping_needed) 5848, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 5849, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5850, ! blockidx%x threadidx%x collapsed 5848, Generating default present(l_clipping_needed(:ngrdcol),xm_tndcy_wpxp_cl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),wpxp_chnge(:ngrdcol,:nzt+1),invrs_dzt(:ngrdcol,:nzt)) 5850, Generating implicit firstprivate(dt) 5861, Generating update self(xm_tndcy_wpxp_cl(:,:)) 5872, Generating exit data delete(l_any_clipping_needed,xm_tndcy_wpxp_cl(:,:),l_clipping_needed(:)) damp_coefficient: 5920, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5921, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5922, ! blockidx%x threadidx%x collapsed 5920, Generating default present(coefficient(:ngrdcol),damped_value(:ngrdcol,:nzm),gr,gr%zm(1:ngrdcol,1:nzm),threshold(:ngrdcol),max_coeff_value(:ngrdcol),lscale_zm(:ngrdcol,:nzm),altitude_threshold(:ngrdcol),cx_skw_fnc(:ngrdcol,:nzm)) diagnose_upxp: 6000, Generating enter data create(ddzt_xm(:,:),ddzt_ym(:,:)) 6005, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 6006, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 6007, ! blockidx%x threadidx%x collapsed 6005, Generating default present(ypxp(:ngrdcol,2:nzm-1),ypwp(:ngrdcol,2:nzm-1),ddzt_ym(:ngrdcol,2:nzm-1),c6x_skw_fnc(:ngrdcol,2:nzm-1),tau_c6_zm(:ngrdcol,2:nzm-1),ddzt_xm(:ngrdcol,2:nzm-1),wpxp(:ngrdcol,2:nzm-1),c7_skw_fnc(:ngrdcol,2:nzm-1)) 6017, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 6018, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 6017, Generating default present(ypxp(:ngrdcol,:)) 6018, Generating implicit firstprivate(nzm) 6024, Generating exit data delete(ddzt_ym(:,:),ddzt_xm(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/sfc_varnce_module.F90 calc_sfc_varnce: 201, Generating enter data create(vsp2_sfc(:),wp2_splat_sfc_correction(:),zeta(:),usp2_sfc(:),vm_sfc_sqd(:),um_sfc_sqd(:),ustar(:),uf(:),depth_pos_wpthlp(:),min_wp2_sfc_val(:)) 208, Generating update self(rtp2(:,:),rtpthlp(:,:),up2(:,:),thlp2(:,:),vp2(:,:),wp2(:,:)) 237, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 238, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 237, Generating default present(wpthlp(:ngrdcol,:),sfc_elevation(:ngrdcol),gr%zm(1:ngrdcol,:),depth_pos_wpthlp(:ngrdcol),gr) 238, Generating implicit firstprivate(k) 245, Accelerator restriction: induction variable live-out from loop: k 246, Accelerator restriction: induction variable live-out from loop: k 247, Accelerator restriction: induction variable live-out from loop: k 509, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 510, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 509, Generating default present(depth_pos_wpthlp(:ngrdcol),upwp_sfc(:ngrdcol),uf(:ngrdcol),vpwp_sfc(:ngrdcol),wpthlp(:ngrdcol,:1)) 510, Generating implicit firstprivate(t0,l_vary_convect_depth,ustar2,wstar) 537, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 538, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 537, Generating default present(a_const(:ngrdcol),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1),up2(:ngrdcol,:1),uf(:ngrdcol),up2_sfc_coef(:ngrdcol)) 551, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 552, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 551, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),thlp2(:ngrdcol,:1),rtpthlp(:ngrdcol,:1),uf(:ngrdcol),a_const(:ngrdcol),rtp2(:ngrdcol,:1)) 560, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 561, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 560, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),thlp2(:ngrdcol,:1),rtpthlp(:ngrdcol,:1),uf(:ngrdcol),a_const(:ngrdcol),rtp2(:ngrdcol,:1)) 569, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 570, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 569, Generating default present(thlp2(:ngrdcol,:1),rtp2(:ngrdcol,:1)) 581, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 582, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 581, Generating default present(wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),rtp2(:ngrdcol,:1),thlp2(:ngrdcol,:1),min_wp2_sfc_val(:ngrdcol)) 590, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 591, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 590, Generating default present(wp2_splat_sfc_correction(:ngrdcol),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1),min_wp2_sfc_val(:ngrdcol),lhs_splat_wp2(:ngrdcol,:1),tau_zm(:ngrdcol,:1),up2(:ngrdcol,:1)) 611, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 612, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 613, ! blockidx%x threadidx%x collapsed 611, Generating default present(sclr_idx,a_const(:ngrdcol),wprtp_sfc(:ngrdcol),sclrpthlp(:ngrdcol,:1,:sclr_dim),uf(:ngrdcol),sclrp2(:ngrdcol,:1,:sclr_dim),wpthlp(:ngrdcol,:1),wpsclrp_sfc(:ngrdcol,:sclr_dim),sclrprtp(:ngrdcol,:1,:sclr_dim)) 668, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 669, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 668, Generating default present(wp2(:ngrdcol,:1)) 674, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 675, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 674, Generating default present(rtpthlp(:ngrdcol,:1),gr,rtp2(:ngrdcol,:1),gr%zm(1:ngrdcol,1),sfc_elevation(:ngrdcol),up2(:ngrdcol,:1),thlp2(:ngrdcol,:1),wp2(:ngrdcol,:1),vp2(:ngrdcol,:1)) 693, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 694, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 695, ! blockidx%x threadidx%x collapsed 693, Generating default present(gr%zm(1:ngrdcol,1),sclrp2(:ngrdcol,:1,:sclr_dim),sclrprtp(:ngrdcol,:1,:sclr_dim),gr,sfc_elevation(:ngrdcol),sclrpthlp(:ngrdcol,:1,:sclr_dim)) 710, Generating update self(rtp2(:,:),rtpthlp(:,:),up2(:,:),thlp2(:,:),wp2(:,:),vp2(:,:)) 741, Generating update self(wp2(:,:),wprtp_sfc(:),vp2(:,:),up2(:,:),rtp2(:,:),rtpthlp(:,:),upwp_sfc(:),thlp2(:,:),vpwp_sfc(:),wpthlp(:,:)) 744, Generating update self(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:)) 785, Generating exit data delete(vsp2_sfc(:),zeta(:),wp2_splat_sfc_correction(:),usp2_sfc(:),vm_sfc_sqd(:),um_sfc_sqd(:),ustar(:),uf(:),depth_pos_wpthlp(:),min_wp2_sfc_val(:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/mixing_length.F90 compute_mixing_length: 243, Generating enter data create(thv_par_1(:,:),thl_par_j_precalc(:,:),lv_coef(:,:),rt_par_j_precalc(:,:),cape_incr_1(:,:),s_par_1(:,:),rc_par_1(:,:),rsatl_par_1(:,:),tke_i(:,:),tl_par_1(:,:),rt_par_1(:,:),thl_par_1(:,:),dcape_dz_1(:,:),invrs_dzm_on_mu(:,:),exp_mu_dzm(:,:),grav_on_thvm(:,:),entrain_coef(:,:)) 248, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 249, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 248, Generating default present(mu(:ngrdcol)) 249, Generating implicit firstprivate(err_code) 266, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 267, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 268, ! blockidx%x threadidx%x collapsed 266, Generating default present(lscale_up(:ngrdcol,:nzt),lv_coef(:ngrdcol,:nzt),exner(:ngrdcol,:nzt),thv_ds(:ngrdcol,:nzt),thvm(:ngrdcol,:nzt),grav_on_thvm(:ngrdcol,:nzt),lscale_down(:ngrdcol,:nzt)) 282, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 283, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 284, ! blockidx%x threadidx%x collapsed 282, Generating default present(gr%invrs_dzm(1:ngrdcol,1:nzm),exp_mu_dzm(:ngrdcol,:nzm),gr%dzm(1:ngrdcol,1:nzm),entrain_coef(:ngrdcol,:nzm),gr,mu(:ngrdcol),invrs_dzm_on_mu(:ngrdcol,:nzm)) 306, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 307, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 308, ! blockidx%x threadidx%x collapsed 306, Generating default present(exp_mu_dzm(:ngrdcol,2:nzt-1),rt_par_j_precalc(:ngrdcol,2:nzt-1),rtm(:ngrdcol,:nzt-1),entrain_coef(:ngrdcol,2:nzt-1),thlm(:ngrdcol,:nzt-1),thl_par_j_precalc(:ngrdcol,2:nzt-1)) 329, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 330, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 331, ! blockidx%x threadidx%x collapsed 329, Generating default present(exner(:ngrdcol,2:nzt),rt_par_1(:ngrdcol,2:nzt),tl_par_1(:ngrdcol,2:nzt),thlm(:ngrdcol,:nzt),entrain_coef(:ngrdcol,2:nzt),rtm(:ngrdcol,:nzt),thl_par_1(:ngrdcol,2:nzt)) 356, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 357, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 358, !$acc loop seq 394, !$acc loop seq 356, Generating default present(exp_mu_dzm(:ngrdcol,:),gr,cape_incr_1(:ngrdcol,2:nzt),gr%zt(1:ngrdcol,:),thv_par_1(:ngrdcol,2:nzt),thv_ds(:ngrdcol,:),thl_par_j_precalc(:ngrdcol,:),s_par_1(:ngrdcol,2:nzt),lscale_up(:ngrdcol,:nzt-2),p_in_pa(:,:),rt_par_j_precalc(:ngrdcol,:),rc_par_1(:ngrdcol,2:nzt),rsatl_par_1(:ngrdcol,2:nzt),tl_par_1(:ngrdcol,2:nzt),tke_i(:ngrdcol,:nzt-2),gr%dzm(1:ngrdcol,:),exner(:ngrdcol,:),thl_par_1(:ngrdcol,2:nzt),rt_par_1(:ngrdcol,2:nzt),dcape_dz_1(:ngrdcol,2:nzt),lv_coef(:ngrdcol,:),thvm(:ngrdcol,:),grav_on_thvm(:ngrdcol,:),gr%invrs_dzm(1:ngrdcol,:)) 357, Scalar last value needed after loop for dcape_dz_j at line 741,748,761,759 Generating implicit firstprivate(lscale_up_max_alt) 358, Loop is parallelizable Generating implicit firstprivate(tl_par_j_sqd) 394, Loop carried scalar dependence for dcape_dz_j at line 512 Loop carried scalar dependence for lscale_up_max_alt at line 540,536 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 495,502,510 Scalar last value needed after loop for dcape_dz_j at line 741,748,761,759 Loop carried scalar dependence for lscale_up_max_alt at line 540 Generating implicit firstprivate(tke,thl_par_j,rt_par_j,j,dcape_dz_j,dcape_dz_j_minus_1,invrs_dcape_diff) Loop carried scalar dependence for dcape_dz_j at line 512 Loop carried scalar dependence for lscale_up_max_alt at line 536 Loop carried dependence of p_in_pa prevents parallelization Loop carried scalar dependence for dcape_dz_j at line 510 416, Loop carried scalar dependence for thl_par_j at line 427 Scalar last value needed after loop for dcape_dz_j at line 741,748,761,759 Loop carried scalar dependence for rt_par_j at line 434 Loop carried scalar dependence for dcape_dz_j_minus_1 at line 468 Loop carried scalar dependence for tke at line 479,471 Generating implicit firstprivate(thv_par_j,tl_par_j,s_par_j,rc_par_j,rsatl_par_j,j,saturation_formula,cape_incr) Loop carried scalar dependence for thl_par_j at line 427 Loop carried scalar dependence for rt_par_j at line 434 Loop carried scalar dependence for dcape_dz_j_minus_1 at line 468 Loop carried scalar dependence for tke at line 479,471 427, Accelerator restriction: induction variable live-out from loop: j 434, Accelerator restriction: induction variable live-out from loop: j 441, Accelerator restriction: induction variable live-out from loop: j 443, Accelerator restriction: induction variable live-out from loop: j Reference argument passing prevents parallelization: tl_par_j 460, Accelerator restriction: induction variable live-out from loop: j 464, Accelerator restriction: induction variable live-out from loop: j 468, Accelerator restriction: induction variable live-out from loop: j 480, Accelerator restriction: induction variable live-out from loop: j 482, Accelerator restriction: induction variable live-out from loop: j 557, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 558, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 559, ! blockidx%x threadidx%x collapsed 557, Generating default present(exp_mu_dzm(:ngrdcol,2:nzt),rt_par_j_precalc(:ngrdcol,:nzt-1),rtm(:ngrdcol,:nzt),entrain_coef(:ngrdcol,2:nzt),thlm(:ngrdcol,:nzt),thl_par_j_precalc(:ngrdcol,:nzt-1)) 579, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 580, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 581, ! blockidx%x threadidx%x collapsed 579, Generating default present(exner(:ngrdcol,:nzt-1),rt_par_1(:ngrdcol,:nzt-1),tl_par_1(:ngrdcol,:nzt-1),thlm(:ngrdcol,:nzt),entrain_coef(:ngrdcol,2:nzt),rtm(:ngrdcol,:nzt),thl_par_1(:ngrdcol,:nzt-1)) 605, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 606, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 607, !$acc loop seq 642, !$acc loop seq 605, Generating default present(exp_mu_dzm(:ngrdcol,:),gr,cape_incr_1(:ngrdcol,:nzt-1),gr%zt(1:ngrdcol,:),thv_par_1(:ngrdcol,:nzt-1),thv_ds(:ngrdcol,:),thl_par_j_precalc(:ngrdcol,:),s_par_1(:ngrdcol,:nzt-1),lscale_down(:ngrdcol,2:nzt),p_in_pa(:,:),rt_par_j_precalc(:ngrdcol,:),rc_par_1(:ngrdcol,:nzt-1),rsatl_par_1(:ngrdcol,:nzt-1),tl_par_1(:ngrdcol,:nzt-1),tke_i(:ngrdcol,2:nzt),gr%invrs_dzm(1:ngrdcol,:),gr%dzm(1:ngrdcol,:),thl_par_1(:ngrdcol,:nzt-1),exner(:ngrdcol,:),rt_par_1(:ngrdcol,:nzt-1),dcape_dz_1(:ngrdcol,:nzt-1),lv_coef(:ngrdcol,:),thvm(:ngrdcol,:),grav_on_thvm(:ngrdcol,:)) 606, Generating implicit firstprivate(lscale_down_min_alt) 607, Loop is parallelizable Generating implicit firstprivate(tl_par_j_sqd) 642, Loop carried scalar dependence for lscale_down_min_alt at line 784,785 Loop carried dependence of p_in_pa prevents parallelization Loop carried backward dependence of p_in_pa prevents vectorization Loop carried scalar dependence for dcape_dz_j at line 741,748,759,761 Generating implicit firstprivate(tke,thl_par_j,rt_par_j,j,dcape_dz_j,dcape_dz_j_plus_1,invrs_dcape_diff) 664, Loop carried scalar dependence for thl_par_j at line 675 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 741 Scalar last value needed after loop for tke at line 748 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 759 Loop carried scalar dependence for rt_par_j at line 682 Scalar last value needed after loop for dcape_dz_j at line 741,759,761 Loop carried scalar dependence for dcape_dz_j_plus_1 at line 715 Loop carried scalar dependence for tke at line 726,718 Scalar last value needed after loop for dcape_dz_j at line 748 Scalar last value needed after loop for tke at line 761 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 761 Generating implicit firstprivate(tl_par_j,thv_par_j,s_par_j,rc_par_j,rsatl_par_j,j,saturation_formula,cape_incr) Loop carried scalar dependence for thl_par_j at line 675 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 741 Scalar last value needed after loop for tke at line 748 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 759 Loop carried scalar dependence for rt_par_j at line 682 Scalar last value needed after loop for dcape_dz_j at line 741,759,761 Loop carried scalar dependence for dcape_dz_j_plus_1 at line 715 Loop carried scalar dependence for tke at line 726,718 Scalar last value needed after loop for dcape_dz_j at line 748 Scalar last value needed after loop for tke at line 761 Scalar last value needed after loop for dcape_dz_j_plus_1 at line 761 675, Accelerator restriction: induction variable live-out from loop: j 682, Accelerator restriction: induction variable live-out from loop: j 689, Accelerator restriction: induction variable live-out from loop: j 691, Accelerator restriction: induction variable live-out from loop: j Reference argument passing prevents parallelization: tl_par_j 708, Accelerator restriction: induction variable live-out from loop: j 711, Accelerator restriction: induction variable live-out from loop: j 715, Accelerator restriction: induction variable live-out from loop: j 727, Accelerator restriction: induction variable live-out from loop: j 729, Accelerator restriction: induction variable live-out from loop: j 796, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 797, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 798, !$acc loop seq 830, !$acc loop seq 796, Generating default present(gr,gr%zm(1:ngrdcol,1),lscale_up(:ngrdcol,:nzt),lscale_max(:ngrdcol),lscale(:ngrdcol,:),gr%zt(1:ngrdcol,1:nzt),lscale_down(:ngrdcol,:nzt)) 798, Loop is parallelizable Generating implicit firstprivate(l_implemented,lminh,lmin) 830, Loop is parallelizable 838, Generating update self(thlm(:,:),lscale_up(:,:),em(:,:),p_in_pa(:,:),rtm(:,:),thvm(:,:),thv_ds(:,:),lscale(:,:),lscale_down(:,:),exner(:,:)) 869, Generating exit data delete(thv_par_1(:,:),thl_par_j_precalc(:,:),lv_coef(:,:),rt_par_j_precalc(:,:),cape_incr_1(:,:),s_par_1(:,:),rc_par_1(:,:),rsatl_par_1(:,:),tl_par_1(:,:),tke_i(:,:),rt_par_1(:,:),thl_par_1(:,:),dcape_dz_1(:,:),invrs_dzm_on_mu(:,:),exp_mu_dzm(:,:),grav_on_thvm(:,:),entrain_coef(:,:)) calc_lscale_directly: 1021, Generating enter data create(mu_pert_2(:),mu_pert_neg_rt(:),mu_pert_1(:),lscale_pert_2(:,:),rtm_pert_2(:,:),rtm_pert_neg_rt(:,:),thlm_pert_2(:,:),thlm_pert_neg_rt(:,:),thlm_pert_pos_rt(:,:),rtm_pert_1(:,:),mu_pert_pos_rt(:),thlm_pert_1(:,:),sign_rtpthlp_zt(:,:),lscale_pert_1(:,:),rtm_pert_pos_rt(:,:)) 1193, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1194, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1195, ! blockidx%x threadidx%x collapsed 1193, Generating default present(lscale_pert_2(:ngrdcol,:nzt),lscale_pert_1(:ngrdcol,:nzt)) 1205, Generating update self(lscale_pert_2(:,:),lscale_pert_1(:,:)) 1259, Generating exit data delete(mu_pert_2(:),mu_pert_neg_rt(:),mu_pert_1(:),lscale_pert_2(:,:),rtm_pert_2(:,:),rtm_pert_neg_rt(:,:),thlm_pert_2(:,:),thlm_pert_pos_rt(:,:),thlm_pert_neg_rt(:,:),rtm_pert_1(:,:),mu_pert_pos_rt(:),thlm_pert_1(:,:),sign_rtpthlp_zt(:,:),lscale_pert_1(:,:),rtm_pert_pos_rt(:,:)) diagnose_lscale_from_tau: 1472, Generating enter data create(smooth_norm_ddzt_umvm(:,:),ice_supersat_frac_zm(:,:),h_invrs_tau_wpxp_n2(:,:),brunt_freq_pos(:,:),norm_ddzt_umvm(:,:),invrs_tau_shear_smooth(:,:),tmp_calc_ngrdcol(:),bvf_thresh(:,:),brunt_vaisala_freq_clipped(:,:),brunt_freq_out_cloud(:,:),ustar(:)) 1479, Generating enter data create(tmp_calc_max(:,:),tmp_calc_min_max(:,:),tmp_calc(:,:),tau_zt_unclipped(:,:),em_clipped(:,:),tau_zm_unclipped(:,:),ri_zm_smooth(:,:)) 1483, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1484, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1483, Generating default present(gr%zm(1:ngrdcol,1),sfc_elevation(:ngrdcol),clubb_params(:ngrdcol,102),gr) 1484, Generating implicit firstprivate(err_code) 1497, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1498, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1497, Generating default present(vpwp_sfc(:ngrdcol),upwp_sfc(:ngrdcol),tmp_calc_ngrdcol(:ngrdcol)) 1513, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1514, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1513, Generating default present(tmp_calc_ngrdcol(:ngrdcol),ustar(:ngrdcol)) 1514, Generating implicit firstprivate(ufmin) 1521, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1522, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1523, ! blockidx%x threadidx%x collapsed 1521, Generating default present(invrs_tau_bkgnd(:ngrdcol,:nzm),clubb_params(:ngrdcol,80)) 1523, Generating implicit firstprivate(tau_const) 1529, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1530, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1531, ! blockidx%x threadidx%x collapsed 1529, Generating default present(norm_ddzt_umvm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1539, Generating implicit firstprivate(ngrdcol,nzm) Generating NVIDIA GPU code 1540, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1541, ! blockidx%x threadidx%x collapsed 1539, Generating default present(clubb_params(:ngrdcol,82),smooth_norm_ddzt_umvm(:ngrdcol,:nzm),invrs_tau_shear_smooth(:ngrdcol,:nzm)) 1552, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1553, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1554, ! blockidx%x threadidx%x collapsed 1552, Generating default present(gr%zm(1:ngrdcol,1:nzm),invrs_tau_sfc(:ngrdcol,:nzm),clubb_params(:ngrdcol,81:),gr,ustar(:ngrdcol),sfc_elevation(:ngrdcol)) 1563, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1564, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1565, ! blockidx%x threadidx%x collapsed 1563, Generating default present(invrs_tau_bkgnd(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),invrs_tau_shear(:ngrdcol,:nzm),invrs_tau_sfc(:ngrdcol,:nzm)) 1587, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1588, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1589, ! blockidx%x threadidx%x collapsed 1587, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm)) 1626, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1627, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1628, ! blockidx%x threadidx%x collapsed 1626, Generating default present(ice_supersat_frac_zm(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1639, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1640, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1641, ! blockidx%x threadidx%x collapsed 1639, Generating default present(clubb_params(:ngrdcol,92),gr%zm(1:ngrdcol,1:nzm),gr,brunt_freq_out_cloud(:ngrdcol,:nzm)) 1652, Generating update self(brunt_freq_pos(:,:),brunt_freq_out_cloud(:,:)) 1666, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1667, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1668, ! blockidx%x threadidx%x collapsed 1666, Generating default present(invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_shear(:ngrdcol,:nzm),invrs_tau_n2_iso(:ngrdcol,:nzm),invrs_tau_bkgnd(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:84),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),brunt_freq_pos(:ngrdcol,:nzm)) 1668, Generating implicit firstprivate(c_invrs_tau_n2_wp2,c_invrs_tau_n2) 1689, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1690, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1691, ! blockidx%x threadidx%x collapsed 1689, Generating default present(invrs_tau_zm(:ngrdcol,:nzm)) 1697, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1698, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1699, ! blockidx%x threadidx%x collapsed 1697, Generating default present(invrs_tau_no_n2_zm(:ngrdcol,:nzm),gr%zm(1:ngrdcol,1:nzm),sfc_elevation(:ngrdcol),invrs_tau_xp2_zm(:ngrdcol,:nzm),em(:ngrdcol,:nzm),gr,brunt_freq_pos(:ngrdcol,:nzm),clubb_params(:ngrdcol,81:)) 1740, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1741, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1742, ! blockidx%x threadidx%x collapsed 1740, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),invrs_tau_xp2_zm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1754, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1755, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1756, ! blockidx%x threadidx%x collapsed 1754, Generating default present(clubb_params(:ngrdcol,86),invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1766, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1767, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1768, ! blockidx%x threadidx%x collapsed 1766, Generating default present(invrs_tau_xp2_zm(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:85),brunt_freq_pos(:ngrdcol,:nzm)) 1789, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1790, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1791, ! blockidx%x threadidx%x collapsed 1789, Generating default present(invrs_tau_wpxp_zm(:ngrdcol,:nzm),invrs_tau_no_n2_zm(:ngrdcol,:nzm),brunt_freq_out_cloud(:ngrdcol,:nzm),clubb_params(:ngrdcol,83:86),brunt_freq_pos(:ngrdcol,:nzm)) 1803, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1804, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1805, ! blockidx%x threadidx%x collapsed 1803, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),clubb_params(:ngrdcol,89),bvf_thresh(:ngrdcol,:nzm)) 1817, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1818, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1819, ! blockidx%x threadidx%x collapsed 1817, Generating default present(brunt_vaisala_freq_sqd_smth(:ngrdcol,:nzm),h_invrs_tau_wpxp_n2(:ngrdcol,:nzm),clubb_params(:ngrdcol,89)) 1865, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1866, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1867, ! blockidx%x threadidx%x collapsed 1865, Generating default present(h_invrs_tau_wpxp_n2(:ngrdcol,:nzm),gr%zm(1:ngrdcol,1:nzm),ri_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,88:101),gr) 1880, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1881, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1882, ! blockidx%x threadidx%x collapsed 1880, Generating default present(invrs_tau_wp3_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,87),brunt_freq_out_cloud(:ngrdcol,:nzm)) 1914, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1915, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1916, ! blockidx%x threadidx%x collapsed 1914, Generating default present(tau_max_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale_max(:ngrdcol)) 1922, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1923, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1924, ! blockidx%x threadidx%x collapsed 1922, Generating default present(tau_max_zm(:ngrdcol,:nzm),lscale_max(:ngrdcol),em(:ngrdcol,:nzm)) 1952, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1953, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1954, ! blockidx%x threadidx%x collapsed 1952, Generating default present(tau_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm)) 1962, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1963, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1964, ! blockidx%x threadidx%x collapsed 1962, Generating default present(tau_zt(:ngrdcol,:nzt),tau_max_zt(:ngrdcol,:nzt)) 1975, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1976, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1977, ! blockidx%x threadidx%x collapsed 1975, Generating default present(lscale(:ngrdcol,:nzt),lscale_down(:ngrdcol,:nzt),tau_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale_up(:ngrdcol,:nzt)) 1990, Generating exit data delete(smooth_norm_ddzt_umvm(:,:),ice_supersat_frac_zm(:,:),h_invrs_tau_wpxp_n2(:,:),brunt_freq_pos(:,:),norm_ddzt_umvm(:,:),invrs_tau_shear_smooth(:,:),tmp_calc_ngrdcol(:),bvf_thresh(:,:),brunt_vaisala_freq_clipped(:,:),brunt_freq_out_cloud(:,:),ustar(:)) 1997, Generating exit data delete(tmp_calc_min_max(:,:),tmp_calc_max(:,:),tmp_calc(:,:),tau_zt_unclipped(:,:),em_clipped(:,:),tau_zm_unclipped(:,:),ri_zm_smooth(:,:)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/pdf_closure_module.F90 pdf_closure: 438, Generating enter data create(rsatl_1(:,:),rc_2_ice(:,:),rc_1_ice(:,:),corr_v_w_2(:,:),vprcp_contrib_comp_1(:,:),varnce_v_2(:,:),uprcp_contrib_comp_1(:,:),u_2(:,:),thlprcp_contrib_comp_1(:,:),sqrt_wp2(:,:),rtprcp_contrib_comp_1(:,:),rsatl_2(:,:),wp2rcp_contrib_comp_1(:,:),vprcp_contrib_comp_2(:,:),wprcp_contrib_comp_1(:,:),wp2rcp_contrib_comp_2(:,:),sku(:,:),skthl(:,:),rtprcp_contrib_comp_2(:,:),skrt(:,:),skv(:,:),tl1(:,:),thlprcp_contrib_comp_2(:,:),corr_v_w_1(:,:),corr_u_w_2(:,:),corr_u_w_1(:,:),alpha_v(:,:),alpha_u(:,:),varnce_v_1(:,:),varnce_u_2(:,:),v_1(:,:),uprcp_contrib_comp_2(:,:),varnce_u_1(:,:),v_2(:,:),u_1(:,:),tl2(:,:),wprcp_contrib_comp_2(:,:)) 450, Generating enter data create(sclr2(:,:,:),corr_w_sclr_1(:,:,:),corr_sclr_thl_2(:,:,:),corr_sclr_rt_1(:,:,:),alpha_sclr(:,:,:),corr_sclr_thl_1(:,:,:),corr_sclr_rt_2(:,:,:),varnce_sclr2(:,:,:),varnce_sclr1(:,:,:),sksclr(:,:,:),sclr1(:,:,:),corr_w_sclr_2(:,:,:)) 516, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 517, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 518, ! blockidx%x threadidx%x collapsed 516, Generating default present(sqrt_wp2(:ngrdcol,:nz),wp2(:ngrdcol,:nz)) 681, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 682, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 683, ! blockidx%x threadidx%x collapsed 681, Generating default present(corr_v_w_1(:ngrdcol,:nz),corr_u_w_2(:ngrdcol,:nz),corr_u_w_1(:ngrdcol,:nz),corr_v_w_2(:ngrdcol,:nz),pdf_params%corr_w_thl_2(1:ngrdcol,1:nz),pdf_params%corr_w_thl_1(1:ngrdcol,1:nz),pdf_params%corr_w_rt_2(1:ngrdcol,1:nz),pdf_params%corr_w_rt_1(1:ngrdcol,1:nz),pdf_params) 750, Generating implicit firstprivate(ngrdcol,sclr_dim,nz) Generating NVIDIA GPU code 751, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 752, ! blockidx%x threadidx%x collapsed 753, !$acc loop seq 750, Generating default present(corr_w_sclr_2(:ngrdcol,:nz,:sclr_dim),corr_w_sclr_1(:ngrdcol,:nz,:sclr_dim)) 753, Loop is parallelizable 944, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 945, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 946, ! blockidx%x threadidx%x collapsed 944, Generating default present(tl2(:ngrdcol,:nz),tl1(:ngrdcol,:nz),exner(:ngrdcol,:nz),pdf_params%thl_1(1:ngrdcol,1:nz),pdf_params%thl_2(1:ngrdcol,1:nz),pdf_params) 1012, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1013, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1014, ! blockidx%x threadidx%x collapsed 1012, Generating default present(pdf_params%rsatl_1(1:ngrdcol,1:nz),rsatl_1(:ngrdcol,:nz),rsatl_2(:ngrdcol,:nz),pdf_params,pdf_params%rsatl_2(1:ngrdcol,1:nz)) 1078, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1079, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1080, ! blockidx%x threadidx%x collapsed 1078, Generating default present(ice_supersat_frac(:ngrdcol,:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%ice_supersat_frac_2(1:ngrdcol,1:nz),pdf_params%ice_supersat_frac_1(1:ngrdcol,1:nz)) 1111, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1112, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1113, ! blockidx%x threadidx%x collapsed 1111, Generating default present(rcm(:ngrdcol,:nz),pdf_params%rc_2(1:ngrdcol,1:nz),cloud_frac(:ngrdcol,:nz),pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),pdf_params,pdf_params%cloud_frac_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz)) 1128, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1129, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1130, ! blockidx%x threadidx%x collapsed 1128, Generating default present(pdf_params%corr_w_eta_2(1:ngrdcol,1:nz),pdf_params%corr_w_eta_1(1:ngrdcol,1:nz),pdf_params%corr_w_chi_2(1:ngrdcol,1:nz),pdf_params%corr_w_chi_1(1:ngrdcol,1:nz),pdf_params) 1218, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1219, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1220, ! blockidx%x threadidx%x collapsed 1218, Generating default present(uprcp_contrib_comp_2(:ngrdcol,:nz),vprcp(:ngrdcol,:nz),vprcp_contrib_comp_1(:ngrdcol,:nz),thv_ds(:ngrdcol,:nz),uprcp(:ngrdcol,:nz),uprcp_contrib_comp_1(:ngrdcol,:nz),rtprcp_contrib_comp_2(:ngrdcol,:nz),thlprcp(:ngrdcol,:nz),thlprcp_contrib_comp_1(:ngrdcol,:nz),rc_coef(:ngrdcol,:nz),rtprcp(:ngrdcol,:nz),rtprcp_contrib_comp_1(:ngrdcol,:nz),vprcp_contrib_comp_2(:ngrdcol,:nz),wp2rcp(:ngrdcol,:nz),wp2rcp_contrib_comp_1(:ngrdcol,:nz),wp2rcp_contrib_comp_2(:ngrdcol,:nz),wprcp(:ngrdcol,:nz),wprcp_contrib_comp_2(:ngrdcol,:nz),wprcp_contrib_comp_1(:ngrdcol,:nz),exner(:ngrdcol,:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),thlprcp_contrib_comp_2(:ngrdcol,:nz)) 1247, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1248, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1249, ! blockidx%x threadidx%x collapsed 1247, Generating default present(thlprcp(:ngrdcol,:nz),rtpthvp(:ngrdcol,:nz),thlp2(:ngrdcol,:nz),rtpthlp(:ngrdcol,:nz),rtprcp(:ngrdcol,:nz),rc_coef(:ngrdcol,:nz),rtp2(:ngrdcol,:nz),wp2thlp(:ngrdcol,:nz),wp2rtp(:ngrdcol,:nz),wp2rcp(:ngrdcol,:nz),thv_ds(:ngrdcol,:nz),wpthvp(:ngrdcol,:nz),wpthlp(:ngrdcol,:nz),wprtp(:ngrdcol,:nz),thlpthvp(:ngrdcol,:nz),wprcp(:ngrdcol,:nz),wp2thvp(:ngrdcol,:nz)) 1285, Generating implicit firstprivate(ngrdcol,sclr_dim,nz) Generating NVIDIA GPU code 1286, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1287, ! blockidx%x threadidx%x collapsed 1288, ! blockidx%x threadidx%x collapsed 1285, Generating default present(corr_sclr_thl_2(:ngrdcol,:nz,:sclr_dim),pdf_params%cloud_frac_1(1:ngrdcol,1:nz),varnce_sclr2(:ngrdcol,:nz,:sclr_dim),varnce_sclr1(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_rt_1(1:ngrdcol,1:nz),pdf_params%crt_1(1:ngrdcol,1:nz),pdf_params%cthl_2(1:ngrdcol,1:nz),corr_sclr_rt_1(:ngrdcol,:nz,:sclr_dim),pdf_params,thv_ds(:ngrdcol,:nz),pdf_params%rc_2(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),sclr1(:ngrdcol,:nz,:sclr_dim),sclr2(:ngrdcol,:nz,:sclr_dim),pdf_params%mixt_frac(1:ngrdcol,1:nz),rc_coef(:ngrdcol,:nz),pdf_params%varnce_rt_2(1:ngrdcol,1:nz),pdf_params%crt_2(1:ngrdcol,1:nz),corr_sclr_rt_2(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_thl_1(1:ngrdcol,1:nz),pdf_params%cthl_1(1:ngrdcol,1:nz),corr_sclr_thl_1(:ngrdcol,:nz,:sclr_dim),sclrm(:ngrdcol,:nz,:sclr_dim),pdf_params%varnce_thl_2(1:ngrdcol,1:nz),sclrpthvp(:ngrdcol,:nz,:sclr_dim),sclrprcp(:ngrdcol,:nz,:sclr_dim),sclrprtp(:ngrdcol,:nz,:sclr_dim),sclrpthlp(:ngrdcol,:nz,:sclr_dim)) 1328, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1329, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1330, ! blockidx%x threadidx%x collapsed 1328, Generating default present(rcp2(:ngrdcol,:nz),rcm(:ngrdcol,:nz),pdf_params%stdev_chi_2(1:ngrdcol,1:nz),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nz),pdf_params%rc_2(1:ngrdcol,1:nz),pdf_params%chi_2(1:ngrdcol,1:nz),pdf_params%chi_1(1:ngrdcol,1:nz),pdf_params%rc_1(1:ngrdcol,1:nz),pdf_params%stdev_chi_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_1(1:ngrdcol,1:nz),pdf_params%cloud_frac_2(1:ngrdcol,1:nz)) 1361, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1362, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1363, ! blockidx%x threadidx%x collapsed 1361, Generating default present(cloudy_downdraft_frac(:ngrdcol,:nz),cloudy_updraft_frac(:ngrdcol,:nz),w_up_in_cloud(:ngrdcol,:nz),w_down_in_cloud(:ngrdcol,:nz)) 1409, Generating update self(pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),cloud_frac(:,:),pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),wprtp2(:,:),rcm(:,:),rtpthvp(:,:),rcp2(:,:),thlpthvp(:,:),wp4(:,:),thlprcp(:,:),rtprcp(:,:),wp2thlp(:,:),wpthlp2(:,:),pdf_params%w_2(:,:),wp2rtp(:,:),wprtpthlp(:,:),wp2rcp(:,:),wprcp(:,:),wp2thvp(:,:),wpthvp(:,:)) 1436, Generating update self(sclrpthvp(:,:,:),wpsclrpthlp(:,:,:),wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:)) 1461, Generating update self(exner(:,:),rtp2(:,:),wprtp(:,:),thlm(:,:),sigma_sqd_w(:,:),wp3(:,:),rtm(:,:),p_in_pa(:,:),rtpthlp(:,:),wp2(:,:),wm(:,:),thv_ds(:,:),thlp2(:,:),ice_supersat_frac(:,:),wpthlp(:,:)) 1464, Generating update self(sclrprtp(:,:,:),sclrp2(:,:,:),sclrm(:,:,:),wpsclrp(:,:,:),sclrpthlp(:,:,:)) 1756, Generating exit data delete(rsatl_1(:,:),rc_2_ice(:,:),rc_1_ice(:,:),corr_v_w_2(:,:),vprcp_contrib_comp_1(:,:),varnce_v_2(:,:),uprcp_contrib_comp_1(:,:),u_2(:,:),thlprcp_contrib_comp_1(:,:),sqrt_wp2(:,:),rtprcp_contrib_comp_1(:,:),rsatl_2(:,:),wp2rcp_contrib_comp_1(:,:),vprcp_contrib_comp_2(:,:),wprcp_contrib_comp_1(:,:),wp2rcp_contrib_comp_2(:,:),sku(:,:),skthl(:,:),rtprcp_contrib_comp_2(:,:),skrt(:,:),skv(:,:),tl1(:,:),thlprcp_contrib_comp_2(:,:),corr_v_w_1(:,:),corr_u_w_2(:,:),corr_u_w_1(:,:),alpha_v(:,:),alpha_u(:,:),varnce_v_1(:,:),varnce_u_2(:,:),v_1(:,:),uprcp_contrib_comp_2(:,:),varnce_u_1(:,:),v_2(:,:),u_1(:,:),tl2(:,:),wprcp_contrib_comp_2(:,:)) 1768, Generating exit data delete(sclr2(:,:,:),corr_w_sclr_1(:,:,:),corr_sclr_thl_2(:,:,:),corr_sclr_rt_1(:,:,:),alpha_sclr(:,:,:),corr_sclr_thl_1(:,:,:),corr_sclr_rt_2(:,:,:),varnce_sclr2(:,:,:),varnce_sclr1(:,:,:),sksclr(:,:,:),sclr1(:,:,:),corr_w_sclr_2(:,:,:)) transform_pdf_chi_eta_component: 1844, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1845, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1846, ! blockidx%x threadidx%x collapsed 1844, Generating default present(crt(:ngrdcol,:nz),cthl(:ngrdcol,:nz),chi(:ngrdcol,:nz),rsatl(:ngrdcol,:nz),exner(:ngrdcol,:nz),rt(:ngrdcol,:nz),tl(:ngrdcol,:nz)) 1846, Generating implicit firstprivate(invrs_beta_rsatl_p1,beta) 1871, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 1872, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1873, ! blockidx%x threadidx%x collapsed 1871, Generating default present(stdev_chi(:ngrdcol,:nz),cthl(:ngrdcol,:nz),corr_chi_eta(:ngrdcol,:nz),corr_rt_thl(:ngrdcol,:nz),crt(:ngrdcol,:nz),varnce_thl(:ngrdcol,:nz),varnce_rt(:ngrdcol,:nz),covar_chi_eta(:ngrdcol,:nz),stdev_eta(:ngrdcol,:nz)) 1873, Generating implicit firstprivate(varnce_eta,varnce_thl_term,varnce_rt_term,corr_rt_thl_term,varnce_chi) calc_wp4_pdf: 1981, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 1982, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1983, ! blockidx%x threadidx%x collapsed 1981, Generating default present(wp4(:ngrdcol,:nz),wm(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz)) calc_wp2xp2_pdf: 2086, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2087, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2088, ! blockidx%x threadidx%x collapsed 2086, Generating default present(wm(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),wp2xp2(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_wp2xp_pdf: 2193, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2194, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2195, ! blockidx%x threadidx%x collapsed 2193, Generating default present(wm(:ngrdcol,:nz),wp2xp(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz)) calc_wpxp2_pdf: 2293, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2294, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2295, ! blockidx%x threadidx%x collapsed 2293, Generating default present(wm(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),wpxp2(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),xm(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_wpxpyp_pdf: 2420, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2421, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2422, ! blockidx%x threadidx%x collapsed 2420, Generating default present(wm(:ngrdcol,:nz),varnce_y_2(:ngrdcol,:nz),corr_w_y_2(:ngrdcol,:nz),wpxpyp(:ngrdcol,:nz),corr_w_x_2(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),xm(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),corr_x_y_2(:ngrdcol,:nz),w_2(:ngrdcol,:nz),w_1(:ngrdcol,:nz),corr_x_y_1(:ngrdcol,:nz),x_2(:ngrdcol,:nz),x_1(:ngrdcol,:nz),corr_w_y_1(:ngrdcol,:nz),varnce_y_1(:ngrdcol,:nz),ym(:ngrdcol,:nz),y_2(:ngrdcol,:nz),y_1(:ngrdcol,:nz),corr_w_x_1(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz)) calc_liquid_cloud_frac_component: 2540, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2541, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2542, ! blockidx%x threadidx%x collapsed 2540, Generating default present(rc(:ngrdcol,:nz),stdev_chi(:ngrdcol,:nz),cloud_frac(:ngrdcol,:nz),mean_chi(:ngrdcol,:nz)) 2542, Generating implicit firstprivate(zeta) calc_ice_cloud_frac_component: 2667, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 2669, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_any_below_freezing) 2670, ! blockidx%x threadidx%x collapsed 2667, Generating default present(tl(:ngrdcol,:nz),rc_in(:ngrdcol,:nz),cloud_frac(:ngrdcol,:nz),rc(:ngrdcol,:nz),ice_supersat_frac(:ngrdcol,:nz)) Generating implicit copy(l_any_below_freezing) [if not already present] 2687, Generating create(rsat_ice(:,:)) [if not already present] 2692, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 2693, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2694, ! blockidx%x threadidx%x collapsed 2692, Generating default present(mean_chi(:ngrdcol,:nz),crt(:ngrdcol,:nz),rc(:ngrdcol,:nz),ice_supersat_frac(:ngrdcol,:nz),rsatl(:ngrdcol,:nz),tl(:ngrdcol,:nz),stdev_chi(:ngrdcol,:nz)) 2694, Generating implicit firstprivate(zeta,chi_at_ice_sat) calc_xprcp_component: 3176, Generating implicit firstprivate(ngrdcol,nz) Generating NVIDIA GPU code 3177, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3178, ! blockidx%x threadidx%x collapsed 3176, Generating default present(vm(:ngrdcol,:nz),varnce_w_i(:ngrdcol,:nz),uprcp_contrib_comp_i(:ngrdcol,:nz),um(:ngrdcol,:nz),u_i(:ngrdcol,:nz),thlprcp_contrib_comp_i(:ngrdcol,:nz),thlm(:ngrdcol,:nz),thl_i(:ngrdcol,:nz),stdev_eta_i(:ngrdcol,:nz),crt_i(:ngrdcol,:nz),rtm(:ngrdcol,:nz),rt_i(:ngrdcol,:nz),rcm(:ngrdcol,:nz),corr_chi_eta_i(:ngrdcol,:nz),cloud_frac_i(:ngrdcol,:nz),stdev_chi_i(:ngrdcol,:nz),rtprcp_contrib_comp_i(:ngrdcol,:nz),wm(:ngrdcol,:nz),v_i(:ngrdcol,:nz),wprcp_contrib_comp_i(:ngrdcol,:nz),wp2rcp_contrib_comp_i(:ngrdcol,:nz),w_i(:ngrdcol,:nz),vprcp_contrib_comp_i(:ngrdcol,:nz),rc_i(:ngrdcol,:nz),cthl_i(:ngrdcol,:nz)) calc_w_up_in_cloud: 3312, Generating implicit firstprivate(nz,ngrdcol) Generating NVIDIA GPU code 3313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3314, ! blockidx%x threadidx%x collapsed 3312, Generating default present(w_2(:ngrdcol,:nz),w_up_in_cloud(:ngrdcol,:nz),w_down_in_cloud(:ngrdcol,:nz),cloud_frac_2(:ngrdcol,:nz),cloudy_downdraft_frac(:ngrdcol,:nz),cloudy_updraft_frac(:ngrdcol,:nz),cloud_frac_1(:ngrdcol,:nz),w_1(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz)) 3314, Generating implicit firstprivate(ratio_w_2,stdev_w_1,w_down_2,stdev_w_2,updraft_frac_2,exp_neg_ratio_w_2_sqd,downdraft_frac_2,erf_ratio_w_2,w_up_2,w_up_1,updraft_frac_1,w_down_1,downdraft_frac_1,ratio_w_1,erf_ratio_w_1,exp_neg_ratio_w_1_sqd) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/advance_clubb_core_module.F90 advance_clubb_core: 887, Generating enter data create(lhs_splat_wp2(:,:),kmh_zm(:,:),mixt_frac_zm(:,:),tau_max_zm(:,:),stability_correction(:,:),lscale_down(:,:),rcp2_zt(:,:),a3_coef_zt(:,:),brunt_vaisala_freq_sqd_splat(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_clipped(:,:),cloud_frac_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_xp2_zm(:,:),invrs_tau_no_n2_zm(:,:),invrs_tau_sfc(:,:),ice_supersat_frac_zm(:,:),invrs_tau_n2_zm(:,:),invrs_tau_wp2_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_shear(:,:),invrs_tau_bkgnd(:,:),invrs_tau_c1_zm(:,:),invrs_tau_c6_zm(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_n2_iso(:,:),sqrt_em_zt(:,:),rc_coef(:,:),thlm1000(:),tau_zt(:,:),rcm_supersat_adj(:,:),thlm700(:),ri_zm(:,:),gamma_skw_fnc(:,:),brunt_vaisala_freq_sqd_zt(:,:),rcp2(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_zt(:,:),w_1_zm(:,:),vpwp_zt(:,:),wpthlp_zt(:,:),skw_zt(:,:),sigma_sqd_w_tmp(:,:),sigma_sqd_w(:,:),rtpthlp_zt(:,:),em(:,:),km_zm(:,:),invrs_tau_zt(:,:),mu(:),wp3_on_wp2(:,:),wp2rcp(:,:),a3_coef(:,:),sigma_sqd_w_zt(:,:),vp2_zt(:,:),up2_zt(:,:),varnce_w_2_zm(:,:),thvm_zm(:,:),rtprcp(:,:),rtm_zm(:,:),wprtp2(:,:),wpthlp2(:,:),thlm_zm(:,:),w_2_zm(:,:),tau_zm(:,:),tau_max_zt(:,:),ddzt_vm(:,:),lscale(:,:),lscale_up(:,:),lscale_max(:),lhs_splat_wp3(:,:),wp3_on_wp2_zt(:,:),wp2_zt(:,:),wprtp_zt(:,:),wp3_zm(:,:),wprtpthlp(:,:),ddzt_umvm_sqd(:,:),ddzt_um(:,:),ddzt_umvm_sqd_clipped(:,:),ddzm_thvm_zm(:,:),rcm_zm(:,:),rtp2_zt(:,:),cx_fnc_richardson(:,:),thvm(:,:),thlp2_zt(:,:),skw_zm(:,:),skw_velocity(:,:),xp3_coef_fnc(:,:)) 908, Generating enter data create(wpsclrp2(:,:,:),wpsclrprtp(:,:,:),wpsclrp_zt(:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:),sclrp2_zt(:,:),wpsclrpthlp(:,:,:)) 912, Generating enter data create(wpedsclrp(:,:,:)) 929, Generating update self(rtm(:,:),rho_ds_zt(:,:),gr%dzt(:,:),thlm(:,:),wm_zt(:,:),wm_zm(:,:)) 956, Generating update self(rtp2(:,:),thlm_forcing(:,:),rtm_forcing(:,:),wp2(:,:),wm_zt(:,:),wprtp_sfc(:),rtpthlp(:,:),wp3(:,:),rho_zm(:,:),vm_forcing(:,:),um_forcing(:,:),vp2(:,:),upwp_sfc(:),up2(:,:),thv_ds_zt(:,:),p_in_pa(:,:),vpwp(:,:),upwp(:,:),wprtp(:,:),wpthlp(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),p_sfc(:),rho_ds_zt(:,:),invrs_rho_ds_zt(:,:),wm_zm(:,:),vpwp_sfc(:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),wpthlp_sfc(:)) 963, Generating update self(sclrm(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:),sclrm_forcing(:,:,:),wpedsclrp_sfc(:,:),sclrpthlp(:,:,:),wpsclrp(:,:,:),wpsclrp_sfc(:,:)) 967, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 1000, Generating update self(wp2(:,:),upwp(:,:),thlp2(:,:),rtpthlp(:,:),rfrzm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),vp2(:,:),up2(:,:),wpthlp(:,:),wprtp(:,:),wp3(:,:),um(:,:),vm(:,:),vpwp(:,:)) 1061, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1062, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1061, Generating default present(wpthlp_sfc(:ngrdcol),wpthlp(:ngrdcol,:1),wprtp_sfc(:ngrdcol),wprtp(:ngrdcol,:1),vpwp_sfc(:ngrdcol),upwp(:ngrdcol,:1),vpwp(:ngrdcol,:1),upwp_sfc(:ngrdcol)) 1071, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1072, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1071, Generating default present(upwp_pert(:ngrdcol,:1),vpwp_sfc_pert(:ngrdcol),vpwp_pert(:ngrdcol,:1),upwp_sfc_pert(:ngrdcol)) 1081, Generating implicit firstprivate(ngrdcol,sclr_dim) Generating NVIDIA GPU code 1082, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1083, ! blockidx%x threadidx%x collapsed 1081, Generating default present(wpsclrp_sfc(:ngrdcol,:sclr_dim),wpsclrp(:ngrdcol,:1,:sclr_dim)) 1091, Generating implicit firstprivate(edsclr_dim,ngrdcol) Generating NVIDIA GPU code 1092, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1093, ! blockidx%x threadidx%x collapsed 1091, Generating default present(wpedsclrp(:ngrdcol,:1,:edsclr_dim),wpedsclrp_sfc(:ngrdcol,:edsclr_dim)) 1102, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1103, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1102, Generating default present(wprtp(:ngrdcol,:1),wpthlp(:ngrdcol,:1),vpwp(:ngrdcol,:1),upwp(:ngrdcol,:1)) 1113, Generating implicit firstprivate(sclr_dim,ngrdcol) Generating NVIDIA GPU code 1114, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1115, ! blockidx%x threadidx%x collapsed 1113, Generating default present(wpsclrp(:ngrdcol,:1,:sclr_dim)) 1123, Generating implicit firstprivate(ngrdcol,edsclr_dim) Generating NVIDIA GPU code 1124, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1125, ! blockidx%x threadidx%x collapsed 1123, Generating default present(wpedsclrp(:ngrdcol,:1,:edsclr_dim)) 1141, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 1142, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 1141, Generating default present(mu(:ngrdcol),clubb_params(:ngrdcol,60)) 1250, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1251, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1252, ! blockidx%x threadidx%x collapsed 1250, Generating default present(skw_zm(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,57:59)) 1252, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 1306, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1307, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1308, ! blockidx%x threadidx%x collapsed 1306, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),a3_coef(:ngrdcol,:nzm)) 1317, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1318, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1319, ! blockidx%x threadidx%x collapsed 1317, Generating default present(clubb_params(:ngrdcol,98),a3_coef(:ngrdcol,:nzm)) 1340, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1341, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1342, ! blockidx%x threadidx%x collapsed 1340, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt),wp2_zt(:ngrdcol,:nzt)) 1349, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1350, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1351, ! blockidx%x threadidx%x collapsed 1349, Generating default present(wp3_on_wp2_zt(:ngrdcol,:nzt)) 1380, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1381, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1382, ! blockidx%x threadidx%x collapsed 1380, Generating default present(wp2(:ngrdcol,:nzm),em(:ngrdcol,:nzm)) 1388, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1389, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1390, ! blockidx%x threadidx%x collapsed 1388, Generating default present(up2(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm),em(:ngrdcol,:nzm)) 1400, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1401, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1402, ! blockidx%x threadidx%x collapsed 1400, Generating default present(sqrt_em_zt(:ngrdcol,:nzt)) 1431, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1432, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1433, ! blockidx%x threadidx%x collapsed 1431, Generating default present(ddzt_um(:ngrdcol,:nzm),ddzt_vm(:ngrdcol,:nzm),ddzt_umvm_sqd(:ngrdcol,:nzm)) 1440, Generating update self(ddzt_umvm_sqd(:,:)) 1504, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 1505, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1506, ! blockidx%x threadidx%x collapsed 1504, Generating default present(tau_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt),clubb_params(:ngrdcol,69)) 1514, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1515, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1516, ! blockidx%x threadidx%x collapsed 1514, Generating default present(clubb_params(:ngrdcol,69),em(:ngrdcol,:nzm),tau_zm(:ngrdcol,:nzm)) 1523, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1524, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1525, ! blockidx%x threadidx%x collapsed 1523, Generating default present(invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_wp3_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,69),invrs_tau_xp2_zm(:ngrdcol,:nzm),tau_zm(:ngrdcol,:nzm),tau_max_zm(:ngrdcol,:nzm)) 1536, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1537, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1538, ! blockidx%x threadidx%x collapsed 1536, Generating default present(invrs_tau_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,69),invrs_tau_wp3_zt(:ngrdcol,:nzt),tau_zt(:ngrdcol,:nzt),tau_max_zt(:ngrdcol,:nzt)) 1594, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 1595, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1596, ! blockidx%x threadidx%x collapsed 1594, Generating default present(clubb_params(:ngrdcol,37),kh_zt(:ngrdcol,:nzt),sqrt_em_zt(:ngrdcol,:nzt),lscale(:ngrdcol,:nzt)) 1604, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1605, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1606, ! blockidx%x threadidx%x collapsed 1604, Generating default present(em(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,37)) 1667, Generating update self(exner(:,:),thlm(:,:),rtm(:,:),p_in_pa(:,:),rcm(:,:)) 1700, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1701, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1702, ! blockidx%x threadidx%x collapsed 1700, Generating default present(mixt_frac_zm(:ngrdcol,:nzm),pdf_params_zm,varnce_w_1_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_1(1:ngrdcol,1:nzm),pdf_params_zm%w_2(1:ngrdcol,1:nzm),pdf_params_zm%mixt_frac(1:ngrdcol,1:nzm),w_1_zm(:ngrdcol,:nzm),w_2_zm(:ngrdcol,:nzm),pdf_params_zm%w_1(1:ngrdcol,1:nzm),varnce_w_2_zm(:ngrdcol,:nzm),pdf_params_zm%varnce_w_2(1:ngrdcol,1:nzm)) 1738, Generating update self(stability_correction(:,:)) 1749, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1750, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1751, ! blockidx%x threadidx%x collapsed 1749, Generating default present(invrs_tau_c1_zm(:ngrdcol,:nzm),invrs_tau_c6_zm(:ngrdcol,:nzm),stability_correction(:ngrdcol,:nzm),invrs_tau_zm(:ngrdcol,:nzm),invrs_tau_n2_zm(:ngrdcol,:nzm)) 1759, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1760, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1761, ! blockidx%x threadidx%x collapsed 1759, Generating default present(invrs_tau_c6_zm(:ngrdcol,:nzm),invrs_tau_c1_zm(:ngrdcol,:nzm),invrs_tau_wpxp_zm(:ngrdcol,:nzm),invrs_tau_wp2_zm(:ngrdcol,:nzm)) 1771, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1772, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1773, ! blockidx%x threadidx%x collapsed 1771, Generating default present(invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_c14_zm(:ngrdcol,:nzm)) 1789, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1790, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1791, ! blockidx%x threadidx%x collapsed 1789, Generating default present(invrs_tau_wp2_zm(:ngrdcol,:nzm),invrs_tau_c4_zm(:ngrdcol,:nzm)) 1808, Generating update self(brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_sqd_smth(:,:),invrs_tau_sfc(:,:),invrs_tau_no_n2_zm(:,:),brunt_vaisala_freq_sqd_splat(:,:),invrs_tau_bkgnd(:,:),invrs_tau_wp2_zm(:,:),ri_zm(:,:),invrs_tau_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_shear(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_xp2_zm(:,:)) 1886, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 1887, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 1888, ! blockidx%x threadidx%x collapsed 1886, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm)) 2207, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 2208, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2209, ! blockidx%x threadidx%x collapsed 2207, Generating default present(kmh_zm(:ngrdcol,:nzm),km_zm(:ngrdcol,:nzm),kh_zm(:ngrdcol,:nzm),clubb_params(:ngrdcol,74:75)) 2218, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2219, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2220, ! blockidx%x threadidx%x collapsed 2218, Generating default present(edsclrm(:ngrdcol,:nzt,edsclr_dim-1:edsclr_dim),thlm(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt)) 2220, Generating implicit firstprivate(edsclr_dim) 2260, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 2261, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 2262, ! blockidx%x threadidx%x collapsed 2260, Generating default present(rtm(:ngrdcol,:nzt),edsclrm(:ngrdcol,:nzt,edsclr_dim-1:edsclr_dim),thlm700(:ngrdcol),thlm1000(:ngrdcol),thlm(:ngrdcol,:nzt)) 2262, Generating implicit firstprivate(edsclr_dim) 2593, Generating update self(cloud_frac_zm(:,:),cloudy_downdraft_frac(:,:),vpwp_zt(:,:),w_down_in_cloud(:,:),sigma_sqd_w_zt(:,:),wp3_on_wp2(:,:),wp3_on_wp2_zt(:,:),a3_coef(:,:),cloudy_updraft_frac(:,:),rcm_zm(:,:),rtp3(:,:),thlp3(:,:),ice_supersat_frac_zm(:,:),skw_velocity(:,:),wp3_zm(:,:),wp2up2(:,:),wp2thvp(:,:),wpup2(:,:),wpthvp(:,:),wprtp2(:,:),wpthlp2(:,:),sigma_sqd_w(:,:),wprtp_zt(:,:),wp2_zt(:,:),kh_zm(:,:),tau_zm(:,:),lscale(:,:),lscale_down(:,:),wp2rcp(:,:),wp2rtp(:,:),kh_zt(:,:),upwp_zt(:,:),thvm(:,:),thv_ds_zt(:,:),rtpthvp(:,:),rcm_in_layer(:,:),a3_coef_zt(:,:),rcm(:,:),ice_supersat_frac(:,:),cloud_frac(:,:),exner(:,:),cloud_cover(:,:),rcm_supersat_adj(:,:),pdf_params_zm%w_2(:,:),rc_coef(:,:),wp4(:,:),rc_coef_zm(:,:),w_up_in_cloud(:,:),wm_zm(:,:),thv_ds_zm(:,:),thlpthvp(:,:),rho_ds_zm(:,:),rho(:,:),rho_ds_zt(:,:),rcp2(:,:),em(:,:),lscale_up(:,:),thlprcp(:,:),rtpthlp_zt(:,:),wp2thlp(:,:),wpthlp_zt(:,:),rtpthlp(:,:),rtprcp(:,:),thlp2_zt(:,:),thlp2(:,:),thlm_zm(:,:),rtp2_zt(:,:),rtp2(:,:),rtm_zm(:,:),wp3(:,:),wp2vp2(:,:),wp2(:,:),wm_zt(:,:),wpthlp(:,:),wprtpthlp(:,:),wprtp(:,:),wprcp(:,:),rtm(:,:),rho_zm(:,:),thlm(:,:),tau_zt(:,:),vp2(:,:),up2(:,:),vpwp(:,:),vp2_zt(:,:),upwp(:,:),up2_zt(:,:),vm(:,:),vg(:,:),um(:,:),ug(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:),pdf_params%w_2(:,:),pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),p_in_pa(:,:),pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),wpvp2(:,:)) 2663, Generating update self(wp2sclrp(:,:,:),wpsclrprtp(:,:,:),wpsclrp2(:,:,:),wpsclrp(:,:,:),sclrpthvp(:,:,:),sclrp2(:,:,:),wpedsclrp(:,:,:),sclrpthlp(:,:,:),sclrm(:,:,:),sclrprtp(:,:,:),sclrprcp(:,:,:),sclrm_forcing(:,:,:),wpsclrpthlp(:,:,:)) 2668, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 2795, Generating update self(rtp2(:,:),thlm_forcing(:,:),rtm_forcing(:,:),wp2(:,:),wm_zt(:,:),wprtp_sfc(:),rtpthlp(:,:),wp3(:,:),rho_zm(:,:),vm_forcing(:,:),um_forcing(:,:),vp2(:,:),upwp_sfc(:),up2(:,:),thv_ds_zt(:,:),p_in_pa(:,:),vpwp(:,:),upwp(:,:),wprtp(:,:),wpthlp(:,:),thv_ds_zm(:,:),thlp2(:,:),invrs_rho_ds_zm(:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),p_sfc(:),rho_ds_zt(:,:),invrs_rho_ds_zt(:,:),wm_zm(:,:),vpwp_sfc(:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),wpthlp_sfc(:)) 2802, Generating update self(sclrm(:,:,:),sclrprtp(:,:,:),sclrp2(:,:,:),sclrm_forcing(:,:,:),wpedsclrp_sfc(:,:),sclrpthlp(:,:,:),wpsclrp(:,:,:),wpsclrp_sfc(:,:)) 2806, Generating update self(edsclrm_forcing(:,:,:),edsclrm(:,:,:)) 2838, Generating update self(thlm(:,:),rtm_forcing(:,:),rtm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),wprtp_sfc(:),wprtp(:,:),wm_zt(:,:),thlm_forcing(:,:),wm_zm(:,:)) 2910, Generating exit data delete(wpsclrp2(:,:,:),wpsclrprtp(:,:,:),wpsclrp_zt(:,:),wp2sclrp(:,:,:),sclrprcp(:,:,:),sclrp2_zt(:,:),wpsclrpthlp(:,:,:)) 2914, Generating exit data delete(wpedsclrp(:,:,:)) 2917, Generating exit data delete(lhs_splat_wp2(:,:),kmh_zm(:,:),mixt_frac_zm(:,:),tau_max_zm(:,:),stability_correction(:,:),lscale_down(:,:),rcp2_zt(:,:),a3_coef_zt(:,:),brunt_vaisala_freq_sqd_splat(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_dry(:,:),brunt_vaisala_freq_clipped(:,:),cloud_frac_zm(:,:),invrs_tau_wp3_zm(:,:),invrs_tau_xp2_zm(:,:),invrs_tau_no_n2_zm(:,:),invrs_tau_sfc(:,:),ice_supersat_frac_zm(:,:),invrs_tau_n2_zm(:,:),invrs_tau_wp2_zm(:,:),invrs_tau_wp3_zt(:,:),invrs_tau_shear(:,:),invrs_tau_bkgnd(:,:),invrs_tau_c1_zm(:,:),invrs_tau_c6_zm(:,:),invrs_tau_wpxp_zm(:,:),invrs_tau_c14_zm(:,:),invrs_tau_c4_zm(:,:),invrs_tau_n2_iso(:,:),sqrt_em_zt(:,:),rc_coef(:,:),thlm1000(:),tau_zt(:,:),rcm_supersat_adj(:,:),thlm700(:),ri_zm(:,:),gamma_skw_fnc(:,:),brunt_vaisala_freq_sqd_zt(:,:),rcp2(:,:),lscale_zm(:,:),varnce_w_1_zm(:,:),upwp_zt(:,:),w_1_zm(:,:),vpwp_zt(:,:),xp3_coef_fnc(:,:),wpthlp_zt(:,:),skw_zt(:,:),sigma_sqd_w(:,:),rtpthlp_zt(:,:),em(:,:),km_zm(:,:),invrs_tau_zt(:,:),mu(:),wp3_on_wp2(:,:),wp2rcp(:,:),a3_coef(:,:),sigma_sqd_w_zt(:,:),vp2_zt(:,:),up2_zt(:,:),varnce_w_2_zm(:,:),thvm_zm(:,:),rtprcp(:,:),rtm_zm(:,:),wprtp2(:,:),wpthlp2(:,:),thlm_zm(:,:),w_2_zm(:,:),ddzt_umvm_sqd(:,:),ddzt_um(:,:),ddzt_umvm_sqd_clipped(:,:),ddzm_thvm_zm(:,:),sigma_sqd_w_tmp(:,:),tau_zm(:,:),tau_max_zt(:,:),ddzt_vm(:,:),lscale(:,:),lscale_up(:,:),lscale_max(:),lhs_splat_wp3(:,:),wp3_on_wp2_zt(:,:),wp2_zt(:,:),wprtp_zt(:,:),wp3_zm(:,:),wprtpthlp(:,:),rcm_zm(:,:),rtp2_zt(:,:),cx_fnc_richardson(:,:),thvm(:,:),thlp2_zt(:,:),skw_zm(:,:),skw_velocity(:,:)) pdf_closure_driver: 3458, Generating enter data create(rtpthvp_zt(:,:),skw_zt(:,:),upwp_zt(:,:),thlpthvp_zt(:,:),gamma_skw_fnc_zt(:,:),rel_humidity(:,:),vp3_zm(:,:),up3_zm(:,:),thlp3_zm(:,:),rtp3_zm(:,:),wp4_zt(:,:),thlprcp_zt(:,:),rtpthlp_zt(:,:),wpthlp_zt(:,:),wp3_zm(:,:),wp2up2_zt(:,:),wp2_zt(:,:),sku_zt(:,:),skv_zm(:,:),skthl_zt(:,:),sku_zm(:,:),skrt_zt(:,:),skthl_zm(:,:),sigma_sqd_w_zt(:,:),skrt_zm(:,:),skv_zt(:,:),skw_zm(:,:),sigma_sqd_w_tmp(:,:),gamma_skw_fnc(:,:),vprcp_zt(:,:),uprcp_zt(:,:),vp2_zt(:,:),vm_zm(:,:),up2_zt(:,:),um_zm(:,:),rtprcp_zt(:,:),wprtp_zt(:,:),wprcp_zt(:,:),thlp2_zt(:,:),t_in_k(:,:),rtp2_zt(:,:),rsat(:,:),wp2vp2_zt(:,:),vpwp_zt(:,:),wpthvp_zt(:,:)) 3468, Generating enter data create(w_up_in_cloud_zm(:,:),wp2thlp_zm(:,:),wprtp2_zm(:,:),wp2rtp_zm(:,:),wprtpthlp_zm(:,:),wp2rcp_zm(:,:),wp2thvp_zm(:,:),cloudy_updraft_frac_zm(:,:),exner_zm(:,:),cloudy_downdraft_frac_zm(:,:),p_in_pa_zm(:,:),wpup2_zm(:,:),wpthlp2_zm(:,:),w_down_in_cloud_zm(:,:),wpvp2_zm(:,:)) 3475, Generating enter data create(sksclr_zt(:,:,:),wpsclrprtp_zm(:,:,:),wp2sclrp_zm(:,:,:),wpsclrp_zt(:,:,:),sclrp3_zm(:,:,:),sclrpthlp_zt(:,:,:),sclrpthvp_zt(:,:,:),sksclr_zm(:,:,:),sclrprtp_zt(:,:,:),sclrprcp_zt(:,:,:),sclrp2_zt(:,:,:),sclrm_zm(:,:,:),wpsclrp2_zm(:,:,:),wpsclrpthlp_zm(:,:,:)) 3480, Generating enter data create(rtphmp(:,:,:),thlphmp(:,:,:),wphydrometp_zt(:,:,:),wp2hmp_zm(:,:,:)) 3564, Generating update self(skrt_zt(:,:),skrt_zm(:,:),skthl_zm(:,:),skthl_zt(:,:),skw_zt(:,:),skw_zm(:,:)) 3589, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3590, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3591, ! blockidx%x threadidx%x collapsed 3589, Generating default present(skw_zm(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm),clubb_params(:ngrdcol,57:59)) 3591, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 3613, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3614, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3615, ! blockidx%x threadidx%x collapsed 3613, Generating default present(skw_zt(:ngrdcol,:nzt),gamma_skw_fnc_zt(:ngrdcol,:nzt),clubb_params(:ngrdcol,57:59)) 3615, Generating implicit firstprivate(gamma_coef,gamma_coefc,gamma_coefb) 3658, Generating update self(gamma_skw_fnc(:,:)) 3707, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3708, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3709, ! blockidx%x threadidx%x collapsed 3707, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),skw_velocity(:ngrdcol,:nzm),wp3_zm(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm)) 3818, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 3819, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3820, ! blockidx%x threadidx%x collapsed 3818, Generating default present(rtm_ref(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),gr,gr%zt(1:ngrdcol,1:nzt)) 3820, Generating implicit firstprivate(dt,rtm_min,ts_nudge,rtm_nudge_max_altitude) 3847, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3848, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3847, Generating default present(p_sfc(:ngrdcol),p_in_pa_zm(:ngrdcol,:),p_in_pa(:ngrdcol,nzt)) 3848, Generating implicit firstprivate(nzt,nzm) 3857, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 3858, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 3859, ! blockidx%x threadidx%x collapsed 3857, Generating default present(p_in_pa_zm(:ngrdcol,:nzm),exner_zm(:ngrdcol,:nzm)) 3947, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3948, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3947, Generating default present(wp4(:ngrdcol,:)) 3948, Generating implicit firstprivate(nzm) 3967, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3968, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3967, Generating default present(rcp2(:ngrdcol,nzm)) 3968, Generating implicit firstprivate(nzm) 3987, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 3988, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 3987, Generating default present(wpthvp(:ngrdcol,nzm),wprcp(:ngrdcol,nzm),thlprcp(:ngrdcol,nzm),rtprcp(:ngrdcol,nzm),wp2vp2(:ngrdcol,nzm),rc_coef_zm(:ngrdcol,nzm),rtpthvp(:ngrdcol,nzm),thlpthvp(:ngrdcol,nzm),uprcp(:ngrdcol,nzm),vprcp(:ngrdcol,nzm),wp2up2(:ngrdcol,nzm)) 3988, Generating implicit firstprivate(nzm) 4004, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 4005, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4006, ! blockidx%x threadidx%x collapsed 4004, Generating default present(thlm_zm(:ngrdcol,:nzm),rtm_zm(:ngrdcol,:nzm),rcm_zm(:ngrdcol,:nzm),ice_supersat_frac_zm(:ngrdcol,:nzm),cloud_frac_zm(:ngrdcol,:nzm)) 4021, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4022, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4021, Generating default present(sclrpthvp(:ngrdcol,nzm,sclr),sclrprcp(:ngrdcol,nzm,sclr)) 4022, Generating implicit firstprivate(sclr,nzm) 4033, Generating update self(vprcp(:,:),uprcp(:,:)) 4061, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4062, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4061, Generating default present(cloud_frac_zm(:ngrdcol,nzm)) 4062, Generating implicit firstprivate(nzm) 4097, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4098, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4099, ! blockidx%x threadidx%x collapsed 4097, Generating default present(cloud_frac(:ngrdcol,:nzt),rcm_in_layer(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),cloud_cover(:ngrdcol,:nzt)) 4107, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4109, ! blockidx%x threadidx%x collapsed 4107, Generating default present(ice_supersat_frac(:ngrdcol,:nzt),cloud_frac(:ngrdcol,:nzt)) 4121, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4122, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 4123, ! blockidx%x threadidx%x collapsed 4121, Generating default present(rcm(:ngrdcol,:nzt),rcm_supersat_adj(:ngrdcol,:nzt),rel_humidity(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),rsat(:ngrdcol,:nzt)) 4138, Generating implicit firstprivate(nzt,ngrdcol) Generating NVIDIA GPU code 4139, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:l_spur_supersat) 4140, ! blockidx%x threadidx%x collapsed 4138, Generating default present(rtm(:ngrdcol,:nzt),rsat(:ngrdcol,:nzt),rel_humidity(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),rcm_supersat_adj(:ngrdcol,:nzt)) Generating implicit copy(l_spur_supersat) [if not already present] 4156, Generating exit data delete(rtpthvp_zt(:,:),skw_zt(:,:),upwp_zt(:,:),thlpthvp_zt(:,:),gamma_skw_fnc_zt(:,:),rel_humidity(:,:),vp3_zm(:,:),up3_zm(:,:),thlp3_zm(:,:),rtp3_zm(:,:),wp4_zt(:,:),thlprcp_zt(:,:),rtpthlp_zt(:,:),wpthlp_zt(:,:),wp3_zm(:,:),wp2up2_zt(:,:),wp2_zt(:,:),sku_zt(:,:),skv_zm(:,:),skthl_zt(:,:),sku_zm(:,:),skrt_zt(:,:),skthl_zm(:,:),sigma_sqd_w_zt(:,:),skrt_zm(:,:),skv_zt(:,:),skw_zm(:,:),sigma_sqd_w_tmp(:,:),gamma_skw_fnc(:,:),vprcp_zt(:,:),uprcp_zt(:,:),vp2_zt(:,:),vm_zm(:,:),up2_zt(:,:),um_zm(:,:),rtprcp_zt(:,:),wprtp_zt(:,:),wprcp_zt(:,:),thlp2_zt(:,:),t_in_k(:,:),rtp2_zt(:,:),rsat(:,:),wp2vp2_zt(:,:),vpwp_zt(:,:),wpthvp_zt(:,:)) 4166, Generating exit data delete(w_up_in_cloud_zm(:,:),wp2thlp_zm(:,:),wprtp2_zm(:,:),wp2rtp_zm(:,:),wprtpthlp_zm(:,:),wp2rcp_zm(:,:),wp2thvp_zm(:,:),cloudy_updraft_frac_zm(:,:),exner_zm(:,:),cloudy_downdraft_frac_zm(:,:),p_in_pa_zm(:,:),wpup2_zm(:,:),wpthlp2_zm(:,:),w_down_in_cloud_zm(:,:),wpvp2_zm(:,:)) 4173, Generating exit data delete(sksclr_zt(:,:,:),wpsclrprtp_zm(:,:,:),wp2sclrp_zm(:,:,:),wpsclrp_zt(:,:,:),sclrp3_zm(:,:,:),sclrpthlp_zt(:,:,:),sclrpthvp_zt(:,:,:),sksclr_zm(:,:,:),sclrprtp_zt(:,:,:),sclrprcp_zt(:,:,:),sclrp2_zt(:,:,:),sclrm_zm(:,:,:),wpsclrp2_zm(:,:,:),wpsclrpthlp_zm(:,:,:)) 4178, Generating exit data delete(rtphmp(:,:,:),thlphmp(:,:,:),wphydrometp_zt(:,:,:),wp2hmp_zm(:,:,:)) trapezoidal_rule_zt: 4906, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4907, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4906, Generating default present(wp2thvp_zm(:ngrdcol,nzm),wprtpthlp_zm(:ngrdcol,nzm),wpthlp2_zm(:ngrdcol,nzm),wprtp2_zm(:ngrdcol,nzm),cloud_frac_zm(:ngrdcol,nzm),ice_supersat_frac_zm(:ngrdcol,nzm),rcm_zm(:ngrdcol,nzm)) 4907, Generating implicit firstprivate(nzm) 4923, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 4924, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 4923, Generating default present(wpsclrp2_zm(:ngrdcol,nzm,sclr),wpsclrprtp_zm(:ngrdcol,nzm,sclr),wpsclrpthlp_zm(:ngrdcol,nzm,sclr)) 4924, Generating implicit firstprivate(sclr,nzm) calc_trapezoid_zt: 5100, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5101, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5102, ! blockidx%x threadidx%x collapsed 5100, Generating default present(gr%zt(1:ngrdcol,1:nzt),variable_zm(:ngrdcol,:nzt+1),variable_zt(:ngrdcol,:nzt),trapezoid_zt(:ngrdcol,:nzt),gr%invrs_dzt(1:ngrdcol,1:nzt),gr%zm(1:ngrdcol,1:nzt+1),gr) calc_trapezoid_zm: 5160, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5161, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5160, Generating default present(variable_zm(:ngrdcol,:),trapezoid_zm(:ngrdcol,:)) 5161, Generating implicit firstprivate(nzm) 5167, Generating implicit firstprivate(nzm,ngrdcol) Generating NVIDIA GPU code 5168, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5169, ! blockidx%x threadidx%x collapsed 5167, Generating default present(gr%zt(1:ngrdcol,1:nzm-1),trapezoid_zm(:ngrdcol,2:nzm-1),variable_zt(:ngrdcol,:nzm-1),variable_zm(:ngrdcol,2:nzm-1),gr%zm(1:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr) compute_cloud_cover: 5252, Generating enter data create(chi_mean(:,:),vert_cloud_frac(:,:),vert_cloud_frac_upper(:,:),vert_cloud_frac_lower(:,:)) 5255, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5256, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5257, ! blockidx%x threadidx%x collapsed 5255, Generating default present(chi_mean(:ngrdcol,:nzt),pdf_params,pdf_params%mixt_frac(1:ngrdcol,1:nzt),pdf_params%chi_2(1:ngrdcol,1:nzt),pdf_params%chi_1(1:ngrdcol,1:nzt)) 5266, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5267, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x Generating reduction(.or.:err_code) 5268, ! blockidx%x threadidx%x collapsed 5266, Generating default present(rcm(:ngrdcol,:),chi_mean(:ngrdcol,:),cloud_cover(:ngrdcol,:nzt-1),gr%zt(1:ngrdcol,1:nzt-1),cloud_frac(:ngrdcol,:nzt-1),gr%zm(1:ngrdcol,:),gr%invrs_dzm(1:ngrdcol,:),gr,vert_cloud_frac_upper(:ngrdcol,:nzt-1),vert_cloud_frac_lower(:ngrdcol,:nzt-1),vert_cloud_frac(:ngrdcol,:nzt-1),rcm_in_layer(:ngrdcol,:nzt-1)) Generating implicit copy(err_code) [if not already present] 5268, Generating implicit firstprivate(kp1,km1) 5354, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5355, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5354, Generating default present(cloud_cover(:ngrdcol,nzt),cloud_frac(:ngrdcol,nzt),rcm_in_layer(:ngrdcol,nzt),rcm(:ngrdcol,nzt)) 5355, Generating implicit firstprivate(nzt) 5364, Generating update self(rcm(:,:),pdf_params%mixt_frac(:,:),pdf_params%chi_1(:,:),cloud_frac(:,:),pdf_params%chi_2(:,:)) 5378, Generating exit data delete(chi_mean(:,:),vert_cloud_frac(:,:),vert_cloud_frac_upper(:,:),vert_cloud_frac_lower(:,:)) clip_rcm: 5429, Generating copy(rcm(:,:)) [if not already present] Generating copyin(rtm(:,:)) [if not already present] 5434, Generating update self(rcm(:,:),rtm(:,:)) 5454, Generating implicit firstprivate(ngrdcol,nzt) Generating NVIDIA GPU code 5455, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x 5456, ! blockidx%x threadidx%x collapsed set_lscale_max: 5518, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5519, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5518, Generating default present(host_dx(:ngrdcol),lscale_max(:ngrdcol),host_dy(:ngrdcol)) 5524, Generating implicit firstprivate(ngrdcol) Generating NVIDIA GPU code 5525, !$acc loop gang, vector(128) ! blockidx%x threadidx%x 5524, Generating default present(lscale_max(:ngrdcol)) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/CLUBB_core/clubb_api_module.F90 advance_clubb_core_api_single_col: 1202, Generating copyin(fcor_col(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present] Generating copyout(kh_zt_col(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present] Generating copy(rtpthvp_col(:,:)) [if not already present] Generating copyout(cloudy_updraft_frac_col(:,:)) [if not already present] Generating copy(exner_col(:,:)) [if not already present] Generating copyin(sclr_idx) [if not already present] Generating copy(thlm_col(:,:),rtm_col(:,:),um_col(:,:),vm_col(:,:),wprtp_col(:,:),wpthlp_col(:,:),rtp2_col(:,:),thlp2_col(:,:),rtpthlp_col(:,:)) [if not already present] Generating copyout(w_up_in_cloud_col(:,:)) [if not already present] Generating copyin(wm_zm_col(:,:),rho_ds_zt_col(:,:),rfrzm_col(:,:),rho_col(:,:),rho_ds_zm_col(:,:)) [if not already present] Generating copy(ice_supersat_frac_col(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm_col(:,:)) [if not already present] Generating copy(thlpthvp_col(:,:)) [if not already present] Generating copyin(thv_ds_zm_col(:,:)) [if not already present] Generating copyout(rcm_in_layer_col(:,:)) [if not already present] Generating copyin(wpthlp_forcing_col(:,:),wprtp_forcing_col(:,:)) [if not already present] Generating copy(upwp_pert_col(:,:),vpwp_pert_col(:,:),p_in_pa_col(:,:)) [if not already present] Generating copyin(upwp_sfc_col(:),vpwp_sfc_col(:),rtm_forcing_col(:,:),thlm_forcing_col(:,:)) [if not already present] Generating copy(um_pert_col(:,:),vm_pert_col(:,:)) [if not already present] Generating copyin(thv_ds_zt_col(:,:),upwp_sfc_pert_col(:),gr%zt(:,:),host_dx_col(:),p_sfc_col(:)) [if not already present] Generating copy(pdf_params%w_2(:,:)) [if not already present] Generating copyin(ug_col(:,:)) [if not already present] Generating copy(uprcp_col(:,:)) [if not already present] Generating copyin(vg_col(:,:)) [if not already present] Generating copy(vprcp_col(:,:)) [if not already present] Generating copyin(um_ref_col(:,:),vm_ref_col(:,:)) [if not already present] Generating copy(up2_col(:,:),vp2_col(:,:)) [if not already present] Generating copyin(rho_zm_col(:,:)) [if not already present] Generating copyout(wprcp_col(:,:)) [if not already present] Generating copyin(sfc_elevation_col(:),wprtp_sfc_col(:),rtm_ref_col(:,:),rtp2_forcing_col(:,:),thlm_ref_col(:,:),thlp2_forcing_col(:,:)) [if not already present] Generating copy(rtp3_col(:,:)) [if not already present] Generating copyin(wm_zt_col(:,:)) [if not already present] Generating copy(wp2vp2_col(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu9(:),clubb_params_col(:,:)) [if not already present] Generating copy(rc_coef_zm_col(:,:)) [if not already present] Generating copyout(cloud_cover_col(:,:)) [if not already present] Generating copyin(wpthlp_sfc_col(:)) [if not already present] Generating copy(wp2thlp_col(:,:)) [if not already present] Generating copyin(rtpthlp_forcing_col(:,:)) [if not already present] Generating copyout(thlprcp_col(:,:)) [if not already present] Generating copy(wp2_col(:,:),wp2rtp_col(:,:),up3_col(:,:),vp3_col(:,:),pdf_params_zm%w_2(:,:),wp3_col(:,:),wpthvp_col(:,:),wpup2_col(:,:),wp2thvp_col(:,:),wp2up2_col(:,:)) [if not already present] Generating copyin(host_dy_col(:),um_forcing_col(:,:),vm_forcing_col(:,:)) [if not already present] Generating copy(upwp_col(:,:),vpwp_col(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params) [if not already present] Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params_zm) [if not already present] Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm_col(:,:),wp4_col(:,:)) [if not already present] Generating copyout(w_down_in_cloud_col(:,:)) [if not already present] Generating copyin(vpwp_sfc_pert_col(:)) [if not already present] Generating copyout(cloudy_downdraft_frac_col(:,:)) [if not already present] Generating copy(cloud_frac_col(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zt_col(:,:)) [if not already present] Generating copyout(kh_zm_col(:,:),invrs_tau_zm_col(:,:)) [if not already present] Generating copy(thlp3_col(:,:),wpvp2_col(:,:)) [if not already present] 1284, Generating copy(sclrm_col(:,:,:),wpsclrp_col(:,:,:)) [if not already present] Generating copyin(sclr_tol(:)) [if not already present] Generating copy(sclrpthvp_col(:,:,:)) [if not already present] Generating copyin(sclrm_forcing_col(:,:,:)) [if not already present] Generating copy(sclrp2_col(:,:,:),sclrp3_col(:,:,:),sclrprtp_col(:,:,:),sclrpthlp_col(:,:,:)) [if not already present] Generating copyin(wpsclrp_sfc_col(:,:)) [if not already present] 1289, Generating copyin(edsclrm_forcing_col(:,:,:)) [if not already present] Generating copy(edsclrm_col(:,:,:)) [if not already present] Generating copyin(wpedsclrp_sfc_col(:,:)) [if not already present] 1293, Generating copyin(wphydrometp_col(:,:,:),wp2hmp_col(:,:,:),thlphmp_zt_col(:,:,:),l_mix_rat_hm(:),rtphmp_zt_col(:,:,:),hydromet_col(:,:,:)) [if not already present] advance_clubb_core_api_multi_col: 1802, Generating copyin(fcor(:),gr%weights_zt2zm(:,:,:),gr%zm(:,:),gr,gr%dzm(:,:),gr%invrs_dzm(:,:),gr%dzt(:,:),gr%weights_zm2zt(:,:,:),gr%invrs_dzt(:,:)) [if not already present] Generating copyout(kh_zt(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu10(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep,nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu2(:)) [if not already present] Generating copy(rtpthvp(:,:)) [if not already present] Generating copyout(cloudy_updraft_frac(:,:)) [if not already present] Generating copy(exner(:,:)) [if not already present] Generating copyin(sclr_idx) [if not already present] Generating copy(thlm(:,:),rtm(:,:),um(:,:),vm(:,:),wprtp(:,:),wpthlp(:,:),rtp2(:,:),thlp2(:,:),rtpthlp(:,:)) [if not already present] Generating copyout(w_up_in_cloud(:,:)) [if not already present] Generating copyin(wm_zm(:,:),rho_ds_zt(:,:),rfrzm(:,:),rho(:,:),rho_ds_zm(:,:)) [if not already present] Generating copy(ice_supersat_frac(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zm(:,:)) [if not already present] Generating copy(thlpthvp(:,:)) [if not already present] Generating copyin(thv_ds_zm(:,:)) [if not already present] Generating copyout(rcm_in_layer(:,:)) [if not already present] Generating copyin(wpthlp_forcing(:,:),wprtp_forcing(:,:)) [if not already present] Generating copy(upwp_pert(:,:),vpwp_pert(:,:),p_in_pa(:,:)) [if not already present] Generating copyin(upwp_sfc(:),vpwp_sfc(:),rtm_forcing(:,:),thlm_forcing(:,:)) [if not already present] Generating copy(um_pert(:,:),vm_pert(:,:)) [if not already present] Generating copyin(thv_ds_zt(:,:),upwp_sfc_pert(:),gr%zt(:,:),host_dx(:),p_sfc(:)) [if not already present] Generating copy(pdf_params%w_2(:,:)) [if not already present] Generating copyin(ug(:,:)) [if not already present] Generating copy(uprcp(:,:)) [if not already present] Generating copyin(vg(:,:)) [if not already present] Generating copy(vprcp(:,:)) [if not already present] Generating copyin(um_ref(:,:),vm_ref(:,:)) [if not already present] Generating copy(up2(:,:),vp2(:,:)) [if not already present] Generating copyin(rho_zm(:,:)) [if not already present] Generating copyout(wprcp(:,:)) [if not already present] Generating copyin(sfc_elevation(:),wprtp_sfc(:),rtm_ref(:,:),rtp2_forcing(:,:),thlm_ref(:,:),thlp2_forcing(:,:)) [if not already present] Generating copy(rtp3(:,:)) [if not already present] Generating copyin(wm_zt(:,:)) [if not already present] Generating copy(wp2vp2(:,:)) [if not already present] Generating copyin(nu_vert_res_dep%nu9(:),clubb_params(:,:)) [if not already present] Generating copy(rc_coef_zm(:,:)) [if not already present] Generating copyout(cloud_cover(:,:)) [if not already present] Generating copyin(wpthlp_sfc(:)) [if not already present] Generating copy(wp2thlp(:,:)) [if not already present] Generating copyin(rtpthlp_forcing(:,:)) [if not already present] Generating copyout(thlprcp(:,:)) [if not already present] Generating copy(wp2(:,:),wp2rtp(:,:),up3(:,:),vp3(:,:),pdf_params_zm%w_2(:,:),wp3(:,:),wpthvp(:,:),wpup2(:,:),wp2thvp(:,:),wp2up2(:,:)) [if not already present] Generating copyin(host_dy(:),um_forcing(:,:),vm_forcing(:,:)) [if not already present] Generating copy(upwp(:,:),vpwp(:,:),pdf_params%varnce_w_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%rsatl_2(:,:),pdf_params%rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params) [if not already present] Generating copy(pdf_params%covar_chi_eta_2(:,:),pdf_params%crt_1(:,:),pdf_params%crt_2(:,:),pdf_params%cthl_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%rc_2(:,:),pdf_params%rsatl_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rc_1(:,:),pdf_params%chi_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%cthl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%alpha_rt(:,:)) [if not already present] Generating copyin(pdf_params_zm) [if not already present] Generating copy(pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%ice_supersat_frac_1(:,:),rcm(:,:),wp4(:,:)) [if not already present] Generating copyout(w_down_in_cloud(:,:)) [if not already present] Generating copyin(vpwp_sfc_pert(:)) [if not already present] Generating copyout(cloudy_downdraft_frac(:,:)) [if not already present] Generating copy(cloud_frac(:,:)) [if not already present] Generating copyin(invrs_rho_ds_zt(:,:)) [if not already present] Generating copyout(kh_zm(:,:),invrs_tau_zm(:,:)) [if not already present] Generating copy(thlp3(:,:),wpvp2(:,:)) [if not already present] 1874, Generating copy(sclrm(:,:,:),wpsclrp(:,:,:)) [if not already present] Generating copyin(sclr_tol(:)) [if not already present] Generating copy(sclrpthvp(:,:,:)) [if not already present] Generating copyin(sclrm_forcing(:,:,:)) [if not already present] Generating copy(sclrp2(:,:,:),sclrp3(:,:,:),sclrprtp(:,:,:),sclrpthlp(:,:,:)) [if not already present] Generating copyin(wpsclrp_sfc(:,:)) [if not already present] 1878, Generating copyin(edsclrm_forcing(:,:,:)) [if not already present] Generating copy(edsclrm(:,:,:)) [if not already present] Generating copyin(wpedsclrp_sfc(:,:)) [if not already present] 1882, Generating copyin(wphydrometp(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:),l_mix_rat_hm(:),rtphmp_zt(:,:,:),hydromet(:,:,:)) [if not already present] ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_param.a diagnose_correlations_module.o clubb_api_module.o stats_lh_sfc_module.o parameter_indices.o stats_lh_zt_module.o clip_explicit.o tridiag_lu_solver.o stats_type.o stat_file_module.o input_names.o advance_clubb_core_module.o stats_rad_zm_module.o input_reader.o stats_clubb_utilities.o parameters_tunable.o pos_definite_module.o T_in_K_module.o corr_varnce_module.o mt95.o advance_windm_edsclrm_module.o mean_adv.o pdf_utilities.o advance_xm_wpxp_module.o stats_type_utilities.o new_hybrid_pdf.o pdf_parameter_module.o pdf_closure_module.o sfc_varnce_module.o turbulent_adv_pdf.o stats_sfc_module.o advance_xp3_module.o interpolation.o numerical_check.o precipitation_fraction.o advance_xp2_xpyp_module.o matrix_operations.o calc_pressure.o sigma_sqd_w_module.o mixing_length.o new_tsdadg_pdf.o advance_helper_module.o Nc_Ncn_eqns.o output_netcdf.o endian.o calc_roots.o LY93_pdf.o stats_zm_module.o diffusion.o lapack_interfaces.o grid_class.o matrix_solver_wrapper.o saturation.o Skx_module.o code_timer_module.o file_functions.o clubb_precision.o adg1_adg2_3d_luhar_pdf.o model_flags.o output_grads.o parameters_model.o error_code.o constants_clubb.o setup_clubb_pdf_params.o new_pdf.o stats_zt_module.o new_hybrid_pdf_main.o lapack_wrap.o calendar.o penta_lu_solver.o array_index.o hydromet_pdf_parameter_module.o new_pdf_main.o advance_wp2_wp3_module.o stats_variables.o sponge_layer_damping.o index_mapping.o fill_holes.o stats_rad_zt_module.o mono_flux_limiter.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_param.a a - diagnose_correlations_module.o a - clubb_api_module.o a - stats_lh_sfc_module.o a - parameter_indices.o a - stats_lh_zt_module.o a - clip_explicit.o a - tridiag_lu_solver.o a - stats_type.o a - stat_file_module.o a - input_names.o a - advance_clubb_core_module.o a - stats_rad_zm_module.o a - input_reader.o a - stats_clubb_utilities.o a - parameters_tunable.o a - pos_definite_module.o a - T_in_K_module.o a - corr_varnce_module.o a - mt95.o a - advance_windm_edsclrm_module.o a - mean_adv.o a - pdf_utilities.o a - advance_xm_wpxp_module.o a - stats_type_utilities.o a - new_hybrid_pdf.o a - pdf_parameter_module.o a - pdf_closure_module.o a - sfc_varnce_module.o a - turbulent_adv_pdf.o a - stats_sfc_module.o a - advance_xp3_module.o a - interpolation.o a - numerical_check.o a - precipitation_fraction.o a - advance_xp2_xpyp_module.o a - matrix_operations.o a - calc_pressure.o a - sigma_sqd_w_module.o a - mixing_length.o a - new_tsdadg_pdf.o a - advance_helper_module.o a - Nc_Ncn_eqns.o a - output_netcdf.o a - endian.o a - calc_roots.o a - LY93_pdf.o a - stats_zm_module.o a - diffusion.o a - lapack_interfaces.o a - grid_class.o a - matrix_solver_wrapper.o a - saturation.o a - Skx_module.o a - code_timer_module.o a - file_functions.o a - clubb_precision.o a - adg1_adg2_3d_luhar_pdf.o a - model_flags.o a - output_grads.o a - parameters_model.o a - error_code.o a - constants_clubb.o a - setup_clubb_pdf_params.o a - new_pdf.o a - stats_zt_module.o a - new_hybrid_pdf_main.o a - lapack_wrap.o a - calendar.o a - penta_lu_solver.o a - array_index.o a - hydromet_pdf_parameter_module.o a - new_pdf_main.o a - advance_wp2_wp3_module.o a - stats_variables.o a - sponge_layer_damping.o a - index_mapping.o a - fill_holes.o a - stats_rad_zt_module.o a - mono_flux_limiter.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_lapack make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slamch.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_shared/xerbla.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slamch.f: 113) 0 inform, 1 warnings, 0 severes, 0 fatal for slamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/daxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iparmq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dcopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/isamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iladlr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/drscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/idamax.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlansy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/snrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_shared/lsame.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/strsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ilaslc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sdot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slatbs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlacn2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorgqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ieeeck.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlae2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dorg2l.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgttrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsymv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slabad.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spotrf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaset.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgemm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlaqsy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/disnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slangt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgql.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/stbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlatrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorg2r.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgemv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsteqr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/saxpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrmm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlasrt.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarfg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlangb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrmv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlamch.f NVFORTRAN-W-0130-Floating point underflow. Check constants and constant expressions (/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlamch.f: 109) 0 inform, 1 warnings, 0 severes, 0 fatal for dlamch nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssytd2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/scopy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ilaslr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaev2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dnrm2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlapy2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sger.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgttrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaqgb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbtf2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlagtm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyr2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slarft.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sasum.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dpoequ.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ddot.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/spotrf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssterf.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbsv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dswap.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dtrsm.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sorgtr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsytrd.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtts2.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgtrfs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/ilaenv.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlacpy.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dsyrk.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/srscl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlanst.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyev.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slantb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaswp.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/iladlc.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgbsvx.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlarfb.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/ssyr2k.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlartg.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dgbtrs.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slasr.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slaisnan.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slassq.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sgtcon.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_double/dlascl.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/sscal.f nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Lapack/Lapack_single/slansy.f ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_lapack.a slasrt.o slarfg.o slangb.o strmv.o slamch.o xerbla.o dgtsv.o ssteqr.o sgbmv.o daxpy.o strmm.o dgbrfs.o iparmq.o dcopy.o dgbequ.o dlaev2.o isamax.o sgbtrf.o dsytd2.o sorg2l.o dgttrs.o iladlr.o ssymv.o dlatbs.o sgbcon.o slacn2.o sorgqr.o slae2.o dtbsv.o sgemv.o slatrd.o dorg2r.o dlabad.o slarf.o dlaset.o sgemm.o dpotrf2.o slaqsy.o sisnan.o sgtsvx.o dorgql.o dlangt.o dlaswp.o dlantb.o dgbsvx.o slacpy.o ssyrk.o drscl.o idamax.o slanst.o dsyev.o dgtcon.o slascl.o dscal.o dlansy.o slarfb.o dsyr2k.o sgbtrs.o slartg.o dlasr.o dlaisnan.o dlassq.o slagtm.o dgbtf2.o ssyr2.o dlarft.o snrm2.o slapy2.o dger.o dgttrf.o dlaqgb.o lsame.o sswap.o sgbsv.o strsm.o dorgtr.o ssytrd.o ilaslc.o sgtts2.o sgtrfs.o dasum.o spoequ.o sdot.o dsterf.o dpotrf.o slatbs.o dgbcon.o dlacn2.o dorgqr.o ieeeck.o dlae2.o dorg2l.o sgttrs.o dsymv.o slabad.o dlarf.o spotrf2.o slaset.o dgemm.o dlaqsy.o disnan.o dgtsvx.o slangt.o sorgql.o stbsv.o dlatrd.o sorg2r.o dgemv.o sgtsv.o dsteqr.o dgbmv.o saxpy.o dtrmm.o sgbrfs.o dlasrt.o dlarfg.o dlangb.o dtrmv.o dlamch.o ssytd2.o scopy.o sgbequ.o ilaslr.o slaev2.o dgbtrf.o dnrm2.o dlapy2.o sger.o sgttrf.o slaqgb.o sgbtf2.o dlagtm.o dsyr2.o slarft.o sasum.o dpoequ.o ddot.o spotrf.o ssterf.o dgbsv.o dswap.o dtrsm.o sorgtr.o dsytrd.o dgtts2.o dgtrfs.o ilaenv.o dlacpy.o dsyrk.o srscl.o dlanst.o ssyev.o slantb.o slaswp.o iladlc.o sgbsvx.o dlarfb.o ssyr2k.o dlartg.o dgbtrs.o slasr.o slaisnan.o slassq.o sgtcon.o dlascl.o sscal.o slansy.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_lapack.a a - slasrt.o a - slarfg.o a - slangb.o a - strmv.o a - slamch.o a - xerbla.o a - dgtsv.o a - ssteqr.o a - sgbmv.o a - daxpy.o a - strmm.o a - dgbrfs.o a - iparmq.o a - dcopy.o a - dgbequ.o a - dlaev2.o a - isamax.o a - sgbtrf.o a - dsytd2.o a - sorg2l.o a - dgttrs.o a - iladlr.o a - ssymv.o a - dlatbs.o a - sgbcon.o a - slacn2.o a - sorgqr.o a - slae2.o a - dtbsv.o a - sgemv.o a - slatrd.o a - dorg2r.o a - dlabad.o a - slarf.o a - dlaset.o a - sgemm.o a - dpotrf2.o a - slaqsy.o a - sisnan.o a - sgtsvx.o a - dorgql.o a - dlangt.o a - dlaswp.o a - dlantb.o a - dgbsvx.o a - slacpy.o a - ssyrk.o a - drscl.o a - idamax.o a - slanst.o a - dsyev.o a - dgtcon.o a - slascl.o a - dscal.o a - dlansy.o a - slarfb.o a - dsyr2k.o a - sgbtrs.o a - slartg.o a - dlasr.o a - dlaisnan.o a - dlassq.o a - slagtm.o a - dgbtf2.o a - ssyr2.o a - dlarft.o a - snrm2.o a - slapy2.o a - dger.o a - dgttrf.o a - dlaqgb.o a - lsame.o a - sswap.o a - sgbsv.o a - strsm.o a - dorgtr.o a - ssytrd.o a - ilaslc.o a - sgtts2.o a - sgtrfs.o a - dasum.o a - spoequ.o a - sdot.o a - dsterf.o a - dpotrf.o a - slatbs.o a - dgbcon.o a - dlacn2.o a - dorgqr.o a - ieeeck.o a - dlae2.o a - dorg2l.o a - sgttrs.o a - dsymv.o a - slabad.o a - dlarf.o a - spotrf2.o a - slaset.o a - dgemm.o a - dlaqsy.o a - disnan.o a - dgtsvx.o a - slangt.o a - sorgql.o a - stbsv.o a - dlatrd.o a - sorg2r.o a - dgemv.o a - sgtsv.o a - dsteqr.o a - dgbmv.o a - saxpy.o a - dtrmm.o a - sgbrfs.o a - dlasrt.o a - dlarfg.o a - dlangb.o a - dtrmv.o a - dlamch.o a - ssytd2.o a - scopy.o a - sgbequ.o a - ilaslr.o a - slaev2.o a - dgbtrf.o a - dnrm2.o a - dlapy2.o a - sger.o a - sgttrf.o a - slaqgb.o a - sgbtf2.o a - dlagtm.o a - dsyr2.o a - slarft.o a - sasum.o a - dpoequ.o a - ddot.o a - spotrf.o a - ssterf.o a - dgbsv.o a - dswap.o a - dtrsm.o a - sorgtr.o a - dsytrd.o a - dgtts2.o a - dgtrfs.o a - ilaenv.o a - dlacpy.o a - dsyrk.o a - srscl.o a - dlanst.o a - ssyev.o a - slantb.o a - slaswp.o a - iladlc.o a - sgbsvx.o a - dlarfb.o a - ssyr2k.o a - dlartg.o a - dgbtrs.o a - slasr.o a - slaisnan.o a - slassq.o a - sgtcon.o a - dlascl.o a - sscal.o a - slansy.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_bugsrad cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.microphys_utils cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_parabolic cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_coamps make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/kinds.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Parabolic_constants.f90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Microphys_utils/microphys_stats_vars_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/variables_radiation_module.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esatv.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/adjmlt.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/cloudg.F nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/AiryFunction.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/qsatvi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/adjtq.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/gamma.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugsrad_physconst.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/newexp.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/comscp1.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa28.F ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libmicrophys_utils.a microphys_stats_vars_module.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libmicrophys_utils.a a - microphys_stats_vars_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_morrison make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Morrison_microphys/module_mp_graupel.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Parabolic.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esati.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_bs.F NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 300) 0 inform, 1 warnings, 0 severes, 0 fatal for module_mp_graupel nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmtqi.F NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5894) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5905) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5928) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5976) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 5980) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6066) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6073) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6079) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6204) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6210) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6248) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6253) NVFORTRAN-W-0173-PGI Fortran extension: nonstandard use of data type length specifier (../src/Morrison_microphys/module_mp_graupel.F90: 6257) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/qtadj.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/comscp2.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa7.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/cloud_correlate.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa18g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa27r.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugsrad_planck.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/gascon.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_sel.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa7g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw_ocastrndm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/rayle.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa21.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa25.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_rad.F ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_parabolic.a Parabolic_constants.o Parabolic.o AiryFunction.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_parabolic.a a - Parabolic_constants.o a - Parabolic.o a - AiryFunction.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_KK_microphys make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa11g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_sw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqs.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/BUGSrad ../src/BUGSrad/gases_ckd.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/parameters_KK.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/esat_new.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_covar.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa22g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqi.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa10g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/conice.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa26.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/text_writer.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa12.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_all_MM.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa19.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_local_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/two_rt_lw_iter.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa20g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa17g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa19g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/PDF_integrals_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa12g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa14g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_means.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa27.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa22.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa6.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa15.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa9.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa13g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_turbulent_sed.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa21g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa9g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_swr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmcol.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa5g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/nrmtqw.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa18.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/frzh.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/eqa8g.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqr.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/slope.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_covariances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/COAMPS_microphys/tgqg.F nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_upscaled_variances.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys/KK_Nrm_tendencies.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a esatv.o adjmlt.o qsatvi.o adjtq.o gamma.o eqa28.o esati.o nrmtqi.o qtadj.o eqa7.o eqa18g.o eqa27r.o eqa7g.o eqa21.o eqa25.o eqa11g.o tgqs.o esat_new.o eqa22g.o tgqi.o eqa10g.o conice.o eqa26.o eqa12.o eqa19.o eqa20g.o eqa17g.o eqa19g.o eqa12g.o eqa14g.o eqa27.o eqa22.o eqa6.o eqa15.o eqa9.o eqa13g.o eqa21g.o eqa9g.o nrmcol.o eqa5g.o nrmtqw.o eqa18.o frzh.o eqa8g.o tgqr.o slope.o tgqg.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a a - esatv.o a - adjmlt.o a - qsatvi.o a - adjtq.o a - gamma.o a - eqa28.o a - esati.o a - nrmtqi.o a - qtadj.o a - eqa7.o a - eqa18g.o a - eqa27r.o a - eqa7g.o a - eqa21.o a - eqa25.o a - eqa11g.o a - tgqs.o a - esat_new.o a - eqa22g.o a - tgqi.o a - eqa10g.o a - conice.o a - eqa26.o a - eqa12.o a - eqa19.o a - eqa20g.o a - eqa17g.o a - eqa19g.o a - eqa12g.o a - eqa14g.o a - eqa27.o a - eqa22.o a - eqa6.o a - eqa15.o a - eqa9.o a - eqa13g.o a - eqa21g.o a - eqa9g.o a - nrmcol.o a - eqa5g.o a - nrmtqw.o a - eqa18.o a - frzh.o a - eqa8g.o a - tgqr.o a - slope.o a - tgqg.o nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/BUGSrad/bugs_lwr.F make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_bugsrad.a cloudg.o bugs_swr.o two_rt_lw_iter.o comscp1.o two_rt_lw_ocastrndm.o two_rt_sw_bs.o newexp.o comscp2.o bugsrad_physconst.o cloud_correlate.o variables_radiation_module.o two_rt_lw.o bugs_lwr.o gascon.o two_rt_lw_sel.o two_rt_sw_iter.o bugsrad_planck.o two_rt_sw_ocastrndm.o rayle.o gases_ckd.o bugs_rad.o two_rt_sw.o kinds.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_bugsrad.a a - cloudg.o a - bugs_swr.o a - two_rt_lw_iter.o a - comscp1.o a - two_rt_lw_ocastrndm.o a - two_rt_sw_bs.o a - newexp.o a - comscp2.o a - bugsrad_physconst.o a - cloud_correlate.o a - variables_radiation_module.o a - two_rt_lw.o a - bugs_lwr.o a - gascon.o a - two_rt_lw_sel.o a - two_rt_sw_iter.o a - bugsrad_planck.o a - two_rt_sw_ocastrndm.o a - rayle.o a - gases_ckd.o a - bugs_rad.o a - two_rt_sw.o a - kinds.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_KK_microphys.a PDF_integrals_means.o KK_upscaled_turbulent_sed.o PDF_integrals_covar.o KK_upscaled_covariances.o KK_upscaled_means.o text_writer.o parameters_KK.o KK_utilities.o PDF_integrals_all_MM.o KK_local_means.o KK_upscaled_variances.o KK_Nrm_tendencies.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_KK_microphys.a a - PDF_integrals_means.o a - KK_upscaled_turbulent_sed.o a - PDF_integrals_covar.o a - KK_upscaled_covariances.o a - KK_upscaled_means.o a - text_writer.o a - parameters_KK.o a - KK_utilities.o a - PDF_integrals_all_MM.o a - KK_local_means.o a - KK_upscaled_variances.o a - KK_Nrm_tendencies.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.silhs make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/parameters_silhs.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_arrays.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/est_kessler_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/output_2D_samples_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/transform_to_pdf_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/math_utilities.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/generate_uniform_sample_module.F90 transform_uniform_samples_to_pdf: 111, Generating create(std_normal(:,:,:,:)) [if not already present] 125, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 126, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 127, ! blockidx%x threadidx%x collapsed 128, ! blockidx%x threadidx%x collapsed 129, ! blockidx%x threadidx%x collapsed 125, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),hm_metadata) 137, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 138, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 139, ! blockidx%x threadidx%x collapsed 140, ! blockidx%x threadidx%x collapsed 141, ! blockidx%x threadidx%x collapsed 137, Generating default present(hm_metadata,l_in_precip_all_levs(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_ncn+1:pdf_dim)) 162, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 163, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 164, ! blockidx%x threadidx%x collapsed 165, ! blockidx%x threadidx%x collapsed 162, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_chi),hm_metadata,cloud_frac(:ngrdcol,:num_samples,:nzt)) cdfnorminv: 256, Generating implicit firstprivate(pdf_dim,nzt,num_samples,ngrdcol) Generating NVIDIA GPU code 257, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 258, ! blockidx%x threadidx%x collapsed 259, ! blockidx%x threadidx%x collapsed 260, ! blockidx%x threadidx%x collapsed 256, Generating implicit copy(std_normal(:pdf_dim,:ngrdcol,:nzt,:num_samples)) [if not already present] Generating implicit copyin(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim)) [if not already present] 260, Generating implicit firstprivate(x,w) multiply_cholesky: 546, Generating copyin(mu2(:,:,:),sigma_cholesky1(:,:,:,:),sigma_cholesky2(:,:,:,:),mu1(:,:,:)) [if not already present] 548, Generating implicit firstprivate(num_samples,ngrdcol,pdf_dim,nzt) Generating NVIDIA GPU code 549, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 550, ! blockidx%x threadidx%x collapsed 551, ! blockidx%x threadidx%x collapsed 552, ! blockidx%x threadidx%x collapsed 562, !$acc loop seq 548, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),std_normal(:,:ngrdcol,:nzt,:num_samples)) 552, Generating implicit firstprivate(j,x_nl_k_sample_i_tmp,l_first_comp) 562, Loop carried scalar dependence for x_nl_k_sample_i_tmp at line 565,568 Scalar last value needed after loop for x_nl_k_sample_i_tmp at line 573 chi_eta_2_rtthl: 651, Generating copyin(mu_chi_2(:,:),rt_1(:,:),rt_2(:,:),thl_2(:,:),thl_1(:,:),chi(:,:,:),crt_1(:,:),crt_2(:,:),cthl_1(:,:),eta(:,:,:),mu_chi_1(:,:),cthl_2(:,:)) [if not already present] 655, Generating implicit firstprivate(nzt,num_samples,ngrdcol) Generating NVIDIA GPU code 656, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 657, ! blockidx%x threadidx%x collapsed 658, ! blockidx%x threadidx%x collapsed 655, Generating default present(lh_rt(:ngrdcol,:num_samples,:nzt),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),lh_thl(:ngrdcol,:num_samples,:nzt)) 658, Generating implicit firstprivate(lh_dev_thl_lim) nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_importance_sample_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/lh_microphys_var_covar_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a module_mp_graupel.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a a - module_mp_graupel.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_driver_module.F90 generate_silhs_sample: 295, Generating copyin(k_lh_start(:)) [if not already present] Generating create(rand_pool(:,:,:,:),x_u_all_levs(:,:,:,:)) [if not already present] Generating copyin(x_vert_corr(:,:)) [if not already present] 323, Generating create(cloud_frac(:,:,:),l_in_precip(:,:,:)) [if not already present] Generating copyin(pdf_params%mixt_frac(:,:),pdf_params%cloud_frac_2(:,:),pdf_params,pdf_params%cloud_frac_1(:,:),precip_fracs,precip_fracs%precip_frac_2(:,:),precip_fracs%precip_frac_1(:,:)) [if not already present] 329, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 330, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 331, ! blockidx%x threadidx%x collapsed 332, ! blockidx%x threadidx%x collapsed 329, Generating default present(x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt)) 332, Generating implicit firstprivate(pdf_dim) 388, Generating update self(lh_sample_point_weights(:,:,:),l_in_precip(:,:,:),x_u_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:)) 425, Generating update self(x_mixt_comp_all_levs(:,:,:),x_u_all_levs(:,:,:,:),x_nl_all_levs(:,:,:,:)) generate_all_uniform_samples: 718, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 719, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 720, ! blockidx%x threadidx%x collapsed 721, ! blockidx%x threadidx%x collapsed 722, ! blockidx%x threadidx%x collapsed 718, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim)) 731, Generating implicit firstprivate(ngrdcol,num_samples,nzt) Generating NVIDIA GPU code 732, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 733, ! blockidx%x threadidx%x collapsed 734, ! blockidx%x threadidx%x collapsed 731, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt)) 814, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt) Generating NVIDIA GPU code 815, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x 816, ! blockidx%x threadidx%x collapsed 817, ! blockidx%x threadidx%x collapsed 818, ! blockidx%x threadidx%x collapsed 814, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim)) 827, Generating implicit firstprivate(ngrdcol,nzt,num_samples) Generating NVIDIA GPU code 828, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 829, ! blockidx%x threadidx%x collapsed 830, ! blockidx%x threadidx%x collapsed 827, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt)) clip_transform_silhs_output: 1122, Generating implicit firstprivate(ngrdcol,num_samples,nzt) Generating NVIDIA GPU code 1123, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1124, ! blockidx%x threadidx%x collapsed 1125, ! blockidx%x threadidx%x collapsed 1122, Generating default present(lh_rc_clipped(:ngrdcol,:num_samples,:nzt),lh_nc_clipped(:ngrdcol,:num_samples,:nzt),lh_rt_clipped(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),lh_rv_clipped(:ngrdcol,:num_samples,:nzt),hm_metadata) 1125, Generating implicit firstprivate(l_use_ncn_to_nc) compute_arb_overlap: 1900, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples) Generating NVIDIA GPU code 1901, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1902, ! blockidx%x threadidx%x collapsed 1903, ! blockidx%x threadidx%x collapsed 1908, !$acc loop seq 1900, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim)) 1903, Generating implicit firstprivate(k,unbounded_point,nzt,k_lh_start_i) 1908, Loop carried scalar dependence for unbounded_point at line 1911 Generating implicit firstprivate(half_width,offset,min_val) Loop carried scalar dependence for unbounded_point at line 1911 1934, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples) Generating NVIDIA GPU code 1935, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x 1936, ! blockidx%x threadidx%x collapsed 1937, ! blockidx%x threadidx%x collapsed 1942, !$acc loop seq 1934, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim)) 1937, Generating implicit firstprivate(k,unbounded_point,k_lh_start_i) 1942, Loop carried scalar dependence for unbounded_point at line 1945 Generating implicit firstprivate(half_width,offset,min_val) Loop carried scalar dependence for unbounded_point at line 1945 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_api_module.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a silhs_importance_sample_module.o parameters_silhs.o est_kessler_microphys_module.o output_2D_samples_module.o latin_hypercube_driver_module.o math_utilities.o lh_microphys_var_covar_module.o latin_hypercube_arrays.o silhs_api_module.o generate_uniform_sample_module.o transform_to_pdf_module.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a a - silhs_importance_sample_module.o a - parameters_silhs.o a - est_kessler_microphys_module.o a - output_2D_samples_module.o a - latin_hypercube_driver_module.o a - math_utilities.o a - lh_microphys_var_covar_module.o a - latin_hypercube_arrays.o a - silhs_api_module.o a - generate_uniform_sample_module.o a - transform_to_pdf_module.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_other make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_model_settings.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/time_dependent_input.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/diag_ustar_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/cos_solar_zen_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/soil_vegetation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/input_grads.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extrapolation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_microphys.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_sed_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/silhs_category_variance_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/ice_dfsn_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/gfdl_activation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/hydrostatic_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_radiation.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rad_lwsw_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/mixed_moment_PDF_integrals.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/spec_hum_to_mixing_ratio.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_nov02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_oct14.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/jun25.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/nov11.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/wangara.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/quicksort.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_netcdf.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/sfc_flux.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/advance_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/morrison_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/coamps_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_init_cleanup.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_interpret.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/simple_rad_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_a.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_0003.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_3year.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/astex_a209.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/atex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_97.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/bomex.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_feedback.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cobra.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf02.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/fire.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls2.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/lba.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_b.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rico.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/twp_ice.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf01.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/neutral_case.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3_night.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/stat_file_utils.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extended_atmosphere_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_fields.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/bugsrad_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/sounding.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/estimate_scm_microphys_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/lh_microphys_driver_module.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_driver.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_driver.F90 NVFORTRAN-W-0435-Array declared with zero size (../src/clubb_driver.F90: 419) run_clubb: 2681, Generating copyout(lh_thl_clipped(:,:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:),lh_rv_clipped(:,:,:),lh_rc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_nc_clipped(:,:,:),lh_rt_clipped(:,:,:)) [if not already present] Generating copyin(hm_metadata) [if not already present] nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/error.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/enhanced_simann.F90 ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a input_netcdf.o dycoms2_rf01.o neutral_case.o cos_solar_zen_module.o gabls3_night.o arm.o soil_vegetation.o error.o input_grads.o twp_ice.o astex_a209.o bugsrad_driver.o hydrostatic_module.o morrison_microphys_module.o extrapolation.o parameters_microphys.o input_interpret.o clex9_oct14.o enhanced_simann.o diag_ustar_module.o advance_microphys_module.o atex.o mpace_b.o time_dependent_input.o gabls2.o ice_dfsn_module.o simple_rad_module.o microphys_init_cleanup.o input_fields.o parameters_radiation.o mpace_a.o bomex.o nov11.o estimate_scm_microphys_module.o cloud_sed_module.o gfdl_activation.o quicksort.o fire.o dycoms2_rf02.o clubb_driver.o rico.o lba.o clex9_nov02.o stat_file_utils.o microphys_driver.o sounding.o extended_atmosphere_module.o spec_hum_to_mixing_ratio.o KK_microphys_module.o rad_lwsw_module.o mixed_moment_PDF_integrals.o cloud_feedback.o arm_3year.o wangara.o arm_97.o gabls3.o silhs_category_variance_module.o jun25.o arm_0003.o clubb_model_settings.o coamps_microphys_driver_module.o lh_microphys_driver_module.o sfc_flux.o cobra.o ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a a - input_netcdf.o a - dycoms2_rf01.o a - neutral_case.o a - cos_solar_zen_module.o a - gabls3_night.o a - arm.o a - soil_vegetation.o a - error.o a - input_grads.o a - twp_ice.o a - astex_a209.o a - bugsrad_driver.o a - hydrostatic_module.o a - morrison_microphys_module.o a - extrapolation.o a - parameters_microphys.o a - input_interpret.o a - clex9_oct14.o a - enhanced_simann.o a - diag_ustar_module.o a - advance_microphys_module.o a - atex.o a - mpace_b.o a - time_dependent_input.o a - gabls2.o a - ice_dfsn_module.o a - simple_rad_module.o a - microphys_init_cleanup.o a - input_fields.o a - parameters_radiation.o a - mpace_a.o a - bomex.o a - nov11.o a - estimate_scm_microphys_module.o a - cloud_sed_module.o a - gfdl_activation.o a - quicksort.o a - fire.o a - dycoms2_rf02.o a - clubb_driver.o a - rico.o a - lba.o a - clex9_nov02.o a - stat_file_utils.o a - microphys_driver.o a - sounding.o a - extended_atmosphere_module.o a - spec_hum_to_mixing_ratio.o a - KK_microphys_module.o a - rad_lwsw_module.o a - mixed_moment_PDF_integrals.o a - cloud_feedback.o a - arm_3year.o a - wangara.o a - arm_97.o a - gabls3.o a - silhs_category_variance_module.o a - jun25.o a - arm_0003.o a - clubb_model_settings.o a - coamps_microphys_driver_module.o a - lh_microphys_driver_module.o a - sfc_flux.o a - cobra.o make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_standalone cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_tuner cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.jacobian cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.G_unit_tests cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.int2txt cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_thread_test make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_standalone.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_min_max_tests.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/int2txt.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_thread_test.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/jacobian.F90 make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrtype.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nr.f90 nvfortran int2txt.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/int2txt -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrutil.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/spurious_source_test.F90 nvfortran clubb_standalone.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_standalone -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran clubb_thread_test.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_thread_test -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 218) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 222) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 275) NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 278) nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran jacobian.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/jacobian -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/Nc_Ncn_test.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/KK_integrals_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/corr_cholesky_mtx_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/hole_filling_tests.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_tuner.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/read_corr_mtx_test.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/silhs_category_test.F90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/mu_sigma_hm_tests.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran_state.f90 make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amebsa.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/tuner_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/w_up_in_cloud_tests.F90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_heaviside_tests.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amoeba.f90 nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/pdf_parameter_tests.F90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_v.f90 nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_s.f90 NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/pdf_parameter_tests.F90: 416) nvfortran nr.o nrutil.o clubb_tuner.o ran1_v.o amebsa.o nrtype.o ran_state.o ran1_s.o amoeba.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_tuner -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_tests.F90 nvfortran smooth_min_max_tests.o spurious_source_test.o Nc_Ncn_test.o G_unit_tests.o smooth_heaviside_tests.o tuner_tests.o w_up_in_cloud_tests.o read_corr_mtx_test.o hole_filling_tests.o corr_cholesky_mtx_tests.o KK_integrals_tests.o pdf_parameter_tests.o mu_sigma_hm_tests.o silhs_category_test.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/G_unit_tests -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-mgzln5dterhzvueatfeyc3v4ujcl4nds/lib -lnetcdff -acc -Mcuda nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead. make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj' python ../utilities/check_for_missing_threadprivate.py ../src/CLUBB_core/ ../src/SILHS/ check_for_missing_threadprivate.py has begun. [91mcheck_for_missing_threadprivate.py did not pass.[0m [91mfailedFiles = ['../src/CLUBB_core/parameters_model.F90', '../src/CLUBB_core/error_code.F90', '../src/CLUBB_core/sponge_layer_damping.F90', '../src/CLUBB_core/corr_varnce_module.F90'][0m perl ../utilities/CLUBBStandardsCheck.pl ../src/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Expected read_random_seed for end function. CLUBBStandardsCheck.pl WARNING: Endings of either program, module, subroutine, or function blocks to not match the beginning ../src/error.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/CLUBB_core/*.F90 CLUBBStandardsCheck.pl has begun. -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl WARNING: Missing 'implicit none' statements. 'Implicit None' check FAILED! CLUBBStandardsCheck.pl Add a line containing 'implicit none' to each program, module, subroutine, and function. ../src/CLUBB_core/mt95.F90 -------------------------------------------------------------------------------- CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/Benchmark_cases/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/KK_microphys/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/SILHS/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. perl ../utilities/CLUBBStandardsCheck.pl ../src/G_unit_test_types/*.F90 CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run GPU_ACC) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + module load nvhpc netcdf-fortran + '[' -z '' ']' + case "$-" in + __lmod_sh_dbg=x + '[' -n x ']' + set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output Shell debugging restarted + unset __lmod_sh_dbg + return 0 + run_scripts/run_scm_all.bash -i Performing priority-cases run Running arm Running arm_97 Running atex Running bomex Running cgils_s6 Running cgils_s11 Running cgils_s12 Running dycoms2_rf01 Running dycoms2_rf01_fixed_sst Running dycoms2_rf02_ds Running dycoms2_rf02_nd Running gabls3_night Running lba Running mpace_b Running rico Running twp_ice Running wangara All cases ran to completion. + mv output gpu_1632cf1 + mkdir output [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Plot) [Pipeline] sh + scp -r carson:/home/pub/clubb_nvhpc_gpu_plots/master/cur_out . [Pipeline] sh ++ cat cur_out/commit + python postprocessing/pyplotgen/pyplotgen.py -l -c cpu_1632cf1 gpu_1632cf1 cur_out/cpu_8bbf5db cur_out/gpu_8bbf5db -o 1632cf1_vs_master_8bbf5db ******************************************* Welcome to PyPlotGen. ******************************************* Checking for model benchmark output... Benchmark output found in /home/pub/les_and_clubb_benchmark_runs/. ------------------------------------------- Running... ---------- NOTE: If processing multiple cases (ARM, BOMEX, etc.) with multithreading, the total number of panels to be processed may increase as threads complete and begin processing new cases. ---------- Progress: 0 of ? total .png panels complete Progress: 11 of 166 total .png panels complete Progress: 14 of 166 total .png panels complete Progress: 17 of 166 total .png panels complete Progress: 19 of 166 total .png panels complete Progress: 23 of 224 total .png panels complete Progress: 27 of 224 total .png panels complete Progress: 30 of 224 total .png panels complete Progress: 34 of 282 total .png panels complete Progress: 38 of 282 total .png panels complete Progress: 42 of 282 total .png panels complete Progress: 46 of 282 total .png panels complete Progress: 52 of 282 total .png panels complete Progress: 56 of 282 total .png panels complete Progress: 61 of 359 total .png panels complete Progress: 66 of 359 total .png panels complete Progress: 70 of 359 total .png panels complete Progress: 76 of 359 total .png panels complete Progress: 82 of 359 total .png panels complete Progress: 88 of 359 total .png panels complete Progress: 94 of 359 total .png panels complete Progress: 100 of 359 total .png panels complete Progress: 108 of 359 total .png panels complete Progress: 118 of 359 total .png panels complete Progress: 125 of 435 total .png panels complete Progress: 134 of 435 total .png panels complete Progress: 142 of 435 total .png panels complete Progress: 149 of 435 total .png panels complete Progress: 159 of 435 total .png panels complete Progress: 171 of 435 total .png panels complete Progress: 176 of 435 total .png panels complete Progress: 182 of 435 total .png panels complete Progress: 189 of 435 total .png panels complete Progress: 193 of 435 total .png panels complete Progress: 198 of 435 total .png panels complete Progress: 203 of 435 total .png panels complete Progress: 209 of 435 total .png panels complete Progress: 215 of 435 total .png panels complete Progress: 220 of 435 total .png panels complete Progress: 225 of 435 total .png panels complete Progress: 232 of 435 total .png panels complete Progress: 235 of 435 total .png panels complete Progress: 240 of 435 total .png panels complete Progress: 245 of 435 total .png panels complete Progress: 251 of 435 total .png panels complete Progress: 257 of 492 total .png panels complete Progress: 263 of 492 total .png panels complete Progress: 271 of 492 total .png panels complete Progress: 277 of 492 total .png panels complete Progress: 287 of 492 total .png panels complete Progress: 293 of 492 total .png panels complete Progress: 299 of 492 total .png panels complete Progress: 309 of 492 total .png panels complete Progress: 316 of 492 total .png panels complete Progress: 323 of 492 total .png panels complete Progress: 418 of 619 total .png panels complete Progress: 422 of 619 total .png panels complete Progress: 427 of 619 total .png panels complete Progress: 429 of 619 total .png panels complete Progress: 433 of 619 total .png panels complete Progress: 437 of 619 total .png panels complete Progress: 442 of 619 total .png panels complete Progress: 447 of 619 total .png panels complete Progress: 452 of 619 total .png panels complete Progress: 457 of 619 total .png panels complete Progress: 462 of 619 total .png panels complete Progress: 465 of 619 total .png panels complete Progress: 470 of 619 total .png panels complete Progress: 474 of 619 total .png panels complete Progress: 479 of 619 total .png panels complete Progress: 483 of 619 total .png panels complete Progress: 488 of 619 total .png panels complete Progress: 492 of 619 total .png panels complete Progress: 502 of 672 total .png panels complete Progress: 507 of 672 total .png panels complete Progress: 513 of 672 total .png panels complete Progress: 518 of 672 total .png panels complete Progress: 523 of 672 total .png panels complete Progress: 527 of 711 total .png panels complete Progress: 537 of 711 total .png panels complete Progress: 544 of 711 total .png panels complete Progress: 550 of 711 total .png panels complete Progress: 554 of 711 total .png panels complete Progress: 558 of 711 total .png panels complete Progress: 564 of 711 total .png panels complete Progress: 569 of 711 total .png panels complete Progress: 574 of 711 total .png panels complete Progress: 579 of 711 total .png panels complete Progress: 583 of 711 total .png panels complete Progress: 588 of 711 total .png panels complete Progress: 592 of 711 total .png panels complete Progress: 596 of 711 total .png panels complete Progress: 600 of 711 total .png panels complete Progress: 602 of 711 total .png panels complete Progress: 606 of 771 total .png panels complete Progress: 610 of 771 total .png panels complete Progress: 616 of 771 total .png panels complete Progress: 622 of 771 total .png panels complete Progress: 627 of 771 total .png panels complete Progress: 632 of 771 total .png panels complete Progress: 637 of 840 total .png panels complete Progress: 642 of 840 total .png panels complete Progress: 648 of 840 total .png panels complete Progress: 654 of 840 total .png panels complete Progress: 659 of 840 total .png panels complete Progress: 664 of 840 total .png panels complete Progress: 670 of 840 total .png panels complete Progress: 676 of 840 total .png panels complete Progress: 683 of 840 total .png panels complete Progress: 789 of 898 total .png panels complete Progress: 792 of 898 total .png panels complete Progress: 795 of 898 total .png panels complete Progress: 799 of 898 total .png panels complete Progress: 802 of 898 total .png panels complete Progress: 805 of 898 total .png panels complete Progress: 808 of 898 total .png panels complete Progress: 811 of 898 total .png panels complete Progress: 813 of 898 total .png panels complete Progress: 816 of 898 total .png panels complete Progress: 821 of 898 total .png panels complete Progress: 824 of 898 total .png panels complete Progress: 827 of 898 total .png panels complete Progress: 829 of 898 total .png panels complete Progress: 831 of 898 total .png panels complete Progress: 833 of 898 total .png panels complete Progress: 835 of 898 total .png panels complete Progress: 837 of 898 total .png panels complete Progress: 839 of 898 total .png panels complete Progress: 841 of 898 total .png panels complete Progress: 842 of 898 total .png panels complete Progress: 845 of 898 total .png panels complete Progress: 847 of 898 total .png panels complete Progress: 848 of 898 total .png panels complete Progress: 850 of 898 total .png panels complete Progress: 852 of 898 total .png panels complete Progress: 854 of 898 total .png panels complete Progress: 857 of 898 total .png panels complete Progress: 859 of 898 total .png panels complete Progress: 861 of 898 total .png panels complete Progress: 863 of 898 total .png panels complete Progress: 865 of 898 total .png panels complete Progress: 867 of 898 total .png panels complete Progress: 869 of 898 total .png panels complete Progress: 872 of 975 total .png panels complete Progress: 874 of 975 total .png panels complete Progress: 876 of 975 total .png panels complete Progress: 879 of 975 total .png panels complete Progress: 882 of 975 total .png panels complete Progress: 884 of 975 total .png panels complete Progress: 886 of 975 total .png panels complete Progress: 888 of 975 total .png panels complete Progress: 890 of 975 total .png panels complete Progress: 892 of 975 total .png panels complete Progress: 894 of 975 total .png panels complete Progress: 896 of 975 total .png panels complete Progress: 898 of 975 total .png panels complete Progress: 900 of 975 total .png panels complete Progress: 902 of 975 total .png panels complete Progress: 905 of 975 total .png panels complete Progress: 907 of 975 total .png panels complete Progress: 909 of 975 total .png panels complete Progress: 911 of 975 total .png panels complete Progress: 913 of 975 total .png panels complete Progress: 915 of 975 total .png panels complete Progress: 48 of 282 total .png panels complete Progress: 53 of 282 total .png panels complete Progress: 58 of 359 total .png panels complete Progress: 63 of 359 total .png panels complete Progress: 68 of 359 total .png panels complete Progress: 74 of 359 total .png panels complete Progress: 78 of 359 total .png panels complete Progress: 84 of 359 total .png panels complete Progress: 90 of 359 total .png panels complete Progress: 96 of 359 total .png panels complete Progress: 102 of 359 total .png panels complete Progress: 106 of 359 total .png panels complete Progress: 112 of 359 total .png panels complete Progress: 116 of 359 total .png panels complete Progress: 121 of 359 total .png panels complete Progress: 128 of 435 total .png panels complete Progress: 133 of 435 total .png panels complete Progress: 140 of 435 total .png panels complete Progress: 143 of 435 total .png panels complete Progress: 150 of 435 total .png panels complete Progress: 156 of 435 total .png panels complete Progress: 162 of 435 total .png panels complete Progress: 167 of 435 total .png panels complete Progress: 173 of 435 total .png panels complete Progress: 180 of 435 total .png panels complete Progress: 185 of 435 total .png panels complete Progress: 195 of 435 total .png panels complete Progress: 204 of 435 total .png panels complete Progress: 210 of 435 total .png panels complete Progress: 216 of 435 total .png panels complete Progress: 221 of 435 total .png panels complete Progress: 226 of 435 total .png panels complete Progress: 231 of 435 total .png panels complete Progress: 236 of 435 total .png panels complete Progress: 243 of 435 total .png panels complete Progress: 246 of 435 total .png panels complete Progress: 253 of 435 total .png panels complete Progress: 258 of 492 total .png panels complete Progress: 264 of 492 total .png panels complete Progress: 268 of 492 total .png panels complete Progress: 279 of 492 total .png panels complete Progress: 285 of 492 total .png panels complete Progress: 291 of 492 total .png panels complete Progress: 297 of 492 total .png panels complete Progress: 304 of 492 total .png panels complete Progress: 310 of 492 total .png panels complete Progress: 317 of 492 total .png panels complete Progress: 322 of 492 total .png panels complete Progress: 328 of 492 total .png panels complete Progress: 334 of 492 total .png panels complete Progress: 342 of 492 total .png panels complete Progress: 348 of 492 total .png panels complete Progress: 354 of 492 total .png panels complete Progress: 359 of 492 total .png panels complete Progress: 366 of 492 total .png panels complete Progress: 372 of 492 total .png panels complete Progress: 376 of 492 total .png panels complete Progress: 382 of 492 total .png panels complete Progress: 530 of 711 total .png panels complete Progress: 535 of 711 total .png panels complete Progress: 542 of 711 total .png panels complete Progress: 551 of 711 total .png panels complete Progress: 555 of 711 total .png panels complete Progress: 560 of 711 total .png panels complete Progress: 563 of 711 total .png panels complete Progress: 566 of 711 total .png panels complete Progress: 571 of 711 total .png panels complete Progress: 576 of 711 total .png panels complete Progress: 581 of 711 total .png panels complete Progress: 587 of 711 total .png panels complete Progress: 591 of 711 total .png panels complete Progress: 594 of 711 total .png panels complete Progress: 598 of 711 total .png panels complete Progress: 604 of 771 total .png panels complete Progress: 608 of 771 total .png panels complete Progress: 612 of 771 total .png panels complete Progress: 617 of 771 total .png panels complete Progress: 619 of 771 total .png panels complete Progress: 624 of 771 total .png panels complete Progress: 628 of 771 total .png panels complete Progress: 634 of 771 total .png panels complete Progress: 640 of 840 total .png panels complete Progress: 647 of 840 total .png panels complete Progress: 653 of 840 total .png panels complete Progress: 660 of 840 total .png panels complete Progress: 667 of 840 total .png panels complete Progress: 673 of 840 total .png panels complete Progress: 678 of 840 total .png panels complete Progress: 682 of 840 total .png panels complete Progress: 689 of 840 total .png panels complete Progress: 692 of 840 total .png panels complete Progress: 697 of 840 total .png panels complete Progress: 700 of 840 total .png panels complete Progress: 705 of 840 total .png panels complete Progress: 710 of 840 total .png panels complete Progress: 715 of 840 total .png panels complete Progress: 721 of 840 total .png panels complete Progress: 31 of 224 total .png panels complete Progress: 36 of 282 total .png panels complete Progress: 40 of 282 total .png panels complete Progress: 45 of 282 total .png panels complete Progress: 49 of 282 total .png panels complete Progress: 57 of 282 total .png panels complete Progress: 62 of 359 total .png panels complete Progress: 67 of 359 total .png panels complete Progress: 71 of 359 total .png panels complete Progress: 77 of 359 total .png panels complete Progress: 81 of 359 total .png panels complete Progress: 87 of 359 total .png panels complete Progress: 93 of 359 total .png panels complete Progress: 99 of 359 total .png panels complete Progress: 104 of 359 total .png panels complete Progress: 110 of 359 total .png panels complete Progress: 119 of 359 total .png panels complete Progress: 124 of 435 total .png panels complete Progress: 130 of 435 total .png panels complete Progress: 135 of 435 total .png panels complete Progress: 141 of 435 total .png panels complete Progress: 147 of 435 total .png panels complete Progress: 154 of 435 total .png panels complete Progress: 158 of 435 total .png panels complete Progress: 165 of 435 total .png panels complete Progress: 175 of 435 total .png panels complete Progress: 186 of 435 total .png panels complete Progress: 201 of 435 total .png panels complete Progress: 205 of 435 total .png panels complete Progress: 211 of 435 total .png panels complete Progress: 217 of 435 total .png panels complete Progress: 222 of 435 total .png panels complete Progress: 228 of 435 total .png panels complete Progress: 234 of 435 total .png panels complete Progress: 241 of 435 total .png panels complete Progress: 248 of 435 total .png panels complete Progress: 255 of 492 total .png panels complete Progress: 260 of 492 total .png panels complete Progress: 265 of 492 total .png panels complete Progress: 273 of 492 total .png panels complete Progress: 278 of 492 total .png panels complete Progress: 284 of 492 total .png panels complete Progress: 290 of 492 total .png panels complete Progress: 298 of 492 total .png panels complete Progress: 305 of 492 total .png panels complete Progress: 313 of 492 total .png panels complete Progress: 321 of 492 total .png panels complete Progress: 327 of 492 total .png panels complete Progress: 332 of 492 total .png panels complete Progress: 341 of 492 total .png panels complete Progress: 347 of 492 total .png panels complete Progress: 353 of 492 total .png panels complete Progress: 358 of 492 total .png panels complete Progress: 364 of 492 total .png panels complete Progress: 370 of 492 total .png panels complete Progress: 378 of 492 total .png panels complete Progress: 384 of 492 total .png panels complete Progress: 389 of 492 total .png panels complete Progress: 497 of 672 total .png panels complete Progress: 503 of 672 total .png panels complete Progress: 511 of 672 total .png panels complete Progress: 516 of 672 total .png panels complete Progress: 520 of 672 total .png panels complete Progress: 526 of 711 total .png panels complete Progress: 531 of 711 total .png panels complete Progress: 536 of 711 total .png panels complete Progress: 541 of 711 total .png panels complete Progress: 546 of 711 total .png panels complete Progress: 552 of 711 total .png panels complete Progress: 556 of 711 total .png panels complete Progress: 561 of 711 total .png panels complete Progress: 565 of 711 total .png panels complete Progress: 570 of 711 total .png panels complete Progress: 575 of 711 total .png panels complete Progress: 580 of 711 total .png panels complete Progress: 585 of 711 total .png panels complete Progress: 590 of 711 total .png panels complete Progress: 593 of 711 total .png panels complete Progress: 597 of 711 total .png panels complete Progress: 601 of 711 total .png panels complete Progress: 605 of 771 total .png panels complete Progress: 613 of 771 total .png panels complete Progress: 623 of 771 total .png panels complete Progress: 626 of 771 total .png panels complete Progress: 631 of 771 total .png panels complete Progress: 638 of 840 total .png panels complete Progress: 643 of 840 total .png panels complete Progress: 650 of 840 total .png panels complete Progress: 658 of 840 total .png panels complete Progress: 665 of 840 total .png panels complete Progress: 671 of 840 total .png panels complete Progress: 677 of 840 total .png panels complete Progress: 684 of 840 total .png panels complete Progress: 691 of 840 total .png panels complete Progress: 695 of 840 total .png panels complete Progress: 702 of 840 total .png panels complete Progress: 707 of 840 total .png panels complete Progress: 714 of 840 total .png panels complete Progress: 719 of 840 total .png panels complete Progress: 725 of 840 total .png panels complete Progress: 728 of 840 total .png panels complete Progress: 732 of 840 total .png panels complete Progress: 735 of 840 total .png panels complete Progress: 740 of 840 total .png panels complete Progress: 744 of 840 total .png panels complete Progress: 748 of 840 total .png panels complete Progress: 754 of 840 total .png panels complete Progress: 757 of 840 total .png panels complete Progress: 760 of 840 total .png panels complete Progress: 764 of 840 total .png panels complete Progress: 768 of 840 total .png panels complete Progress: 13 of 166 total .png panels complete Progress: 16 of 166 total .png panels complete Progress: 20 of 166 total .png panels complete Progress: 24 of 224 total .png panels complete Progress: 26 of 224 total .png panels complete Progress: 29 of 224 total .png panels complete Progress: 33 of 224 total .png panels complete Progress: 37 of 282 total .png panels complete Progress: 41 of 282 total .png panels complete Progress: 44 of 282 total .png panels complete Progress: 50 of 282 total .png panels complete Progress: 54 of 282 total .png panels complete Progress: 59 of 359 total .png panels complete Progress: 64 of 359 total .png panels complete Progress: 69 of 359 total .png panels complete Progress: 72 of 359 total .png panels complete Progress: 79 of 359 total .png panels complete Progress: 83 of 359 total .png panels complete Progress: 89 of 359 total .png panels complete Progress: 95 of 359 total .png panels complete Progress: 101 of 359 total .png panels complete Progress: 107 of 359 total .png panels complete Progress: 113 of 359 total .png panels complete Progress: 117 of 359 total .png panels complete Progress: 123 of 435 total .png panels complete Progress: 129 of 435 total .png panels complete Progress: 137 of 435 total .png panels complete Progress: 148 of 435 total .png panels complete Progress: 155 of 435 total .png panels complete Progress: 161 of 435 total .png panels complete Progress: 170 of 435 total .png panels complete Progress: 174 of 435 total .png panels complete Progress: 181 of 435 total .png panels complete Progress: 187 of 435 total .png panels complete Progress: 192 of 435 total .png panels complete Progress: 197 of 435 total .png panels complete Progress: 202 of 435 total .png panels complete Progress: 208 of 435 total .png panels complete Progress: 214 of 435 total .png panels complete Progress: 219 of 435 total .png panels complete Progress: 227 of 435 total .png panels complete Progress: 233 of 435 total .png panels complete Progress: 238 of 435 total .png panels complete Progress: 244 of 435 total .png panels complete Progress: 247 of 435 total .png panels complete Progress: 254 of 492 total .png panels complete Progress: 262 of 492 total .png panels complete Progress: 269 of 492 total .png panels complete Progress: 275 of 492 total .png panels complete Progress: 282 of 492 total .png panels complete Progress: 294 of 492 total .png panels complete Progress: 300 of 492 total .png panels complete Progress: 306 of 492 total .png panels complete Progress: 312 of 492 total .png panels complete Progress: 318 of 492 total .png panels complete Progress: 325 of 492 total .png panels complete Progress: 330 of 492 total .png panels complete Progress: 336 of 492 total .png panels complete Progress: 340 of 492 total .png panels complete Progress: 346 of 492 total .png panels complete Progress: 352 of 492 total .png panels complete Progress: 360 of 492 total .png panels complete Progress: 365 of 492 total .png panels complete Progress: 371 of 492 total .png panels complete Progress: 375 of 492 total .png panels complete Progress: 381 of 492 total .png panels complete Progress: 386 of 492 total .png panels complete Progress: 392 of 492 total .png panels complete Progress: 607 of 771 total .png panels complete Progress: 611 of 771 total .png panels complete Progress: 615 of 771 total .png panels complete Progress: 620 of 771 total .png panels complete Progress: 625 of 771 total .png panels complete Progress: 629 of 771 total .png panels complete Progress: 633 of 771 total .png panels complete Progress: 636 of 771 total .png panels complete Progress: 641 of 840 total .png panels complete Progress: 646 of 840 total .png panels complete Progress: 652 of 840 total .png panels complete Progress: 657 of 840 total .png panels complete Progress: 661 of 840 total .png panels complete Progress: 666 of 840 total .png panels complete Progress: 672 of 840 total .png panels complete Progress: 681 of 840 total .png panels complete Progress: 686 of 840 total .png panels complete Progress: 688 of 840 total .png panels complete Progress: 694 of 840 total .png panels complete Progress: 698 of 840 total .png panels complete Progress: 701 of 840 total .png panels complete Progress: 706 of 840 total .png panels complete Progress: 711 of 840 total .png panels complete Progress: 716 of 840 total .png panels complete Progress: 720 of 840 total .png panels complete Progress: 724 of 840 total .png panels complete Progress: 731 of 840 total .png panels complete Progress: 736 of 840 total .png panels complete Progress: 739 of 840 total .png panels complete Progress: 743 of 840 total .png panels complete Progress: 746 of 840 total .png panels complete Progress: 749 of 840 total .png panels complete Progress: 752 of 840 total .png panels complete Progress: 756 of 840 total .png panels complete Progress: 759 of 840 total .png panels complete Progress: 762 of 840 total .png panels complete Progress: 765 of 840 total .png panels complete Progress: 769 of 840 total .png panels complete Progress: 772 of 840 total .png panels complete Progress: 776 of 840 total .png panels complete Progress: 778 of 840 total .png panels complete Progress: 781 of 840 total .png panels complete Progress: 784 of 840 total .png panels complete Progress: 786 of 840 total .png panels complete Progress: 788 of 898 total .png panels complete Progress: 790 of 898 total .png panels complete Progress: 793 of 898 total .png panels complete Progress: 796 of 898 total .png panels complete Progress: 798 of 898 total .png panels complete Progress: 801 of 898 total .png panels complete Progress: 803 of 898 total .png panels complete Progress: 807 of 898 total .png panels complete Progress: 809 of 898 total .png panels complete Progress: 812 of 898 total .png panels complete Progress: 815 of 898 total .png panels complete Progress: 818 of 898 total .png panels complete Progress: 819 of 898 total .png panels complete Progress: 822 of 898 total .png panels complete Progress: 825 of 898 total .png panels complete Progress: 828 of 898 total .png panels complete Progress: 139 of 435 total .png panels complete Progress: 145 of 435 total .png panels complete Progress: 153 of 435 total .png panels complete Progress: 163 of 435 total .png panels complete Progress: 168 of 435 total .png panels complete Progress: 178 of 435 total .png panels complete Progress: 184 of 435 total .png panels complete Progress: 191 of 435 total .png panels complete Progress: 196 of 435 total .png panels complete Progress: 200 of 435 total .png panels complete Progress: 206 of 435 total .png panels complete Progress: 212 of 435 total .png panels complete Progress: 218 of 435 total .png panels complete Progress: 224 of 435 total .png panels complete Progress: 230 of 435 total .png panels complete Progress: 237 of 435 total .png panels complete Progress: 242 of 435 total .png panels complete Progress: 250 of 435 total .png panels complete Progress: 256 of 492 total .png panels complete Progress: 261 of 492 total .png panels complete Progress: 267 of 492 total .png panels complete Progress: 274 of 492 total .png panels complete Progress: 283 of 492 total .png panels complete Progress: 289 of 492 total .png panels complete Progress: 296 of 492 total .png panels complete Progress: 303 of 492 total .png panels complete Progress: 311 of 492 total .png panels complete Progress: 324 of 492 total .png panels complete Progress: 331 of 492 total .png panels complete Progress: 337 of 492 total .png panels complete Progress: 343 of 492 total .png panels complete Progress: 350 of 492 total .png panels complete Progress: 357 of 492 total .png panels complete Progress: 362 of 492 total .png panels complete Progress: 368 of 492 total .png panels complete Progress: 374 of 492 total .png panels complete Progress: 380 of 492 total .png panels complete Progress: 385 of 492 total .png panels complete Progress: 390 of 492 total .png panels complete Progress: 394 of 492 total .png panels complete Progress: 396 of 492 total .png panels complete Progress: 400 of 492 total .png panels complete Progress: 403 of 492 total .png panels complete Progress: 405 of 492 total .png panels complete Progress: 408 of 565 total .png panels complete Progress: 412 of 565 total .png panels complete Progress: 417 of 619 total .png panels complete Progress: 421 of 619 total .png panels complete Progress: 426 of 619 total .png panels complete Progress: 430 of 619 total .png panels complete Progress: 434 of 619 total .png panels complete Progress: 438 of 619 total .png panels complete Progress: 446 of 619 total .png panels complete Progress: 450 of 619 total .png panels complete Progress: 454 of 619 total .png panels complete Progress: 459 of 619 total .png panels complete Progress: 463 of 619 total .png panels complete Progress: 468 of 619 total .png panels complete Progress: 473 of 619 total .png panels complete Progress: 476 of 619 total .png panels complete Progress: 481 of 619 total .png panels complete Progress: 484 of 619 total .png panels complete Progress: 489 of 619 total .png panels complete Progress: 493 of 619 total .png panels complete Progress: 498 of 672 total .png panels complete Progress: 504 of 672 total .png panels complete Progress: 508 of 672 total .png panels complete Progress: 512 of 672 total .png panels complete Progress: 517 of 672 total .png panels complete Progress: 521 of 672 total .png panels complete Progress: 525 of 711 total .png panels complete Progress: 529 of 711 total .png panels complete Progress: 534 of 711 total .png panels complete Progress: 540 of 711 total .png panels complete Progress: 545 of 711 total .png panels complete Progress: 550 of 711 total .png panels complete Progress: 645 of 840 total .png panels complete Progress: 651 of 840 total .png panels complete Progress: 656 of 840 total .png panels complete Progress: 663 of 840 total .png panels complete Progress: 668 of 840 total .png panels complete Progress: 674 of 840 total .png panels complete Progress: 679 of 840 total .png panels complete Progress: 685 of 840 total .png panels complete Progress: 690 of 840 total .png panels complete Progress: 696 of 840 total .png panels complete Progress: 703 of 840 total .png panels complete Progress: 709 of 840 total .png panels complete Progress: 713 of 840 total .png panels complete Progress: 718 of 840 total .png panels complete Progress: 723 of 840 total .png panels complete Progress: 727 of 840 total .png panels complete Progress: 729 of 840 total .png panels complete Progress: 734 of 840 total .png panels complete Progress: 737 of 840 total .png panels complete Progress: 741 of 840 total .png panels complete Progress: 745 of 840 total .png panels complete Progress: 750 of 840 total .png panels complete Progress: 753 of 840 total .png panels complete Progress: 761 of 840 total .png panels complete Progress: 766 of 840 total .png panels complete Progress: 770 of 840 total .png panels complete Progress: 773 of 840 total .png panels complete Progress: 775 of 840 total .png panels complete Progress: 779 of 840 total .png panels complete Progress: 782 of 840 total .png panels complete Progress: 785 of 840 total .png panels complete Progress: 787 of 898 total .png panels complete Progress: 791 of 898 total .png panels complete Progress: 794 of 898 total .png panels complete Progress: 797 of 898 total .png panels complete Progress: 800 of 898 total .png panels complete Progress: 804 of 898 total .png panels complete Progress: 806 of 898 total .png panels complete Progress: 810 of 898 total .png panels complete Progress: 814 of 898 total .png panels complete Progress: 817 of 898 total .png panels complete Progress: 820 of 898 total .png panels complete Progress: 823 of 898 total .png panels complete Progress: 826 of 898 total .png panels complete Progress: 830 of 898 total .png panels complete Progress: 832 of 898 total .png panels complete Progress: 834 of 898 total .png panels complete Progress: 836 of 898 total .png panels complete Progress: 838 of 898 total .png panels complete Progress: 840 of 898 total .png panels complete Progress: 843 of 898 total .png panels complete Progress: 844 of 898 total .png panels complete Progress: 846 of 898 total .png panels complete Progress: 849 of 898 total .png panels complete Progress: 851 of 898 total .png panels complete Progress: 853 of 898 total .png panels complete Progress: 855 of 898 total .png panels complete Progress: 856 of 898 total .png panels complete Progress: 858 of 898 total .png panels complete Progress: 860 of 898 total .png panels complete Progress: 862 of 898 total .png panels complete Progress: 864 of 898 total .png panels complete Progress: 866 of 898 total .png panels complete Progress: 868 of 898 total .png panels complete Progress: 870 of 898 total .png panels complete Progress: 871 of 975 total .png panels complete Progress: 875 of 975 total .png panels complete Progress: 878 of 975 total .png panels complete Progress: 880 of 975 total .png panels complete Progress: 1 of 44 total .png panels complete Progress: 2 of 44 total .png panels complete Progress: 3 of 44 total .png panels complete Progress: 4 of 44 total .png panels complete Progress: 5 of 44 total .png panels complete Progress: 6 of 44 total .png panels complete Progress: 7 of 98 total .png panels complete Progress: 8 of 166 total .png panels complete Progress: 9 of 166 total .png panels complete Progress: 10 of 166 total .png panels complete Progress: 12 of 166 total .png panels complete Progress: 15 of 166 total .png panels complete Progress: 18 of 166 total .png panels complete Progress: 21 of 166 total .png panels complete Progress: 22 of 224 total .png panels complete Progress: 25 of 224 total .png panels complete Progress: 28 of 224 total .png panels complete Progress: 32 of 224 total .png panels complete Progress: 35 of 282 total .png panels complete Progress: 39 of 282 total .png panels complete Progress: 43 of 282 total .png panels complete Progress: 47 of 282 total .png panels complete Progress: 51 of 282 total .png panels complete Progress: 55 of 282 total .png panels complete Progress: 60 of 359 total .png panels complete Progress: 65 of 359 total .png panels complete Progress: 73 of 359 total .png panels complete Progress: 85 of 359 total .png panels complete Progress: 91 of 359 total .png panels complete Progress: 97 of 359 total .png panels complete Progress: 103 of 359 total .png panels complete Progress: 109 of 359 total .png panels complete Progress: 114 of 359 total .png panels complete Progress: 120 of 359 total .png panels complete Progress: 126 of 435 total .png panels complete Progress: 131 of 435 total .png panels complete Progress: 136 of 435 total .png panels complete Progress: 144 of 435 total .png panels complete Progress: 151 of 435 total .png panels complete Progress: 160 of 435 total .png panels complete Progress: 166 of 435 total .png panels complete Progress: 172 of 435 total .png panels complete Progress: 179 of 435 total .png panels complete Progress: 188 of 435 total .png panels complete Progress: 411 of 565 total .png panels complete Progress: 415 of 619 total .png panels complete Progress: 419 of 619 total .png panels complete Progress: 424 of 619 total .png panels complete Progress: 428 of 619 total .png panels complete Progress: 439 of 619 total .png panels complete Progress: 443 of 619 total .png panels complete Progress: 451 of 619 total .png panels complete Progress: 456 of 619 total .png panels complete Progress: 461 of 619 total .png panels complete Progress: 467 of 619 total .png panels complete Progress: 472 of 619 total .png panels complete Progress: 477 of 619 total .png panels complete Progress: 482 of 619 total .png panels complete Progress: 487 of 619 total .png panels complete Progress: 491 of 619 total .png panels complete Progress: 499 of 672 total .png panels complete Progress: 505 of 672 total .png panels complete Progress: 509 of 672 total .png panels complete Progress: 514 of 672 total .png panels complete Progress: 519 of 672 total .png panels complete Progress: 524 of 711 total .png panels complete Progress: 532 of 711 total .png panels complete Progress: 538 of 711 total .png panels complete Progress: 543 of 711 total .png panels complete Progress: 548 of 711 total .png panels complete Progress: 557 of 711 total .png panels complete Progress: 568 of 711 total .png panels complete Progress: 573 of 711 total .png panels complete Progress: 578 of 711 total .png panels complete Progress: 584 of 711 total .png panels complete Progress: 590 of 711 total .png panels complete Progress: 595 of 711 total .png panels complete Progress: 599 of 711 total .png panels complete Progress: 603 of 711 total .png panels complete Progress: 609 of 771 total .png panels complete Progress: 614 of 771 total .png panels complete Progress: 618 of 771 total .png panels complete Progress: 621 of 771 total .png panels complete Progress: 630 of 771 total .png panels complete Progress: 635 of 771 total .png panels complete Progress: 639 of 840 total .png panels complete Progress: 644 of 840 total .png panels complete Progress: 649 of 840 total .png panels complete Progress: 655 of 840 total .png panels complete Progress: 662 of 840 total .png panels complete Progress: 669 of 840 total .png panels complete Progress: 675 of 840 total .png panels complete Progress: 680 of 840 total .png panels complete Progress: 687 of 840 total .png panels complete Progress: 693 of 840 total .png panels complete Progress: 699 of 840 total .png panels complete Progress: 704 of 840 total .png panels complete Progress: 708 of 840 total .png panels complete Progress: 712 of 840 total .png panels complete Progress: 717 of 840 total .png panels complete Progress: 722 of 840 total .png panels complete Progress: 726 of 840 total .png panels complete Progress: 730 of 840 total .png panels complete Progress: 733 of 840 total .png panels complete Progress: 738 of 840 total .png panels complete Progress: 742 of 840 total .png panels complete Progress: 747 of 840 total .png panels complete Progress: 751 of 840 total .png panels complete Progress: 755 of 840 total .png panels complete Progress: 758 of 840 total .png panels complete Progress: 763 of 840 total .png panels complete Progress: 767 of 840 total .png panels complete Progress: 771 of 840 total .png panels complete Progress: 774 of 840 total .png panels complete Progress: 777 of 840 total .png panels complete Progress: 780 of 840 total .png panels complete Progress: 783 of 840 total .png panels complete Progress: 917 of 975 total .png panels complete Progress: 919 of 975 total .png panels complete Progress: 921 of 975 total .png panels complete Progress: 75 of 359 total .png panels complete Progress: 80 of 359 total .png panels complete Progress: 86 of 359 total .png panels complete Progress: 92 of 359 total .png panels complete Progress: 98 of 359 total .png panels complete Progress: 105 of 359 total .png panels complete Progress: 111 of 359 total .png panels complete Progress: 115 of 359 total .png panels complete Progress: 122 of 359 total .png panels complete Progress: 127 of 435 total .png panels complete Progress: 132 of 435 total .png panels complete Progress: 138 of 435 total .png panels complete Progress: 146 of 435 total .png panels complete Progress: 152 of 435 total .png panels complete Progress: 157 of 435 total .png panels complete Progress: 164 of 435 total .png panels complete Progress: 169 of 435 total .png panels complete Progress: 177 of 435 total .png panels complete Progress: 183 of 435 total .png panels complete Progress: 190 of 435 total .png panels complete Progress: 194 of 435 total .png panels complete Progress: 199 of 435 total .png panels complete Progress: 207 of 435 total .png panels complete Progress: 213 of 435 total .png panels complete Progress: 223 of 435 total .png panels complete Progress: 229 of 435 total .png panels complete Progress: 239 of 435 total .png panels complete Progress: 249 of 435 total .png panels complete Progress: 252 of 435 total .png panels complete Progress: 259 of 492 total .png panels complete Progress: 266 of 492 total .png panels complete Progress: 270 of 492 total .png panels complete Progress: 276 of 492 total .png panels complete Progress: 281 of 492 total .png panels complete Progress: 288 of 492 total .png panels complete Progress: 295 of 492 total .png panels complete Progress: 302 of 492 total .png panels complete Progress: 308 of 492 total .png panels complete Progress: 314 of 492 total .png panels complete Progress: 319 of 492 total .png panels complete Progress: 329 of 492 total .png panels complete Progress: 335 of 492 total .png panels complete Progress: 339 of 492 total .png panels complete Progress: 344 of 492 total .png panels complete Progress: 349 of 492 total .png panels complete Progress: 355 of 492 total .png panels complete Progress: 361 of 492 total .png panels complete Progress: 367 of 492 total .png panels complete Progress: 373 of 492 total .png panels complete Progress: 379 of 492 total .png panels complete Progress: 387 of 492 total .png panels complete Progress: 391 of 492 total .png panels complete Progress: 395 of 492 total .png panels complete Progress: 398 of 492 total .png panels complete Progress: 401 of 492 total .png panels complete Progress: 404 of 492 total .png panels complete Progress: 406 of 492 total .png panels complete Progress: 409 of 565 total .png panels complete Progress: 413 of 565 total .png panels complete Progress: 416 of 619 total .png panels complete Progress: 420 of 619 total .png panels complete Progress: 425 of 619 total .png panels complete Progress: 431 of 619 total .png panels complete Progress: 435 of 619 total .png panels complete Progress: 440 of 619 total .png panels complete Progress: 444 of 619 total .png panels complete Progress: 448 of 619 total .png panels complete Progress: 453 of 619 total .png panels complete Progress: 458 of 619 total .png panels complete Progress: 464 of 619 total .png panels complete Progress: 469 of 619 total .png panels complete Progress: 475 of 619 total .png panels complete Progress: 480 of 619 total .png panels complete Progress: 486 of 619 total .png panels complete Progress: 494 of 619 total .png panels complete Progress: 496 of 672 total .png panels complete Progress: 501 of 672 total .png panels complete Progress: 873 of 975 total .png panels complete Progress: 877 of 975 total .png panels complete Progress: 881 of 975 total .png panels complete Progress: 883 of 975 total .png panels complete Progress: 885 of 975 total .png panels complete Progress: 887 of 975 total .png panels complete Progress: 889 of 975 total .png panels complete Progress: 891 of 975 total .png panels complete Progress: 893 of 975 total .png panels complete Progress: 895 of 975 total .png panels complete Progress: 897 of 975 total .png panels complete Progress: 899 of 975 total .png panels complete Progress: 901 of 975 total .png panels complete Progress: 903 of 975 total .png panels complete Progress: 904 of 975 total .png panels complete Progress: 906 of 975 total .png panels complete Progress: 908 of 975 total .png panels complete Progress: 910 of 975 total .png panels complete Progress: 912 of 975 total .png panels complete Progress: 914 of 975 total .png panels complete Progress: 916 of 975 total .png panels complete Progress: 918 of 975 total .png panels complete Progress: 920 of 975 total .png panels complete Progress: 922 of 975 total .png panels complete Progress: 923 of 975 total .png panels complete Progress: 924 of 975 total .png panels complete Progress: 925 of 975 total .png panels complete Progress: 926 of 975 total .png panels complete Progress: 927 of 975 total .png panels complete Progress: 928 of 975 total .png panels complete Progress: 929 of 975 total .png panels complete Progress: 930 of 975 total .png panels complete Progress: 931 of 975 total .png panels complete Progress: 932 of 975 total .png panels complete Progress: 933 of 975 total .png panels complete Progress: 934 of 975 total .png panels complete Progress: 935 of 975 total .png panels complete Progress: 936 of 975 total .png panels complete Progress: 937 of 975 total .png panels complete Progress: 938 of 975 total .png panels complete Progress: 939 of 975 total .png panels complete Progress: 940 of 975 total .png panels complete Progress: 941 of 975 total .png panels complete Progress: 942 of 975 total .png panels complete Progress: 943 of 975 total .png panels complete Progress: 944 of 975 total .png panels complete Progress: 945 of 975 total .png panels complete Progress: 946 of 975 total .png panels complete Progress: 947 of 975 total .png panels complete Progress: 948 of 975 total .png panels complete Progress: 949 of 975 total .png panels complete Progress: 950 of 975 total .png panels complete Progress: 951 of 975 total .png panels complete Progress: 952 of 975 total .png panels complete Progress: 953 of 975 total .png panels complete Progress: 954 of 975 total .png panels complete Progress: 955 of 975 total .png panels complete Progress: 956 of 975 total .png panels complete Progress: 957 of 975 total .png panels complete Progress: 958 of 975 total .png panels complete Progress: 959 of 975 total .png panels complete Progress: 960 of 975 total .png panels complete Progress: 961 of 975 total .png panels complete Progress: 962 of 975 total .png panels complete Progress: 963 of 975 total .png panels complete Progress: 964 of 975 total .png panels complete Progress: 965 of 975 total .png panels complete Progress: 966 of 975 total .png panels complete Progress: 967 of 975 total .png panels complete Progress: 968 of 975 total .png panels complete Progress: 969 of 975 total .png panels complete Progress: 970 of 975 total .png panels complete Progress: 971 of 975 total .png panels complete Progress: 972 of 975 total .png panels complete Progress: 973 of 975 total .png panels complete Progress: 974 of 975 total .png panels complete Progress: 975 of 975 total .png panels complete Progress: 272 of 492 total .png panels complete Progress: 280 of 492 total .png panels complete Progress: 286 of 492 total .png panels complete Progress: 292 of 492 total .png panels complete Progress: 301 of 492 total .png panels complete Progress: 307 of 492 total .png panels complete Progress: 315 of 492 total .png panels complete Progress: 320 of 492 total .png panels complete Progress: 326 of 492 total .png panels complete Progress: 333 of 492 total .png panels complete Progress: 338 of 492 total .png panels complete Progress: 345 of 492 total .png panels complete Progress: 351 of 492 total .png panels complete Progress: 356 of 492 total .png panels complete Progress: 363 of 492 total .png panels complete Progress: 369 of 492 total .png panels complete Progress: 377 of 492 total .png panels complete Progress: 383 of 492 total .png panels complete Progress: 388 of 492 total .png panels complete Progress: 393 of 492 total .png panels complete Progress: 397 of 492 total .png panels complete Progress: 399 of 492 total .png panels complete Progress: 402 of 492 total .png panels complete Progress: 407 of 492 total .png panels complete Progress: 410 of 565 total .png panels complete Progress: 414 of 565 total .png panels complete Progress: 423 of 619 total .png panels complete Progress: 432 of 619 total .png panels complete Progress: 436 of 619 total .png panels complete Progress: 441 of 619 total .png panels complete Progress: 445 of 619 total .png panels complete Progress: 449 of 619 total .png panels complete Progress: 455 of 619 total .png panels complete Progress: 460 of 619 total .png panels complete Progress: 466 of 619 total .png panels complete Progress: 471 of 619 total .png panels complete Progress: 478 of 619 total .png panels complete Progress: 485 of 619 total .png panels complete Progress: 490 of 619 total .png panels complete Progress: 495 of 672 total .png panels complete Progress: 500 of 672 total .png panels complete Progress: 506 of 672 total .png panels complete Progress: 510 of 672 total .png panels complete Progress: 515 of 672 total .png panels complete Progress: 522 of 672 total .png panels complete Progress: 528 of 711 total .png panels complete Progress: 533 of 711 total .png panels complete Progress: 539 of 711 total .png panels complete Progress: 547 of 711 total .png panels complete Progress: 553 of 711 total .png panels complete Progress: 559 of 711 total .png panels complete Progress: 562 of 711 total .png panels complete Progress: 567 of 711 total .png panels complete Progress: 572 of 711 total .png panels complete Progress: 577 of 711 total .png panels complete Progress: 582 of 711 total .png panels complete Progress: 586 of 711 total .png panels complete Progress: 976 of 1045 total .png panels complete Progress: 977 of 1045 total .png panels complete Progress: 978 of 1045 total .png panels complete Progress: 979 of 1045 total .png panels complete Progress: 980 of 1045 total .png panels complete Progress: 981 of 1045 total .png panels complete Progress: 982 of 1045 total .png panels complete Progress: 983 of 1045 total .png panels complete Progress: 984 of 1045 total .png panels complete Progress: 985 of 1045 total .png panels complete Progress: 986 of 1045 total .png panels complete Progress: 987 of 1045 total .png panels complete Progress: 988 of 1045 total .png panels complete Progress: 989 of 1045 total .png panels complete Progress: 990 of 1045 total .png panels complete Progress: 991 of 1045 total .png panels complete Progress: 992 of 1045 total .png panels complete Progress: 993 of 1045 total .png panels complete Progress: 994 of 1045 total .png panels complete Progress: 995 of 1045 total .png panels complete Progress: 996 of 1045 total .png panels complete Progress: 997 of 1045 total .png panels complete Progress: 998 of 1045 total .png panels complete Progress: 999 of 1045 total .png panels complete Progress: 1000 of 1045 total .png panels complete Progress: 1001 of 1045 total .png panels complete Progress: 1002 of 1045 total .png panels complete Progress: 1003 of 1045 total .png panels complete Progress: 1004 of 1045 total .png panels complete Progress: 1005 of 1045 total .png panels complete Progress: 1006 of 1045 total .png panels complete Progress: 1007 of 1045 total .png panels complete Progress: 1008 of 1045 total .png panels complete Progress: 1009 of 1045 total .png panels complete Progress: 1010 of 1045 total .png panels complete Progress: 1011 of 1045 total .png panels complete Progress: 1012 of 1045 total .png panels complete Progress: 1013 of 1045 total .png panels complete Progress: 1014 of 1045 total .png panels complete Progress: 1015 of 1045 total .png panels complete Progress: 1016 of 1045 total .png panels complete Progress: 1017 of 1045 total .png panels complete Progress: 1018 of 1045 total .png panels complete Progress: 1019 of 1045 total .png panels complete Progress: 1020 of 1045 total .png panels complete Progress: 1021 of 1045 total .png panels complete Progress: 1022 of 1045 total .png panels complete Progress: 1023 of 1045 total .png panels complete Progress: 1024 of 1045 total .png panels complete Progress: 1025 of 1045 total .png panels complete Progress: 1026 of 1045 total .png panels complete Progress: 1027 of 1045 total .png panels complete Progress: 1028 of 1045 total .png panels complete Progress: 1029 of 1045 total .png panels complete Progress: 1030 of 1045 total .png panels complete Progress: 1031 of 1045 total .png panels complete Progress: 1032 of 1045 total .png panels complete Progress: 1033 of 1045 total .png panels complete Progress: 1034 of 1045 total .png panels complete Progress: 1035 of 1045 total .png panels complete Progress: 1036 of 1045 total .png panels complete Progress: 1037 of 1045 total .png panels complete Progress: 1038 of 1045 total .png panels complete Progress: 1039 of 1045 total .png panels complete Progress: 1040 of 1045 total .png panels complete Progress: 1041 of 1045 total .png panels complete Progress: 1042 of 1045 total .png panels complete Progress: 1043 of 1045 total .png panels complete Progress: 1044 of 1045 total .png panels complete Progress: 1045 of 1045 total .png panels complete ------------------------------------------- ARM: SUCCESS --> Images found. ARM_97: SUCCESS --> Images found. ATEX: SUCCESS --> Images found. BOMEX: SUCCESS --> Images found. CGILS_S11: SUCCESS --> Images found. CGILS_S12: SUCCESS --> Images found. CGILS_S6: SUCCESS --> Images found. DYCOMS2_RF01: SUCCESS --> Images found. DYCOMS2_RF01_FIXED_SST: SUCCESS --> Images found. DYCOMS2_RF02_DS: SUCCESS --> Images found. DYCOMS2_RF02_ND: SUCCESS --> Images found. GABLS3_NIGHT: SUCCESS --> Images found. LBA: SUCCESS --> Images found. MPACE_B: SUCCESS --> Images found. RICO: SUCCESS --> Images found. TWP_ICE: SUCCESS --> Images found. WANGARA: SUCCESS --> Images found. ------------------------------------------- Output can be viewed at file:///home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/1632cf1_vs_master_8bbf5db/index.html with a web browser Pyplotgen ran in 106 seconds. See error.log in the output folder for detailed info including warnings. error.log messages include: 24-09-27 04:42:07.631 proc_id: 3624433 Warning! Averaging over heights is not yet implemented. [Pipeline] sh + ssh carson 'mkdir -p /home/pub/clubb_nvhpc_gpu_plots/master' [Pipeline] sh + scp -r 1632cf1_vs_master_8bbf5db carson:/home/pub/clubb_nvhpc_gpu_plots/master [Pipeline] sh + ssh carson '/home/pub/create_plot_list.py /home/pub/clubb_nvhpc_gpu_plots/' /home/pub/clubb_nvhpc_gpu_plots/ updated successfully. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Update Master Output) [Pipeline] sh + rm -rf cur_out [Pipeline] sh + mkdir cur_out [Pipeline] sh + mv cpu_1632cf1 gpu_1632cf1 cur_out [Pipeline] sh + echo 1632cf1 [Pipeline] sh + ssh carson 'rm -rf /home/pub/clubb_nvhpc_gpu_plots/master/cur_out' [Pipeline] sh + scp -r cur_out carson:/home/pub/clubb_nvhpc_gpu_plots/master/ [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] script [Pipeline] { [Pipeline] cleanWs [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is used... [WS-CLEANUP] done [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline Finished: SUCCESS