Skipping 598 KB..
Full LogTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTest
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/output_2D_samples_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_arrays.F90
ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a eqa11g.o qsatvi.o conice.o eqa9.o eqa15.o tgqr.o eqa14g.o eqa28.o nrmtqi.o eqa22g.o eqa17g.o eqa10g.o eqa22.o esati.o adjmlt.o eqa13g.o esatv.o eqa8g.o nrmtqw.o eqa7.o esat_new.o eqa26.o adjtq.o eqa7g.o eqa5g.o slope.o frzh.o tgqs.o eqa19.o eqa18.o tgqi.o eqa25.o eqa18g.o eqa19g.o gamma.o eqa21.o eqa21g.o eqa9g.o eqa6.o qtadj.o eqa27.o eqa27r.o eqa12.o eqa20g.o eqa12g.o nrmcol.o tgqg.o
ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_coamps.a
a - eqa11g.o
a - qsatvi.o
a - conice.o
a - eqa9.o
a - eqa15.o
a - tgqr.o
a - eqa14g.o
a - eqa28.o
a - nrmtqi.o
a - eqa22g.o
a - eqa17g.o
a - eqa10g.o
a - eqa22.o
a - esati.o
a - adjmlt.o
a - eqa13g.o
a - esatv.o
a - eqa8g.o
a - nrmtqw.o
a - eqa7.o
a - esat_new.o
a - eqa26.o
a - adjtq.o
a - eqa7g.o
a - eqa5g.o
a - slope.o
a - frzh.o
a - tgqs.o
a - eqa19.o
a - eqa18.o
a - tgqi.o
a - eqa25.o
a - eqa18g.o
a - eqa19g.o
a - gamma.o
a - eqa21.o
a - eqa21g.o
a - eqa9g.o
a - eqa6.o
a - qtadj.o
a - eqa27.o
a - eqa27r.o
a - eqa12.o
a - eqa20g.o
a - eqa12g.o
a - nrmcol.o
a - tgqg.o
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/math_utilities.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/est_kessler_microphys_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/generate_uniform_sample_module.F90
transform_uniform_samples_to_pdf:
111, Generating create(std_normal(:,:,:,:)) [if not already present]
125, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt)
Generating NVIDIA GPU code
126, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
127, ! blockidx%x threadidx%x collapsed
128, ! blockidx%x threadidx%x collapsed
129, ! blockidx%x threadidx%x collapsed
125, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),hm_metadata)
137, Generating implicit firstprivate(ngrdcol,num_samples,pdf_dim,nzt)
Generating NVIDIA GPU code
138, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
139, ! blockidx%x threadidx%x collapsed
140, ! blockidx%x threadidx%x collapsed
141, ! blockidx%x threadidx%x collapsed
137, Generating default present(hm_metadata,l_in_precip_all_levs(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_ncn+1:pdf_dim))
162, Generating implicit firstprivate(ngrdcol,nzt,num_samples)
Generating NVIDIA GPU code
163, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
164, ! blockidx%x threadidx%x collapsed
165, ! blockidx%x threadidx%x collapsed
162, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,hm_metadata%iipdf_chi),hm_metadata,cloud_frac(:ngrdcol,:num_samples,:nzt))
cdfnorminv:
256, Generating implicit firstprivate(pdf_dim,nzt,num_samples,ngrdcol)
Generating NVIDIA GPU code
257, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
258, ! blockidx%x threadidx%x collapsed
259, ! blockidx%x threadidx%x collapsed
260, ! blockidx%x threadidx%x collapsed
256, Generating implicit copy(std_normal(:pdf_dim,:ngrdcol,:nzt,:num_samples)) [if not already present]
Generating implicit copyin(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim)) [if not already present]
260, Generating implicit firstprivate(x,w)
multiply_cholesky:
546, Generating copyin(mu2(:,:,:),sigma_cholesky1(:,:,:,:),sigma_cholesky2(:,:,:,:),mu1(:,:,:)) [if not already present]
548, Generating implicit firstprivate(num_samples,ngrdcol,pdf_dim,nzt)
Generating NVIDIA GPU code
549, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
550, ! blockidx%x threadidx%x collapsed
551, ! blockidx%x threadidx%x collapsed
552, ! blockidx%x threadidx%x collapsed
562, !$acc loop seq
548, Generating default present(x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:pdf_dim),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),std_normal(:,:ngrdcol,:nzt,:num_samples))
552, Generating implicit firstprivate(j,x_nl_k_sample_i_tmp,l_first_comp)
562, Loop carried scalar dependence for x_nl_k_sample_i_tmp at line 565,568
Scalar last value needed after loop for x_nl_k_sample_i_tmp at line 573
chi_eta_2_rtthl:
651, Generating copyin(mu_chi_2(:,:),rt_1(:,:),rt_2(:,:),thl_2(:,:),thl_1(:,:),chi(:,:,:),crt_1(:,:),crt_2(:,:),cthl_1(:,:),eta(:,:,:),mu_chi_1(:,:),cthl_2(:,:)) [if not already present]
655, Generating implicit firstprivate(nzt,num_samples,ngrdcol)
Generating NVIDIA GPU code
656, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
657, ! blockidx%x threadidx%x collapsed
658, ! blockidx%x threadidx%x collapsed
655, Generating default present(lh_rt(:ngrdcol,:num_samples,:nzt),x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt),lh_thl(:ngrdcol,:num_samples,:nzt))
658, Generating implicit firstprivate(lh_dev_thl_lim)
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_importance_sample_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/lh_microphys_var_covar_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/latin_hypercube_driver_module.F90
ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a module_mp_graupel.o
ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_morrison.a
a - module_mp_graupel.o
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
generate_silhs_sample:
295, Generating copyin(k_lh_start(:)) [if not already present]
Generating create(rand_pool(:,:,:,:),x_u_all_levs(:,:,:,:)) [if not already present]
Generating copyin(x_vert_corr(:,:)) [if not already present]
323, Generating create(cloud_frac(:,:,:),l_in_precip(:,:,:)) [if not already present]
Generating copyin(pdf_params%mixt_frac(:,:),pdf_params%cloud_frac_2(:,:),pdf_params,pdf_params%cloud_frac_1(:,:),precip_fracs,precip_fracs%precip_frac_2(:,:),precip_fracs%precip_frac_1(:,:)) [if not already present]
329, Generating implicit firstprivate(ngrdcol,nzt,num_samples)
Generating NVIDIA GPU code
330, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
331, ! blockidx%x threadidx%x collapsed
332, ! blockidx%x threadidx%x collapsed
329, Generating default present(x_mixt_comp_all_levs(:ngrdcol,:num_samples,:nzt))
332, Generating implicit firstprivate(pdf_dim)
388, Generating update self(lh_sample_point_weights(:,:,:),l_in_precip(:,:,:),x_u_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:))
425, Generating update self(x_mixt_comp_all_levs(:,:,:),x_u_all_levs(:,:,:,:),x_nl_all_levs(:,:,:,:))
generate_all_uniform_samples:
718, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt)
Generating NVIDIA GPU code
719, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
720, ! blockidx%x threadidx%x collapsed
721, ! blockidx%x threadidx%x collapsed
722, ! blockidx%x threadidx%x collapsed
718, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim))
731, Generating implicit firstprivate(ngrdcol,num_samples,nzt)
Generating NVIDIA GPU code
732, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
733, ! blockidx%x threadidx%x collapsed
734, ! blockidx%x threadidx%x collapsed
731, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt))
814, Generating implicit firstprivate(d_uniform_extra,ngrdcol,num_samples,pdf_dim,nzt)
Generating NVIDIA GPU code
815, !$acc loop gang, vector(128) collapse(4) ! blockidx%x threadidx%x
816, ! blockidx%x threadidx%x collapsed
817, ! blockidx%x threadidx%x collapsed
818, ! blockidx%x threadidx%x collapsed
814, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim),rand_pool(:ngrdcol,:num_samples,:nzt,:d_uniform_extra+pdf_dim))
827, Generating implicit firstprivate(ngrdcol,nzt,num_samples)
Generating NVIDIA GPU code
828, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
829, ! blockidx%x threadidx%x collapsed
830, ! blockidx%x threadidx%x collapsed
827, Generating default present(lh_sample_point_weights(:ngrdcol,:num_samples,:nzt))
clip_transform_silhs_output:
1122, Generating implicit firstprivate(ngrdcol,num_samples,nzt)
Generating NVIDIA GPU code
1123, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
1124, ! blockidx%x threadidx%x collapsed
1125, ! blockidx%x threadidx%x collapsed
1122, Generating default present(lh_rc_clipped(:ngrdcol,:num_samples,:nzt),lh_nc_clipped(:ngrdcol,:num_samples,:nzt),lh_rt_clipped(:ngrdcol,:num_samples,:nzt),x_nl_all_levs(:ngrdcol,:num_samples,:nzt,:),lh_rv_clipped(:ngrdcol,:num_samples,:nzt),hm_metadata)
1125, Generating implicit firstprivate(l_use_ncn_to_nc)
compute_arb_overlap:
1900, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples)
Generating NVIDIA GPU code
1901, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
1902, ! blockidx%x threadidx%x collapsed
1903, ! blockidx%x threadidx%x collapsed
1908, !$acc loop seq
1900, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim))
1903, Generating implicit firstprivate(k,unbounded_point,nzt,k_lh_start_i)
1908, Loop carried scalar dependence for unbounded_point at line 1911
Generating implicit firstprivate(half_width,offset,min_val)
Loop carried scalar dependence for unbounded_point at line 1911
1934, Generating implicit firstprivate(d_uniform_extra,ngrdcol,pdf_dim,num_samples)
Generating NVIDIA GPU code
1935, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
1936, ! blockidx%x threadidx%x collapsed
1937, ! blockidx%x threadidx%x collapsed
1942, !$acc loop seq
1934, Generating default present(x_u_all_levs(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim),vert_corr(:ngrdcol,:),k_lh_start(:ngrdcol),rand_pool(:ngrdcol,:num_samples,:,:d_uniform_extra+pdf_dim))
1937, Generating implicit firstprivate(k,unbounded_point,k_lh_start_i)
1942, Loop carried scalar dependence for unbounded_point at line 1945
Generating implicit firstprivate(half_width,offset,min_val)
Loop carried scalar dependence for unbounded_point at line 1945
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/SILHS/silhs_api_module.F90
ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a silhs_api_module.o math_utilities.o generate_uniform_sample_module.o transform_to_pdf_module.o est_kessler_microphys_module.o parameters_silhs.o latin_hypercube_driver_module.o output_2D_samples_module.o silhs_importance_sample_module.o latin_hypercube_arrays.o lh_microphys_var_covar_module.o
ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libsilhs.a
a - silhs_api_module.o
a - math_utilities.o
a - generate_uniform_sample_module.o
a - transform_to_pdf_module.o
a - est_kessler_microphys_module.o
a - parameters_silhs.o
a - latin_hypercube_driver_module.o
a - output_2D_samples_module.o
a - silhs_importance_sample_module.o
a - latin_hypercube_arrays.o
a - lh_microphys_var_covar_module.o
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_other
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_model_settings.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/hydrostatic_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/diag_ustar_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/time_dependent_input.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/input_grads.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extrapolation.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_microphys.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/soil_vegetation.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/cos_solar_zen_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/quicksort.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/parameters_radiation.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rad_lwsw_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/wangara.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/gfdl_activation.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/silhs_category_variance_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/advance_microphys_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_interpret.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/ice_dfsn_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_sed_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/morrison_microphys_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/coamps_microphys_driver_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_init_cleanup.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/mixed_moment_PDF_integrals.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/spec_hum_to_mixing_ratio.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_nov02.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/clex9_oct14.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/jun25.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/nov11.F90
microphys_lhs:
1845, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
Generating copyout(lhs_ta(:,:,:)) [if not already present]
Generating copyin(gr%invrs_dzt(:,:),rho_ds_zm_col(:,:),nu_col(:),kh_zt(:,:)) [if not already present]
1875, Generating copyin(gr%invrs_dzt(:,:),gr%invrs_dzm(:,:),gr,wm_zt_col(:,:)) [if not already present]
Generating copyout(lhs_ma(:,:)) [if not already present]
Generating copyin(gr%weights_zt2zm(:,:,:)) [if not already present]
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_netcdf.F90
microphys_rhs:
2161, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
Generating copyout(lhs_ta(:,:)) [if not already present]
Generating copyin(gr%invrs_dzt(:,:),nu_col(:),rho_ds_zm_col(:,:),kh_zt(:,:)) [if not already present]
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/sfc_flux.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/simple_rad_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_a.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls2.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cobra.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/twp_ice.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/extended_atmosphere_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_0003.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_3year.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/astex_a209.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/atex.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/arm_97.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/bomex.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/cloud_feedback.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf01.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/dycoms2_rf02.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/fire.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/gabls3_night.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/mpace_b.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/rico.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/lba.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/Benchmark_cases/neutral_case.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/stat_file_utils.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/KK_microphys_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/bugsrad_driver.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/sounding.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/input_fields.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/estimate_scm_microphys_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/lh_microphys_driver_module.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/microphys_driver.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_driver.F90
NVFORTRAN-W-0435-Array declared with zero size (../src/clubb_driver.F90: 433)
run_clubb:
2651, Generating copyout(lh_thl_clipped(:,:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:),lh_rv_clipped(:,:,:),lh_rc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_nc_clipped(:,:,:),lh_rt_clipped(:,:,:)) [if not already present]
Generating copyin(hm_metadata) [if not already present]
2759, Generating copyout(skw_zm(:,:)) [if not already present]
Generating copyin(wp3_zm(:,:),wp2(:,:),clubb_params(:,:)) [if not already present]
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/error.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src ../src/enhanced_simann.F90
ar rv /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a input_netcdf.o hydrostatic_module.o lba.o neutral_case.o input_fields.o cos_solar_zen_module.o quicksort.o simple_rad_module.o wangara.o clubb_model_settings.o mpace_a.o gabls2.o gfdl_activation.o sfc_flux.o cobra.o rad_lwsw_module.o estimate_scm_microphys_module.o twp_ice.o extended_atmosphere_module.o arm.o lh_microphys_driver_module.o ice_dfsn_module.o bugsrad_driver.o enhanced_simann.o mpace_b.o jun25.o cloud_feedback.o input_interpret.o advance_microphys_module.o soil_vegetation.o microphys_driver.o parameters_radiation.o mixed_moment_PDF_integrals.o morrison_microphys_module.o dycoms2_rf02.o astex_a209.o clubb_driver.o arm_3year.o cloud_sed_module.o diag_ustar_module.o sounding.o atex.o nov11.o silhs_category_variance_module.o stat_file_utils.o microphys_init_cleanup.o spec_hum_to_mixing_ratio.o dycoms2_rf01.o fire.o bomex.o rico.o coamps_microphys_driver_module.o parameters_microphys.o gabls3_night.o error.o gabls3.o arm_97.o extrapolation.o input_grads.o time_dependent_input.o arm_0003.o clex9_oct14.o KK_microphys_module.o clex9_nov02.o
ar: creating /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib/libclubb_other.a
a - input_netcdf.o
a - hydrostatic_module.o
a - lba.o
a - neutral_case.o
a - input_fields.o
a - cos_solar_zen_module.o
a - quicksort.o
a - simple_rad_module.o
a - wangara.o
a - clubb_model_settings.o
a - mpace_a.o
a - gabls2.o
a - gfdl_activation.o
a - sfc_flux.o
a - cobra.o
a - rad_lwsw_module.o
a - estimate_scm_microphys_module.o
a - twp_ice.o
a - extended_atmosphere_module.o
a - arm.o
a - lh_microphys_driver_module.o
a - ice_dfsn_module.o
a - bugsrad_driver.o
a - enhanced_simann.o
a - mpace_b.o
a - jun25.o
a - cloud_feedback.o
a - input_interpret.o
a - advance_microphys_module.o
a - soil_vegetation.o
a - microphys_driver.o
a - parameters_radiation.o
a - mixed_moment_PDF_integrals.o
a - morrison_microphys_module.o
a - dycoms2_rf02.o
a - astex_a209.o
a - clubb_driver.o
a - arm_3year.o
a - cloud_sed_module.o
a - diag_ustar_module.o
a - sounding.o
a - atex.o
a - nov11.o
a - silhs_category_variance_module.o
a - stat_file_utils.o
a - microphys_init_cleanup.o
a - spec_hum_to_mixing_ratio.o
a - dycoms2_rf01.o
a - fire.o
a - bomex.o
a - rico.o
a - coamps_microphys_driver_module.o
a - parameters_microphys.o
a - gabls3_night.o
a - error.o
a - gabls3.o
a - arm_97.o
a - extrapolation.o
a - input_grads.o
a - time_dependent_input.o
a - arm_0003.o
a - clex9_oct14.o
a - KK_microphys_module.o
a - clex9_nov02.o
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_standalone
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_tuner
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.jacobian
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.G_unit_tests
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.int2txt
cd /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../obj; make -f Make.clubb_thread_test
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/jacobian.F90
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrtype.f90
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_standalone.F90
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c -I../src/CLUBB_core ../src/int2txt.F90
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_heaviside_tests.F90
make[1]: Entering directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_thread_test.F90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nrutil.f90
nvfortran int2txt.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/int2txt -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/spurious_source_test.F90
nvfortran clubb_thread_test.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_thread_test -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran clubb_standalone.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_standalone -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 218)
NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 222)
NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 275)
NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/spurious_source_test.F90: 278)
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
nvfortran jacobian.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/jacobian -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/mu_sigma_hm_tests.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/hole_filling_tests.F90
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/read_corr_mtx_test.F90
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/smooth_min_max_tests.F90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/nr.f90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/KK_integrals_tests.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/clubb_tuner.F90
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/silhs_category_test.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/corr_cholesky_mtx_tests.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/tuner_tests.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/Nc_Ncn_test.F90
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/w_up_in_cloud_tests.F90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran_state.f90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amebsa.f90
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_test_types/pdf_parameter_tests.F90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/amoeba.f90
NVFORTRAN-W-0435-Array declared with zero size (../src/G_unit_test_types/pdf_parameter_tests.F90: 413)
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_v.f90
nvfortran -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../src/Numerical_recipes/ran1_s.f90
nvfortran ran1_v.o ran_state.o nrtype.o ran1_s.o nrutil.o amebsa.o amoeba.o clubb_tuner.o nr.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/clubb_tuner -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
nvfortran -DNETCDF -DCLUBB_REAL_TYPE=8 -DCLUBB_GPU -DCUDA -DCOAMPS_MICRO -DNR_SP -DSILHS -Dradoffline -Dnooverlap -DCLUBB -I/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/include -Mcache_align -O2 -Mbackslash -Mstandard -Kieee -acc -Minfo=accel -c ../src/G_unit_tests.F90
nvfortran smooth_heaviside_tests.o spurious_source_test.o pdf_parameter_tests.o hole_filling_tests.o read_corr_mtx_test.o smooth_min_max_tests.o KK_integrals_tests.o silhs_category_test.o corr_cholesky_mtx_tests.o mu_sigma_hm_tests.o tuner_tests.o G_unit_tests.o w_up_in_cloud_tests.o Nc_Ncn_test.o -o /home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../bin/G_unit_tests -L/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/compile/../lib -lclubb_other -lclubb_coamps -lclubb_gfdlact -lsilhs -lclubb_bugsrad -lclubb_KK_microphys -lclubb_parabolic -lclubb_morrison -lmicrophys_utils -lclubb_param -lclubb_lapack -Mcache_align -L/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/nvhpc-24.3/netcdf-fortran-4.5.3-yx2farr5afrrmep3vdkk2p6zdeshpybm/lib -lnetcdff -acc -Mcuda
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
make[1]: Leaving directory '/home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/obj'
python ../utilities/check_for_missing_threadprivate.py ../src/CLUBB_core/ ../src/SILHS/
check_for_missing_threadprivate.py has begun.
[91mcheck_for_missing_threadprivate.py did not pass.[0m
[91mfailedFiles = ['../src/CLUBB_core/corr_varnce_module.F90', '../src/CLUBB_core/parameters_model.F90', '../src/CLUBB_core/sponge_layer_damping.F90', '../src/CLUBB_core/error_code.F90'][0m
perl ../utilities/CLUBBStandardsCheck.pl ../src/*.F90
CLUBBStandardsCheck.pl has begun.
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
381 : um(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
383 : vm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
385 : ugm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
387 : vgm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
389 : thlm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
391 : rtm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
393 : press(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
396 : wm(i,k) = mono_cubic_interp( gr%zt(i,k), km1, k00, kp1, kp2, z(km1), z(k00), z(kp1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
413 : edsclr_snd(km1,edsclr), edsclr_snd(k00,edsclr), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
414 : edsclr_snd(kp1,edsclr), edsclr_snd(kp2,edsclr) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
438 : um(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), u(k_above), u(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
439 : vm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), v(k_above), v(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
440 : ugm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), ug(k_above), ug(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
441 : vgm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), vg(k_above), vg(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
442 : thlm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), theta(k_above), theta(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
443 : rtm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), rt(k_above), rt(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
444 : press(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), p_in_Pa(k_above), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
446 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
450 : sclrm(i,k,sclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
456 : edsclrm(i,k,edsclr) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
485 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
511 : wm(i,k) = lin_interpolate_two_points( gr%zt(i,k), z(k_above), z(k_above-1), subs(k_above), subs(k_above-1) )
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/sounding.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Expected read_random_seed for end function.
CLUBBStandardsCheck.pl WARNING: Endings of either program, module, subroutine, or function blocks to not match the beginning
../src/error.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1710 : allocate( um_ref(ngrdcol, gr%nzt) ) ! Reference u wind for nudging; Michael Falk, 17 Oct 2007
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1711 : allocate( vm_ref(ngrdcol, gr%nzt) ) ! Reference v wind for nudging; Michael Falk, 17 Oct 2007
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2129 : um(i,:), upwp(i,:), vm(i,:), vpwp(i,:), up2(i,:), vp2(i,:), rtm(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2130 : wprtp(i,:), thlm(i,:), wpthlp(i,:), rtp2(i,:), rtp3(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2133 : wpthvp(i,:), wp2thvp(i,:), rtpthvp(i,:), thlpthvp(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2134 : wp2rtp(i,:), wp2thlp(i,:), uprcp(i,:), vprcp(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2135 : rc_coef_zm(i,:), wp4(i,:), wpup2(i,:), wpvp2(i,:), wp2up2(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2137 : wm_zt(i,:), rho(i,:), rho_zm(i,:), rho_ds_zm(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2142 : hydromet(i,:,:), hydrometp2(i,:,:), wphydrometp(i,:,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2143 : Ncm(i,:), Nccnm(i,:), thvm(i,:), em(i,:), tau_zm(i,:), tau_zt(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2144 : Kh_zt(i,:), Kh_zm(i,:), ug(i,:), vg(i,:), Lscale(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2189 : ! Initialize statistics output, note that this will allocate/initialize stats variables for all
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2210 : ! Initialize statistics output, note that this will allocate/initialize stats variables for all
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2348 : um(i,:), upwp(i,:), vm(i,:), vpwp(i,:), up2(i,:), vp2(i,:), rtm(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2349 : wprtp(i,:), thlm(i,:), wpthlp(i,:), rtp2(i,:), rtp3(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2350 : thlp2(i,:), thlp3(i,:), rtpthlp(i,:), wp2(i,:), wp3(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2354 : rc_coef_zm(i,:), wp4(i,:), wpup2(i,:), wpvp2(i,:), wp2up2(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2362 : Ncm(i,:), Nccnm(i,:), thvm(i,:), em(i,:), tau_zm(i,:), tau_zt(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2373 : wp2_zt = max( zm2zt( gr%nzm, gr%nzt, ngrdcol, gr, wp2 ), w_tol_sqd ) ! Positive definite quantity
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2389 : um(i,:), vm(i,:), rtm(i,:), wprtp(i,:), thlm(i,:), wpthlp(i,:), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2423 : rtm(i,:), wm_zm(i,:), wm_zt(i,:), ug(i,:), vg(i,:), um_ref(i,:), vm_ref(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2426 : rtp2_forcing(i,:), thlp2_forcing(i,:), rtpthlp_forcing(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2427 : wpsclrp(i,:,:), sclrm_forcing(i,:,:), edsclrm_forcing(i,:,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2546 : wp2_zt = max( zm2zt( gr%nzm, gr%nzt, ngrdcol, gr, wp2 ), w_tol_sqd ) ! Positive definite quantity
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2552 : call setup_pdf_parameters( gr, gr%nzm, gr%nzt, ngrdcol, pdf_dim, hydromet_dim, dt_main, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2553 : Nc_in_cloud, cloud_frac, Kh_zm, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2554 : ice_supersat_frac, hydromet, wphydrometp, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2555 : corr_array_n_cloud, corr_array_n_below, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2556 : hm_metadata, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2557 : pdf_params, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2558 : clubb_params, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2559 : clubb_config_flags%iiPDF_type, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2560 : l_use_precip_frac, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2561 : clubb_config_flags%l_predict_upwp_vpwp, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2562 : clubb_config_flags%l_diagnose_correlations, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2563 : clubb_config_flags%l_calc_w_corr, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2564 : clubb_config_flags%l_const_Nc_in_cloud, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2565 : clubb_config_flags%l_fix_w_chi_eta_correlations, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2566 : stats_metadata, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2567 : stats_zt, stats_zm, stats_sfc, & ! In/Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2573 : precip_fracs, & ! In/Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2574 : hydromet_pdf_params ) ! Optional(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2594 : stats_zt(i), stats_zm(i), & ! In/Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2595 : rtphmp_zt(i,:,:), thlphmp_zt(i,:,:), wp2hmp(i,:,:) ) ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2644 : = max( zm2zt( gr, Kh_zm(i,:) / ( clubb_params(i,ic_K) * sqrt( max( em(i,:), em_min ) ) ) ), &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2722 : thlm(i,:), p_in_Pa(i,:), exner(i,:), rho(i,:), rho_zm(i,:), rtm(i,:), &! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2723 : rcm(i,:), cloud_frac(i,:), wm_zt(i,:), wm_zm(i,:), wp2_zt(i,:), & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2724 : hydromet(i,:,:), Nc_in_cloud(i,:), & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2740 : stats_zt(i), stats_zm(i), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2741 : stats_sfc(i), stats_lh_zt(i), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2743 : hydromet_mc(i,:,:), Ncm_mc(i,:), rcm_mc(i,:), rvm_mc(i,:), & ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2744 : thlm_mc(i,:), hydromet_vel_zt(i,:,:), & ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2747 : wprtp_mc(i,:), wpthlp_mc(i,:), rtp2_mc(i,:), & ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2748 : thlp2_mc(i,:), rtpthlp_mc(i,:) ) ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2786 : hydromet(i,:,:), hydromet_vel_zt(i,:,:), hydrometp2(i,:,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2787 : K_hm(i,:,:), Ncm(i,:), Nc_in_cloud(i,:), rvm_mc(i,:), thlm_mc(i,:), & ! Inout
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2810 : call stat_update_var( stats_metadata%iwprtp_mc, wprtp_mc, stats_zm(i) ) ! m*(kg/kg)/s^2
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2834 : time_current, time_initial, rho(i,:), rho_zm(i,:), & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2835 : p_in_Pa(i,:), exner(i,:), cloud_frac(i,:), ice_supersat_frac(i,:), X_nl_all_levs(i,:,:,:), & !In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2837 : lh_sample_point_weights(i,:,:), hydromet(i,:,:), & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2838 : stats_metadata, stats_sfc(i), & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2839 : radht(i,:), Frad(i,:), Frad_SW_up(i,:), Frad_LW_up(i,:), Frad_SW_down(i,:), Frad_LW_down(i,:) ) ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2912 : if ( ( stats_metadata%l_stats_last .or. stats_metadata%l_stats .or. l_output_multi_col ) .and. l_stdout ) then
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3359 : p_sfc(i), rtm_sfc(i), rtm(i,:), & ! Intent(in)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3361 : thlm(i,:), p_in_Pa(i,:), p_in_Pa_zm(i,:), & ! Intent(inout)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3362 : exner(i,:), rho(i,:), rho_zm(i,:), & ! Intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3363 : rcm(i,:), thvm(i,:), rho_ds_zm(i,:), & ! Intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3364 : rho_ds_zt(i,:), invrs_rho_ds_zm(i,:), & ! Intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3365 : invrs_rho_ds_zt(i,:), thv_ds_zm(i,:), & ! Intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
3366 : thv_ds_zt(i,:), sclrm(i,:,:), edsclrm(i,:,:) ) ! Intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
6567 : hm_metadata, stats_metadata, stats_sfc, & ! Intent(in)
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/clubb_driver.F90
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl has finished.
perl ../utilities/CLUBBStandardsCheck.pl ../src/CLUBB_core/*.F90
CLUBBStandardsCheck.pl has begun.
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Missing 'implicit none' statements. 'Implicit None' check FAILED!
CLUBBStandardsCheck.pl Add a line containing 'implicit none' to each program, module, subroutine, and function.
../src/CLUBB_core/mt95.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1241 : status = nf90_def_var( ncid_zm, "columns", NF90_DOUBLE, (/column_id_zm/), column_var_id_zm )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1242 : status = nf90_def_var( ncid_zm, "altitude", NF90_DOUBLE, (/vertical_id_zm/), vertical_var_id_zm )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1243 : status = nf90_def_var( ncid_zm, "time", NF90_DOUBLE, (/time_id_zm/), time_var_id_zm )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1300 : status = nf90_def_var( ncid_zt, "columns", NF90_DOUBLE, (/column_id_zt/), column_var_id_zt )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1301 : status = nf90_def_var( ncid_zt, "altitude", NF90_DOUBLE, (/vertical_id_zt/), vertical_var_id_zt )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1302 : status = nf90_def_var( ncid_zt, "time", NF90_DOUBLE, (/time_id_zt/), time_var_id_zt )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1381 : status = nf90_put_var( ncid_zm, ind_zm(1), wpthlp, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1382 : status = nf90_put_var( ncid_zm, ind_zm(2), wprtp, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1383 : status = nf90_put_var( ncid_zm, ind_zm(3), wp2, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1384 : status = nf90_put_var( ncid_zm, ind_zm(4), thlp2, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1385 : status = nf90_put_var( ncid_zm, ind_zm(5), rtp2, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1386 : status = nf90_put_var( ncid_zm, ind_zm(6), rtpthlp, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1387 : status = nf90_put_var( ncid_zm, ind_zm(7), upwp, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1388 : status = nf90_put_var( ncid_zm, ind_zm(8), vpwp, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1389 : status = nf90_put_var( ncid_zm, ind_zm(9), up2, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1390 : status = nf90_put_var( ncid_zm, ind_zm(10), vp2, (/1,1,n_calls/), (/ngrdcol,nzm,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1393 : status = nf90_put_var( ncid_zt, ind_zt(1), wp3, (/1,1,n_calls/), (/ngrdcol,nzt,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1394 : status = nf90_put_var( ncid_zt, ind_zt(2), rcm, (/1,1,n_calls/), (/ngrdcol,nzt,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1395 : status = nf90_put_var( ncid_zt, ind_zt(3), cloud_frac, (/1,1,n_calls/), (/ngrdcol,nzt,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1396 : status = nf90_put_var( ncid_zt, ind_zt(4), rtm, (/1,1,n_calls/), (/ngrdcol,nzt,1/) )
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1397 : status = nf90_put_var( ncid_zt, ind_zt(5), thlm, (/1,1,n_calls/), (/ngrdcol,nzt,1/) )
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/CLUBB_core/output_netcdf.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
718 : ! MONOFLUX TEST COMMENT DO NOT REMOVE if( any(wpxp_net_adjust /= 0.0) ) write(fstderr,*) "MONOFLUX: wpxp adjusted "
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/CLUBB_core/mono_flux_limiter.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1548 : !$acc data copyin( C_uu_shr_zeros, C_uu_shr_plus_one, C11_Skw_fnc_zeros, C11_Skw_fnc_plus_one ) &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1571 : lhs_wp3_pr2_term ) ! intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
2677 : !$acc data copyin( C_uu_buoy_zeros, C_uu_buoy_plus_one, C11_Skw_fnc_zeros, C11_Skw_fnc_plus_one ) &
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/CLUBB_core/advance_wp2_wp3_module.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
709 : call stats_zero( stats_zt(i)%ii, stats_zt(i)%jj, stats_zt(i)%kk, stats_zt(i)%num_output_fields, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
710 : stats_zt(i)%accum_field_values, stats_zt(i)%accum_num_samples, stats_zt(i)%l_in_update ) ! Out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
738 : call open_netcdf_for_writing( nlat, nlon, fdir, fname, 1, stats_zt(1)%kk, stats_zt(1)%z, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
817 : allocate( stats_lh_zt(i)%l_in_update( stats_lh_zt(i)%ii, stats_lh_zt(i)%jj, stats_lh_zt(i)%kk, &
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1148 : call stats_zero( stats_zm(i)%ii, stats_zm(i)%jj, stats_zm(i)%kk, stats_zm(i)%num_output_fields, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1149 : stats_zm(i)%accum_field_values, stats_zm(i)%accum_num_samples, stats_zm(i)%l_in_update ) ! intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1174 : call open_netcdf_for_writing( nlat, nlon, fdir, fname, 1, stats_zm(1)%kk, stats_zm(1)%z, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1238 : stats_rad_zt(i)%accum_num_samples, stats_rad_zt(i)%l_in_update )! intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1325 : stats_rad_zm(i)%accum_num_samples, stats_rad_zm(i)%l_in_update ) ! intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1415 : call stats_zero( stats_sfc(i)%ii, stats_sfc(i)%jj, stats_sfc(i)%kk, stats_sfc(i)%num_output_fields, & ! In
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1416 : stats_sfc(i)%accum_field_values, stats_sfc(i)%accum_num_samples, stats_sfc(i)%l_in_update ) ! out
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1440 : call open_netcdf_for_writing( nlat, nlon, fdir, fname, 1, stats_sfc(1)%kk, stats_sfc(1)%z, & ! In
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/CLUBB_core/stats_clubb_utilities.F90
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1916 : rhs_bp ) ! intent(out)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1921 : call wpxp_terms_bp_pr3_rhs( nzm, ngrdcol, C7_Skw_fnc_plus_one, thv_ds_zm, xpthvp, & ! intent(in)
CLUBBStandardsCheck.pl WARNING: Line has exceeded 100 characters.
1922 : rhs_pr3 ) ! intent(out)
CLUBBStandardsCheck.pl WARNING: File has lines that exceed 100 characters.
../src/CLUBB_core/advance_xm_wpxp_module.F90
--------------------------------------------------------------------------------
CLUBBStandardsCheck.pl has finished.
perl ../utilities/CLUBBStandardsCheck.pl ../src/Benchmark_cases/*.F90
CLUBBStandardsCheck.pl has begun.
CLUBBStandardsCheck.pl has finished.
perl ../utilities/CLUBBStandardsCheck.pl ../src/KK_microphys/*.F90
CLUBBStandardsCheck.pl has begun.
CLUBBStandardsCheck.pl has finished.
perl ../utilities/CLUBBStandardsCheck.pl ../src/SILHS/*.F90
CLUBBStandardsCheck.pl has begun.
CLUBBStandardsCheck.pl has finished.
perl ../utilities/CLUBBStandardsCheck.pl ../src/G_unit_test_types/*.F90
CLUBBStandardsCheck.pl has begun.
CLUBBStandardsCheck.pl has finished.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run GPU_ACC)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load nvhpc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ run_scripts/run_scm_all.bash -i
Performing priority-cases run
Running arm
Running arm_97
Running atex
Running bomex
Running cgils_s6
Running cgils_s11
Running cgils_s12
Running dycoms2_rf01
Running dycoms2_rf01_fixed_sst
Running dycoms2_rf02_ds
Running dycoms2_rf02_nd
Running gabls3_night
Running lba
Running mpace_b
Running rico
Running twp_ice
Running wangara
All cases ran to completion.
+ mv output gpu_7726602
+ mkdir output
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Plot)
[Pipeline] sh
+ scp -r carson:/home/pub/clubb_nvhpc_gpu_plots/master/cur_out .
[Pipeline] sh
++ cat cur_out/commit
+ python postprocessing/pyplotgen/pyplotgen.py -l -c cpu_7726602 gpu_7726602 cur_out/cpu_f8d7cc4 cur_out/gpu_f8d7cc4 -o 7726602_vs_master_f8d7cc4
*******************************************
Welcome to PyPlotGen.
*******************************************
Checking for model benchmark output...
Benchmark output found in /home/pub/les_and_clubb_benchmark_runs/.
-------------------------------------------
Running...
----------
NOTE: If processing multiple cases (ARM, BOMEX, etc.) with multithreading,
the total number of panels to be processed may increase as threads complete
and begin processing new cases.
----------
Progress: 0 of ? total .png panels complete
Progress: 5 of 98 total .png panels complete
Progress: 7 of 166 total .png panels complete
Progress: 8 of 224 total .png panels complete
Progress: 10 of 282 total .png panels complete
Progress: 13 of 282 total .png panels complete
Progress: 17 of 282 total .png panels complete
Progress: 21 of 359 total .png panels complete
Progress: 26 of 359 total .png panels complete
Progress: 32 of 359 total .png panels complete
Progress: 38 of 359 total .png panels complete
Progress: 43 of 359 total .png panels complete
Progress: 48 of 359 total .png panels complete
Progress: 54 of 359 total .png panels complete
Progress: 59 of 359 total .png panels complete
Progress: 64 of 359 total .png panels complete
Progress: 70 of 359 total .png panels complete
Progress: 79 of 435 total .png panels complete
Progress: 85 of 435 total .png panels complete
Progress: 91 of 435 total .png panels complete
Progress: 98 of 435 total .png panels complete
Progress: 104 of 435 total .png panels complete
Progress: 110 of 435 total .png panels complete
Progress: 117 of 435 total .png panels complete
Progress: 125 of 435 total .png panels complete
Progress: 135 of 435 total .png panels complete
Progress: 143 of 435 total .png panels complete
Progress: 150 of 435 total .png panels complete
Progress: 161 of 435 total .png panels complete
Progress: 167 of 435 total .png panels complete
Progress: 170 of 435 total .png panels complete
Progress: 176 of 492 total .png panels complete
Progress: 183 of 492 total .png panels complete
Progress: 192 of 492 total .png panels complete
Progress: 198 of 492 total .png panels complete
Progress: 206 of 492 total .png panels complete
Progress: 211 of 492 total .png panels complete
Progress: 219 of 492 total .png panels complete
Progress: 226 of 492 total .png panels complete
Progress: 234 of 492 total .png panels complete
Progress: 244 of 492 total .png panels complete
Progress: 252 of 492 total .png panels complete
Progress: 261 of 492 total .png panels complete
Progress: 267 of 492 total .png panels complete
Progress: 274 of 492 total .png panels complete
Progress: 280 of 492 total .png panels complete
Progress: 287 of 492 total .png panels complete
Progress: 294 of 492 total .png panels complete
Progress: 300 of 492 total .png panels complete
Progress: 306 of 492 total .png panels complete
Progress: 313 of 492 total .png panels complete
Progress: 320 of 492 total .png panels complete
Progress: 327 of 492 total .png panels complete
Progress: 334 of 492 total .png panels complete
Progress: 341 of 492 total .png panels complete
Progress: 415 of 619 total .png panels complete
Progress: 421 of 619 total .png panels complete
Progress: 428 of 619 total .png panels complete
Progress: 435 of 619 total .png panels complete
Progress: 442 of 619 total .png panels complete
Progress: 447 of 619 total .png panels complete
Progress: 452 of 619 total .png panels complete
Progress: 459 of 619 total .png panels complete
Progress: 465 of 658 total .png panels complete
Progress: 470 of 658 total .png panels complete
Progress: 476 of 658 total .png panels complete
Progress: 481 of 658 total .png panels complete
Progress: 486 of 658 total .png panels complete
Progress: 492 of 658 total .png panels complete
Progress: 498 of 658 total .png panels complete
Progress: 504 of 658 total .png panels complete
Progress: 509 of 658 total .png panels complete
Progress: 515 of 711 total .png panels complete
Progress: 524 of 711 total .png panels complete
Progress: 530 of 711 total .png panels complete
Progress: 539 of 711 total .png panels complete
Progress: 543 of 711 total .png panels complete
Progress: 549 of 711 total .png panels complete
Progress: 554 of 711 total .png panels complete
Progress: 562 of 711 total .png panels complete
Progress: 569 of 711 total .png panels complete
Progress: 574 of 711 total .png panels complete
Progress: 578 of 711 total .png panels complete
Progress: 583 of 711 total .png panels complete
Progress: 590 of 711 total .png panels complete
Progress: 595 of 771 total .png panels complete
Progress: 599 of 771 total .png panels complete
Progress: 604 of 771 total .png panels complete
Progress: 609 of 771 total .png panels complete
Progress: 613 of 771 total .png panels complete
Progress: 617 of 771 total .png panels complete
Progress: 622 of 771 total .png panels complete
Progress: 626 of 840 total .png panels complete
Progress: 631 of 840 total .png panels complete
Progress: 638 of 840 total .png panels complete
Progress: 644 of 840 total .png panels complete
Progress: 649 of 840 total .png panels complete
Progress: 655 of 840 total .png panels complete
Progress: 661 of 840 total .png panels complete
Progress: 667 of 840 total .png panels complete
Progress: 674 of 840 total .png panels complete
Progress: 679 of 840 total .png panels complete
Progress: 682 of 840 total .png panels complete
Progress: 688 of 840 total .png panels complete
Progress: 692 of 840 total .png panels complete
Progress: 697 of 840 total .png panels complete
Progress: 702 of 840 total .png panels complete
Progress: 706 of 840 total .png panels complete
Progress: 711 of 840 total .png panels complete
Progress: 1 of 44 total .png panels complete
Progress: 2 of 98 total .png panels complete
Progress: 3 of 98 total .png panels complete
Progress: 4 of 98 total .png panels complete
Progress: 6 of 166 total .png panels complete
Progress: 9 of 224 total .png panels complete
Progress: 12 of 282 total .png panels complete
Progress: 16 of 282 total .png panels complete
Progress: 20 of 282 total .png panels complete
Progress: 25 of 359 total .png panels complete
Progress: 30 of 359 total .png panels complete
Progress: 34 of 359 total .png panels complete
Progress: 40 of 359 total .png panels complete
Progress: 46 of 359 total .png panels complete
Progress: 52 of 359 total .png panels complete
Progress: 58 of 359 total .png panels complete
Progress: 66 of 359 total .png panels complete
Progress: 72 of 359 total .png panels complete
Progress: 77 of 435 total .png panels complete
Progress: 84 of 435 total .png panels complete
Progress: 90 of 435 total .png panels complete
Progress: 97 of 435 total .png panels complete
Progress: 103 of 435 total .png panels complete
Progress: 109 of 435 total .png panels complete
Progress: 116 of 435 total .png panels complete
Progress: 123 of 435 total .png panels complete
Progress: 132 of 435 total .png panels complete
Progress: 147 of 435 total .png panels complete
Progress: 154 of 435 total .png panels complete
Progress: 160 of 435 total .png panels complete
Progress: 165 of 435 total .png panels complete
Progress: 173 of 435 total .png panels complete
Progress: 178 of 492 total .png panels complete
Progress: 185 of 492 total .png panels complete
Progress: 193 of 492 total .png panels complete
Progress: 201 of 492 total .png panels complete
Progress: 208 of 492 total .png panels complete
Progress: 215 of 492 total .png panels complete
Progress: 225 of 492 total .png panels complete
Progress: 233 of 492 total .png panels complete
Progress: 240 of 492 total .png panels complete
Progress: 249 of 492 total .png panels complete
Progress: 258 of 492 total .png panels complete
Progress: 266 of 492 total .png panels complete
Progress: 384 of 565 total .png panels complete
Progress: 390 of 565 total .png panels complete
Progress: 396 of 565 total .png panels complete
Progress: 402 of 565 total .png panels complete
Progress: 410 of 619 total .png panels complete
Progress: 416 of 619 total .png panels complete
Progress: 423 of 619 total .png panels complete
Progress: 431 of 619 total .png panels complete
Progress: 438 of 619 total .png panels complete
Progress: 444 of 619 total .png panels complete
Progress: 449 of 619 total .png panels complete
Progress: 454 of 619 total .png panels complete
Progress: 458 of 619 total .png panels complete
Progress: 462 of 658 total .png panels complete
Progress: 469 of 658 total .png panels complete
Progress: 475 of 658 total .png panels complete
Progress: 484 of 658 total .png panels complete
Progress: 490 of 658 total .png panels complete
Progress: 494 of 658 total .png panels complete
Progress: 499 of 658 total .png panels complete
Progress: 505 of 658 total .png panels complete
Progress: 512 of 658 total .png panels complete
Progress: 517 of 711 total .png panels complete
Progress: 523 of 711 total .png panels complete
Progress: 531 of 711 total .png panels complete
Progress: 538 of 711 total .png panels complete
Progress: 548 of 711 total .png panels complete
Progress: 559 of 711 total .png panels complete
Progress: 564 of 711 total .png panels complete
Progress: 568 of 711 total .png panels complete
Progress: 573 of 711 total .png panels complete
Progress: 579 of 711 total .png panels complete
Progress: 584 of 711 total .png panels complete
Progress: 588 of 711 total .png panels complete
Progress: 594 of 771 total .png panels complete
Progress: 598 of 771 total .png panels complete
Progress: 603 of 771 total .png panels complete
Progress: 607 of 771 total .png panels complete
Progress: 614 of 771 total .png panels complete
Progress: 619 of 771 total .png panels complete
Progress: 624 of 840 total .png panels complete
Progress: 630 of 840 total .png panels complete
Progress: 636 of 840 total .png panels complete
Progress: 642 of 840 total .png panels complete
Progress: 648 of 840 total .png panels complete
Progress: 654 of 840 total .png panels complete
Progress: 659 of 840 total .png panels complete
Progress: 665 of 840 total .png panels complete
Progress: 670 of 840 total .png panels complete
Progress: 676 of 840 total .png panels complete
Progress: 684 of 840 total .png panels complete
Progress: 690 of 840 total .png panels complete
Progress: 695 of 840 total .png panels complete
Progress: 700 of 840 total .png panels complete
Progress: 705 of 840 total .png panels complete
Progress: 709 of 840 total .png panels complete
Progress: 714 of 840 total .png panels complete
Progress: 716 of 840 total .png panels complete
Progress: 719 of 840 total .png panels complete
Progress: 723 of 840 total .png panels complete
Progress: 728 of 840 total .png panels complete
Progress: 732 of 840 total .png panels complete
Progress: 735 of 840 total .png panels complete
Progress: 740 of 840 total .png panels complete
Progress: 744 of 840 total .png panels complete
Progress: 747 of 840 total .png panels complete
Progress: 754 of 840 total .png panels complete
Progress: 758 of 898 total .png panels complete
Progress: 763 of 898 total .png panels complete
Progress: 768 of 898 total .png panels complete
Progress: 774 of 898 total .png panels complete
Progress: 781 of 975 total .png panels complete
Progress: 786 of 975 total .png panels complete
Progress: 11 of 282 total .png panels complete
Progress: 15 of 282 total .png panels complete
Progress: 19 of 282 total .png panels complete
Progress: 24 of 359 total .png panels complete
Progress: 29 of 359 total .png panels complete
Progress: 33 of 359 total .png panels complete
Progress: 39 of 359 total .png panels complete
Progress: 45 of 359 total .png panels complete
Progress: 50 of 359 total .png panels complete
Progress: 56 of 359 total .png panels complete
Progress: 62 of 359 total .png panels complete
Progress: 68 of 359 total .png panels complete
Progress: 74 of 359 total .png panels complete
Progress: 80 of 435 total .png panels complete
Progress: 86 of 435 total .png panels complete
Progress: 92 of 435 total .png panels complete
Progress: 101 of 435 total .png panels complete
Progress: 108 of 435 total .png panels complete
Progress: 115 of 435 total .png panels complete
Progress: 122 of 435 total .png panels complete
Progress: 129 of 435 total .png panels complete
Progress: 133 of 435 total .png panels complete
Progress: 139 of 435 total .png panels complete
Progress: 145 of 435 total .png panels complete
Progress: 152 of 435 total .png panels complete
Progress: 158 of 435 total .png panels complete
Progress: 168 of 435 total .png panels complete
Progress: 181 of 492 total .png panels complete
Progress: 188 of 492 total .png panels complete
Progress: 195 of 492 total .png panels complete
Progress: 199 of 492 total .png panels complete
Progress: 207 of 492 total .png panels complete
Progress: 213 of 492 total .png panels complete
Progress: 221 of 492 total .png panels complete
Progress: 229 of 492 total .png panels complete
Progress: 239 of 492 total .png panels complete
Progress: 245 of 492 total .png panels complete
Progress: 253 of 492 total .png panels complete
Progress: 260 of 492 total .png panels complete
Progress: 270 of 492 total .png panels complete
Progress: 275 of 492 total .png panels complete
Progress: 282 of 492 total .png panels complete
Progress: 288 of 492 total .png panels complete
Progress: 295 of 492 total .png panels complete
Progress: 302 of 492 total .png panels complete
Progress: 308 of 492 total .png panels complete
Progress: 316 of 492 total .png panels complete
Progress: 322 of 492 total .png panels complete
Progress: 328 of 492 total .png panels complete
Progress: 335 of 492 total .png panels complete
Progress: 346 of 492 total .png panels complete
Progress: 351 of 492 total .png panels complete
Progress: 357 of 492 total .png panels complete
Progress: 363 of 492 total .png panels complete
Progress: 369 of 492 total .png panels complete
Progress: 373 of 492 total .png panels complete
Progress: 378 of 565 total .png panels complete
Progress: 383 of 565 total .png panels complete
Progress: 389 of 565 total .png panels complete
Progress: 394 of 565 total .png panels complete
Progress: 399 of 565 total .png panels complete
Progress: 407 of 565 total .png panels complete
Progress: 413 of 619 total .png panels complete
Progress: 420 of 619 total .png panels complete
Progress: 427 of 619 total .png panels complete
Progress: 432 of 619 total .png panels complete
Progress: 439 of 619 total .png panels complete
Progress: 445 of 619 total .png panels complete
Progress: 596 of 771 total .png panels complete
Progress: 600 of 771 total .png panels complete
Progress: 605 of 771 total .png panels complete
Progress: 612 of 771 total .png panels complete
Progress: 615 of 771 total .png panels complete
Progress: 621 of 771 total .png panels complete
Progress: 628 of 840 total .png panels complete
Progress: 634 of 840 total .png panels complete
Progress: 640 of 840 total .png panels complete
Progress: 645 of 840 total .png panels complete
Progress: 651 of 840 total .png panels complete
Progress: 657 of 840 total .png panels complete
Progress: 663 of 840 total .png panels complete
Progress: 669 of 840 total .png panels complete
Progress: 675 of 840 total .png panels complete
Progress: 685 of 840 total .png panels complete
Progress: 691 of 840 total .png panels complete
Progress: 696 of 840 total .png panels complete
Progress: 701 of 840 total .png panels complete
Progress: 708 of 840 total .png panels complete
Progress: 713 of 840 total .png panels complete
Progress: 718 of 840 total .png panels complete
Progress: 721 of 840 total .png panels complete
Progress: 724 of 840 total .png panels complete
Progress: 727 of 840 total .png panels complete
Progress: 729 of 840 total .png panels complete
Progress: 738 of 840 total .png panels complete
Progress: 745 of 840 total .png panels complete
Progress: 748 of 840 total .png panels complete
Progress: 752 of 840 total .png panels complete
Progress: 757 of 898 total .png panels complete
Progress: 762 of 898 total .png panels complete
Progress: 767 of 898 total .png panels complete
Progress: 772 of 898 total .png panels complete
Progress: 779 of 975 total .png panels complete
Progress: 784 of 975 total .png panels complete
Progress: 791 of 975 total .png panels complete
Progress: 794 of 975 total .png panels complete
Progress: 800 of 975 total .png panels complete
Progress: 806 of 975 total .png panels complete
Progress: 812 of 975 total .png panels complete
Progress: 817 of 975 total .png panels complete
Progress: 824 of 975 total .png panels complete
Progress: 830 of 975 total .png panels complete
Progress: 834 of 975 total .png panels complete
Progress: 838 of 975 total .png panels complete
Progress: 842 of 975 total .png panels complete
Progress: 848 of 975 total .png panels complete
Progress: 852 of 975 total .png panels complete
Progress: 857 of 975 total .png panels complete
Progress: 861 of 975 total .png panels complete
Progress: 867 of 975 total .png panels complete
Progress: 872 of 975 total .png panels complete
Progress: 878 of 975 total .png panels complete
Progress: 885 of 975 total .png panels complete
Progress: 892 of 975 total .png panels complete
Progress: 897 of 975 total .png panels complete
Progress: 902 of 975 total .png panels complete
Progress: 904 of 975 total .png panels complete
Progress: 908 of 975 total .png panels complete
Progress: 23 of 359 total .png panels complete
Progress: 28 of 359 total .png panels complete
Progress: 35 of 359 total .png panels complete
Progress: 42 of 359 total .png panels complete
Progress: 51 of 359 total .png panels complete
Progress: 57 of 359 total .png panels complete
Progress: 63 of 359 total .png panels complete
Progress: 69 of 359 total .png panels complete
Progress: 75 of 435 total .png panels complete
Progress: 81 of 435 total .png panels complete
Progress: 87 of 435 total .png panels complete
Progress: 93 of 435 total .png panels complete
Progress: 102 of 435 total .png panels complete
Progress: 111 of 435 total .png panels complete
Progress: 119 of 435 total .png panels complete
Progress: 126 of 435 total .png panels complete
Progress: 136 of 435 total .png panels complete
Progress: 141 of 435 total .png panels complete
Progress: 148 of 435 total .png panels complete
Progress: 156 of 435 total .png panels complete
Progress: 164 of 435 total .png panels complete
Progress: 174 of 435 total .png panels complete
Progress: 179 of 492 total .png panels complete
Progress: 187 of 492 total .png panels complete
Progress: 194 of 492 total .png panels complete
Progress: 200 of 492 total .png panels complete
Progress: 217 of 492 total .png panels complete
Progress: 227 of 492 total .png panels complete
Progress: 235 of 492 total .png panels complete
Progress: 242 of 492 total .png panels complete
Progress: 250 of 492 total .png panels complete
Progress: 257 of 492 total .png panels complete
Progress: 265 of 492 total .png panels complete
Progress: 271 of 492 total .png panels complete
Progress: 277 of 492 total .png panels complete
Progress: 284 of 492 total .png panels complete
Progress: 293 of 492 total .png panels complete
Progress: 301 of 492 total .png panels complete
Progress: 310 of 492 total .png panels complete
Progress: 319 of 492 total .png panels complete
Progress: 326 of 492 total .png panels complete
Progress: 333 of 492 total .png panels complete
Progress: 340 of 492 total .png panels complete
Progress: 347 of 492 total .png panels complete
Progress: 352 of 492 total .png panels complete
Progress: 358 of 492 total .png panels complete
Progress: 364 of 492 total .png panels complete
Progress: 370 of 492 total .png panels complete
Progress: 374 of 492 total .png panels complete
Progress: 385 of 565 total .png panels complete
Progress: 391 of 565 total .png panels complete
Progress: 397 of 565 total .png panels complete
Progress: 403 of 565 total .png panels complete
Progress: 409 of 619 total .png panels complete
Progress: 417 of 619 total .png panels complete
Progress: 425 of 619 total .png panels complete
Progress: 433 of 619 total .png panels complete
Progress: 440 of 619 total .png panels complete
Progress: 519 of 711 total .png panels complete
Progress: 528 of 711 total .png panels complete
Progress: 535 of 711 total .png panels complete
Progress: 541 of 711 total .png panels complete
Progress: 546 of 711 total .png panels complete
Progress: 552 of 711 total .png panels complete
Progress: 556 of 711 total .png panels complete
Progress: 561 of 711 total .png panels complete
Progress: 567 of 711 total .png panels complete
Progress: 572 of 711 total .png panels complete
Progress: 577 of 711 total .png panels complete
Progress: 582 of 711 total .png panels complete
Progress: 587 of 711 total .png panels complete
Progress: 592 of 771 total .png panels complete
Progress: 597 of 771 total .png panels complete
Progress: 602 of 771 total .png panels complete
Progress: 606 of 771 total .png panels complete
Progress: 611 of 771 total .png panels complete
Progress: 616 of 771 total .png panels complete
Progress: 620 of 771 total .png panels complete
Progress: 625 of 840 total .png panels complete
Progress: 633 of 840 total .png panels complete
Progress: 639 of 840 total .png panels complete
Progress: 650 of 840 total .png panels complete
Progress: 660 of 840 total .png panels complete
Progress: 666 of 840 total .png panels complete
Progress: 672 of 840 total .png panels complete
Progress: 678 of 840 total .png panels complete
Progress: 681 of 840 total .png panels complete
Progress: 687 of 840 total .png panels complete
Progress: 693 of 840 total .png panels complete
Progress: 699 of 840 total .png panels complete
Progress: 704 of 840 total .png panels complete
Progress: 710 of 840 total .png panels complete
Progress: 715 of 840 total .png panels complete
Progress: 720 of 840 total .png panels complete
Progress: 725 of 840 total .png panels complete
Progress: 731 of 840 total .png panels complete
Progress: 733 of 840 total .png panels complete
Progress: 736 of 840 total .png panels complete
Progress: 739 of 840 total .png panels complete
Progress: 741 of 840 total .png panels complete
Progress: 742 of 840 total .png panels complete
Progress: 746 of 840 total .png panels complete
Progress: 750 of 840 total .png panels complete
Progress: 753 of 840 total .png panels complete
Progress: 759 of 898 total .png panels complete
Progress: 764 of 898 total .png panels complete
Progress: 770 of 898 total .png panels complete
Progress: 773 of 898 total .png panels complete
Progress: 777 of 898 total .png panels complete
Progress: 782 of 975 total .png panels complete
Progress: 788 of 975 total .png panels complete
Progress: 95 of 435 total .png panels complete
Progress: 99 of 435 total .png panels complete
Progress: 106 of 435 total .png panels complete
Progress: 114 of 435 total .png panels complete
Progress: 120 of 435 total .png panels complete
Progress: 128 of 435 total .png panels complete
Progress: 131 of 435 total .png panels complete
Progress: 138 of 435 total .png panels complete
Progress: 144 of 435 total .png panels complete
Progress: 151 of 435 total .png panels complete
Progress: 157 of 435 total .png panels complete
Progress: 163 of 435 total .png panels complete
Progress: 169 of 435 total .png panels complete
Progress: 175 of 435 total .png panels complete
Progress: 180 of 492 total .png panels complete
Progress: 186 of 492 total .png panels complete
Progress: 191 of 492 total .png panels complete
Progress: 202 of 492 total .png panels complete
Progress: 209 of 492 total .png panels complete
Progress: 214 of 492 total .png panels complete
Progress: 222 of 492 total .png panels complete
Progress: 228 of 492 total .png panels complete
Progress: 236 of 492 total .png panels complete
Progress: 243 of 492 total .png panels complete
Progress: 251 of 492 total .png panels complete
Progress: 259 of 492 total .png panels complete
Progress: 273 of 492 total .png panels complete
Progress: 281 of 492 total .png panels complete
Progress: 290 of 492 total .png panels complete
Progress: 297 of 492 total .png panels complete
Progress: 303 of 492 total .png panels complete
Progress: 309 of 492 total .png panels complete
Progress: 315 of 492 total .png panels complete
Progress: 321 of 492 total .png panels complete
Progress: 329 of 492 total .png panels complete
Progress: 337 of 492 total .png panels complete
Progress: 344 of 492 total .png panels complete
Progress: 349 of 492 total .png panels complete
Progress: 355 of 492 total .png panels complete
Progress: 360 of 492 total .png panels complete
Progress: 366 of 492 total .png panels complete
Progress: 377 of 492 total .png panels complete
Progress: 381 of 565 total .png panels complete
Progress: 387 of 565 total .png panels complete
Progress: 393 of 565 total .png panels complete
Progress: 398 of 565 total .png panels complete
Progress: 404 of 565 total .png panels complete
Progress: 408 of 565 total .png panels complete
Progress: 414 of 619 total .png panels complete
Progress: 422 of 619 total .png panels complete
Progress: 429 of 619 total .png panels complete
Progress: 436 of 619 total .png panels complete
Progress: 446 of 619 total .png panels complete
Progress: 450 of 619 total .png panels complete
Progress: 455 of 619 total .png panels complete
Progress: 461 of 619 total .png panels complete
Progress: 463 of 658 total .png panels complete
Progress: 468 of 658 total .png panels complete
Progress: 474 of 658 total .png panels complete
Progress: 479 of 658 total .png panels complete
Progress: 485 of 658 total .png panels complete
Progress: 488 of 658 total .png panels complete
Progress: 493 of 658 total .png panels complete
Progress: 502 of 658 total .png panels complete
Progress: 507 of 658 total .png panels complete
Progress: 511 of 658 total .png panels complete
Progress: 516 of 711 total .png panels complete
Progress: 521 of 711 total .png panels complete
Progress: 527 of 711 total .png panels complete
Progress: 533 of 711 total .png panels complete
Progress: 540 of 711 total .png panels complete
Progress: 545 of 711 total .png panels complete
Progress: 550 of 711 total .png panels complete
Progress: 555 of 711 total .png panels complete
Progress: 558 of 711 total .png panels complete
Progress: 563 of 711 total .png panels complete
Progress: 627 of 840 total .png panels complete
Progress: 632 of 840 total .png panels complete
Progress: 637 of 840 total .png panels complete
Progress: 643 of 840 total .png panels complete
Progress: 646 of 840 total .png panels complete
Progress: 653 of 840 total .png panels complete
Progress: 658 of 840 total .png panels complete
Progress: 664 of 840 total .png panels complete
Progress: 671 of 840 total .png panels complete
Progress: 677 of 840 total .png panels complete
Progress: 686 of 840 total .png panels complete
Progress: 689 of 840 total .png panels complete
Progress: 694 of 840 total .png panels complete
Progress: 698 of 840 total .png panels complete
Progress: 703 of 840 total .png panels complete
Progress: 707 of 840 total .png panels complete
Progress: 712 of 840 total .png panels complete
Progress: 717 of 840 total .png panels complete
Progress: 722 of 840 total .png panels complete
Progress: 726 of 840 total .png panels complete
Progress: 730 of 840 total .png panels complete
Progress: 734 of 840 total .png panels complete
Progress: 737 of 840 total .png panels complete
Progress: 743 of 840 total .png panels complete
Progress: 749 of 840 total .png panels complete
Progress: 751 of 840 total .png panels complete
Progress: 755 of 840 total .png panels complete
Progress: 756 of 898 total .png panels complete
Progress: 760 of 898 total .png panels complete
Progress: 765 of 898 total .png panels complete
Progress: 769 of 898 total .png panels complete
Progress: 775 of 898 total .png panels complete
Progress: 778 of 898 total .png panels complete
Progress: 785 of 975 total .png panels complete
Progress: 792 of 975 total .png panels complete
Progress: 796 of 975 total .png panels complete
Progress: 799 of 975 total .png panels complete
Progress: 802 of 975 total .png panels complete
Progress: 805 of 975 total .png panels complete
Progress: 809 of 975 total .png panels complete
Progress: 811 of 975 total .png panels complete
Progress: 815 of 975 total .png panels complete
Progress: 819 of 975 total .png panels complete
Progress: 822 of 975 total .png panels complete
Progress: 827 of 975 total .png panels complete
Progress: 831 of 975 total .png panels complete
Progress: 835 of 975 total .png panels complete
Progress: 840 of 975 total .png panels complete
Progress: 844 of 975 total .png panels complete
Progress: 847 of 975 total .png panels complete
Progress: 850 of 975 total .png panels complete
Progress: 853 of 975 total .png panels complete
Progress: 856 of 975 total .png panels complete
Progress: 860 of 975 total .png panels complete
Progress: 864 of 975 total .png panels complete
Progress: 868 of 975 total .png panels complete
Progress: 870 of 975 total .png panels complete
Progress: 874 of 975 total .png panels complete
Progress: 877 of 975 total .png panels complete
Progress: 881 of 975 total .png panels complete
Progress: 883 of 975 total .png panels complete
Progress: 887 of 975 total .png panels complete
Progress: 891 of 975 total .png panels complete
Progress: 893 of 975 total .png panels complete
Progress: 896 of 975 total .png panels complete
Progress: 900 of 975 total .png panels complete
Progress: 905 of 975 total .png panels complete
Progress: 910 of 975 total .png panels complete
Progress: 912 of 975 total .png panels complete
Progress: 14 of 282 total .png panels complete
Progress: 18 of 282 total .png panels complete
Progress: 22 of 359 total .png panels complete
Progress: 27 of 359 total .png panels complete
Progress: 31 of 359 total .png panels complete
Progress: 37 of 359 total .png panels complete
Progress: 44 of 359 total .png panels complete
Progress: 49 of 359 total .png panels complete
Progress: 55 of 359 total .png panels complete
Progress: 61 of 359 total .png panels complete
Progress: 67 of 359 total .png panels complete
Progress: 73 of 359 total .png panels complete
Progress: 78 of 435 total .png panels complete
Progress: 83 of 435 total .png panels complete
Progress: 89 of 435 total .png panels complete
Progress: 96 of 435 total .png panels complete
Progress: 105 of 435 total .png panels complete
Progress: 112 of 435 total .png panels complete
Progress: 118 of 435 total .png panels complete
Progress: 124 of 435 total .png panels complete
Progress: 130 of 435 total .png panels complete
Progress: 137 of 435 total .png panels complete
Progress: 142 of 435 total .png panels complete
Progress: 149 of 435 total .png panels complete
Progress: 155 of 435 total .png panels complete
Progress: 162 of 435 total .png panels complete
Progress: 172 of 435 total .png panels complete
Progress: 184 of 492 total .png panels complete
Progress: 190 of 492 total .png panels complete
Progress: 196 of 492 total .png panels complete
Progress: 204 of 492 total .png panels complete
Progress: 210 of 492 total .png panels complete
Progress: 216 of 492 total .png panels complete
Progress: 224 of 492 total .png panels complete
Progress: 232 of 492 total .png panels complete
Progress: 241 of 492 total .png panels complete
Progress: 248 of 492 total .png panels complete
Progress: 256 of 492 total .png panels complete
Progress: 263 of 492 total .png panels complete
Progress: 268 of 492 total .png panels complete
Progress: 279 of 492 total .png panels complete
Progress: 286 of 492 total .png panels complete
Progress: 291 of 492 total .png panels complete
Progress: 298 of 492 total .png panels complete
Progress: 304 of 492 total .png panels complete
Progress: 311 of 492 total .png panels complete
Progress: 317 of 492 total .png panels complete
Progress: 324 of 492 total .png panels complete
Progress: 332 of 492 total .png panels complete
Progress: 339 of 492 total .png panels complete
Progress: 345 of 492 total .png panels complete
Progress: 353 of 492 total .png panels complete
Progress: 359 of 492 total .png panels complete
Progress: 365 of 492 total .png panels complete
Progress: 371 of 492 total .png panels complete
Progress: 375 of 492 total .png panels complete
Progress: 380 of 565 total .png panels complete
Progress: 386 of 565 total .png panels complete
Progress: 467 of 658 total .png panels complete
Progress: 473 of 658 total .png panels complete
Progress: 480 of 658 total .png panels complete
Progress: 489 of 658 total .png panels complete
Progress: 495 of 658 total .png panels complete
Progress: 500 of 658 total .png panels complete
Progress: 506 of 658 total .png panels complete
Progress: 513 of 711 total .png panels complete
Progress: 520 of 711 total .png panels complete
Progress: 525 of 711 total .png panels complete
Progress: 532 of 711 total .png panels complete
Progress: 537 of 711 total .png panels complete
Progress: 542 of 711 total .png panels complete
Progress: 547 of 711 total .png panels complete
Progress: 553 of 711 total .png panels complete
Progress: 560 of 711 total .png panels complete
Progress: 566 of 711 total .png panels complete
Progress: 571 of 711 total .png panels complete
Progress: 575 of 711 total .png panels complete
Progress: 580 of 711 total .png panels complete
Progress: 585 of 711 total .png panels complete
Progress: 589 of 711 total .png panels complete
Progress: 593 of 771 total .png panels complete
Progress: 601 of 771 total .png panels complete
Progress: 608 of 771 total .png panels complete
Progress: 610 of 771 total .png panels complete
Progress: 618 of 771 total .png panels complete
Progress: 623 of 840 total .png panels complete
Progress: 629 of 840 total .png panels complete
Progress: 635 of 840 total .png panels complete
Progress: 641 of 840 total .png panels complete
Progress: 647 of 840 total .png panels complete
Progress: 652 of 840 total .png panels complete
Progress: 656 of 840 total .png panels complete
Progress: 662 of 840 total .png panels complete
Progress: 668 of 840 total .png panels complete
Progress: 673 of 840 total .png panels complete
Progress: 680 of 840 total .png panels complete
Progress: 683 of 840 total .png panels complete
Progress: 761 of 898 total .png panels complete
Progress: 766 of 898 total .png panels complete
Progress: 771 of 898 total .png panels complete
Progress: 776 of 898 total .png panels complete
Progress: 780 of 975 total .png panels complete
Progress: 787 of 975 total .png panels complete
Progress: 790 of 975 total .png panels complete
Progress: 795 of 975 total .png panels complete
Progress: 798 of 975 total .png panels complete
Progress: 803 of 975 total .png panels complete
Progress: 808 of 975 total .png panels complete
Progress: 810 of 975 total .png panels complete
Progress: 814 of 975 total .png panels complete
Progress: 818 of 975 total .png panels complete
Progress: 821 of 975 total .png panels complete
Progress: 825 of 975 total .png panels complete
Progress: 828 of 975 total .png panels complete
Progress: 832 of 975 total .png panels complete
Progress: 837 of 975 total .png panels complete
Progress: 841 of 975 total .png panels complete
Progress: 845 of 975 total .png panels complete
Progress: 851 of 975 total .png panels complete
Progress: 854 of 975 total .png panels complete
Progress: 858 of 975 total .png panels complete
Progress: 862 of 975 total .png panels complete
Progress: 865 of 975 total .png panels complete
Progress: 873 of 975 total .png panels complete
Progress: 876 of 975 total .png panels complete
Progress: 879 of 975 total .png panels complete
Progress: 882 of 975 total .png panels complete
Progress: 886 of 975 total .png panels complete
Progress: 889 of 975 total .png panels complete
Progress: 894 of 975 total .png panels complete
Progress: 898 of 975 total .png panels complete
Progress: 903 of 975 total .png panels complete
Progress: 907 of 975 total .png panels complete
Progress: 911 of 975 total .png panels complete
Progress: 914 of 975 total .png panels complete
Progress: 916 of 975 total .png panels complete
Progress: 918 of 975 total .png panels complete
Progress: 920 of 975 total .png panels complete
Progress: 922 of 975 total .png panels complete
Progress: 924 of 975 total .png panels complete
Progress: 926 of 975 total .png panels complete
Progress: 928 of 975 total .png panels complete
Progress: 930 of 975 total .png panels complete
Progress: 931 of 975 total .png panels complete
Progress: 933 of 975 total .png panels complete
Progress: 935 of 975 total .png panels complete
Progress: 937 of 975 total .png panels complete
Progress: 939 of 975 total .png panels complete
Progress: 940 of 975 total .png panels complete
Progress: 942 of 975 total .png panels complete
Progress: 944 of 975 total .png panels complete
Progress: 947 of 975 total .png panels complete
Progress: 949 of 975 total .png panels complete
Progress: 950 of 975 total .png panels complete
Progress: 952 of 975 total .png panels complete
Progress: 36 of 359 total .png panels complete
Progress: 41 of 359 total .png panels complete
Progress: 47 of 359 total .png panels complete
Progress: 53 of 359 total .png panels complete
Progress: 60 of 359 total .png panels complete
Progress: 65 of 359 total .png panels complete
Progress: 71 of 359 total .png panels complete
Progress: 76 of 435 total .png panels complete
Progress: 82 of 435 total .png panels complete
Progress: 88 of 435 total .png panels complete
Progress: 94 of 435 total .png panels complete
Progress: 100 of 435 total .png panels complete
Progress: 107 of 435 total .png panels complete
Progress: 113 of 435 total .png panels complete
Progress: 121 of 435 total .png panels complete
Progress: 127 of 435 total .png panels complete
Progress: 134 of 435 total .png panels complete
Progress: 140 of 435 total .png panels complete
Progress: 146 of 435 total .png panels complete
Progress: 153 of 435 total .png panels complete
Progress: 159 of 435 total .png panels complete
Progress: 166 of 435 total .png panels complete
Progress: 171 of 435 total .png panels complete
Progress: 177 of 492 total .png panels complete
Progress: 182 of 492 total .png panels complete
Progress: 189 of 492 total .png panels complete
Progress: 203 of 492 total .png panels complete
Progress: 218 of 492 total .png panels complete
Progress: 223 of 492 total .png panels complete
Progress: 231 of 492 total .png panels complete
Progress: 237 of 492 total .png panels complete
Progress: 246 of 492 total .png panels complete
Progress: 254 of 492 total .png panels complete
Progress: 262 of 492 total .png panels complete
Progress: 269 of 492 total .png panels complete
Progress: 276 of 492 total .png panels complete
Progress: 283 of 492 total .png panels complete
Progress: 289 of 492 total .png panels complete
Progress: 296 of 492 total .png panels complete
Progress: 305 of 492 total .png panels complete
Progress: 312 of 492 total .png panels complete
Progress: 318 of 492 total .png panels complete
Progress: 325 of 492 total .png panels complete
Progress: 331 of 492 total .png panels complete
Progress: 336 of 492 total .png panels complete
Progress: 342 of 492 total .png panels complete
Progress: 348 of 492 total .png panels complete
Progress: 354 of 492 total .png panels complete
Progress: 361 of 492 total .png panels complete
Progress: 367 of 492 total .png panels complete
Progress: 376 of 492 total .png panels complete
Progress: 382 of 565 total .png panels complete
Progress: 388 of 565 total .png panels complete
Progress: 395 of 565 total .png panels complete
Progress: 400 of 565 total .png panels complete
Progress: 406 of 565 total .png panels complete
Progress: 411 of 619 total .png panels complete
Progress: 418 of 619 total .png panels complete
Progress: 424 of 619 total .png panels complete
Progress: 430 of 619 total .png panels complete
Progress: 437 of 619 total .png panels complete
Progress: 443 of 619 total .png panels complete
Progress: 451 of 619 total .png panels complete
Progress: 456 of 619 total .png panels complete
Progress: 460 of 619 total .png panels complete
Progress: 466 of 658 total .png panels complete
Progress: 472 of 658 total .png panels complete
Progress: 478 of 658 total .png panels complete
Progress: 482 of 658 total .png panels complete
Progress: 487 of 658 total .png panels complete
Progress: 496 of 658 total .png panels complete
Progress: 501 of 658 total .png panels complete
Progress: 508 of 658 total .png panels complete
Progress: 514 of 711 total .png panels complete
Progress: 522 of 711 total .png panels complete
Progress: 529 of 711 total .png panels complete
Progress: 536 of 711 total .png panels complete
Progress: 783 of 975 total .png panels complete
Progress: 789 of 975 total .png panels complete
Progress: 793 of 975 total .png panels complete
Progress: 797 of 975 total .png panels complete
Progress: 801 of 975 total .png panels complete
Progress: 804 of 975 total .png panels complete
Progress: 807 of 975 total .png panels complete
Progress: 813 of 975 total .png panels complete
Progress: 816 of 975 total .png panels complete
Progress: 820 of 975 total .png panels complete
Progress: 823 of 975 total .png panels complete
Progress: 826 of 975 total .png panels complete
Progress: 829 of 975 total .png panels complete
Progress: 833 of 975 total .png panels complete
Progress: 836 of 975 total .png panels complete
Progress: 839 of 975 total .png panels complete
Progress: 843 of 975 total .png panels complete
Progress: 846 of 975 total .png panels complete
Progress: 849 of 975 total .png panels complete
Progress: 855 of 975 total .png panels complete
Progress: 859 of 975 total .png panels complete
Progress: 863 of 975 total .png panels complete
Progress: 866 of 975 total .png panels complete
Progress: 869 of 975 total .png panels complete
Progress: 871 of 975 total .png panels complete
Progress: 875 of 975 total .png panels complete
Progress: 880 of 975 total .png panels complete
Progress: 884 of 975 total .png panels complete
Progress: 888 of 975 total .png panels complete
Progress: 890 of 975 total .png panels complete
Progress: 895 of 975 total .png panels complete
Progress: 899 of 975 total .png panels complete
Progress: 901 of 975 total .png panels complete
Progress: 906 of 975 total .png panels complete
Progress: 909 of 975 total .png panels complete
Progress: 913 of 975 total .png panels complete
Progress: 915 of 975 total .png panels complete
Progress: 917 of 975 total .png panels complete
Progress: 919 of 975 total .png panels complete
Progress: 921 of 975 total .png panels complete
Progress: 923 of 975 total .png panels complete
Progress: 925 of 975 total .png panels complete
Progress: 927 of 975 total .png panels complete
Progress: 929 of 975 total .png panels complete
Progress: 932 of 975 total .png panels complete
Progress: 934 of 975 total .png panels complete
Progress: 936 of 975 total .png panels complete
Progress: 938 of 975 total .png panels complete
Progress: 941 of 975 total .png panels complete
Progress: 943 of 975 total .png panels complete
Progress: 945 of 975 total .png panels complete
Progress: 946 of 975 total .png panels complete
Progress: 948 of 975 total .png panels complete
Progress: 951 of 975 total .png panels complete
Progress: 953 of 975 total .png panels complete
Progress: 954 of 975 total .png panels complete
Progress: 955 of 975 total .png panels complete
Progress: 956 of 975 total .png panels complete
Progress: 957 of 975 total .png panels complete
Progress: 958 of 975 total .png panels complete
Progress: 959 of 975 total .png panels complete
Progress: 960 of 975 total .png panels complete
Progress: 961 of 975 total .png panels complete
Progress: 962 of 975 total .png panels complete
Progress: 963 of 975 total .png panels complete
Progress: 964 of 975 total .png panels complete
Progress: 965 of 975 total .png panels complete
Progress: 966 of 975 total .png panels complete
Progress: 967 of 975 total .png panels complete
Progress: 968 of 975 total .png panels complete
Progress: 969 of 975 total .png panels complete
Progress: 970 of 975 total .png panels complete
Progress: 971 of 975 total .png panels complete
Progress: 972 of 975 total .png panels complete
Progress: 973 of 975 total .png panels complete
Progress: 974 of 975 total .png panels complete
Progress: 975 of 975 total .png panels complete
Progress: 197 of 492 total .png panels complete
Progress: 205 of 492 total .png panels complete
Progress: 212 of 492 total .png panels complete
Progress: 220 of 492 total .png panels complete
Progress: 230 of 492 total .png panels complete
Progress: 238 of 492 total .png panels complete
Progress: 247 of 492 total .png panels complete
Progress: 255 of 492 total .png panels complete
Progress: 264 of 492 total .png panels complete
Progress: 272 of 492 total .png panels complete
Progress: 278 of 492 total .png panels complete
Progress: 285 of 492 total .png panels complete
Progress: 292 of 492 total .png panels complete
Progress: 299 of 492 total .png panels complete
Progress: 307 of 492 total .png panels complete
Progress: 314 of 492 total .png panels complete
Progress: 323 of 492 total .png panels complete
Progress: 330 of 492 total .png panels complete
Progress: 338 of 492 total .png panels complete
Progress: 343 of 492 total .png panels complete
Progress: 350 of 492 total .png panels complete
Progress: 356 of 492 total .png panels complete
Progress: 362 of 492 total .png panels complete
Progress: 368 of 492 total .png panels complete
Progress: 372 of 492 total .png panels complete
Progress: 379 of 565 total .png panels complete
Progress: 392 of 565 total .png panels complete
Progress: 401 of 565 total .png panels complete
Progress: 405 of 565 total .png panels complete
Progress: 412 of 619 total .png panels complete
Progress: 419 of 619 total .png panels complete
Progress: 427 of 619 total .png panels complete
Progress: 434 of 619 total .png panels complete
Progress: 441 of 619 total .png panels complete
Progress: 448 of 619 total .png panels complete
Progress: 453 of 619 total .png panels complete
Progress: 457 of 619 total .png panels complete
Progress: 464 of 658 total .png panels complete
Progress: 471 of 658 total .png panels complete
Progress: 477 of 658 total .png panels complete
Progress: 483 of 658 total .png panels complete
Progress: 491 of 658 total .png panels complete
Progress: 497 of 658 total .png panels complete
Progress: 503 of 658 total .png panels complete
Progress: 510 of 658 total .png panels complete
Progress: 518 of 711 total .png panels complete
Progress: 526 of 711 total .png panels complete
Progress: 534 of 711 total .png panels complete
Progress: 544 of 711 total .png panels complete
Progress: 551 of 711 total .png panels complete
Progress: 557 of 711 total .png panels complete
Progress: 565 of 711 total .png panels complete
Progress: 570 of 711 total .png panels complete
Progress: 576 of 711 total .png panels complete
Progress: 581 of 711 total .png panels complete
Progress: 586 of 711 total .png panels complete
Progress: 591 of 711 total .png panels complete
Progress: 976 of 1045 total .png panels complete
Progress: 977 of 1045 total .png panels complete
Progress: 978 of 1045 total .png panels complete
Progress: 979 of 1045 total .png panels complete
Progress: 980 of 1045 total .png panels complete
Progress: 981 of 1045 total .png panels complete
Progress: 982 of 1045 total .png panels complete
Progress: 983 of 1045 total .png panels complete
Progress: 984 of 1045 total .png panels complete
Progress: 985 of 1045 total .png panels complete
Progress: 986 of 1045 total .png panels complete
Progress: 987 of 1045 total .png panels complete
Progress: 988 of 1045 total .png panels complete
Progress: 989 of 1045 total .png panels complete
Progress: 990 of 1045 total .png panels complete
Progress: 991 of 1045 total .png panels complete
Progress: 992 of 1045 total .png panels complete
Progress: 993 of 1045 total .png panels complete
Progress: 994 of 1045 total .png panels complete
Progress: 995 of 1045 total .png panels complete
Progress: 996 of 1045 total .png panels complete
Progress: 997 of 1045 total .png panels complete
Progress: 998 of 1045 total .png panels complete
Progress: 999 of 1045 total .png panels complete
Progress: 1000 of 1045 total .png panels complete
Progress: 1001 of 1045 total .png panels complete
Progress: 1002 of 1045 total .png panels complete
Progress: 1003 of 1045 total .png panels complete
Progress: 1004 of 1045 total .png panels complete
Progress: 1005 of 1045 total .png panels complete
Progress: 1006 of 1045 total .png panels complete
Progress: 1007 of 1045 total .png panels complete
Progress: 1008 of 1045 total .png panels complete
Progress: 1009 of 1045 total .png panels complete
Progress: 1010 of 1045 total .png panels complete
Progress: 1011 of 1045 total .png panels complete
Progress: 1012 of 1045 total .png panels complete
Progress: 1013 of 1045 total .png panels complete
Progress: 1014 of 1045 total .png panels complete
Progress: 1015 of 1045 total .png panels complete
Progress: 1016 of 1045 total .png panels complete
Progress: 1017 of 1045 total .png panels complete
Progress: 1018 of 1045 total .png panels complete
Progress: 1019 of 1045 total .png panels complete
Progress: 1020 of 1045 total .png panels complete
Progress: 1021 of 1045 total .png panels complete
Progress: 1022 of 1045 total .png panels complete
Progress: 1023 of 1045 total .png panels complete
Progress: 1024 of 1045 total .png panels complete
Progress: 1025 of 1045 total .png panels complete
Progress: 1026 of 1045 total .png panels complete
Progress: 1027 of 1045 total .png panels complete
Progress: 1028 of 1045 total .png panels complete
Progress: 1029 of 1045 total .png panels complete
Progress: 1030 of 1045 total .png panels complete
Progress: 1031 of 1045 total .png panels complete
Progress: 1032 of 1045 total .png panels complete
Progress: 1033 of 1045 total .png panels complete
Progress: 1034 of 1045 total .png panels complete
Progress: 1035 of 1045 total .png panels complete
Progress: 1036 of 1045 total .png panels complete
Progress: 1037 of 1045 total .png panels complete
Progress: 1038 of 1045 total .png panels complete
Progress: 1039 of 1045 total .png panels complete
Progress: 1040 of 1045 total .png panels complete
Progress: 1041 of 1045 total .png panels complete
Progress: 1042 of 1045 total .png panels complete
Progress: 1043 of 1045 total .png panels complete
Progress: 1044 of 1045 total .png panels complete
Progress: 1045 of 1045 total .png panels complete
-------------------------------------------
ARM: SUCCESS --> Images found.
ARM_97: SUCCESS --> Images found.
ATEX: SUCCESS --> Images found.
BOMEX: SUCCESS --> Images found.
CGILS_S11: SUCCESS --> Images found.
CGILS_S12: SUCCESS --> Images found.
CGILS_S6: SUCCESS --> Images found.
DYCOMS2_RF01: SUCCESS --> Images found.
DYCOMS2_RF01_FIXED_SST: SUCCESS --> Images found.
DYCOMS2_RF02_DS: SUCCESS --> Images found.
DYCOMS2_RF02_ND: SUCCESS --> Images found.
GABLS3_NIGHT: SUCCESS --> Images found.
LBA: SUCCESS --> Images found.
MPACE_B: SUCCESS --> Images found.
RICO: SUCCESS --> Images found.
TWP_ICE: SUCCESS --> Images found.
WANGARA: SUCCESS --> Images found.
-------------------------------------------
Output can be viewed at file:///home/jenkins/workspace/clubb_nvhpc_gpu_vs_cpu_plot/7726602_vs_master_f8d7cc4/index.html with a web browser
Pyplotgen ran in 78 seconds.
See error.log in the output folder for detailed info including warnings.
error.log messages include:
24-10-20 04:30:52.127 proc_id: 1183614 Warning! Averaging over heights is not yet implemented.
[Pipeline] sh
+ ssh carson 'mkdir -p /home/pub/clubb_nvhpc_gpu_plots/master'
[Pipeline] sh
+ scp -r 7726602_vs_master_f8d7cc4 carson:/home/pub/clubb_nvhpc_gpu_plots/master
[Pipeline] sh
+ ssh carson '/home/pub/create_plot_list.py /home/pub/clubb_nvhpc_gpu_plots/'
/home/pub/clubb_nvhpc_gpu_plots/ updated successfully.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Update Master Output)
[Pipeline] sh
+ rm -rf cur_out
[Pipeline] sh
+ mkdir cur_out
[Pipeline] sh
+ mv cpu_7726602 gpu_7726602 cur_out
[Pipeline] sh
+ echo 7726602
[Pipeline] sh
+ ssh carson 'rm -rf /home/pub/clubb_nvhpc_gpu_plots/master/cur_out'
[Pipeline] sh
+ scp -r cur_out carson:/home/pub/clubb_nvhpc_gpu_plots/master/
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] cleanWs
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is used...
[WS-CLEANUP] done
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS