Skipping 566 KB..
Full LogTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTest
[833/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/corr_cholesky_mtx_tests.F90.o
[834/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/smooth_min_max_tests.F90.o
[835/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/cloud_sed_module.F90.o
[836/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/read_corr_mtx_test.F90.o
[837/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/KK_integrals_tests.F90.o
[838/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/spec_hum_to_mixing_ratio.F90.o
flux_spec_hum_to_mixing_ratio:
62, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
63, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
62, Generating default present(rtm_zm(:ngrdcol),wprtp(:ngrdcol),wpqtp(:ngrdcol))
force_spec_hum_to_mixing_ratio:
106, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
107, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
108, ! blockidx%x threadidx%x collapsed
106, Generating default present(rtm_forcing(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt),qtm_forcing(:ngrdcol,:nzt))
[839/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/diag_ustar_module.F90.o
diag_ustar:
36, Generating acc routine seq
Generating NVIDIA GPU code
[840/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/gfdl_activation.F90.o
[841/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/w_up_in_cloud_tests.F90.o
[842/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/tuner_tests.F90.o
[843/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/ice_dfsn_module.F90.o
[844/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/silhs_category_variance_module.F90.o
[845/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/hole_filling_tests.F90.o
[846/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/wangara.F90.o
wangara_tndcy:
68, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
69, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
70, ! blockidx%x threadidx%x collapsed
68, Generating default present(wm_zm(:ngrdcol,:gr%nzm),gr)
75, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
76, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
77, ! blockidx%x threadidx%x collapsed
75, Generating default present(wm_zt(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr,rtm_forcing(:ngrdcol,:gr%nzt))
90, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
91, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
92, ! blockidx%x threadidx%x collapsed
90, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
101, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
102, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
103, ! blockidx%x threadidx%x collapsed
101, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
wangara_sfclyr:
173, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
174, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
173, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
174, Generating implicit firstprivate(time_est)
[847/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/mixed_moment_PDF_integrals.F90.o
[848/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/fill_holes_tests.F90.o
[849/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/mu_sigma_hm_tests.F90.o
[850/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/spurious_source_test.F90.o
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/src/G_unit_test_types/spurious_source_test.F90: 218)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/src/G_unit_test_types/spurious_source_test.F90: 222)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/src/G_unit_test_types/spurious_source_test.F90: 275)
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/src/G_unit_test_types/spurious_source_test.F90: 278)
[851/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/rev_direction_grid_test.F90.o
[852/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_init_cleanup.F90.o
[853/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/time_dependent_input.F90.o
apply_time_dependent_forcings_from_array:
646, Generating create(temp_array(:)) [if not already present]
660, Generating update device(temp_array(:))
668, Generating implicit firstprivate(ngrdcol,nzt)
Generating NVIDIA GPU code
669, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
670, ! blockidx%x threadidx%x collapsed
668, Generating default present(thlm_f(:ngrdcol,:nzt),exner(:ngrdcol,:nzt))
677, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
678, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
679, ! blockidx%x threadidx%x collapsed
677, Generating default present(thlm_f(:ngrdcol,:nzt))
686, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
687, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
688, ! blockidx%x threadidx%x collapsed
686, Generating default present(thlm_f(:ngrdcol,:nzt))
697, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
698, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
699, ! blockidx%x threadidx%x collapsed
697, Generating default present(sclr_idx,thlm_f(:ngrdcol,:nzt),sclrm_forcing(:ngrdcol,:nzt,sclr_idx%iisclr_thl))
708, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
709, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
710, ! blockidx%x threadidx%x collapsed
708, Generating default present(edsclrm_forcing(:ngrdcol,:nzt,sclr_idx%iiedsclr_thl),thlm_f(:ngrdcol,:nzt),sclr_idx)
722, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
723, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
724, ! blockidx%x threadidx%x collapsed
722, Generating default present(rtm_f(:ngrdcol,:nzt),rtm(:ngrdcol,:nzt))
731, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
732, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
733, ! blockidx%x threadidx%x collapsed
731, Generating default present(rtm_f(:ngrdcol,:nzt))
742, Generating implicit firstprivate(ngrdcol,nzt)
Generating NVIDIA GPU code
743, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
744, ! blockidx%x threadidx%x collapsed
742, Generating default present(sclrm_forcing(:ngrdcol,:nzt,sclr_idx%iisclr_rt),sclr_idx,rtm_f(:ngrdcol,:nzt))
753, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
754, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
755, ! blockidx%x threadidx%x collapsed
753, Generating default present(sclr_idx,rtm_f(:ngrdcol,:nzt),edsclrm_forcing(:ngrdcol,:nzt,sclr_idx%iiedsclr_rt))
764, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
765, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
766, ! blockidx%x threadidx%x collapsed
764, Generating default present(um_ref(:ngrdcol,:nzt))
773, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
774, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
775, ! blockidx%x threadidx%x collapsed
773, Generating default present(vm_ref(:ngrdcol,:nzt))
782, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
783, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
784, ! blockidx%x threadidx%x collapsed
782, Generating default present(um_f(:ngrdcol,:nzt))
791, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
792, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
793, ! blockidx%x threadidx%x collapsed
791, Generating default present(vm_f(:ngrdcol,:nzt))
803, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
804, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
805, ! blockidx%x threadidx%x collapsed
803, Generating default present(wm_zt(:ngrdcol,:nzt))
812, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
813, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
814, ! blockidx%x threadidx%x collapsed
812, Generating default present(wm_zt(:ngrdcol,:nzt),rho(:ngrdcol,:nzt))
821, Generating implicit firstprivate(nzt)
Generating NVIDIA GPU code
822, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
826, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
827, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
828, ! blockidx%x threadidx%x collapsed
826, Generating default present(wm_zt(:ngrdcol,:nzt),rho(:ngrdcol,:nzt))
841, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
842, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
843, ! blockidx%x threadidx%x collapsed
841, Generating default present(ug(:ngrdcol,:nzt))
850, Generating implicit firstprivate(nzt,ngrdcol)
Generating NVIDIA GPU code
851, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
852, ! blockidx%x threadidx%x collapsed
850, Generating default present(vg(:ngrdcol,:nzt))
[854/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/clex9_nov02.F90.o
[855/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/clex9_oct14.F90.o
[856/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/jun25.F90.o
[857/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/nov11.F90.o
nov11_altocu_rtm_adjust:
91, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
92, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
93, ! blockidx%x threadidx%x collapsed
91, Generating default present(gr,gr%zm(1:ngrdcol,1),gr%zt(1:ngrdcol,1:gr%nzt),rtm(:ngrdcol,:gr%nzt))
[858/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/pdf_hydromet_microphys_wrapper.F90.o
pdf_hydromet_microphys_prep:
244, Generating update self(cloud_frac(:,:),ice_supersat_frac(:,:),kh_zm(:,:))
246, Generating update self(wphydrometp(:,:,:))
296, Generating update device(corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:),sigma_x_1_n(:,:,:),mu_x_2_n(:,:,:),mu_x_1_n(:,:,:),corr_cholesky_mtx_2(:,:,:,:),sigma_x_2_n(:,:,:))
299, Generating update device(rtphmp_zt(:,:,:),wp2hmp(:,:,:),thlphmp_zt(:,:,:))
397, Generating update self(lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),x_nl_all_levs(:,:,:,:),rho_ds_zt(:,:),lh_rv_clipped(:,:,:),lh_thl_clipped(:,:,:))
[859/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/mpace_a.F90.o
[860/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/bomex.F90.o
bomex_tndcy:
81, Generating enter data create(qtm_forcing(:,:))
86, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
87, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
88, ! blockidx%x threadidx%x collapsed
86, Generating default present(gr%zt(1:ngrdcol,1:gr%nzt),gr,qtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt))
113, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
114, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
115, ! blockidx%x threadidx%x collapsed
113, Generating default present(sclrm_forcing(:ngrdcol,:gr%nzt,:),thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
123, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
124, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
125, ! blockidx%x threadidx%x collapsed
123, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
134, Generating exit data delete(qtm_forcing(:,:))
bomex_sfclyr:
194, Generating enter data copyin(wpqtp_sfc(:))
209, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
210, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
209, Generating default present(wpqtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol))
210, Generating implicit firstprivate(wpqtp_sfc_calc,wpthlp_sfc_calc)
225, Generating exit data delete(wpqtp_sfc(:))
[861/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/sfc_flux.F90.o
compute_momentum_flux:
57, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
58, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
57, Generating default present(upwp_sfc(:ngrdcol),ubar(:ngrdcol),um_sfc(:ngrdcol),ustar(:ngrdcol),vpwp_sfc(:ngrdcol),vm_sfc(:ngrdcol))
compute_ubar:
102, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
103, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
102, Generating default present(vm_sfc(:ngrdcol),um_sfc(:ngrdcol),ubar(:ngrdcol))
compute_wpthlp_sfc:
216, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
217, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
216, Generating default present(t_sfc(:ngrdcol),exner_sfc(:ngrdcol),cd(:ngrdcol),thlm_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ubar(:ngrdcol))
compute_wprtp_sfc:
258, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
259, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
258, Generating default present(cd(:ngrdcol),rtm_sfc(:ngrdcol),adjustment(:ngrdcol),wprtp_sfc(:ngrdcol),ubar(:ngrdcol))
set_sclr_sfc_rtm_thlm:
314, Generating implicit firstprivate(ngrdcol,sclr_dim)
Generating NVIDIA GPU code
315, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
316, !$acc loop seq
314, Generating default present(wpsclrp_sfc(:ngrdcol,:sclr_dim))
315, Generating implicit firstprivate(i)
316, Loop is parallelizable
321, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
322, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
321, Generating default present(wpthlp_sfc(:ngrdcol),wpsclrp_sfc(:ngrdcol,:),wprtp_sfc(:ngrdcol),wpedsclrp_sfc(:ngrdcol,:),sclr_idx)
334, Generating implicit firstprivate(ngrdcol,edsclr_dim)
Generating NVIDIA GPU code
335, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
336, !$acc loop seq
334, Generating default present(wpedsclrp_sfc(:ngrdcol,:edsclr_dim))
336, Loop is parallelizable
convert_sens_ht_to_km_s:
348, Generating acc routine seq
Generating NVIDIA GPU code
convert_latent_ht_to_m_s:
375, Generating acc routine seq
Generating NVIDIA GPU code
[862/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/advance_microphys_module.F90.o
microphys_lhs:
1749, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
Generating copyout(lhs_ta(:,:,:)) [if not already present]
Generating copyin(gr%invrs_dzt(:,:),rho_ds_zm_col(:,:),nu_col(:),kh_zt(:,:)) [if not already present]
1779, Generating copyin(gr%invrs_dzt(:,:),gr%invrs_dzm(:,:),gr,wm_zt_col(:,:)) [if not already present]
Generating copyout(lhs_ma(:,:)) [if not already present]
Generating copyin(gr%weights_zt2zm(:,:,:)) [if not already present]
microphys_rhs:
2082, Generating copyin(gr,gr%invrs_dzm(:,:),invrs_rho_ds_zt_col(:,:),kh_zm(:,:)) [if not already present]
Generating copyout(lhs_ta(:,:)) [if not already present]
Generating copyin(gr%invrs_dzt(:,:),nu_col(:),rho_ds_zm_col(:,:),kh_zt(:,:)) [if not already present]
[863/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/arm.F90.o
arm_sfclyr:
98, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
99, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
98, Generating default present(thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
99, Generating implicit firstprivate(bflx,moisture_flx2,heat_flx2)
[864/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/arm_0003.F90.o
arm_0003_sfclyr:
91, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
92, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
91, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:))
92, Generating implicit firstprivate(bflx,moisture_flx,heat_flx)
[865/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/fire.F90.o
fire_sfclyr:
92, Generating enter data create(cz(:),rsat(:))
102, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
103, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
102, Generating default present(t_sfc(:),ustar(:ngrdcol),rsat(:ngrdcol),cz(:ngrdcol),p_sfc(:))
103, Generating implicit firstprivate(t_sfc_interp,saturation_formula)
118, Generating exit data delete(rsat(:),cz(:))
[866/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/twp_ice.F90.o
twp_ice_sfclyr:
96, Generating enter data create(ch(:),rsat(:),cq(:))
106, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
107, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
106, Generating default present(t_sfc(:),z(:ngrdcol),ustar(:ngrdcol),ch(:ngrdcol),rsat(:ngrdcol),cq(:ngrdcol),p_sfc(:))
107, Generating implicit firstprivate(t_sfc_interp,saturation_formula)
138, Generating exit data delete(ch(:),rsat(:),cq(:))
[867/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/ekman.F90.o
ekman_sfclyr:
60, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
61, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
60, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
[868/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/arm_97.F90.o
arm_97_sfclyr:
96, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
97, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
96, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:))
97, Generating implicit firstprivate(bflx,moisture_flx,heat_flx)
[869/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/arm_3year.F90.o
arm_3year_sfclyr:
79, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
80, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
79, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:))
80, Generating implicit firstprivate(bflx,moisture_flx,heat_flx)
[870/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/astex_a209.F90.o
astex_a209_sfclyr:
193, Generating enter data create(ch(:),cq(:),rsat(:))
207, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
208, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
207, Generating default present(ustar(:ngrdcol),t_sfc(:),rsat(:ngrdcol),lowestlevel(:ngrdcol),p_sfc(:),cq(:ngrdcol),ch(:ngrdcol))
208, Generating implicit firstprivate(t_sfc_interp,saturation_formula)
238, Generating exit data delete(ch(:),rsat(:),cq(:))
[871/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/gabls3.F90.o
gabls3_sfclyr:
98, Generating enter data create(c_10(:),offset(:))
101, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
102, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
101, Generating default present(c_10(:ngrdcol),offset(:ngrdcol))
114, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
115, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
114, Generating default present(veg_t_in_k(:ngrdcol),ustar(:ngrdcol),wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),lowest_level(:),exner_sfc(:ngrdcol),ubar(:))
115, Generating implicit firstprivate(veg_theta_in_k,bflx)
122, Generating exit data delete(offset(:),c_10(:))
[872/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/neutral_case.F90.o
neutral_case_sfclyr:
74, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
75, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
74, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
75, Generating implicit firstprivate(time)
[873/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/cloud_feedback.F90.o
cloud_feedback_sfclyr:
103, Generating enter data create(cq(:),ch(:),exner_sfc(:),rsat(:))
115, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
116, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
115, Generating default present(cq(:ngrdcol),ustar(:ngrdcol),t_sfc(:),exner_sfc(:ngrdcol),ch(:ngrdcol),rsat(:ngrdcol),lowest_level(:ngrdcol),p_sfc(:))
116, Generating implicit firstprivate(saturation_formula,t_sfc_interp)
164, Generating exit data delete(cq(:),ch(:),rsat(:),exner_sfc(:))
[874/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/cobra.F90.o
cobra_sfclyr:
144, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
145, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
144, Generating default present(rho_sfc(:),t_sfc(:ngrdcol),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
145, Generating implicit firstprivate(t_sfc_calc,moisture_flx2,co2_flx2,heat_flx,heat_flx2,moisture_flx,bflx,co2_flx)
176, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
177, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
176, Generating default present(wpthlp_sfc(:ngrdcol),wpsclrp_sfc(:ngrdcol,:),wprtp_sfc(:ngrdcol),sclr_idx)
177, Generating implicit firstprivate(co2_flx2)
185, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
186, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
185, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),sclr_idx,wpedsclrp_sfc(:ngrdcol,:))
186, Generating implicit firstprivate(co2_flx2)
[875/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/gabls3_night.F90.o
gabls3_night_sfclyr:
97, Generating enter data create(ubar(:))
113, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
114, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
113, Generating default present(um_sfc(:),thlm_sfc(:),vm_sfc(:),wpthlp_sfc(:),wprtp_sfc(:),ustar(:),ubar(:),lowest_level(:),rtm_sfc(:))
114, Generating implicit firstprivate(ts,qs)
129, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
130, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
129, Generating default present(vpwp_sfc(:ngrdcol),upwp_sfc(:ngrdcol))
130, Generating implicit firstprivate(vpwp_sfc_interp,upwp_sfc_interp)
143, Generating exit data delete(ubar(:))
psi_h:
150, Generating implicit acc routine seq
Generating acc routine seq
Generating NVIDIA GPU code
gm1:
163, Generating implicit acc routine seq
Generating acc routine seq
Generating NVIDIA GPU code
gh1:
175, Generating implicit acc routine seq
Generating acc routine seq
Generating NVIDIA GPU code
fm1:
188, Generating implicit acc routine seq
Generating acc routine seq
Generating NVIDIA GPU code
fh1:
206, Generating implicit acc routine seq
Generating acc routine seq
Generating NVIDIA GPU code
landflx:
220, Generating acc routine seq
Generating NVIDIA GPU code
[876/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/dycoms2_rf02.F90.o
dycoms2_rf02_tndcy:
90, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
91, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
90, Generating default present(wm_zt(:ngrdcol,gr%nzt),wm_zm(:ngrdcol,gr%nzm),gr)
96, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
97, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
98, ! blockidx%x threadidx%x collapsed
96, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr)
107, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
108, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
109, ! blockidx%x threadidx%x collapsed
107, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
118, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
120, ! blockidx%x threadidx%x collapsed
118, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
dycoms2_rf02_sfclyr:
196, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
197, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
196, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),ustar(:ngrdcol))
197, Generating implicit firstprivate(sens_ht,latent_ht)
[877/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/lba.F90.o
lba_tndcy:
68, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
69, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
70, ! blockidx%x threadidx%x collapsed
68, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr)
82, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
83, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
84, ! blockidx%x threadidx%x collapsed
82, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
93, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
94, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
95, ! blockidx%x threadidx%x collapsed
93, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
lba_sfclyr:
174, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
175, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
174, Generating default present(wprtp_sfc(:ngrdcol),ustar(:ngrdcol),rho_sfc(:),thlm_sfc(:ngrdcol),z(:),wpthlp_sfc(:ngrdcol),ubar(:))
175, Generating implicit firstprivate(ft,bflx)
[878/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/dycoms2_rf01.F90.o
dycoms2_rf01_tndcy:
66, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
67, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
68, ! blockidx%x threadidx%x collapsed
66, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),gr)
77, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
78, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
79, ! blockidx%x threadidx%x collapsed
77, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
88, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
89, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
90, ! blockidx%x threadidx%x collapsed
88, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
dycoms2_rf01_sfclyr:
178, Generating enter data create(rsat(:),cd(:))
194, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
195, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
194, Generating default present(t_sfc(:ngrdcol),rho_sfc(:),wprtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol))
195, Generating implicit firstprivate(t_sfc_interp,sens_ht,latent_ht)
204, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
205, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
204, Generating default present(ustar(:ngrdcol),t_sfc(:),rsat(:ngrdcol),cd(:ngrdcol),p_sfc(:))
205, Generating implicit firstprivate(t_sfc_interp,saturation_formula)
225, Generating exit data delete(rsat(:),cd(:))
[879/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/mpace_b.F90.o
mpace_b_tndcy:
106, Generating enter data create(t_tendency,velocity_omega)
109, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
110, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
111, ! blockidx%x threadidx%x collapsed
109, Generating default present(gr,p_in_pa(:ngrdcol,:gr%nzt),wm_zt(:ngrdcol,:gr%nzt),thvm(:ngrdcol,:gr%nzt))
111, Generating implicit firstprivate(velocity_omega)
121, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
122, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
121, Generating default present(wm_zm(:ngrdcol,:),gr)
128, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
129, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
130, ! blockidx%x threadidx%x collapsed
128, Generating default present(gr,thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),p_in_pa(:ngrdcol,:gr%nzt))
130, Generating implicit firstprivate(t_tendency)
143, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
144, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
145, ! blockidx%x threadidx%x collapsed
143, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
154, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
155, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
156, ! blockidx%x threadidx%x collapsed
154, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
165, Generating exit data delete(velocity_omega,t_tendency)
mpace_b_sfclyr:
234, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
235, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
234, Generating default present(rho_sfc(:),wprtp_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),ustar(:ngrdcol))
235, Generating implicit firstprivate(latent_heat_flx,sensible_heat_flx)
[880/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/atex_long.F90.o
calc_forcings:
39, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
40, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
41, ! blockidx%x threadidx%x collapsed
39, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr,gr%zt(1:ngrdcol,1:gr%nzt))
atex_long_tndcy:
135, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
136, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
137, ! blockidx%x threadidx%x collapsed
135, Generating default present(gr,gr%zt(1:ngrdcol,1:gr%nzt),wm_zt(:ngrdcol,:gr%nzt))
165, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
166, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
165, Generating default present(wm_zm(:ngrdcol,:),gr)
172, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
173, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
174, ! blockidx%x threadidx%x collapsed
172, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
183, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
184, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
185, ! blockidx%x threadidx%x collapsed
183, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
atex_long_sfclyr:
268, Generating enter data create(c_10(:),adjustment(:))
290, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
291, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
290, Generating default present(adjustment(:ngrdcol),ustar(:ngrdcol),t_sfc(:ngrdcol),c_10(:ngrdcol))
291, Generating implicit firstprivate(t_sfc_interp)
313, Generating exit data delete(c_10(:),adjustment(:))
[881/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/gabls2.F90.o
gabls2_tndcy:
91, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
92, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
93, ! blockidx%x threadidx%x collapsed
91, Generating default present(wm_zt(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt),gr)
106, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
107, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
108, ! blockidx%x threadidx%x collapsed
106, Generating default present(wm_zt(:ngrdcol,:gr%nzt),gr)
118, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
119, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
118, Generating default present(wm_zm(:ngrdcol,:),gr)
124, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
125, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
126, ! blockidx%x threadidx%x collapsed
124, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
138, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
139, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
140, ! blockidx%x threadidx%x collapsed
138, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
149, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
150, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
151, ! blockidx%x threadidx%x collapsed
149, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
gabls2_sfclyr:
243, Generating enter data create(rsat(:),cz(:))
278, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
279, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
278, Generating default present(cz(:ngrdcol),t_sfc(:),rsat(:ngrdcol),lowest_level(:ngrdcol),p_sfc(:))
279, Generating implicit firstprivate(t_sfc_calc,saturation_formula)
295, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
296, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
295, Generating default present(ustar(:ngrdcol),lowest_level(:),p_sfc(:ngrdcol),wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol),t_sfc(:ngrdcol),ubar(:))
296, Generating implicit firstprivate(sstheta,bflx)
307, Generating exit data delete(rsat(:),cz(:))
[882/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/coamps_microphys_driver_module.F90.o
[883/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/rico.F90.o
rico_tndcy:
88, Generating enter data create(qtm_forcing(:,:))
93, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
94, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
95, ! blockidx%x threadidx%x collapsed
93, Generating default present(exner(:ngrdcol,:gr%nzt),gr,gr%zt(1:ngrdcol,1:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt))
95, Generating implicit firstprivate(t_tendency)
116, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
117, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
118, ! blockidx%x threadidx%x collapsed
116, Generating default present(qtm_forcing(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt),gr)
145, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
146, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
147, ! blockidx%x threadidx%x collapsed
145, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
156, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
157, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
158, ! blockidx%x threadidx%x collapsed
156, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
167, Generating exit data delete(qtm_forcing(:,:))
rico_sfclyr:
272, Generating enter data create(cm(:),ch(:),cq(:),ubar(:),rsat(:),cz(:))
289, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
290, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
289, Generating default present(t_sfc(:),ustar(:ngrdcol),rsat(:ngrdcol),p_sfc(:))
290, Generating implicit firstprivate(t_sfc_interp,saturation_formula)
320, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
321, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
320, Generating default present(z_bot(:ngrdcol),cq(:ngrdcol),ch(:ngrdcol),cm(:ngrdcol))
346, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
347, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
346, Generating default present(cm(:ngrdcol),ubar(:ngrdcol),um_sfc(:ngrdcol),upwp_sfc(:ngrdcol),vpwp_sfc(:ngrdcol),vm_sfc(:ngrdcol))
354, Generating exit data delete(cm(:),ch(:),cq(:),ubar(:),rsat(:),cz(:))
[884/915] Building Fortran object src/G_unit_test_types/CMakeFiles/G_unit_test_lib.dir/pdf_parameter_tests.F90.o
NVFORTRAN-W-0435-Array declared with zero size (/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/src/G_unit_test_types/pdf_parameter_tests.F90: 428)
[885/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/atex.F90.o
calc_forcings:
42, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
43, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
44, ! blockidx%x threadidx%x collapsed
42, Generating default present(rtm_forcing(:ngrdcol,:gr%nzt),gr,z_inversion(:ngrdcol),thlm_forcing(:ngrdcol,:gr%nzt),gr%zt(1:ngrdcol,1:gr%nzt))
atex_tndcy:
213, Generating enter data create(z_lev(:),z_inversion(:))
219, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
220, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
219, Generating default present(z_lev(:ngrdcol),rtm(:ngrdcol,:),gr)
222, Complex loop carried dependence of z_lev prevents parallelization
Loop carried reuse of z_lev prevents parallelization
229, Generating update self(rtm(:,:),z_lev(:))
244, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
245, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
244, Generating default present(z_lev(:ngrdcol),z_inversion(:ngrdcol),gr,gr%zt(1:ngrdcol,:))
250, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
251, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
252, ! blockidx%x threadidx%x collapsed
250, Generating default present(z_inversion(:ngrdcol),wm_zt(:ngrdcol,:gr%nzt),gr,gr%zt(1:ngrdcol,1:gr%nzt))
270, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
271, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
270, Generating default present(wm_zm(:ngrdcol,:),gr)
286, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
287, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
286, Generating default present(z_lev_dycore(:ngrdcol),rtm_dycore(:ngrdcol,:),gr_dycore)
289, Complex loop carried dependence of z_lev_dycore prevents parallelization
Loop carried reuse of z_lev_dycore prevents parallelization
311, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
312, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
311, Generating default present(z_lev_dycore(:ngrdcol),z_inversion_dycore(:ngrdcol),gr_dycore,gr_dycore%zt(1:ngrdcol,:))
355, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
356, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
357, ! blockidx%x threadidx%x collapsed
355, Generating default present(wm_zt(:ngrdcol,:gr%nzt),thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
365, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
366, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
367, ! blockidx%x threadidx%x collapsed
365, Generating default present(thlm_forcing_dycore(:ngrdcol,:gr_dycore%nzt),rtm_forcing_dycore(:ngrdcol,:gr_dycore%nzt),gr_dycore)
374, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
375, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
376, ! blockidx%x threadidx%x collapsed
374, Generating default present(wm_zm(:ngrdcol,:gr%nzm),gr)
384, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
385, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
386, ! blockidx%x threadidx%x collapsed
384, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclrm_forcing(:ngrdcol,:gr%nzt,:),rtm_forcing(:ngrdcol,:gr%nzt),sclr_idx,gr)
395, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
396, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
397, ! blockidx%x threadidx%x collapsed
395, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),sclr_idx,rtm_forcing(:ngrdcol,:gr%nzt),gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:))
406, Generating exit data delete(z_lev(:),z_inversion(:))
atex_sfclyr:
472, Generating enter data create(c_10(:),adjustment(:))
482, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
483, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
482, Generating default present(adjustment(:ngrdcol),ustar(:ngrdcol),t_sfc(:ngrdcol),c_10(:ngrdcol))
483, Generating implicit firstprivate(t_sfc_interp)
497, Generating exit data delete(c_10(:),adjustment(:))
[886/915] Linking Fortran static library src/G_unit_test_types/libG_unit_test_lib.a
[887/915] Generating Fortran dyndep file src/CMakeFiles/G_unit_tests.dir/Fortran.dd
[888/915] Building Fortran object src/CMakeFiles/G_unit_tests.dir/G_unit_tests.F90.o
[889/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/KK_microphys_module.F90.o
[890/915] Linking Fortran executable src/G_unit_tests
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
[891/915] Building Fortran object src/Benchmark_cases/CMakeFiles/benchmark_cases_lib.dir/prescribe_forcings.F90.o
prescribe_forcings:
297, Generating enter data create(thlm_bot(:),um_bot(:),vm_bot(:),z_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:))
313, Generating implicit firstprivate(ngrdcol,nzt)
Generating NVIDIA GPU code
314, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
315, ! blockidx%x threadidx%x collapsed
313, Generating default present(rtm_forcing(:ngrdcol,:nzt),thlm_forcing(:ngrdcol,:nzt))
321, Generating implicit firstprivate(ngrdcol,nzm)
Generating NVIDIA GPU code
322, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
323, ! blockidx%x threadidx%x collapsed
321, Generating default present(rtp2_forcing(:ngrdcol,:nzm),rtpthlp_forcing(:ngrdcol,:nzm),wpthlp_forcing(:ngrdcol,:nzm),wprtp_forcing(:ngrdcol,:nzm),thlp2_forcing(:ngrdcol,:nzm))
369, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
370, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
369, Generating default present(rtm_forcing(:ngrdcol,nzt),thlm_forcing(:ngrdcol,nzt))
370, Generating implicit firstprivate(nzt)
442, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
443, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
444, ! blockidx%x threadidx%x collapsed
442, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
466, Generating update self(p_in_pa(:,:))
472, Generating update device(rtm_forcing(:,:),um_ref(:,:),thlm_forcing(:,:),edsclrm_forcing(:,:,:),sclrm_forcing(:,:,:),vm_ref(:,:),wm_zt(:,:),wm_zm(:,:))
491, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
492, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
493, ! blockidx%x threadidx%x collapsed
491, Generating default present(thlm_forcing(:ngrdcol,:gr%nzt),rtm_forcing(:ngrdcol,:gr%nzt),gr)
500, Generating implicit firstprivate(sclr_dim,ngrdcol)
Generating NVIDIA GPU code
501, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
502, ! blockidx%x threadidx%x collapsed
503, !$acc loop seq
500, Generating default present(sclrm_forcing(:ngrdcol,:gr%nzt,:sclr_dim),gr)
503, Loop is parallelizable
511, Generating implicit firstprivate(ngrdcol,edsclr_dim)
Generating NVIDIA GPU code
512, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
513, ! blockidx%x threadidx%x collapsed
514, !$acc loop seq
511, Generating default present(gr,edsclrm_forcing(:ngrdcol,:gr%nzt,:edsclr_dim))
514, Loop is parallelizable
592, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
593, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
592, Generating default present(ustar(:ngrdcol))
616, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
617, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
616, Generating default present(ustar(:ngrdcol))
630, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
631, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
630, Generating default present(ustar(:ngrdcol))
652, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
653, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
652, Generating default present(ustar(:ngrdcol))
790, Generating update self(rho_bot(:))
793, Generating update device(ustar(:),wpthlp_sfc(:),wprtp_sfc(:))
844, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
845, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
844, Generating default present(ustar(:ngrdcol))
872, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
873, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
872, Generating default present(wpthlp_sfc(:ngrdcol),wprtp_sfc(:ngrdcol))
873, Generating implicit firstprivate(sens_ht,latent_ht)
879, Generating implicit firstprivate(ngrdcol,nzm)
Generating NVIDIA GPU code
880, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
881, ! blockidx%x threadidx%x collapsed
879, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_thl),sclr_idx)
881, Generating implicit firstprivate(sens_ht)
888, Generating implicit firstprivate(ngrdcol,nzm)
Generating NVIDIA GPU code
889, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
890, ! blockidx%x threadidx%x collapsed
888, Generating default present(wpsclrp(:ngrdcol,:nzm,sclr_idx%iisclr_rt),sclr_idx)
890, Generating implicit firstprivate(latent_ht)
902, Generating update self(rho_zm(:,:),upwp_sfc(:),ustar(:),t_sfc(:),vpwp_sfc(:),wpthlp_sfc(:),wprtp_sfc(:))
913, Generating exit data delete(thlm_bot(:),um_bot(:),z_bot(:),vm_bot(:),exner_bot(:),rtm_bot(:),rho_bot(:),ustar(:),ubar(:))
read_surface_var_for_bc:
1018, Generating create(thlm_zm(:,:),um_zm(:,:),vm_zm(:,:),k_min(:),rtm_zm(:,:),exner_zm(:,:)) [if not already present]
1023, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
1024, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
1023, Generating default present(exner_bot(:ngrdcol),gr,z_bot(:ngrdcol),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um(:ngrdcol,:1),um_bot(:ngrdcol),vm(:ngrdcol,:1),rho_zm(:ngrdcol,:1),rtm(:ngrdcol,:1),rtm_bot(:ngrdcol),thlm(:ngrdcol,:1),rho_bot(:ngrdcol),p_sfc(:ngrdcol),gr%zt(1:ngrdcol,1))
1043, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
1044, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
1051, !$acc loop seq
1043, Generating default present(gr,z_bot(:ngrdcol),gr%zt(1:ngrdcol,:))
1044, Generating implicit firstprivate(k,min_val)
1051, Loop carried scalar dependence for min_val at line 1052
Loop carried reuse of k_min prevents parallelization
1061, Generating update self(k_min(:))
1094, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
1095, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
1094, Generating default present(gr,rho_bot(:ngrdcol),p_sfc(:ngrdcol),exner_bot(:ngrdcol),z_bot(:),vm_bot(:ngrdcol),thlm_bot(:ngrdcol),um_bot(:ngrdcol),rtm_bot(:ngrdcol),rho_zm(:ngrdcol,:))
1095, Generating implicit firstprivate(k00,km1,kp2,kp1)
[892/915] Linking Fortran static library src/Benchmark_cases/libbenchmark_cases_lib.a
[893/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/estimate_scm_microphys_module.F90.o
[894/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/lh_microphys_driver_module.F90.o
[895/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/morrison_microphys_module.F90.o
[896/915] Building Fortran object src/Microphys/CMakeFiles/microphys_lib.dir/microphys_driver.F90.o
[897/915] Linking Fortran static library src/Microphys/libmicrophys_lib.a
[898/915] Generating Fortran dyndep file src/CMakeFiles/clubb_driver_lib.dir/Fortran.dd
[899/915] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/generalized_grid_test.F90.o
[900/915] Building Fortran object src/CMakeFiles/clubb_driver_lib.dir/clubb_driver.F90.o
init_clubb_case:
2534, Generating enter data create(pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:))
Generating enter data copyin(pdf_params_zm%mixt_frac(:,:))
Generating enter data create(pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:))
Generating enter data copyin(pdf_params_zm)
Generating enter data create(pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:))
Generating enter data copyin(pdf_params%mixt_frac(:,:))
Generating enter data create(pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:))
Generating enter data copyin(pdf_params)
Generating enter data create(pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:))
Generating enter data copyin(err_info,thv_ds_zt_init(:))
Generating enter data create(rcm_mc(:,:),corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:))
Generating enter data copyin(clubb_params(:,:))
Generating enter data create(sigma_x_1_n(:,:,:))
Generating enter data copyin(sfc_soil_t_in_k_init(:))
Generating enter data create(mu_x_1_n(:,:,:),lscale(:,:),kh_zt(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),wpvp2(:,:),x_mixt_comp_all_levs(:,:,:),lh_thl_clipped(:,:,:),invrs_tau_zm(:,:),kh_zm(:,:))
Generating enter data copyin(invrs_rho_ds_zt_init(:))
Generating enter data create(cloud_frac(:,:),cloudy_downdraft_frac(:,:),vpwp_sfc_pert(:),w_down_in_cloud(:,:),wp4(:,:),rcm(:,:),vpwp(:,:))
Generating enter data copyin(upwp_init(:),vm_init(:),um_init(:),hm_metadata)
Generating enter data create(wp2up2(:,:),wp2up(:,:),wpup2(:,:),wpthvp(:,:),wp3(:,:),radht(:,:),vp3(:,:),up3(:,:),wp2rtp(:,:),wp2thvp(:,:))
Generating enter data copyin(wp2_init(:))
Generating enter data create(wpthlp_sfc(:),cloud_cover(:,:),rc_coef_zm(:,:))
Generating enter data copyin(err_info%err_header(:),nu_vert_res_dep%nu9(:))
Generating enter data create(thlp2_mc(:,:),rtp2_mc(:,:))
Generating enter data copyin(t_sfc(:),vp2_init(:),up2_init(:),vm_ref_init(:),um_ref_init(:))
Generating enter data create(vprcp(:,:))
Generating enter data copyin(vg_init(:))
Generating enter data create(uprcp(:,:))
Generating enter data copyin(ug_init(:))
Generating enter data create(thlm_mc(:,:))
Generating enter data copyin(rtm_init(:))
Generating enter data create(vpwp_sfc(:),upwp_sfc(:))
Generating enter data copyin(thv_ds_zm_init(:))
Generating enter data create(thlpthvp(:,:))
Generating enter data copyin(invrs_rho_ds_zm_init(:))
Generating enter data create(ice_supersat_frac(:,:))
Generating enter data copyin(rho_ds_zm_init(:))
Generating enter data create(rho(:,:),rfrzm(:,:))
Generating enter data copyin(rho_init(:))
Generating enter data create(thlprcp(:,:),rtpthlp_mc(:,:),wp2thlp(:,:),wp2vp2(:,:))
Generating enter data copyin(wm_zt_init(:))
Generating enter data create(rtp3(:,:))
Generating enter data copyin(thlm_ref_init(:),rtm_ref_init(:))
Generating enter data create(wprtp_sfc(:),wprcp(:,:),thlp3(:,:),rtpthlp_forcing(:,:),thlp2_forcing(:,:),rtp2_forcing(:,:),wpthlp_forcing(:,:),wprtp_forcing(:,:))
Generating enter data copyin(pdf_params_zm%w_2(:,:),thlm_init(:))
Generating enter data create(rtpthvp(:,:))
Generating enter data copyin(rcm_init(:))
Generating enter data create(upwp_sfc_pert(:))
Generating enter data copyin(sfc_elevation(:))
Generating enter data create(corr_cholesky_mtx_2(:,:,:,:),vpwp_pert(:,:),upwp_pert(:,:),wprtp_mc(:,:),wpthlp_mc(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),wpthlp(:,:),wprtp(:,:),w_up_in_cloud(:,:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),vm_pert(:,:),um_pert(:,:))
Generating enter data copyin(veg_t_in_k_init(:),thvm_init(:),wm_zm_init(:),rho_zm_init(:))
Generating enter data create(err_info%err_code(:))
Generating enter data copyin(em_init(:))
Generating enter data create(vm_ref(:,:),veg_t_in_k(:),sfc_soil_t_in_k(:),deep_soil_t_in_k(:),um_ref(:,:),thlm_ref(:,:),rtm_ref(:,:),thv_ds_zt(:,:),thv_ds_zm(:,:),invrs_rho_ds_zt(:,:),invrs_rho_ds_zm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),rho_zm(:,:))
Generating enter data copyin(rho_ds_zt_init(:),p_in_pa_init(:))
Generating enter data create(p_in_pa(:,:),thvm(:,:),exner(:,:))
Generating enter data copyin(dummy_dy(:))
Generating enter data create(wm_zm(:,:),wm_zt(:,:),rcm_in_layer(:,:),upwp(:,:),vp2(:,:),up2(:,:),wp2(:,:),vg(:,:),ug(:,:),vm_forcing(:,:),um_forcing(:,:),rtm_forcing(:,:),thlm_forcing(:,:),pdf_params_zm%ice_supersat_frac_2(:,:))
Generating enter data copyin(pdf_params_zm%varnce_w_1(:,:))
Generating enter data create(pdf_params_zm%varnce_thl_2(:,:))
Generating enter data copyin(pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:))
Generating enter data create(pdf_params%ice_supersat_frac_2(:,:))
Generating enter data copyin(pdf_params%varnce_w_1(:,:))
Generating enter data create(pdf_params%varnce_thl_2(:,:))
Generating enter data copyin(pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),deep_soil_t_in_k_init(:),dummy_dx(:),deltaz(:),sclr_idx,fcor(:),exner_init(:),p_in_pa_zm_init(:))
Generating enter data create(sigma_x_2_n(:,:,:))
Generating enter data copyin(gr%zt(:,:))
Generating enter data create(cloudy_updraft_frac(:,:),rvm_mc(:,:))
Generating enter data copyin(pdf_params%w_2(:,:),p_sfc(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep,nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu10(:))
Generating enter data create(mu_x_2_n(:,:,:))
Generating enter data copyin(gr%invrs_dzt(:,:),gr%weights_zm2zt(:,:,:),gr%dzt(:,:),gr%invrs_dzm(:,:),gr%dzm(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:),fcor_y(:))
Generating enter data create(x_nl_all_levs(:,:,:,:))
2609, Generating enter data create(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp3(:,:,:),sclrp2(:,:,:))
Generating enter data copyin(sclrm_init(:,:))
Generating enter data create(sclrpthvp(:,:,:))
Generating enter data copyin(sclr_tol(:))
Generating enter data create(wpsclrp(:,:,:),sclrm(:,:,:),sclrm_forcing(:,:,:),wpsclrp_sfc(:,:))
2614, Generating enter data create(edsclrm(:,:,:))
Generating enter data copyin(edsclrm_init(:,:))
Generating enter data create(edsclrm_forcing(:,:,:),wpedsclrp_sfc(:,:))
2618, Generating enter data create(rtphmp_zt(:,:,:))
Generating enter data copyin(hm_metadata%l_mix_rat_hm(:))
Generating enter data create(thlphmp_zt(:,:,:),wphydrometp(:,:,:),wp2hmp(:,:,:))
set_case_initial_conditions:
2689, Generating implicit firstprivate(ngrdcol,lh_num_samples)
Generating NVIDIA GPU code
2690, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2691, ! blockidx%x threadidx%x collapsed
2692, ! blockidx%x threadidx%x collapsed
2693, !$acc loop seq
2689, Generating default present(x_nl_all_levs(1:ngrdcol,1:lh_num_samples,1:gr%nzt,:),x_mixt_comp_all_levs(1:ngrdcol,1:lh_num_samples,1:gr%nzt),lh_sample_point_weights(1:ngrdcol,1:lh_num_samples,1:gr%nzt),gr)
2693, Loop is parallelizable
2700, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
2701, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
2702, ! blockidx%x threadidx%x collapsed
2700, Generating default present(um_forcing(1:ngrdcol,1:gr%nzt),ug_init(1:gr%nzt),vm_forcing(1:ngrdcol,1:gr%nzt),vg_init(1:gr%nzt),um_ref_init(1:gr%nzt),vm_ref_init(1:gr%nzt),thlm_forcing(1:ngrdcol,1:gr%nzt),rvm_mc(1:ngrdcol,1:gr%nzt),rtm_forcing(1:ngrdcol,1:gr%nzt),rho_init(1:gr%nzt),w_down_in_cloud(1:ngrdcol,1:gr%nzt),vp3(1:ngrdcol,1:gr%nzt),cloudy_downdraft_frac(1:ngrdcol,1:gr%nzt),cloud_frac(1:ngrdcol,1:gr%nzt),wp2up(1:ngrdcol,1:gr%nzt),p_in_pa(1:ngrdcol,1:gr%nzt),lscale(1:ngrdcol,1:gr%nzt),exner(1:ngrdcol,1:gr%nzt),cloudy_updraft_frac(1:ngrdcol,1:gr%nzt),rho_ds_zt_init(1:gr%nzt),rfrzm(1:ngrdcol,1:gr%nzt),rho_ds_zt(1:ngrdcol,1:gr%nzt),rho(1:ngrdcol,1:gr%nzt),invrs_rho_ds_zt(1:ngrdcol,1:gr%nzt),ice_supersat_frac(1:ngrdcol,1:gr%nzt),thv_ds_zt(1:ngrdcol,1:gr%nzt),thlp3(1:ngrdcol,1:gr%nzt),thlm(1:ngrdcol,1:gr%nzt),rtm(1:ngrdcol,1:gr%nzt),um(1:ngrdcol,1:gr%nzt),vm(1:ngrdcol,1:gr%nzt),um_init(1:gr%nzt),vm_init(1:gr%nzt),wm_zt(1:ngrdcol,1:gr%nzt),w_up_in_cloud(1:ngrdcol,1:gr%nzt),rcm_in_layer(1:ngrdcol,1:gr%nzt),radht(1:ngrdcol,1:gr%nzt),cloud_cover(1:ngrdcol,1:gr%nzt),gr,rcm(1:ngrdcol,1:gr%nzt),ug(1:ngrdcol,1:gr%nzt),thvm_init(1:gr%nzt),vg(1:ngrdcol,1:gr%nzt),up3(1:ngrdcol,1:gr%nzt),um_ref(1:ngrdcol,1:gr%nzt),um_pert(1:ngrdcol,1:gr%nzt),vm_ref(1:ngrdcol,1:gr%nzt),vm_pert(1:ngrdcol,1:gr%nzt),thlm_ref(1:ngrdcol,1:gr%nzt),thlm_mc(1:ngrdcol,1:gr%nzt),rtm_ref(1:ngrdcol,1:gr%nzt),rtm_init(1:gr%nzt),thvm(1:ngrdcol,1:gr%nzt),thv_ds_zt_init(1:gr%nzt),p_in_pa_init(1:gr%nzt),thlm_ref_init(1:gr%nzt),rtm_ref_init(1:gr%nzt),wp2thlp(1:ngrdcol,1:gr%nzt),wp2thvp(1:ngrdcol,1:gr%nzt),wm_zt_init(1:gr%nzt),wp2rtp(1:ngrdcol,1:gr%nzt),wp3(1:ngrdcol,1:gr%nzt),wpvp2(1:ngrdcol,1:gr%nzt),wpup2(1:ngrdcol,1:gr%nzt),invrs_rho_ds_zt_init(1:gr%nzt),kh_zt(1:ngrdcol,1:gr%nzt),rtp3(1:ngrdcol,1:gr%nzt),rcm_init(1:gr%nzt),thlm_init(1:gr%nzt),rcm_mc(1:ngrdcol,1:gr%nzt),exner_init(1:gr%nzt))
2757, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
2758, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
2759, ! blockidx%x threadidx%x collapsed
2757, Generating default present(upwp(1:ngrdcol,1:gr%nzm),uprcp(1:ngrdcol,1:gr%nzm),vprcp(1:ngrdcol,1:gr%nzm),up2(1:ngrdcol,1:gr%nzm),thv_ds_zm_init(1:gr%nzm),vp2(1:ngrdcol,1:gr%nzm),upwp_pert(1:ngrdcol,1:gr%nzm),wprcp(1:ngrdcol,1:gr%nzm),wprtp_mc(1:ngrdcol,1:gr%nzm),wp4(1:ngrdcol,1:gr%nzm),wp2(1:ngrdcol,1:gr%nzm),wm_zm_init(1:gr%nzm),rho_zm_init(1:gr%nzm),rtpthvp(1:ngrdcol,1:gr%nzm),rtp2_mc(1:ngrdcol,1:gr%nzm),rho_zm(1:ngrdcol,1:gr%nzm),rho_ds_zm_init(1:gr%nzm),rho_ds_zm(1:ngrdcol,1:gr%nzm),rc_coef_zm(1:ngrdcol,1:gr%nzm),invrs_rho_ds_zm(1:ngrdcol,1:gr%nzm),gr,thv_ds_zm(1:ngrdcol,1:gr%nzm),thlpthvp(1:ngrdcol,1:gr%nzm),wprtp(1:ngrdcol,1:gr%nzm),wpthlp(1:ngrdcol,1:gr%nzm),rtp2(1:ngrdcol,1:gr%nzm),thlp2(1:ngrdcol,1:gr%nzm),rtpthlp(1:ngrdcol,1:gr%nzm),upwp_init(1:gr%nzm),vpwp(1:ngrdcol,1:gr%nzm),wm_zm(1:ngrdcol,1:gr%nzm),vpwp_pert(1:ngrdcol,1:gr%nzm),invrs_rho_ds_zm_init(1:gr%nzm),thlp2_mc(1:ngrdcol,1:gr%nzm),rtpthlp_mc(1:ngrdcol,1:gr%nzm),thlprcp(1:ngrdcol,1:gr%nzm),wpthlp_mc(1:ngrdcol,1:gr%nzm),wpthvp(1:ngrdcol,1:gr%nzm),up2_init(1:gr%nzm),vp2_init(1:gr%nzm),kh_zm(1:ngrdcol,1:gr%nzm),wp2vp2(1:ngrdcol,1:gr%nzm),wp2_init(1:gr%nzm),wp2up2(1:ngrdcol,1:gr%nzm),invrs_tau_zm(1:ngrdcol,1:gr%nzm),wprtp_forcing(1:ngrdcol,1:gr%nzm),wpthlp_forcing(1:ngrdcol,1:gr%nzm),rtp2_forcing(1:ngrdcol,1:gr%nzm),thlp2_forcing(1:ngrdcol,1:gr%nzm),rtpthlp_forcing(1:ngrdcol,1:gr%nzm))
2804, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
2805, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
2804, Generating default present(wpthlp_sfc(1:ngrdcol),wprtp_sfc(1:ngrdcol),vpwp_sfc(1:ngrdcol),sfc_soil_t_in_k_init(:),veg_t_in_k_init(:),deep_soil_t_in_k(1:ngrdcol),sfc_soil_t_in_k(1:ngrdcol),deep_soil_t_in_k_init(:),veg_t_in_k(1:ngrdcol),upwp_sfc(1:ngrdcol))
2818, Generating implicit firstprivate(ngrdcol,sclr_dim)
Generating NVIDIA GPU code
2819, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2820, ! blockidx%x threadidx%x collapsed
2821, ! blockidx%x threadidx%x collapsed
2818, Generating default present(sclrm_forcing(1:ngrdcol,1:gr%nzt,1:sclr_dim),gr,sclrm(1:ngrdcol,1:gr%nzt,1:sclr_dim),sclrp3(1:ngrdcol,1:gr%nzt,1:sclr_dim),sclrm_init(1:gr%nzt,1:sclr_dim))
2829, Generating implicit firstprivate(sclr_dim,ngrdcol)
Generating NVIDIA GPU code
2830, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2831, ! blockidx%x threadidx%x collapsed
2832, ! blockidx%x threadidx%x collapsed
2829, Generating default present(sclrpthlp(1:ngrdcol,1:gr%nzm,1:sclr_dim),gr,sclr_tol(1:sclr_dim),sclrp2(1:ngrdcol,1:gr%nzm,1:sclr_dim),sclrprtp(1:ngrdcol,1:gr%nzm,1:sclr_dim),wpsclrp(1:ngrdcol,1:gr%nzm,1:sclr_dim),sclrpthvp(1:ngrdcol,1:gr%nzm,1:sclr_dim))
2842, Generating implicit firstprivate(sclr_dim,ngrdcol)
Generating NVIDIA GPU code
2843, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
2844, ! blockidx%x threadidx%x collapsed
2842, Generating default present(wpsclrp_sfc(1:ngrdcol,1:sclr_dim))
2853, Generating implicit firstprivate(ngrdcol,edsclr_dim)
Generating NVIDIA GPU code
2854, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2855, ! blockidx%x threadidx%x collapsed
2856, ! blockidx%x threadidx%x collapsed
2853, Generating default present(edsclrm_forcing(1:ngrdcol,1:gr%nzt,1:edsclr_dim),edsclrm(1:ngrdcol,1:gr%nzt,1:edsclr_dim),gr,edsclrm_init(1:gr%nzt,1:edsclr_dim))
2863, Generating implicit firstprivate(ngrdcol,edsclr_dim)
Generating NVIDIA GPU code
2864, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
2865, ! blockidx%x threadidx%x collapsed
2863, Generating default present(wpedsclrp_sfc(1:ngrdcol,1:edsclr_dim))
2874, Generating implicit firstprivate(ngrdcol,hydromet_dim)
Generating NVIDIA GPU code
2875, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2876, ! blockidx%x threadidx%x collapsed
2877, ! blockidx%x threadidx%x collapsed
2874, Generating default present(rtphmp_zt(1:ngrdcol,1:gr%nzt,1:hydromet_dim),gr,wp2hmp(1:ngrdcol,1:gr%nzt,1:hydromet_dim),thlphmp_zt(1:ngrdcol,1:gr%nzt,1:hydromet_dim))
2885, Generating implicit firstprivate(ngrdcol,hydromet_dim)
Generating NVIDIA GPU code
2886, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
2887, ! blockidx%x threadidx%x collapsed
2888, ! blockidx%x threadidx%x collapsed
2885, Generating default present(wphydrometp(1:ngrdcol,1:gr%nzm,1:hydromet_dim),gr)
3008, Generating update self(deltaz(:),gr%zt(:,:),gr%zm(:,:),clubb_params(:,:))
3014, Generating update device(nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu9(:),nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu10(:))
advance_clubb_to_end:
3247, Generating update self(wp2thvp(:,:),thlp2(:,:),rtpthlp(:,:),wp2(:,:),wp2up(:,:),vm(:,:),rtp2(:,:),thlm(:,:),rtm(:,:),wprtp(:,:),rtpthvp(:,:),wp3(:,:),um(:,:),thlpthvp(:,:),wpthlp(:,:))
3250, Generating update self(sclrm(:,:,:))
3251, Generating update self(edsclrm(:,:,:))
3312, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
3313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
3314, ! blockidx%x threadidx%x collapsed
3312, Generating default present(rcm_mc(1:ngrdcol,1:gr%nzt),rtm_forcing(1:ngrdcol,1:gr%nzt),radht(1:ngrdcol,1:gr%nzt),rfrzm(1:ngrdcol,1:gr%nzt),gr,thlm_mc(1:ngrdcol,1:gr%nzt),thlm_forcing(1:ngrdcol,1:gr%nzt),rvm_mc(1:ngrdcol,1:gr%nzt))
3330, Generating implicit firstprivate(ngrdcol)
Generating NVIDIA GPU code
3331, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
3332, ! blockidx%x threadidx%x collapsed
3330, Generating default present(wprtp_forcing(1:ngrdcol,1:gr%nzm),thlp2_mc(1:ngrdcol,1:gr%nzm),wpthlp_mc(1:ngrdcol,1:gr%nzm),wpthlp_forcing(1:ngrdcol,1:gr%nzm),wprtp_mc(1:ngrdcol,1:gr%nzm),rtp2_forcing(1:ngrdcol,1:gr%nzm),gr,thlp2_forcing(1:ngrdcol,1:gr%nzm),rtpthlp_mc(1:ngrdcol,1:gr%nzm),rtpthlp_forcing(1:ngrdcol,1:gr%nzm),rtp2_mc(1:ngrdcol,1:gr%nzm))
3343, Generating update self(rfrzm(:,:))
3353, Generating update device(rfrzm(:,:))
3572, Generating update self(pdf_params%varnce_w_1(:,:),pdf_params%thl_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%crt_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rt_1(:,:),pdf_params%rc_2(:,:),pdf_params%chi_1(:,:),p_in_pa(:,:),pdf_params%cthl_2(:,:),kh_zm(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),corr_array_1_n(:,:,:,:),cloud_frac(:,:),sigma_x_1_n(:,:,:),rtm(:,:),mu_x_1_n(:,:,:),lh_thl_clipped(:,:,:),lh_rv_clipped(:,:,:),wp3(:,:),x_nl_all_levs(:,:,:,:),x_mixt_comp_all_levs(:,:,:),exner(:,:),rho_ds_zm(:,:),rho(:,:),invrs_rho_ds_zt(:,:),wp2(:,:),wm_zt(:,:),thlm(:,:),wm_zm(:,:),pdf_params%w_2(:,:),rho_zm(:,:),rho_ds_zt(:,:),rcm(:,:),corr_array_2_n(:,:,:,:),mu_x_2_n(:,:,:),sigma_x_2_n(:,:,:))
3587, Generating copyout(skw_zm(:,:)) [if not already present]
Generating copyin(wp3_zm(:,:),wp2(:,:),clubb_params(:,:)) [if not already present]
3666, Generating update device(rtp2_mc(:,:),thlm_mc(:,:),rcm_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:),rvm_mc(:,:),rtpthlp_mc(:,:),wpthlp_mc(:,:))
3668, Generating update device(wphydrometp(:,:,:))
3687, Generating update self(cloud_frac(:,:),rcm(:,:),rho_zm(:,:),rho(:,:),exner(:,:))
3702, Generating update device(thlm_mc(:,:),rcm_mc(:,:))
3708, Generating update self(cloud_frac(:,:))
3719, Generating update self(rtp2_mc(:,:),thlm_mc(:,:),rcm_mc(:,:),wpthlp_mc(:,:),wprtp_mc(:,:),thlp2_mc(:,:),rvm_mc(:,:),rtpthlp_mc(:,:))
clean_up_clubb:
4045, Generating exit data delete(pdf_params_zm%ice_supersat_frac_1(:,:),pdf_params_zm%cthl_2(:,:),pdf_params_zm%cloud_frac_1(:,:),pdf_params_zm%chi_2(:,:),pdf_params_zm%rc_1(:,:),pdf_params_zm%mixt_frac(:,:),pdf_params_zm%rsatl_1(:,:),pdf_params_zm%rc_2(:,:),pdf_params_zm%corr_chi_eta_1(:,:),pdf_params_zm%cloud_frac_2(:,:),pdf_params_zm%corr_w_eta_1(:,:),pdf_params_zm%corr_w_chi_2(:,:),pdf_params_zm%corr_w_chi_1(:,:),pdf_params_zm%corr_rt_thl_2(:,:),pdf_params_zm%covar_chi_eta_1(:,:),pdf_params_zm%corr_w_thl_2(:,:),pdf_params_zm%stdev_eta_1(:,:),pdf_params_zm%stdev_chi_2(:,:),pdf_params_zm%stdev_chi_1(:,:),pdf_params_zm%rt_2(:,:),pdf_params_zm%chi_1(:,:),pdf_params_zm%alpha_thl(:,:),pdf_params_zm%cthl_1(:,:),pdf_params_zm%crt_2(:,:),pdf_params_zm%crt_1(:,:),pdf_params_zm%covar_chi_eta_2(:,:),pdf_params_zm,pdf_params_zm%alpha_rt(:,:),pdf_params_zm%corr_rt_thl_1(:,:),pdf_params_zm%corr_chi_eta_2(:,:),pdf_params_zm%corr_w_thl_1(:,:),pdf_params_zm%corr_w_rt_2(:,:),pdf_params_zm%corr_w_rt_1(:,:),pdf_params_zm%corr_w_eta_2(:,:),pdf_params_zm%varnce_thl_1(:,:),pdf_params_zm%varnce_rt_2(:,:),pdf_params_zm%thl_1(:,:),pdf_params_zm%stdev_eta_2(:,:),pdf_params_zm%varnce_rt_1(:,:),pdf_params_zm%thl_2(:,:),pdf_params_zm%rt_1(:,:),pdf_params_zm%rsatl_2(:,:),pdf_params%ice_supersat_frac_1(:,:),pdf_params%cthl_2(:,:),pdf_params%cloud_frac_1(:,:),pdf_params%chi_2(:,:),pdf_params%rc_1(:,:),pdf_params%mixt_frac(:,:),pdf_params%rsatl_1(:,:),pdf_params%rc_2(:,:),pdf_params%corr_chi_eta_1(:,:),pdf_params%cloud_frac_2(:,:),pdf_params%corr_w_eta_1(:,:),pdf_params%corr_w_chi_2(:,:),pdf_params%corr_w_chi_1(:,:),pdf_params%corr_rt_thl_2(:,:),pdf_params%covar_chi_eta_1(:,:),pdf_params%corr_w_thl_2(:,:),pdf_params%stdev_eta_1(:,:),pdf_params%stdev_chi_2(:,:),pdf_params%stdev_chi_1(:,:),pdf_params%rt_2(:,:),pdf_params%chi_1(:,:),pdf_params%alpha_thl(:,:),pdf_params%cthl_1(:,:),pdf_params%crt_2(:,:),pdf_params%crt_1(:,:),pdf_params%covar_chi_eta_2(:,:),pdf_params,pdf_params%alpha_rt(:,:),pdf_params%corr_rt_thl_1(:,:),pdf_params%corr_chi_eta_2(:,:),pdf_params%corr_w_thl_1(:,:),pdf_params%corr_w_rt_2(:,:),pdf_params%corr_w_rt_1(:,:),pdf_params%corr_w_eta_2(:,:),pdf_params%varnce_thl_1(:,:),pdf_params%varnce_rt_2(:,:),pdf_params%thl_1(:,:),pdf_params%stdev_eta_2(:,:),pdf_params%varnce_rt_1(:,:),pdf_params%thl_2(:,:),pdf_params%rt_1(:,:),pdf_params%rsatl_2(:,:),err_info,deep_soil_t_in_k_init(:),thv_ds_zt_init(:),rcm_mc(:,:),corr_cholesky_mtx_1(:,:,:,:),corr_array_2_n(:,:,:,:),corr_array_1_n(:,:,:,:),clubb_params(:,:),sigma_x_1_n(:,:,:),sfc_soil_t_in_k_init(:),mu_x_1_n(:,:,:),lscale(:,:),kh_zt(:,:),lh_rt_clipped(:,:,:),lh_nc_clipped(:,:,:),lh_sample_point_weights(:,:,:),lh_rc_clipped(:,:,:),lh_rv_clipped(:,:,:),wpvp2(:,:),x_mixt_comp_all_levs(:,:,:),lh_thl_clipped(:,:,:),invrs_tau_zm(:,:),kh_zm(:,:),invrs_rho_ds_zt_init(:),cloud_frac(:,:),cloudy_downdraft_frac(:,:),vpwp_sfc_pert(:),w_down_in_cloud(:,:),wp4(:,:),rcm(:,:),vpwp(:,:),upwp_init(:),vm_init(:),um_init(:),hm_metadata,wp2up2(:,:),wp2up(:,:),wpup2(:,:),wpthvp(:,:),wp3(:,:),radht(:,:),vp3(:,:),up3(:,:),wp2rtp(:,:),wp2thvp(:,:),wp2_init(:),wpthlp_sfc(:),cloud_cover(:,:),rc_coef_zm(:,:),err_info%err_header(:),nu_vert_res_dep%nu9(:),thlp2_mc(:,:),rtp2_mc(:,:),t_sfc(:),vp2_init(:),up2_init(:),vm_ref_init(:),um_ref_init(:),vprcp(:,:),vg_init(:),uprcp(:,:),ug_init(:),thlm_mc(:,:),rtm_init(:),vpwp_sfc(:),upwp_sfc(:),thv_ds_zm_init(:),thlpthvp(:,:),invrs_rho_ds_zm_init(:),ice_supersat_frac(:,:),rho_ds_zm_init(:),rho(:,:),rfrzm(:,:),rho_init(:),thlprcp(:,:),rtpthlp_mc(:,:),wp2thlp(:,:),wp2vp2(:,:),wm_zt_init(:),rtp3(:,:),thlm_ref_init(:),rtm_ref_init(:),wprtp_sfc(:),wprcp(:,:),thlp3(:,:),rtpthlp_forcing(:,:),thlp2_forcing(:,:),rtp2_forcing(:,:),wpthlp_forcing(:,:),wprtp_forcing(:,:),pdf_params_zm%w_2(:,:),thlm_init(:),rtpthvp(:,:),rcm_init(:),upwp_sfc_pert(:),sfc_elevation(:),corr_cholesky_mtx_2(:,:,:,:),vpwp_pert(:,:),upwp_pert(:,:),wprtp_mc(:,:),wpthlp_mc(:,:),rtpthlp(:,:),thlp2(:,:),rtp2(:,:),wpthlp(:,:),wprtp(:,:),w_up_in_cloud(:,:),vm(:,:),um(:,:),rtm(:,:),thlm(:,:),vm_pert(:,:),um_pert(:,:),veg_t_in_k_init(:),thvm_init(:),wm_zm_init(:),rho_zm_init(:),err_info%err_code(:),em_init(:),vm_ref(:,:),veg_t_in_k(:),sfc_soil_t_in_k(:),deep_soil_t_in_k(:),um_ref(:,:),thlm_ref(:,:),rtm_ref(:,:),thv_ds_zt(:,:),thv_ds_zm(:,:),invrs_rho_ds_zt(:,:),invrs_rho_ds_zm(:,:),rho_ds_zt(:,:),rho_ds_zm(:,:),rho_zm(:,:),rho_ds_zt_init(:),p_in_pa_init(:),p_in_pa(:,:),thvm(:,:),exner(:,:),dummy_dy(:),wm_zm(:,:),wm_zt(:,:),rcm_in_layer(:,:),upwp(:,:),vp2(:,:),up2(:,:),wp2(:,:),vg(:,:),ug(:,:),vm_forcing(:,:),um_forcing(:,:),rtm_forcing(:,:),thlm_forcing(:,:),pdf_params_zm%ice_supersat_frac_2(:,:),pdf_params_zm%varnce_w_1(:,:),pdf_params_zm%varnce_thl_2(:,:),pdf_params_zm%w_1(:,:),pdf_params_zm%varnce_w_2(:,:),pdf_params%ice_supersat_frac_2(:,:),pdf_params%varnce_w_1(:,:),pdf_params%varnce_thl_2(:,:),pdf_params%w_1(:,:),pdf_params%varnce_w_2(:,:),dummy_dx(:),deltaz(:),sclr_idx,fcor(:),exner_init(:),p_in_pa_zm_init(:),sigma_x_2_n(:,:,:),gr%zt(:,:),cloudy_updraft_frac(:,:),rvm_mc(:,:),pdf_params%w_2(:,:),p_sfc(:),nu_vert_res_dep%nu2(:),nu_vert_res_dep%nu1(:),nu_vert_res_dep%nu6(:),nu_vert_res_dep,nu_vert_res_dep%nu8(:),nu_vert_res_dep%nu10(:),mu_x_2_n(:,:,:),gr%invrs_dzt(:,:),gr%weights_zm2zt(:,:,:),gr%dzt(:,:),gr%invrs_dzm(:,:),gr%dzm(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:),fcor_y(:),x_nl_all_levs(:,:,:,:))
4121, Generating exit data delete(sclrpthlp(:,:,:),sclrprtp(:,:,:),sclrp3(:,:,:),sclrp2(:,:,:),sclrm_init(:,:),sclrpthvp(:,:,:),sclr_tol(:),wpsclrp(:,:,:),sclrm(:,:,:),sclrm_forcing(:,:,:),wpsclrp_sfc(:,:))
4126, Generating exit data delete(edsclrm(:,:,:),edsclrm_init(:,:),edsclrm_forcing(:,:,:),wpedsclrp_sfc(:,:))
4130, Generating exit data delete(rtphmp_zt(:,:,:),hm_metadata%l_mix_rat_hm(:),thlphmp_zt(:,:,:),wphydrometp(:,:,:),wp2hmp(:,:,:))
[901/915] Linking Fortran static library src/libclubb_driver_lib.a
[902/915] Generating Fortran dyndep file src/CMakeFiles/clubb_tuner.dir/Fortran.dd
[903/915] Generating Fortran dyndep file src/CMakeFiles/clubb_standalone.dir/Fortran.dd
[904/915] Generating Fortran dyndep file src/CMakeFiles/clubb_driver_test.dir/Fortran.dd
[905/915] Generating Fortran dyndep file src/CMakeFiles/clubb_thread_test.dir/Fortran.dd
[906/915] Building Fortran object src/CMakeFiles/clubb_driver_test.dir/clubb_driver_test.F90.o
[907/915] Building Fortran object src/CMakeFiles/clubb_standalone.dir/clubb_standalone.F90.o
[908/915] Building Fortran object src/CMakeFiles/clubb_thread_test.dir/clubb_thread_test.F90.o
[909/915] Linking Fortran executable src/clubb_standalone
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
[910/915] Linking Fortran executable src/clubb_driver_test
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
[911/915] Building Fortran object src/CMakeFiles/clubb_tuner.dir/error.F90.o
[912/915] Linking Fortran executable src/clubb_thread_test
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
[913/915] Building Fortran object src/CMakeFiles/clubb_tuner.dir/clubb_tuner.F90.o
[914/915] Linking Fortran executable src/clubb_tuner
nvfortran-Warning-The flag -Mcuda has been deprecated, please use -cuda and -gpu instead.
[914/915] Install the project...
-- Install configuration: "Release"
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/libclubb_driver_lib.a
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_tuner
-- Set runtime path of "/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_tuner" to "/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k:/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k/lib"
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/G_unit_tests
-- Set runtime path of "/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/G_unit_tests" to "/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k:/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k/lib"
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_thread_test
-- Set runtime path of "/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_thread_test" to "/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k:/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k/lib"
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone
-- Set runtime path of "/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_standalone" to "/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k:/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k/lib"
-- Installing: /home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_driver_test
-- Set runtime path of "/home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/install/nvhpc_GPUopenacc_PRECdouble/clubb_driver_test" to "/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k:/usr/local/spack/opt/spack/linux-pop22-cascadelake/nvhpc-24.3/netcdf-fortran-4.5.3-sl35xhk3ea5mtoylsgjg62d2bg3zto3k/lib"
CLUBBStandardsCheck.py: beginning check on src
PASS: 0 checks failed for src
CLUBBStandardsCheck.py: beginning check on src/CLUBB_core
PASS: 0 checks failed for src/CLUBB_core
CLUBBStandardsCheck.py: beginning check on src/SILHS
PASS: 0 checks failed for src/SILHS
CLUBBStandardsCheck.py: beginning check on src/Benchmark_cases
PASS: 0 checks failed for src/Benchmark_cases
CLUBBStandardsCheck.py: beginning check on src/Radiation
PASS: 0 checks failed for src/Radiation
CLUBBStandardsCheck.py: beginning check on src/Microphys
PASS: 0 checks failed for src/Microphys
CLUBBStandardsCheck.py: beginning check on src/Microphys/KK_microphys
PASS: 0 checks failed for src/Microphys/KK_microphys
CLUBBStandardsCheck.py: beginning check on src/G_unit_test_types
PASS: 0 checks failed for src/G_unit_test_types
[92mBuild completed successfully, and all source code checks passed.[0m
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run GPU_ACC)
[Pipeline] lock
Trying to acquire lock on [Resource: GPU_built-in]
The resource [GPU_built-in] is locked by build clubb_nvhpc_gpu_column_mirror_test #122 #122 since Apr 8, 2026, 3:07 AM.
[Resource: GPU_built-in] is not free, waiting for execution ...
[Required resources: [GPU_built-in]] added into queue at position 1
Lock acquired on [Resource: GPU_built-in]
[Pipeline] {
[Pipeline] sh
+ run_scripts/run_scm_all.py -nproc 1 -priority_cases
Performing priority-cases run
Using 1 process(es)
Cases to run: arm, atex, bomex, dycoms2_rf01, dycoms2_rf01_fixed_sst, dycoms2_rf02_ds, dycoms2_rf02_nd, mpace_b, rico, wangara, arm_97, cgils_s6, cgils_s11, cgils_s12, gabls3_night, lba, twp_ice
COMPLETE -- arm
COMPLETE -- atex
COMPLETE -- bomex
COMPLETE -- dycoms2_rf01
COMPLETE -- dycoms2_rf01_fixed_sst
COMPLETE -- dycoms2_rf02_ds
COMPLETE -- dycoms2_rf02_nd
COMPLETE -- mpace_b
COMPLETE -- rico
COMPLETE -- wangara
COMPLETE -- arm_97
COMPLETE -- cgils_s6
COMPLETE -- cgils_s11
COMPLETE -- cgils_s12
COMPLETE -- gabls3_night
COMPLETE -- lba
COMPLETE -- twp_ice
=================== Runs Complete ===================
All cases ran to completion.
+ mv output gpu_475e768
+ mkdir output
[Pipeline] }
Lock released on resource [Resource: GPU_built-in]
[Pipeline] // lock
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Plot)
[Pipeline] sh
+ scp -r carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master/cur_out .
[Pipeline] sh
++ cat cur_out/commit
+ python postprocessing/pyplotgen/pyplotgen.py -l -c cpu_475e768 gpu_475e768 cur_out/cpu_adfc58f cur_out/gpu_adfc58f -o 475e768_vs_master_adfc58f
*******************************************
Welcome to PyPlotGen.
*******************************************
Checking for model benchmark output...
Benchmark output found in /home/pub/les_and_clubb_benchmark_runs/.
-------------------------------------------
Running...
----------
NOTE: If processing multiple cases (ARM, BOMEX, etc.) with multithreading,
the total number of panels to be processed may increase as threads complete
and begin processing new cases.
----------
Progress: 0 of ? total .png panels complete
Progress: 10 of 83 total .png panels complete
Progress: 12 of 83 total .png panels complete
Progress: 14 of 83 total .png panels complete
Progress: 16 of 137 total .png panels complete
Progress: 18 of 137 total .png panels complete
Progress: 19 of 137 total .png panels complete
Progress: 21 of 137 total .png panels complete
Progress: 24 of 302 total .png panels complete
Progress: 26 of 302 total .png panels complete
Progress: 29 of 302 total .png panels complete
Progress: 32 of 302 total .png panels complete
Progress: 37 of 302 total .png panels complete
Progress: 41 of 370 total .png panels complete
Progress: 46 of 428 total .png panels complete
Progress: 48 of 428 total .png panels complete
Progress: 57 of 428 total .png panels complete
Progress: 64 of 428 total .png panels complete
Progress: 70 of 428 total .png panels complete
Progress: 78 of 428 total .png panels complete
Progress: 85 of 428 total .png panels complete
Progress: 91 of 486 total .png panels complete
Progress: 99 of 486 total .png panels complete
Progress: 106 of 486 total .png panels complete
Progress: 115 of 486 total .png panels complete
Progress: 126 of 486 total .png panels complete
Progress: 132 of 555 total .png panels complete
Progress: 146 of 555 total .png panels complete
Progress: 151 of 555 total .png panels complete
Progress: 159 of 555 total .png panels complete
Progress: 169 of 555 total .png panels complete
Progress: 176 of 555 total .png panels complete
Progress: 184 of 555 total .png panels complete
Progress: 191 of 555 total .png panels complete
Progress: 197 of 555 total .png panels complete
Progress: 205 of 555 total .png panels complete
Progress: 213 of 555 total .png panels complete
Progress: 222 of 628 total .png panels complete
Progress: 228 of 628 total .png panels complete
Progress: 235 of 628 total .png panels complete
Progress: 1 of 44 total .png panels complete
Progress: 2 of 44 total .png panels complete
Progress: 3 of 44 total .png panels complete
Progress: 4 of 44 total .png panels complete
Progress: 5 of 44 total .png panels complete
Progress: 6 of 44 total .png panels complete
Progress: 7 of 83 total .png panels complete
Progress: 8 of 83 total .png panels complete
Progress: 9 of 83 total .png panels complete
Progress: 11 of 83 total .png panels complete
Progress: 13 of 83 total .png panels complete
Progress: 15 of 83 total .png panels complete
Progress: 17 of 137 total .png panels complete
Progress: 20 of 137 total .png panels complete
Progress: 23 of 190 total .png panels complete
Progress: 27 of 302 total .png panels complete
Progress: 30 of 302 total .png panels complete
Progress: 36 of 302 total .png panels complete
Progress: 44 of 428 total .png panels complete
Progress: 49 of 428 total .png panels complete
Progress: 55 of 428 total .png panels complete
Progress: 63 of 428 total .png panels complete
Progress: 73 of 428 total .png panels complete
Progress: 80 of 428 total .png panels complete
Progress: 87 of 486 total .png panels complete
Progress: 96 of 486 total .png panels complete
Progress: 116 of 486 total .png panels complete
Progress: 130 of 486 total .png panels complete
Progress: 136 of 555 total .png panels complete
Progress: 145 of 555 total .png panels complete
Progress: 153 of 555 total .png panels complete
Progress: 164 of 555 total .png panels complete
Progress: 174 of 555 total .png panels complete
Progress: 189 of 555 total .png panels complete
Progress: 202 of 555 total .png panels complete
Progress: 212 of 555 total .png panels complete
Progress: 221 of 555 total .png panels complete
Progress: 234 of 628 total .png panels complete
Progress: 242 of 628 total .png panels complete
Progress: 251 of 628 total .png panels complete
Progress: 256 of 628 total .png panels complete
Progress: 267 of 628 total .png panels complete
Progress: 275 of 628 total .png panels complete
Progress: 284 of 688 total .png panels complete
Progress: 22 of 190 total .png panels complete
Progress: 25 of 302 total .png panels complete
Progress: 28 of 302 total .png panels complete
Progress: 34 of 302 total .png panels complete
Progress: 40 of 370 total .png panels complete
Progress: 47 of 428 total .png panels complete
Progress: 52 of 428 total .png panels complete
Progress: 59 of 428 total .png panels complete
Progress: 67 of 428 total .png panels complete
Progress: 75 of 428 total .png panels complete
Progress: 82 of 428 total .png panels complete
Progress: 89 of 486 total .png panels complete
Progress: 97 of 486 total .png panels complete
Progress: 104 of 486 total .png panels complete
Progress: 112 of 486 total .png panels complete
Progress: 124 of 486 total .png panels complete
Progress: 133 of 555 total .png panels complete
Progress: 140 of 555 total .png panels complete
Progress: 149 of 555 total .png panels complete
Progress: 157 of 555 total .png panels complete
Progress: 165 of 555 total .png panels complete
Progress: 171 of 555 total .png panels complete
Progress: 186 of 555 total .png panels complete
Progress: 198 of 555 total .png panels complete
Progress: 215 of 555 total .png panels complete
Progress: 240 of 628 total .png panels complete
Progress: 248 of 628 total .png panels complete
Progress: 259 of 628 total .png panels complete
Progress: 266 of 628 total .png panels complete
Progress: 273 of 628 total .png panels complete
Progress: 283 of 688 total .png panels complete
Progress: 291 of 688 total .png panels complete
Progress: 301 of 764 total .png panels complete
Progress: 311 of 764 total .png panels complete
Progress: 319 of 764 total .png panels complete
Progress: 326 of 764 total .png panels complete
Progress: 335 of 764 total .png panels complete
Progress: 347 of 764 total .png panels complete
Progress: 368 of 764 total .png panels complete
Progress: 379 of 764 total .png panels complete
Progress: 387 of 764 total .png panels complete
Progress: 400 of 764 total .png panels complete
Progress: 408 of 764 total .png panels complete
Progress: 418 of 764 total .png panels complete
Progress: 429 of 821 total .png panels complete
Progress: 445 of 821 total .png panels complete
Progress: 458 of 904 total .png panels complete
Progress: 470 of 904 total .png panels complete
Progress: 484 of 904 total .png panels complete
Progress: 511 of 904 total .png panels complete
Progress: 524 of 904 total .png panels complete
Progress: 533 of 904 total .png panels complete
Progress: 543 of 904 total .png panels complete
Progress: 551 of 904 total .png panels complete
Progress: 31 of 302 total .png panels complete
Progress: 38 of 302 total .png panels complete
Progress: 45 of 428 total .png panels complete
Progress: 53 of 428 total .png panels complete
Progress: 61 of 428 total .png panels complete
Progress: 68 of 428 total .png panels complete
Progress: 76 of 428 total .png panels complete
Progress: 83 of 428 total .png panels complete
Progress: 95 of 486 total .png panels complete
Progress: 102 of 486 total .png panels complete
Progress: 110 of 486 total .png panels complete
Progress: 118 of 486 total .png panels complete
Progress: 123 of 486 total .png panels complete
Progress: 134 of 555 total .png panels complete
Progress: 144 of 555 total .png panels complete
Progress: 158 of 555 total .png panels complete
Progress: 168 of 555 total .png panels complete
Progress: 180 of 555 total .png panels complete
Progress: 188 of 555 total .png panels complete
Progress: 200 of 555 total .png panels complete
Progress: 208 of 555 total .png panels complete
Progress: 219 of 555 total .png panels complete
Progress: 231 of 628 total .png panels complete
Progress: 252 of 628 total .png panels complete
Progress: 260 of 628 total .png panels complete
Progress: 274 of 628 total .png panels complete
Progress: 286 of 688 total .png panels complete
Progress: 295 of 764 total .png panels complete
Progress: 304 of 764 total .png panels complete
Progress: 314 of 764 total .png panels complete
Progress: 325 of 764 total .png panels complete
Progress: 340 of 764 total .png panels complete
Progress: 349 of 764 total .png panels complete
Progress: 358 of 764 total .png panels complete
Progress: 367 of 764 total .png panels complete
Progress: 377 of 764 total .png panels complete
Progress: 385 of 764 total .png panels complete
Progress: 392 of 764 total .png panels complete
Progress: 416 of 764 total .png panels complete
Progress: 428 of 821 total .png panels complete
Progress: 442 of 821 total .png panels complete
Progress: 454 of 904 total .png panels complete
Progress: 471 of 904 total .png panels complete
Progress: 481 of 904 total .png panels complete
Progress: 491 of 904 total .png panels complete
Progress: 502 of 904 total .png panels complete
Progress: 513 of 904 total .png panels complete
Progress: 522 of 904 total .png panels complete
Progress: 535 of 904 total .png panels complete
Progress: 549 of 904 total .png panels complete
Progress: 560 of 904 total .png panels complete
Progress: 572 of 904 total .png panels complete
Progress: 583 of 904 total .png panels complete
Progress: 33 of 302 total .png panels complete
Progress: 39 of 302 total .png panels complete
Progress: 43 of 428 total .png panels complete
Progress: 51 of 428 total .png panels complete
Progress: 56 of 428 total .png panels complete
Progress: 66 of 428 total .png panels complete
Progress: 74 of 428 total .png panels complete
Progress: 79 of 428 total .png panels complete
Progress: 90 of 486 total .png panels complete
Progress: 98 of 486 total .png panels complete
Progress: 105 of 486 total .png panels complete
Progress: 113 of 486 total .png panels complete
Progress: 121 of 486 total .png panels complete
Progress: 129 of 486 total .png panels complete
Progress: 141 of 555 total .png panels complete
Progress: 152 of 555 total .png panels complete
Progress: 161 of 555 total .png panels complete
Progress: 172 of 555 total .png panels complete
Progress: 185 of 555 total .png panels complete
Progress: 194 of 555 total .png panels complete
Progress: 203 of 555 total .png panels complete
Progress: 211 of 555 total .png panels complete
Progress: 223 of 628 total .png panels complete
Progress: 233 of 628 total .png panels complete
Progress: 245 of 628 total .png panels complete
Progress: 268 of 628 total .png panels complete
Progress: 277 of 688 total .png panels complete
Progress: 289 of 688 total .png panels complete
Progress: 300 of 764 total .png panels complete
Progress: 306 of 764 total .png panels complete
Progress: 317 of 764 total .png panels complete
Progress: 330 of 764 total .png panels complete
Progress: 338 of 764 total .png panels complete
Progress: 348 of 764 total .png panels complete
Progress: 357 of 764 total .png panels complete
Progress: 365 of 764 total .png panels complete
Progress: 378 of 764 total .png panels complete
Progress: 388 of 764 total .png panels complete
Progress: 409 of 764 total .png panels complete
Progress: 419 of 764 total .png panels complete
Progress: 436 of 821 total .png panels complete
Progress: 446 of 821 total .png panels complete
Progress: 453 of 904 total .png panels complete
Progress: 467 of 904 total .png panels complete
Progress: 478 of 904 total .png panels complete
Progress: 496 of 904 total .png panels complete
Progress: 512 of 904 total .png panels complete
Progress: 530 of 904 total .png panels complete
Progress: 536 of 904 total .png panels complete
Progress: 554 of 904 total .png panels complete
Progress: 568 of 904 total .png panels complete
Progress: 581 of 904 total .png panels complete
Progress: 592 of 904 total .png panels complete
Progress: 603 of 904 total .png panels complete
Progress: 35 of 302 total .png panels complete
Progress: 42 of 428 total .png panels complete
Progress: 50 of 428 total .png panels complete
Progress: 60 of 428 total .png panels complete
Progress: 71 of 428 total .png panels complete
Progress: 81 of 428 total .png panels complete
Progress: 88 of 486 total .png panels complete
Progress: 94 of 486 total .png panels complete
Progress: 101 of 486 total .png panels complete
Progress: 109 of 486 total .png panels complete
Progress: 120 of 486 total .png panels complete
Progress: 127 of 486 total .png panels complete
Progress: 137 of 555 total .png panels complete
Progress: 148 of 555 total .png panels complete
Progress: 167 of 555 total .png panels complete
Progress: 178 of 555 total .png panels complete
Progress: 187 of 555 total .png panels complete
Progress: 196 of 555 total .png panels complete
Progress: 209 of 555 total .png panels complete
Progress: 220 of 555 total .png panels complete
Progress: 229 of 628 total .png panels complete
Progress: 241 of 628 total .png panels complete
Progress: 249 of 628 total .png panels complete
Progress: 258 of 628 total .png panels complete
Progress: 263 of 628 total .png panels complete
Progress: 278 of 688 total .png panels complete
Progress: 292 of 764 total .png panels complete
Progress: 303 of 764 total .png panels complete
Progress: 313 of 764 total .png panels complete
Progress: 323 of 764 total .png panels complete
Progress: 334 of 764 total .png panels complete
Progress: 344 of 764 total .png panels complete
Progress: 353 of 764 total .png panels complete
Progress: 360 of 764 total .png panels complete
Progress: 369 of 764 total .png panels complete
Progress: 382 of 764 total .png panels complete
Progress: 395 of 764 total .png panels complete
Progress: 403 of 764 total .png panels complete
Progress: 412 of 764 total .png panels complete
Progress: 422 of 764 total .png panels complete
Progress: 430 of 821 total .png panels complete
Progress: 438 of 821 total .png panels complete
Progress: 447 of 821 total .png panels complete
Progress: 456 of 904 total .png panels complete
Progress: 468 of 904 total .png panels complete
Progress: 479 of 904 total .png panels complete
Progress: 489 of 904 total .png panels complete
Progress: 505 of 904 total .png panels complete
Progress: 515 of 904 total .png panels complete
Progress: 527 of 904 total .png panels complete
Progress: 537 of 904 total .png panels complete
Progress: 547 of 904 total .png panels complete
Progress: 559 of 904 total .png panels complete
Progress: 570 of 904 total .png panels complete
Progress: 579 of 904 total .png panels complete
Progress: 593 of 904 total .png panels complete
Progress: 602 of 904 total .png panels complete
Progress: 614 of 904 total .png panels complete
Progress: 58 of 428 total .png panels complete
Progress: 65 of 428 total .png panels complete
Progress: 72 of 428 total .png panels complete
Progress: 84 of 428 total .png panels complete
Progress: 93 of 486 total .png panels complete
Progress: 103 of 486 total .png panels complete
Progress: 111 of 486 total .png panels complete
Progress: 119 of 486 total .png panels complete
Progress: 128 of 486 total .png panels complete
Progress: 135 of 555 total .png panels complete
Progress: 142 of 555 total .png panels complete
Progress: 154 of 555 total .png panels complete
Progress: 162 of 555 total .png panels complete
Progress: 170 of 555 total .png panels complete
Progress: 179 of 555 total .png panels complete
Progress: 195 of 555 total .png panels complete
Progress: 206 of 555 total .png panels complete
Progress: 214 of 555 total .png panels complete
Progress: 226 of 628 total .png panels complete
Progress: 236 of 628 total .png panels complete
Progress: 244 of 628 total .png panels complete
Progress: 254 of 628 total .png panels complete
Progress: 261 of 628 total .png panels complete
Progress: 269 of 628 total .png panels complete
Progress: 280 of 688 total .png panels complete
Progress: 288 of 688 total .png panels complete
Progress: 309 of 764 total .png panels complete
Progress: 328 of 764 total .png panels complete
Progress: 336 of 764 total .png panels complete
Progress: 346 of 764 total .png panels complete
Progress: 356 of 764 total .png panels complete
Progress: 364 of 764 total .png panels complete
Progress: 376 of 764 total .png panels complete
Progress: 384 of 764 total .png panels complete
Progress: 391 of 764 total .png panels complete
Progress: 401 of 764 total .png panels complete
Progress: 417 of 764 total .png panels complete
Progress: 432 of 821 total .png panels complete
Progress: 443 of 821 total .png panels complete
Progress: 452 of 904 total .png panels complete
Progress: 463 of 904 total .png panels complete
Progress: 472 of 904 total .png panels complete
Progress: 483 of 904 total .png panels complete
Progress: 494 of 904 total .png panels complete
Progress: 509 of 904 total .png panels complete
Progress: 516 of 904 total .png panels complete
Progress: 531 of 904 total .png panels complete
Progress: 539 of 904 total .png panels complete
Progress: 552 of 904 total .png panels complete
Progress: 564 of 904 total .png panels complete
Progress: 575 of 904 total .png panels complete
Progress: 584 of 904 total .png panels complete
Progress: 594 of 904 total .png panels complete
Progress: 604 of 904 total .png panels complete
Progress: 613 of 904 total .png panels complete
Progress: 622 of 904 total .png panels complete
Progress: 630 of 904 total .png panels complete
Progress: 637 of 904 total .png panels complete
Progress: 54 of 428 total .png panels complete
Progress: 62 of 428 total .png panels complete
Progress: 69 of 428 total .png panels complete
Progress: 77 of 428 total .png panels complete
Progress: 86 of 428 total .png panels complete
Progress: 92 of 486 total .png panels complete
Progress: 100 of 486 total .png panels complete
Progress: 107 of 486 total .png panels complete
Progress: 114 of 486 total .png panels complete
Progress: 122 of 486 total .png panels complete
Progress: 131 of 486 total .png panels complete
Progress: 138 of 555 total .png panels complete
Progress: 143 of 555 total .png panels complete
Progress: 150 of 555 total .png panels complete
Progress: 160 of 555 total .png panels complete
Progress: 173 of 555 total .png panels complete
Progress: 181 of 555 total .png panels complete
Progress: 190 of 555 total .png panels complete
Progress: 201 of 555 total .png panels complete
Progress: 210 of 555 total .png panels complete
Progress: 218 of 555 total .png panels complete
Progress: 224 of 628 total .png panels complete
Progress: 230 of 628 total .png panels complete
Progress: 238 of 628 total .png panels complete
Progress: 247 of 628 total .png panels complete
Progress: 257 of 628 total .png panels complete
Progress: 276 of 628 total .png panels complete
Progress: 285 of 688 total .png panels complete
Progress: 294 of 764 total .png panels complete
Progress: 302 of 764 total .png panels complete
Progress: 312 of 764 total .png panels complete
Progress: 321 of 764 total .png panels complete
Progress: 331 of 764 total .png panels complete
Progress: 342 of 764 total .png panels complete
Progress: 355 of 764 total .png panels complete
Progress: 370 of 764 total .png panels complete
Progress: 380 of 764 total .png panels complete
Progress: 399 of 764 total .png panels complete
Progress: 404 of 764 total .png panels complete
Progress: 414 of 764 total .png panels complete
Progress: 426 of 821 total .png panels complete
Progress: 439 of 821 total .png panels complete
Progress: 450 of 904 total .png panels complete
Progress: 459 of 904 total .png panels complete
Progress: 469 of 904 total .png panels complete
Progress: 477 of 904 total .png panels complete
Progress: 492 of 904 total .png panels complete
Progress: 506 of 904 total .png panels complete
Progress: 526 of 904 total .png panels complete
Progress: 545 of 904 total .png panels complete
Progress: 557 of 904 total .png panels complete
Progress: 565 of 904 total .png panels complete
Progress: 576 of 904 total .png panels complete
Progress: 588 of 904 total .png panels complete
Progress: 598 of 904 total .png panels complete
Progress: 609 of 904 total .png panels complete
Progress: 615 of 904 total .png panels complete
Progress: 623 of 904 total .png panels complete
Progress: 635 of 904 total .png panels complete
Progress: 642 of 904 total .png panels complete
Progress: 654 of 904 total .png panels complete
Progress: 662 of 904 total .png panels complete
Progress: 669 of 904 total .png panels complete
Progress: 677 of 904 total .png panels complete
Progress: 684 of 904 total .png panels complete
Progress: 691 of 904 total .png panels complete
Progress: 699 of 904 total .png panels complete
Progress: 707 of 904 total .png panels complete
Progress: 108 of 486 total .png panels complete
Progress: 117 of 486 total .png panels complete
Progress: 125 of 486 total .png panels complete
Progress: 139 of 555 total .png panels complete
Progress: 147 of 555 total .png panels complete
Progress: 156 of 555 total .png panels complete
Progress: 166 of 555 total .png panels complete
Progress: 177 of 555 total .png panels complete
Progress: 183 of 555 total .png panels complete
Progress: 193 of 555 total .png panels complete
Progress: 204 of 555 total .png panels complete
Progress: 216 of 555 total .png panels complete
Progress: 227 of 628 total .png panels complete
Progress: 237 of 628 total .png panels complete
Progress: 250 of 628 total .png panels complete
Progress: 264 of 628 total .png panels complete
Progress: 270 of 628 total .png panels complete
Progress: 282 of 688 total .png panels complete
Progress: 293 of 764 total .png panels complete
Progress: 299 of 764 total .png panels complete
Progress: 310 of 764 total .png panels complete
Progress: 322 of 764 total .png panels complete
Progress: 337 of 764 total .png panels complete
Progress: 352 of 764 total .png panels complete
Progress: 362 of 764 total .png panels complete
Progress: 371 of 764 total .png panels complete
Progress: 393 of 764 total .png panels complete
Progress: 406 of 764 total .png panels complete
Progress: 413 of 764 total .png panels complete
Progress: 424 of 764 total .png panels complete
Progress: 435 of 821 total .png panels complete
Progress: 449 of 904 total .png panels complete
Progress: 462 of 904 total .png panels complete
Progress: 473 of 904 total .png panels complete
Progress: 490 of 904 total .png panels complete
Progress: 507 of 904 total .png panels complete
Progress: 523 of 904 total .png panels complete
Progress: 534 of 904 total .png panels complete
Progress: 553 of 904 total .png panels complete
Progress: 567 of 904 total .png panels complete
Progress: 578 of 904 total .png panels complete
Progress: 590 of 904 total .png panels complete
Progress: 599 of 904 total .png panels complete
Progress: 606 of 904 total .png panels complete
Progress: 616 of 904 total .png panels complete
Progress: 624 of 904 total .png panels complete
Progress: 633 of 904 total .png panels complete
Progress: 642 of 904 total .png panels complete
Progress: 649 of 904 total .png panels complete
Progress: 657 of 904 total .png panels complete
Progress: 670 of 904 total .png panels complete
Progress: 678 of 904 total .png panels complete
Progress: 687 of 904 total .png panels complete
Progress: 695 of 904 total .png panels complete
Progress: 706 of 904 total .png panels complete
Progress: 713 of 904 total .png panels complete
Progress: 719 of 904 total .png panels complete
Progress: 725 of 904 total .png panels complete
Progress: 155 of 555 total .png panels complete
Progress: 163 of 555 total .png panels complete
Progress: 175 of 555 total .png panels complete
Progress: 182 of 555 total .png panels complete
Progress: 192 of 555 total .png panels complete
Progress: 199 of 555 total .png panels complete
Progress: 207 of 555 total .png panels complete
Progress: 217 of 555 total .png panels complete
Progress: 225 of 628 total .png panels complete
Progress: 232 of 628 total .png panels complete
Progress: 239 of 628 total .png panels complete
Progress: 246 of 628 total .png panels complete
Progress: 255 of 628 total .png panels complete
Progress: 265 of 628 total .png panels complete
Progress: 272 of 628 total .png panels complete
Progress: 279 of 688 total .png panels complete
Progress: 287 of 688 total .png panels complete
Progress: 297 of 764 total .png panels complete
Progress: 305 of 764 total .png panels complete
Progress: 318 of 764 total .png panels complete
Progress: 329 of 764 total .png panels complete
Progress: 343 of 764 total .png panels complete
Progress: 359 of 764 total .png panels complete
Progress: 374 of 764 total .png panels complete
Progress: 394 of 764 total .png panels complete
Progress: 402 of 764 total .png panels complete
Progress: 411 of 764 total .png panels complete
Progress: 423 of 764 total .png panels complete
Progress: 434 of 821 total .png panels complete
Progress: 440 of 821 total .png panels complete
Progress: 451 of 904 total .png panels complete
Progress: 464 of 904 total .png panels complete
Progress: 474 of 904 total .png panels complete
Progress: 486 of 904 total .png panels complete
Progress: 500 of 904 total .png panels complete
Progress: 517 of 904 total .png panels complete
Progress: 542 of 904 total .png panels complete
Progress: 550 of 904 total .png panels complete
Progress: 562 of 904 total .png panels complete
Progress: 573 of 904 total .png panels complete
Progress: 585 of 904 total .png panels complete
Progress: 595 of 904 total .png panels complete
Progress: 608 of 904 total .png panels complete
Progress: 618 of 904 total .png panels complete
Progress: 627 of 904 total .png panels complete
Progress: 636 of 904 total .png panels complete
Progress: 643 of 904 total .png panels complete
Progress: 656 of 904 total .png panels complete
Progress: 664 of 904 total .png panels complete
Progress: 672 of 904 total .png panels complete
Progress: 679 of 904 total .png panels complete
Progress: 686 of 904 total .png panels complete
Progress: 694 of 904 total .png panels complete
Progress: 700 of 904 total .png panels complete
Progress: 708 of 904 total .png panels complete
Progress: 714 of 904 total .png panels complete
Progress: 721 of 904 total .png panels complete
Progress: 730 of 904 total .png panels complete
Progress: 739 of 904 total .png panels complete
Progress: 745 of 904 total .png panels complete
Progress: 751 of 904 total .png panels complete
Progress: 756 of 904 total .png panels complete
Progress: 762 of 904 total .png panels complete
Progress: 768 of 904 total .png panels complete
Progress: 774 of 904 total .png panels complete
Progress: 777 of 904 total .png panels complete
Progress: 783 of 904 total .png panels complete
Progress: 789 of 904 total .png panels complete
Progress: 793 of 904 total .png panels complete
Progress: 296 of 764 total .png panels complete
Progress: 307 of 764 total .png panels complete
Progress: 320 of 764 total .png panels complete
Progress: 333 of 764 total .png panels complete
Progress: 341 of 764 total .png panels complete
Progress: 350 of 764 total .png panels complete
Progress: 366 of 764 total .png panels complete
Progress: 373 of 764 total .png panels complete
Progress: 381 of 764 total .png panels complete
Progress: 389 of 764 total .png panels complete
Progress: 397 of 764 total .png panels complete
Progress: 410 of 764 total .png panels complete
Progress: 421 of 764 total .png panels complete
Progress: 433 of 821 total .png panels complete
Progress: 441 of 821 total .png panels complete
Progress: 457 of 904 total .png panels complete
Progress: 465 of 904 total .png panels complete
Progress: 476 of 904 total .png panels complete
Progress: 487 of 904 total .png panels complete
Progress: 498 of 904 total .png panels complete
Progress: 510 of 904 total .png panels complete
Progress: 518 of 904 total .png panels complete
Progress: 528 of 904 total .png panels complete
Progress: 541 of 904 total .png panels complete
Progress: 548 of 904 total .png panels complete
Progress: 563 of 904 total .png panels complete
Progress: 597 of 904 total .png panels complete
Progress: 611 of 904 total .png panels complete
Progress: 619 of 904 total .png panels complete
Progress: 628 of 904 total .png panels complete
Progress: 640 of 904 total .png panels complete
Progress: 646 of 904 total .png panels complete
Progress: 651 of 904 total .png panels complete
Progress: 658 of 904 total .png panels complete
Progress: 665 of 904 total .png panels complete
Progress: 674 of 904 total .png panels complete
Progress: 681 of 904 total .png panels complete
Progress: 688 of 904 total .png panels complete
Progress: 698 of 904 total .png panels complete
Progress: 704 of 904 total .png panels complete
Progress: 712 of 904 total .png panels complete
Progress: 718 of 904 total .png panels complete
Progress: 724 of 904 total .png panels complete
Progress: 728 of 904 total .png panels complete
Progress: 733 of 904 total .png panels complete
Progress: 737 of 904 total .png panels complete
Progress: 742 of 904 total .png panels complete
Progress: 747 of 904 total .png panels complete
Progress: 752 of 904 total .png panels complete
Progress: 757 of 904 total .png panels complete
Progress: 766 of 904 total .png panels complete
Progress: 772 of 904 total .png panels complete
Progress: 778 of 904 total .png panels complete
Progress: 782 of 904 total .png panels complete
Progress: 788 of 904 total .png panels complete
Progress: 791 of 904 total .png panels complete
Progress: 796 of 904 total .png panels complete
Progress: 800 of 904 total .png panels complete
Progress: 806 of 904 total .png panels complete
Progress: 811 of 904 total .png panels complete
Progress: 243 of 628 total .png panels complete
Progress: 253 of 628 total .png panels complete
Progress: 262 of 628 total .png panels complete
Progress: 271 of 628 total .png panels complete
Progress: 281 of 688 total .png panels complete
Progress: 290 of 688 total .png panels complete
Progress: 298 of 764 total .png panels complete
Progress: 308 of 764 total .png panels complete
Progress: 316 of 764 total .png panels complete
Progress: 327 of 764 total .png panels complete
Progress: 339 of 764 total .png panels complete
Progress: 351 of 764 total .png panels complete
Progress: 361 of 764 total .png panels complete
Progress: 375 of 764 total .png panels complete
Progress: 386 of 764 total .png panels complete
Progress: 396 of 764 total .png panels complete
Progress: 405 of 764 total .png panels complete
Progress: 415 of 764 total .png panels complete
Progress: 425 of 764 total .png panels complete
Progress: 431 of 821 total .png panels complete
Progress: 444 of 821 total .png panels complete
Progress: 460 of 904 total .png panels complete
Progress: 482 of 904 total .png panels complete
Progress: 495 of 904 total .png panels complete
Progress: 503 of 904 total .png panels complete
Progress: 521 of 904 total .png panels complete
Progress: 546 of 904 total .png panels complete
Progress: 561 of 904 total .png panels complete
Progress: 574 of 904 total .png panels complete
Progress: 586 of 904 total .png panels complete
Progress: 596 of 904 total .png panels complete
Progress: 605 of 904 total .png panels complete
Progress: 620 of 904 total .png panels complete
Progress: 626 of 904 total .png panels complete
Progress: 634 of 904 total .png panels complete
Progress: 648 of 904 total .png panels complete
Progress: 655 of 904 total .png panels complete
Progress: 663 of 904 total .png panels complete
Progress: 671 of 904 total .png panels complete
Progress: 682 of 904 total .png panels complete
Progress: 690 of 904 total .png panels complete
Progress: 697 of 904 total .png panels complete
Progress: 705 of 904 total .png panels complete
Progress: 711 of 904 total .png panels complete
Progress: 717 of 904 total .png panels complete
Progress: 723 of 904 total .png panels complete
Progress: 729 of 904 total .png panels complete
Progress: 736 of 904 total .png panels complete
Progress: 741 of 904 total .png panels complete
Progress: 748 of 904 total .png panels complete
Progress: 754 of 904 total .png panels complete
Progress: 760 of 904 total .png panels complete
Progress: 765 of 904 total .png panels complete
Progress: 770 of 904 total .png panels complete
Progress: 776 of 904 total .png panels complete
Progress: 781 of 904 total .png panels complete
Progress: 787 of 904 total .png panels complete
Progress: 795 of 904 total .png panels complete
Progress: 801 of 904 total .png panels complete
Progress: 805 of 904 total .png panels complete
Progress: 809 of 904 total .png panels complete
Progress: 814 of 904 total .png panels complete
Progress: 818 of 904 total .png panels complete
Progress: 822 of 904 total .png panels complete
Progress: 827 of 904 total .png panels complete
Progress: 831 of 904 total .png panels complete
Progress: 836 of 904 total .png panels complete
Progress: 840 of 904 total .png panels complete
Progress: 846 of 904 total .png panels complete
Progress: 849 of 904 total .png panels complete
Progress: 852 of 904 total .png panels complete
Progress: 856 of 904 total .png panels complete
Progress: 860 of 904 total .png panels complete
Progress: 455 of 904 total .png panels complete
Progress: 466 of 904 total .png panels complete
Progress: 475 of 904 total .png panels complete
Progress: 488 of 904 total .png panels complete
Progress: 499 of 904 total .png panels complete
Progress: 508 of 904 total .png panels complete
Progress: 520 of 904 total .png panels complete
Progress: 532 of 904 total .png panels complete
Progress: 544 of 904 total .png panels complete
Progress: 558 of 904 total .png panels complete
Progress: 571 of 904 total .png panels complete
Progress: 582 of 904 total .png panels complete
Progress: 589 of 904 total .png panels complete
Progress: 600 of 904 total .png panels complete
Progress: 612 of 904 total .png panels complete
Progress: 621 of 904 total .png panels complete
Progress: 629 of 904 total .png panels complete
Progress: 639 of 904 total .png panels complete
Progress: 644 of 904 total .png panels complete
Progress: 652 of 904 total .png panels complete
Progress: 660 of 904 total .png panels complete
Progress: 668 of 904 total .png panels complete
Progress: 675 of 904 total .png panels complete
Progress: 683 of 904 total .png panels complete
Progress: 692 of 904 total .png panels complete
Progress: 703 of 904 total .png panels complete
Progress: 716 of 904 total .png panels complete
Progress: 727 of 904 total .png panels complete
Progress: 732 of 904 total .png panels complete
Progress: 738 of 904 total .png panels complete
Progress: 744 of 904 total .png panels complete
Progress: 750 of 904 total .png panels complete
Progress: 758 of 904 total .png panels complete
Progress: 763 of 904 total .png panels complete
Progress: 771 of 904 total .png panels complete
Progress: 779 of 904 total .png panels complete
Progress: 786 of 904 total .png panels complete
Progress: 794 of 904 total .png panels complete
Progress: 799 of 904 total .png panels complete
Progress: 803 of 904 total .png panels complete
Progress: 808 of 904 total .png panels complete
Progress: 813 of 904 total .png panels complete
Progress: 817 of 904 total .png panels complete
Progress: 820 of 904 total .png panels complete
Progress: 824 of 904 total .png panels complete
Progress: 828 of 904 total .png panels complete
Progress: 833 of 904 total .png panels complete
Progress: 837 of 904 total .png panels complete
Progress: 845 of 904 total .png panels complete
Progress: 850 of 904 total .png panels complete
Progress: 854 of 904 total .png panels complete
Progress: 857 of 904 total .png panels complete
Progress: 861 of 904 total .png panels complete
Progress: 864 of 904 total .png panels complete
Progress: 867 of 987 total .png panels complete
Progress: 870 of 987 total .png panels complete
Progress: 873 of 987 total .png panels complete
Progress: 480 of 904 total .png panels complete
Progress: 493 of 904 total .png panels complete
Progress: 501 of 904 total .png panels complete
Progress: 519 of 904 total .png panels complete
Progress: 529 of 904 total .png panels complete
Progress: 538 of 904 total .png panels complete
Progress: 556 of 904 total .png panels complete
Progress: 566 of 904 total .png panels complete
Progress: 577 of 904 total .png panels complete
Progress: 591 of 904 total .png panels complete
Progress: 601 of 904 total .png panels complete
Progress: 610 of 904 total .png panels complete
Progress: 617 of 904 total .png panels complete
Progress: 625 of 904 total .png panels complete
Progress: 632 of 904 total .png panels complete
Progress: 647 of 904 total .png panels complete
Progress: 653 of 904 total .png panels complete
Progress: 661 of 904 total .png panels complete
Progress: 667 of 904 total .png panels complete
Progress: 676 of 904 total .png panels complete
Progress: 685 of 904 total .png panels complete
Progress: 693 of 904 total .png panels complete
Progress: 701 of 904 total .png panels complete
Progress: 709 of 904 total .png panels complete
Progress: 715 of 904 total .png panels complete
Progress: 722 of 904 total .png panels complete
Progress: 735 of 904 total .png panels complete
Progress: 743 of 904 total .png panels complete
Progress: 749 of 904 total .png panels complete
Progress: 755 of 904 total .png panels complete
Progress: 761 of 904 total .png panels complete
Progress: 767 of 904 total .png panels complete
Progress: 773 of 904 total .png panels complete
Progress: 780 of 904 total .png panels complete
Progress: 785 of 904 total .png panels complete
Progress: 792 of 904 total .png panels complete
Progress: 798 of 904 total .png panels complete
Progress: 804 of 904 total .png panels complete
Progress: 810 of 904 total .png panels complete
Progress: 816 of 904 total .png panels complete
Progress: 821 of 904 total .png panels complete
Progress: 825 of 904 total .png panels complete
Progress: 829 of 904 total .png panels complete
Progress: 832 of 904 total .png panels complete
Progress: 835 of 904 total .png panels complete
Progress: 838 of 904 total .png panels complete
Progress: 841 of 904 total .png panels complete
Progress: 843 of 904 total .png panels complete
Progress: 847 of 904 total .png panels complete
Progress: 853 of 904 total .png panels complete
Progress: 858 of 904 total .png panels complete
Progress: 862 of 904 total .png panels complete
Progress: 865 of 987 total .png panels complete
Progress: 869 of 987 total .png panels complete
Progress: 871 of 987 total .png panels complete
Progress: 874 of 987 total .png panels complete
Progress: 877 of 987 total .png panels complete
Progress: 879 of 987 total .png panels complete
Progress: 882 of 987 total .png panels complete
Progress: 885 of 987 total .png panels complete
Progress: 887 of 987 total .png panels complete
Progress: 890 of 987 total .png panels complete
Progress: 892 of 987 total .png panels complete
Progress: 894 of 987 total .png panels complete
Progress: 896 of 987 total .png panels complete
Progress: 898 of 987 total .png panels complete
Progress: 901 of 987 total .png panels complete
Progress: 903 of 987 total .png panels complete
Progress: 905 of 987 total .png panels complete
Progress: 907 of 987 total .png panels complete
Progress: 909 of 987 total .png panels complete
Progress: 911 of 987 total .png panels complete
Progress: 914 of 987 total .png panels complete
Progress: 916 of 987 total .png panels complete
Progress: 918 of 987 total .png panels complete
Progress: 920 of 987 total .png panels complete
Progress: 922 of 987 total .png panels complete
Progress: 924 of 987 total .png panels complete
Progress: 926 of 987 total .png panels complete
Progress: 927 of 987 total .png panels complete
Progress: 929 of 987 total .png panels complete
Progress: 930 of 987 total .png panels complete
Progress: 933 of 987 total .png panels complete
Progress: 315 of 764 total .png panels complete
Progress: 324 of 764 total .png panels complete
Progress: 332 of 764 total .png panels complete
Progress: 345 of 764 total .png panels complete
Progress: 354 of 764 total .png panels complete
Progress: 363 of 764 total .png panels complete
Progress: 372 of 764 total .png panels complete
Progress: 383 of 764 total .png panels complete
Progress: 390 of 764 total .png panels complete
Progress: 398 of 764 total .png panels complete
Progress: 407 of 764 total .png panels complete
Progress: 420 of 764 total .png panels complete
Progress: 427 of 821 total .png panels complete
Progress: 437 of 821 total .png panels complete
Progress: 448 of 904 total .png panels complete
Progress: 461 of 904 total .png panels complete
Progress: 485 of 904 total .png panels complete
Progress: 497 of 904 total .png panels complete
Progress: 504 of 904 total .png panels complete
Progress: 514 of 904 total .png panels complete
Progress: 525 of 904 total .png panels complete
Progress: 540 of 904 total .png panels complete
Progress: 555 of 904 total .png panels complete
Progress: 569 of 904 total .png panels complete
Progress: 580 of 904 total .png panels complete
Progress: 587 of 904 total .png panels complete
Progress: 607 of 904 total .png panels complete
Progress: 631 of 904 total .png panels complete
Progress: 638 of 904 total .png panels complete
Progress: 645 of 904 total .png panels complete
Progress: 650 of 904 total .png panels complete
Progress: 659 of 904 total .png panels complete
Progress: 666 of 904 total .png panels complete
Progress: 673 of 904 total .png panels complete
Progress: 680 of 904 total .png panels complete
Progress: 689 of 904 total .png panels complete
Progress: 696 of 904 total .png panels complete
Progress: 702 of 904 total .png panels complete
Progress: 710 of 904 total .png panels complete
Progress: 720 of 904 total .png panels complete
Progress: 726 of 904 total .png panels complete
Progress: 731 of 904 total .png panels complete
Progress: 734 of 904 total .png panels complete
Progress: 740 of 904 total .png panels complete
Progress: 746 of 904 total .png panels complete
Progress: 753 of 904 total .png panels complete
Progress: 759 of 904 total .png panels complete
Progress: 764 of 904 total .png panels complete
Progress: 769 of 904 total .png panels complete
Progress: 775 of 904 total .png panels complete
Progress: 784 of 904 total .png panels complete
Progress: 790 of 904 total .png panels complete
Progress: 797 of 904 total .png panels complete
Progress: 802 of 904 total .png panels complete
Progress: 807 of 904 total .png panels complete
Progress: 812 of 904 total .png panels complete
Progress: 815 of 904 total .png panels complete
Progress: 819 of 904 total .png panels complete
Progress: 823 of 904 total .png panels complete
Progress: 826 of 904 total .png panels complete
Progress: 830 of 904 total .png panels complete
Progress: 834 of 904 total .png panels complete
Progress: 839 of 904 total .png panels complete
Progress: 842 of 904 total .png panels complete
Progress: 844 of 904 total .png panels complete
Progress: 848 of 904 total .png panels complete
Progress: 851 of 904 total .png panels complete
Progress: 855 of 904 total .png panels complete
Progress: 859 of 904 total .png panels complete
Progress: 863 of 904 total .png panels complete
Progress: 866 of 987 total .png panels complete
Progress: 868 of 987 total .png panels complete
Progress: 872 of 987 total .png panels complete
Progress: 876 of 987 total .png panels complete
Progress: 880 of 987 total .png panels complete
Progress: 883 of 987 total .png panels complete
Progress: 875 of 987 total .png panels complete
Progress: 878 of 987 total .png panels complete
Progress: 881 of 987 total .png panels complete
Progress: 884 of 987 total .png panels complete
Progress: 886 of 987 total .png panels complete
Progress: 888 of 987 total .png panels complete
Progress: 889 of 987 total .png panels complete
Progress: 891 of 987 total .png panels complete
Progress: 893 of 987 total .png panels complete
Progress: 895 of 987 total .png panels complete
Progress: 897 of 987 total .png panels complete
Progress: 899 of 987 total .png panels complete
Progress: 900 of 987 total .png panels complete
Progress: 902 of 987 total .png panels complete
Progress: 904 of 987 total .png panels complete
Progress: 906 of 987 total .png panels complete
Progress: 908 of 987 total .png panels complete
Progress: 910 of 987 total .png panels complete
Progress: 912 of 987 total .png panels complete
Progress: 913 of 987 total .png panels complete
Progress: 915 of 987 total .png panels complete
Progress: 917 of 987 total .png panels complete
Progress: 919 of 987 total .png panels complete
Progress: 921 of 987 total .png panels complete
Progress: 923 of 987 total .png panels complete
Progress: 925 of 987 total .png panels complete
Progress: 928 of 987 total .png panels complete
Progress: 931 of 987 total .png panels complete
Progress: 932 of 987 total .png panels complete
Progress: 934 of 987 total .png panels complete
Progress: 935 of 987 total .png panels complete
Progress: 936 of 987 total .png panels complete
Progress: 937 of 987 total .png panels complete
Progress: 938 of 987 total .png panels complete
Progress: 939 of 987 total .png panels complete
Progress: 940 of 987 total .png panels complete
Progress: 941 of 987 total .png panels complete
Progress: 942 of 987 total .png panels complete
Progress: 943 of 987 total .png panels complete
Progress: 944 of 987 total .png panels complete
Progress: 945 of 987 total .png panels complete
Progress: 946 of 987 total .png panels complete
Progress: 947 of 987 total .png panels complete
Progress: 948 of 987 total .png panels complete
Progress: 949 of 987 total .png panels complete
Progress: 950 of 987 total .png panels complete
Progress: 951 of 987 total .png panels complete
Progress: 952 of 987 total .png panels complete
Progress: 953 of 987 total .png panels complete
Progress: 954 of 987 total .png panels complete
Progress: 955 of 987 total .png panels complete
Progress: 956 of 987 total .png panels complete
Progress: 957 of 987 total .png panels complete
Progress: 958 of 987 total .png panels complete
Progress: 959 of 987 total .png panels complete
Progress: 960 of 987 total .png panels complete
Progress: 961 of 987 total .png panels complete
Progress: 962 of 987 total .png panels complete
Progress: 963 of 987 total .png panels complete
Progress: 964 of 987 total .png panels complete
Progress: 965 of 987 total .png panels complete
Progress: 966 of 987 total .png panels complete
Progress: 967 of 987 total .png panels complete
Progress: 968 of 987 total .png panels complete
Progress: 969 of 987 total .png panels complete
Progress: 970 of 987 total .png panels complete
Progress: 971 of 987 total .png panels complete
Progress: 972 of 987 total .png panels complete
Progress: 973 of 987 total .png panels complete
Progress: 974 of 987 total .png panels complete
Progress: 975 of 987 total .png panels complete
Progress: 976 of 987 total .png panels complete
Progress: 977 of 987 total .png panels complete
Progress: 978 of 987 total .png panels complete
Progress: 979 of 987 total .png panels complete
Progress: 980 of 987 total .png panels complete
Progress: 981 of 987 total .png panels complete
Progress: 982 of 987 total .png panels complete
Progress: 983 of 987 total .png panels complete
Progress: 984 of 987 total .png panels complete
Progress: 985 of 987 total .png panels complete
Progress: 986 of 987 total .png panels complete
Progress: 987 of 987 total .png panels complete
Progress: 988 of 1057 total .png panels complete
Progress: 989 of 1057 total .png panels complete
Progress: 990 of 1057 total .png panels complete
Progress: 991 of 1057 total .png panels complete
Progress: 992 of 1057 total .png panels complete
Progress: 993 of 1057 total .png panels complete
Progress: 994 of 1057 total .png panels complete
Progress: 995 of 1057 total .png panels complete
Progress: 996 of 1057 total .png panels complete
Progress: 997 of 1057 total .png panels complete
Progress: 998 of 1057 total .png panels complete
Progress: 999 of 1057 total .png panels complete
Progress: 1000 of 1057 total .png panels complete
Progress: 1001 of 1057 total .png panels complete
Progress: 1002 of 1057 total .png panels complete
Progress: 1003 of 1057 total .png panels complete
Progress: 1004 of 1057 total .png panels complete
Progress: 1005 of 1057 total .png panels complete
Progress: 1006 of 1057 total .png panels complete
Progress: 1007 of 1057 total .png panels complete
Progress: 1008 of 1057 total .png panels complete
Progress: 1009 of 1057 total .png panels complete
Progress: 1010 of 1057 total .png panels complete
Progress: 1011 of 1057 total .png panels complete
Progress: 1012 of 1057 total .png panels complete
Progress: 1013 of 1057 total .png panels complete
Progress: 1014 of 1057 total .png panels complete
Progress: 1015 of 1057 total .png panels complete
Progress: 1016 of 1057 total .png panels complete
Progress: 1017 of 1057 total .png panels complete
Progress: 1018 of 1057 total .png panels complete
Progress: 1019 of 1057 total .png panels complete
Progress: 1020 of 1057 total .png panels complete
Progress: 1021 of 1057 total .png panels complete
Progress: 1022 of 1057 total .png panels complete
Progress: 1023 of 1057 total .png panels complete
Progress: 1024 of 1057 total .png panels complete
Progress: 1025 of 1057 total .png panels complete
Progress: 1026 of 1057 total .png panels complete
Progress: 1027 of 1057 total .png panels complete
Progress: 1028 of 1057 total .png panels complete
Progress: 1029 of 1057 total .png panels complete
Progress: 1030 of 1057 total .png panels complete
Progress: 1031 of 1057 total .png panels complete
Progress: 1032 of 1057 total .png panels complete
Progress: 1033 of 1057 total .png panels complete
Progress: 1034 of 1057 total .png panels complete
Progress: 1035 of 1057 total .png panels complete
Progress: 1036 of 1057 total .png panels complete
Progress: 1037 of 1057 total .png panels complete
Progress: 1038 of 1057 total .png panels complete
Progress: 1039 of 1057 total .png panels complete
Progress: 1040 of 1057 total .png panels complete
Progress: 1041 of 1057 total .png panels complete
Progress: 1042 of 1057 total .png panels complete
Progress: 1043 of 1057 total .png panels complete
Progress: 1044 of 1057 total .png panels complete
Progress: 1045 of 1057 total .png panels complete
Progress: 1046 of 1057 total .png panels complete
Progress: 1047 of 1057 total .png panels complete
Progress: 1048 of 1057 total .png panels complete
Progress: 1049 of 1057 total .png panels complete
Progress: 1050 of 1057 total .png panels complete
Progress: 1051 of 1057 total .png panels complete
Progress: 1052 of 1057 total .png panels complete
Progress: 1053 of 1057 total .png panels complete
Progress: 1054 of 1057 total .png panels complete
Progress: 1055 of 1057 total .png panels complete
Progress: 1056 of 1057 total .png panels complete
Progress: 1057 of 1057 total .png panels complete
-------------------------------------------
ARM: SUCCESS --> Images found.
ARM_97: SUCCESS --> Images found.
ATEX: SUCCESS --> Images found.
BOMEX: SUCCESS --> Images found.
CGILS_S11: SUCCESS --> Images found.
CGILS_S12: SUCCESS --> Images found.
CGILS_S6: SUCCESS --> Images found.
DYCOMS2_RF01: SUCCESS --> Images found.
DYCOMS2_RF01_FIXED_SST: SUCCESS --> Images found.
DYCOMS2_RF02_DS: SUCCESS --> Images found.
DYCOMS2_RF02_ND: SUCCESS --> Images found.
GABLS3_NIGHT: SUCCESS --> Images found.
LBA: SUCCESS --> Images found.
MPACE_B: SUCCESS --> Images found.
RICO: SUCCESS --> Images found.
TWP_ICE: SUCCESS --> Images found.
WANGARA: SUCCESS --> Images found.
-------------------------------------------
Output can be viewed at file:///home/jenkins/workspace/clubb_plot_nvhpc_gpu_vs_cpu/475e768_vs_master_adfc58f/index.html with a web browser
Pyplotgen ran in 137 seconds.
See error.log in the output folder for detailed info including warnings.
error.log messages include:
26-04-08 04:09:57.348 proc_id: 773683 Warning, unknown model detected. PyPlotgen doesn't know where this netcdf dependent_data is from. <class 'netCDF4._netCDF4.Dataset'>
[Pipeline] sh
+ ssh carson 'mkdir -p /home/pub/web_plots/clubb_nvhpc_gpu_plots/master'
[Pipeline] sh
+ scp -r 475e768_vs_master_adfc58f carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master
[Pipeline] sh
+ ssh carson '/home/pub/web_plots/generate_plot_directory_page.py /home/pub/web_plots/clubb_nvhpc_gpu_plots/'
/home/pub/web_plots/clubb_nvhpc_gpu_plots/ updated successfully.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Update Master Output)
[Pipeline] sh
+ rm -rf cur_out
[Pipeline] sh
+ mkdir cur_out
[Pipeline] sh
+ mv cpu_475e768 gpu_475e768 cur_out
[Pipeline] sh
+ echo 475e768
[Pipeline] sh
+ ssh carson 'rm -rf /home/pub/web_plots/clubb_nvhpc_gpu_plots/master/cur_out'
[Pipeline] sh
+ scp -r cur_out carson:/home/pub/web_plots/clubb_nvhpc_gpu_plots/master/
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS
