Console Output

Started by user Gunther Huebler
Obtained jenkins_tests/clubb_BFB_multi_col_gpu_nvhpc_test/Jenkinsfile from git https://github.com/larson-group/clubb.git
[Pipeline] Start of Pipeline
[Pipeline] node
Running on Jenkins in /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Declarative: Checkout SCM)
[Pipeline] checkout
The recommended git tool is: git
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/larson-group/clubb.git
 > git init /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test # timeout=10
Fetching upstream changes from https://github.com/larson-group/clubb.git
 > git --version # timeout=10
 > git --version # 'git version 2.34.1'
 > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision 90d139d2d9f8ccfdbe6e3705adfa4e7a9117aeec (refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 90d139d2d9f8ccfdbe6e3705adfa4e7a9117aeec # timeout=10
Commit message: "Moving Lscale from an acc create statement inside clubb to the acc output statement in clubb_api. This is bug fix that is BIT_CHANGING, but only for silhs cases running on the GPU. Also using this to add BIT_CHANGING:aff1bb12551c5b3a8ab1c4d773ef5c17fb96c53b, as that commit was BC but just missing the message."
 > git rev-list --no-walk 3301537e76921afc9e7bb6a3c8b37a1b0005671c # timeout=10
[Pipeline] }
[Pipeline] // stage
[Pipeline] withEnv
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Update sys_admin Repo)
[Pipeline] sh
+ git -C /home/pub/jenkins_BFB_test_configs/sys_admin pull
Already up to date.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Python Test)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load nvhpc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ python3 /home/pub/jenkins_BFB_test_configs/sys_admin/python_nightly_test_suite/run_test.py -c /home/pub/jenkins_BFB_test_configs/clubb_BFB_multi_col_gpu_nvhpc_test_config
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................tridiag_lu_solve_single_rhs_lhs:
    117, Generating create(lower_diag_invrs(:),upper(:)) [if not already present]
    119, Accelerator serial kernel generated
         Generating NVIDIA GPU code
         Generating implicit copyin(soln(:ndim-1)) [if not already present]
         Generating implicit copyin(rhs(1:ndim),lhs(-1:1,1:ndim)) [if not already present]
         Generating implicit copyout(soln(1:ndim)) [if not already present]
    124, Loop carried dependence of upper prevents parallelization
         Loop carried backward dependence of upper prevents vectorization
         Accelerator serial kernel generated
         Generating NVIDIA GPU code
        124, !$acc loop seq
    124, Loop carried dependence of upper prevents parallelization
         Loop carried backward dependence of upper prevents vectorization
    127, Accelerator serial kernel generated
         Generating NVIDIA GPU code
    133, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
         Accelerator serial kernel generated
         Generating NVIDIA GPU code
        133, !$acc loop seq
    133, Loop carried dependence of soln prevents parallelization
    137, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
         Accelerator serial kernel generated
         Generating NVIDIA GPU code
        137, !$acc loop seq
    137, Loop carried backward dependence of soln prevents vectorization
tridiag_lu_solve_single_rhs_multiple_lhs:
    182, Generating create(lower_diag_invrs(:,:),upper(:,:)) [if not already present]
    184, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        185, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    184, Generating default present(lhs(:0,:ngrdcol,:1))
    191, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        192, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        193, !$acc loop seq
    191, Generating default present(lhs(:,:ngrdcol,2:ndim-1))
    192, Generating implicit firstprivate(k)
    193, Loop carried dependence of upper prevents parallelization
         Loop carried backward dependence of upper prevents vectorization
    200, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        201, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    200, Generating default present(lhs(0:,:ngrdcol,ndim))
    201, Generating implicit firstprivate(ndim)
    207, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        208, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        212, !$acc loop seq
    207, Generating default present(lhs(1,:ngrdcol,2:ndim),soln(:ngrdcol,:ndim),rhs(:ngrdcol,:ndim))
    208, Generating implicit firstprivate(k)
    212, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
    218, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        219, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        220, !$acc loop seq
    218, Generating default present(soln(:ngrdcol,:ndim))
    219, Generating implicit firstprivate(k)
    220, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
penta_lu_solve_single_rhs_multiple_lhs:
    146, Generating create(lower_diag_invrs(:,:),upper_2(:,:),upper_1(:,:),lower_1(:,:),lower_2(:,:)) [if not already present]
    148, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        149, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    148, Generating default present(lhs(:1,:ngrdcol,:2))
    161, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        162, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        163, !$acc loop seq
    161, Generating default present(lhs(:,:ngrdcol,3:ndim-2))
    162, Generating implicit firstprivate(k)
    163, Loop carried dependence of upper_1 prevents parallelization
         Loop carried backward dependence of upper_1 prevents vectorization
         Loop carried dependence of upper_2 prevents parallelization
         Loop carried backward dependence of upper_2 prevents vectorization
    176, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        177, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    176, Generating default present(lhs(-1:,:ngrdcol,ndim-1:ndim))
    177, Generating implicit firstprivate(ndim)
    197, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        198, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        204, !$acc loop seq
    197, Generating default present(soln(:ngrdcol,:),rhs(:ngrdcol,:))
    198, Generating implicit firstprivate(k)
    204, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
    211, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        212, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        215, !$acc loop seq
    211, Generating default present(soln(:ngrdcol,:ndim))
    212, Generating implicit firstprivate(k)
    215, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
mono_cubic_interp:
    116, Generating acc routine seq
         Generating NVIDIA GPU code
tridiag_lu_solve_multiple_rhs_lhs:
    268, Generating create(upper(:,:),lower_diag_invrs(:,:)) [if not already present]
    270, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        271, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    270, Generating default present(lhs(:0,:ngrdcol,:1))
    277, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        278, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        279, !$acc loop seq
    277, Generating default present(lhs(:,:ngrdcol,2:ndim-1))
    278, Generating implicit firstprivate(k)
    279, Loop carried dependence of upper prevents parallelization
         Loop carried backward dependence of upper prevents vectorization
    286, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        287, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    286, Generating default present(lhs(0:,:ngrdcol,ndim))
    287, Generating implicit firstprivate(ndim)
    293, Generating implicit firstprivate(ndim,nrhs,ngrdcol)
         Generating NVIDIA GPU code
        294, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        295,   ! blockidx%x threadidx%x collapsed
        299, !$acc loop seq
    293, Generating default present(soln(:ngrdcol,:ndim,:nrhs),rhs(:ngrdcol,:ndim,:nrhs),lhs(1,:ngrdcol,2:ndim))
    295, Generating implicit firstprivate(k)
    299, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
    306, Generating implicit firstprivate(ndim,nrhs,ngrdcol)
         Generating NVIDIA GPU code
        307, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        308,   ! blockidx%x threadidx%x collapsed
        309, !$acc loop seq
    306, Generating default present(soln(:ngrdcol,:ndim,:nrhs))
    308, Generating implicit firstprivate(k)
    309, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
ar: creating /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/compile/../lib/libclubb_gfdlact.a
thlm2t_in_k_2d:
    140, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
        141, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        142,   ! blockidx%x threadidx%x collapsed
    140, Generating default present(thlm(:ngrdcol,:nz),rcm(:ngrdcol,:nz),exner(:ngrdcol,:nz))
sat_mixrat_liq_k:
     88, Generating acc routine seq
         Generating NVIDIA GPU code
skx_func:
     73, Generating create(skx_denom_tol(:)) [if not already present]
     75, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
         76, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
     75, Generating default present(clubb_params(:ngrdcol,73))
     76, Generating implicit firstprivate(x_tol)
     84, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
         85, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
         86,   ! blockidx%x threadidx%x collapsed
     84, Generating default present(xp3(:ngrdcol,:nz),xp2(:ngrdcol,:nz),skx(:ngrdcol,:nz))
pvertinterp:
    548, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
        549, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    548, Generating default present(p_mid(:ngrdcol,:),interp_var(:ngrdcol),input_var(:ngrdcol,:))
    549, Generating implicit firstprivate(p_out,l_found,k_upper,k,dpu,dpl)
    568, Accelerator restriction: induction variable live-out from loop: k
    573, Accelerator restriction: induction variable live-out from loop: k
penta_lu_solve_multiple_rhs_lhs:
    266, Generating create(lower_diag_invrs(:,:),upper_2(:,:),upper_1(:,:),lower_1(:,:),lower_2(:,:)) [if not already present]
    268, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        269, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    268, Generating default present(lhs(:1,:ngrdcol,:2))
    281, Generating implicit firstprivate(ndim,ngrdcol)
         Generating NVIDIA GPU code
        282, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        283, !$acc loop seq
    281, Generating default present(lhs(:,:ngrdcol,3:ndim-2))
    282, Generating implicit firstprivate(k)
    283, Loop carried dependence of upper_1 prevents parallelization
         Loop carried backward dependence of upper_1 prevents vectorization
         Loop carried dependence of upper_2 prevents parallelization
         Loop carried backward dependence of upper_2 prevents vectorization
    296, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        297, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    296, Generating default present(lhs(-1:,:ngrdcol,ndim-1:ndim))
    297, Generating implicit firstprivate(ndim)
    317, Generating implicit firstprivate(ndim,nrhs,ngrdcol)
         Generating NVIDIA GPU code
        318, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        319,   ! blockidx%x threadidx%x collapsed
        325, !$acc loop seq
    317, Generating default present(soln(:ngrdcol,:,:nrhs),rhs(:ngrdcol,:,:nrhs))
    319, Generating implicit firstprivate(k)
    325, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
    333, Generating implicit firstprivate(ndim,nrhs,ngrdcol)
         Generating NVIDIA GPU code
        334, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        335,   ! blockidx%x threadidx%x collapsed
        338, !$acc loop seq
    333, Generating default present(soln(:ngrdcol,:ndim,:nrhs))
    335, Generating implicit firstprivate(k)
    338, Loop carried dependence of soln prevents parallelization
         Loop carried backward dependence of soln prevents vectorization
lg_2005_ansatz:
    171, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
        172, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        173,   ! blockidx%x threadidx%x collapsed
    171, Generating default present(skw(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),beta(:ngrdcol),skx(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),xp2(:ngrdcol,:nz),wp2(:ngrdcol,:nz))
    173, Generating implicit firstprivate(x_tol,nrmlzd_skw,nrmlzd_corr_wx)
xp3_lg_2005_ansatz:
    247, Generating create(skx_zt(:,:),skx_denom_tol(:)) [if not already present]
    254, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        255, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    254, Generating default present(clubb_params(:ngrdcol,73))
    255, Generating implicit firstprivate(x_tol)
    262, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        263, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        264,   ! blockidx%x threadidx%x collapsed
    262, Generating default present(xp3(:ngrdcol,:nzt),xp2_zt(:ngrdcol,:nzt))
sat_mixrat_liq_2d:
    365, Generating create(esat(:,:)) [if not already present]
         Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present]
    380, Generating implicit firstprivate(ngrdcol,nz,start_index)
         Generating NVIDIA GPU code
        381, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        382,   ! blockidx%x threadidx%x collapsed
    382, Generating implicit firstprivate(t_in_c_sqd,t_in_c)
    435, Generating implicit firstprivate(ngrdcol,nz,start_index)
         Generating NVIDIA GPU code
        436, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        437,   ! blockidx%x threadidx%x collapsed
    449, Generating implicit firstprivate(ngrdcol,start_index,nz)
         Generating NVIDIA GPU code
        450, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        451,   ! blockidx%x threadidx%x collapsed
    451, Generating implicit firstprivate(t_in_k_clipped)
    476, Generating implicit firstprivate(ngrdcol,start_index,nz)
         Generating NVIDIA GPU code
        477, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        478,   ! blockidx%x threadidx%x collapsed
    478, Generating implicit firstprivate(t_in_k_int)
    498, Generating implicit firstprivate(ngrdcol,start_index,nz)
         Generating NVIDIA GPU code
        499, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        500,   ! blockidx%x threadidx%x collapsed
calc_comp_corrs_binormal:
    868, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
        869, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        870,   ! blockidx%x threadidx%x collapsed
    868, Generating default present(corr_x_y_1(:ngrdcol,:nz),mu_y_2(:ngrdcol,:nz),sigma_x_2_sqd(:ngrdcol,:nz),sigma_x_1_sqd(:ngrdcol,:nz),sigma_y_1_sqd(:ngrdcol,:nz),xm(:ngrdcol,:nz),mu_x_2(:ngrdcol,:nz),ym(:ngrdcol,:nz),xpyp(:ngrdcol,:nz),corr_x_y_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),sigma_y_2_sqd(:ngrdcol,:nz),mu_y_1(:ngrdcol,:nz),mu_x_1(:ngrdcol,:nz))
sat_mixrat_ice_2d:
    952, Generating create(esat_ice(:,:)) [if not already present]
         Generating copyin(p_in_pa(:,:),t_in_k(:,:)) [if not already present]
    961, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
        962, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        963,   ! blockidx%x threadidx%x collapsed
    976, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
        977, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        978,   ! blockidx%x threadidx%x collapsed
    978, Generating implicit firstprivate(t_in_c)
   1005, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1006, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1007,   ! blockidx%x threadidx%x collapsed
   1007, Generating implicit firstprivate(t_in_k_clipped)
   1035, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1036, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1037,   ! blockidx%x threadidx%x collapsed
compute_sigma_sqd_w:
     97, Generating enter data create(max_corr_w_x_sqd(:,:))
    108, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        109, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        110,   ! blockidx%x threadidx%x collapsed
    108, Generating default present(rtp2(:ngrdcol,:nzm),wprtp(:ngrdcol,:nzm),wpthlp(:ngrdcol,:nzm),thlp2(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm))
    120, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        121, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        122,   ! blockidx%x threadidx%x collapsed
    120, Generating default present(max_corr_w_x_sqd(:ngrdcol,:nzm),up2(:ngrdcol,:nzm),upwp(:ngrdcol,:nzm),wp2(:ngrdcol,:nzm),vpwp(:ngrdcol,:nzm),vp2(:ngrdcol,:nzm))
    134, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        135, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        136,   ! blockidx%x threadidx%x collapsed
    134, Generating default present(sigma_sqd_w(:ngrdcol,:nzm),max_corr_w_x_sqd(:ngrdcol,:nzm),gamma_skw_fnc(:ngrdcol,:nzm))
    142, Generating exit data delete(max_corr_w_x_sqd(:,:))
adg1_pdf_driver:
    152, Generating enter data create(w_1_n(:,:),w_2_n(:,:))
    209, Generating exit data delete(w_2_n(:,:),w_1_n(:,:))
adg1_w_closure:
    660, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
        661, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        662,   ! blockidx%x threadidx%x collapsed
    660, Generating default present(wp2(:ngrdcol,:nz),wm(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),w_1(:ngrdcol,:nz),w_2(:ngrdcol,:nz),skw(:ngrdcol,:nz),w_2_n(:ngrdcol,:nz),varnce_w_2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_w_1(:ngrdcol,:nz))
    662, Generating implicit firstprivate(mixt_frac_max_mag)
Aborted by Gunther Huebler
Sending interrupt signal to process
adg1_adg2_responder_params:
   1116, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
       1117, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1118,   ! blockidx%x threadidx%x collapsed
   1116, Generating default present(wp2(:ngrdcol,:nz),w_1_n(:ngrdcol,:nz),sigma_sqd_w(:ngrdcol,:nz),varnce_x_2(:ngrdcol,:nz),mixt_frac(:ngrdcol,:nz),alpha_x(:ngrdcol,:nz),beta(:ngrdcol),w_2_n(:ngrdcol,:nz),xm(:ngrdcol,:nz),xp2(:ngrdcol,:nz),x_2(:ngrdcol,:nz),wpxp(:ngrdcol,:nz),x_1(:ngrdcol,:nz),sqrt_wp2(:ngrdcol,:nz),varnce_x_1(:ngrdcol,:nz))
   1118, Generating implicit firstprivate(x_tol,width_factor_1)
linear_interpolated_azm_2d:
   1543, Generating copyin(azt(:,:),gr,gr%zm(:,:),gr%weights_zt2zm(:,:,:)) [if not already present]
         Generating copyout(linear_interpolated_azm(:,:)) [if not already present]
         Generating copyin(gr%zt(:,:)) [if not already present]
   1549, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1550, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1551,   ! blockidx%x threadidx%x collapsed
   1562, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1563, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1573, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1574, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1574, Generating implicit firstprivate(nzt,nzm)
   1582, Generating copyin(zm_min) [if not already present]
         Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1583, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1584,   ! blockidx%x threadidx%x collapsed
zt2zm2zt:
   1639, Generating create(azt_zm(:,:)) [if not already present]
zm2zt2zm:
   1695, Generating create(azm_zt(:,:)) [if not already present]
linear_interpolated_azt_2d:
   2109, Generating copyin(azm(:,:),gr,gr%zm(:,:),gr%weights_zm2zt(:,:,:)) [if not already present]
         Generating copyout(linear_interpolated_azt(:,:)) [if not already present]
         Generating copyin(gr%zt(:,:)) [if not already present]
   2115, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       2116, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2117,   ! blockidx%x threadidx%x collapsed
   2126, Generating copyin(zt_min) [if not already present]
         Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       2127, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2128,   ! blockidx%x threadidx%x collapsed
gradzm_2d:
   2414, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       2415, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2416,   ! blockidx%x threadidx%x collapsed
   2414, Generating default present(azm(:ngrdcol,:nzt+1),gr%invrs_dzt(1:ngrdcol,1:nzt),gr)
gradzm_1d:
   2463, Generating copyin(azm_col(:,:),gr) [if not already present]
         Generating copyout(gradzm_1d_col(:,:)) [if not already present]
         Generating copyin(gr%invrs_dzt(:,:)) [if not already present]
gradzt_2d:
   2510, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       2511, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       2512,   ! blockidx%x threadidx%x collapsed
   2510, Generating default present(azt(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr)
   2524, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       2525, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   2525, Generating implicit firstprivate(nzm)
gradzt_1d:
   2571, Generating copyin(azt_col(:,:),gr) [if not already present]
         Generating copyout(gradzt_1d_col(:,:)) [if not already present]
         Generating copyin(gr%invrs_dzm(:,:)) [if not already present]
band_solve_single_rhs_multiple_lhs:
    108, Generating update self(lhs(:,:,:),rhs(:,:))
    121, Generating update device(rcond(:))
    128, Generating update self(rhs(:,:),lhs(:,:,:))
    136, Generating update device(soln(:,:))
band_solve_multiple_rhs_lhs:
    220, Generating update self(lhs(:,:,:),rhs(:,:,:))
    233, Generating update device(rcond(:))
    240, Generating update self(rhs(:,:,:),lhs(:,:,:))
    248, Generating update device(soln(:,:,:))
tridiag_solve_single_rhs_multiple_lhs:
    432, Generating update self(lhs(:,:,:),rhs(:,:))
    443, Generating update device(rcond(:))
    450, Generating update self(rhs(:,:),lhs(:,:,:))
    457, Generating update device(soln(:,:))
tridiag_solve_multiple_rhs_lhs:
    538, Generating update self(lhs(:,:,:),rhs(:,:,:))
    549, Generating update device(rcond(:))
    556, Generating update self(rhs(:,:,:),lhs(:,:,:))
    563, Generating update device(soln(:,:,:))
calculate_thvm:
    232, Generating copyin(rtm(:,:),rcm(:,:),exner(:,:),thlm(:,:)) [if not already present]
         Generating copyout(thvm(:,:)) [if not already present]
         Generating copyin(thv_ds_zt(:,:)) [if not already present]
    236, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        237, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        238,   ! blockidx%x threadidx%x collapsed
xpyp_term_ta_pdf_lhs:
    372, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        373, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        374,   ! blockidx%x threadidx%x collapsed
    372, Generating default present(lhs_ta(:,:ngrdcol,:1))
    383, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        384, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        385,   ! blockidx%x threadidx%x collapsed
    383, Generating default present(coef_wpxpyp_implicit(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%weights_zm2zt(1:ngrdcol,1:nzm-1,1:2),gr,rho_ds_zt(:ngrdcol,:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1))
    414, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        415, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        416,   ! blockidx%x threadidx%x collapsed
    414, Generating default present(sgn_turbulent_vel(:ngrdcol,2:nzm-1),rho_ds_zm(:ngrdcol,:nzm),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),lhs_ta(:,:ngrdcol,2:nzm-1),gr%invrs_dzt(1:ngrdcol,1:nzm-1),coef_wpxpyp_implicit_zm(:ngrdcol,:nzm),gr)
    461, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        462, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        463,   ! blockidx%x threadidx%x collapsed
    461, Generating default present(lhs_ta(:,:ngrdcol,nzm))
    463, Generating implicit firstprivate(nzm)
term_ma_zt_lhs:
    194, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        195, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        196,   ! blockidx%x threadidx%x collapsed
    194, Generating default present(lhs_ma(:,:ngrdcol,2:nzt-1),invrs_dzt(:ngrdcol,2:nzt-1),wm_zt(:ngrdcol,2:nzt-1),weights_zt2zm(:ngrdcol,2:nzt,:))
    217, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        218, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    217, Generating default present(invrs_dzt(:ngrdcol,nzt),lhs_ma(:,:ngrdcol,nzt),wm_zt(:ngrdcol,nzt),weights_zt2zm(:ngrdcol,nzm-1,:))
    218, Generating implicit firstprivate(nzt,nzm)
    237, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        238, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    237, Generating default present(lhs_ma(:,:ngrdcol,:1),wm_zt(:ngrdcol,:1),weights_zt2zm(:ngrdcol,2,:),invrs_dzt(:ngrdcol,:1))
    256, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        257, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        258,   ! blockidx%x threadidx%x collapsed
    256, Generating default present(wm_zt(:ngrdcol,2:nzt-1),lhs_ma(:,:ngrdcol,2:nzt-1),invrs_dzm(:ngrdcol,2:nzt))
    288, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        289, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    288, Generating default present(invrs_dzm(:ngrdcol,nzm-1),wm_zt(:ngrdcol,nzt),lhs_ma(:,:ngrdcol,nzt))
    289, Generating implicit firstprivate(nzt,nzm)
    317, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        318, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    317, Generating default present(invrs_dzm(:ngrdcol,2),wm_zt(:ngrdcol,:1),lhs_ma(:,:ngrdcol,:1))
xpyp_term_ta_pdf_lhs_godunov:
    536, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        537, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        538,   ! blockidx%x threadidx%x collapsed
    536, Generating default present(lhs_ta(:,:ngrdcol,:1))
    545, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        546, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        547,   ! blockidx%x threadidx%x collapsed
    545, Generating default present(invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),coef_wpxpyp_implicit(:ngrdcol,:nzm-1),gr,rho_ds_zm(:ngrdcol,:nzm),lhs_ta(:,:ngrdcol,2:nzm-1))
    569, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        570, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        571,   ! blockidx%x threadidx%x collapsed
    569, Generating default present(lhs_ta(:,:ngrdcol,nzm))
    571, Generating implicit firstprivate(nzm)
diffusion_zt_lhs:
    310, Generating create(k_zm_nu(:,:),ddzm_rho_k_zm_nu(:,:),drhokdz_zt(:,:),lhs_upwind(:,:,:),rho_k_zm_nu(:,:)) [if not already present]
    312, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        313, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        314,   ! blockidx%x threadidx%x collapsed
    312, Generating default present(k_zm(:ngrdcol,:nzm),nu(:ngrdcol))
    391, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        392, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    391, Generating default present(gr,rho_ds_zm(:ngrdcol,2),nu(:ngrdcol),lhs(:,:ngrdcol,:1),invrs_rho_ds_zt(:ngrdcol,:1),gr%invrs_dzt(1:ngrdcol,1),gr%invrs_dzm(1:ngrdcol,2),k_zm(:ngrdcol,2))
    432, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        433, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        434,   ! blockidx%x threadidx%x collapsed
    432, Generating default present(invrs_rho_ds_zt(:ngrdcol,2:nzt-1),gr%invrs_dzm(1:ngrdcol,2:nzt),gr%invrs_dzt(1:ngrdcol,2:nzt-1),rho_ds_zm(:ngrdcol,2:nzt),lhs(:,:ngrdcol,2:nzt-1),gr)
    488, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        489, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    488, Generating default present(k_zm(:ngrdcol,nzm-1),gr,rho_ds_zm(:ngrdcol,nzm-1),nu(:ngrdcol),lhs(:,:ngrdcol,nzt),invrs_rho_ds_zt(:ngrdcol,nzt),gr%invrs_dzt(1:ngrdcol,nzt),gr%invrs_dzm(1:ngrdcol,nzm-1))
    489, Generating implicit firstprivate(nzt,nzm)
term_ma_zm_lhs:
    451, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        452, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        453,   ! blockidx%x threadidx%x collapsed
    451, Generating default present(lhs_ma(:,:ngrdcol,:1))
    460, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        461, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        462,   ! blockidx%x threadidx%x collapsed
    460, Generating default present(lhs_ma(:,:ngrdcol,2:nzm-1),invrs_dzm(:ngrdcol,2:nzm-1),wm_zm(:ngrdcol,2:nzm-1),weights_zm2zt(:ngrdcol,:nzm-1,:))
    479, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        480, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        481,   ! blockidx%x threadidx%x collapsed
    479, Generating default present(lhs_ma(:,:ngrdcol,nzm))
    481, Generating implicit firstprivate(nzm)
xpyp_term_ta_pdf_rhs:
    880, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        881, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    880, Generating default present(rhs_ta(:ngrdcol,:1))
    889, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        890, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        891,   ! blockidx%x threadidx%x collapsed
    889, Generating default present(rho_ds_zt(:ngrdcol,:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,invrs_rho_ds_zm(:ngrdcol,2:nzm-1),term_wpxpyp_explicit(:ngrdcol,:nzm-1),rhs_ta(:ngrdcol,2:nzm-1))
    905, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        906, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        907,   ! blockidx%x threadidx%x collapsed
    905, Generating default present(rhs_ta(:ngrdcol,2:nzm-1),term_wpxpyp_explicit_zm(:ngrdcol,:nzm),sgn_turbulent_vel(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),gr%invrs_dzt(1:ngrdcol,1:nzm-1),gr,rho_ds_zm(:ngrdcol,:nzm))
    936, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        937, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    936, Generating default present(rhs_ta(:ngrdcol,nzm))
    937, Generating implicit firstprivate(nzm)
xpyp_term_ta_pdf_rhs_godunov:
   1005, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1006, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1005, Generating default present(rhs_ta(:ngrdcol,:1))
   1011, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1012, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1013,   ! blockidx%x threadidx%x collapsed
   1011, Generating default present(rho_ds_zm(:ngrdcol,:nzm),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,rhs_ta(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),term_wpxpyp_explicit_zm(:ngrdcol,:nzm),sgn_turbulent_vel(:ngrdcol,:nzm-1))
   1029, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1030, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1029, Generating default present(rhs_ta(:ngrdcol,nzm))
   1030, Generating implicit firstprivate(nzm)
calc_stability_correction:
    309, Generating enter data create(brunt_vaisala_freq_sqd_smth(:,:),lambda0_stability(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:))
    327, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        328, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        329,   ! blockidx%x threadidx%x collapsed
    327, Generating default present(lambda0_stability_coef(:ngrdcol),lambda0_stability(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm))
    339, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        340, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        341,   ! blockidx%x threadidx%x collapsed
    339, Generating default present(stability_correction(:ngrdcol,:nzm),lscale_zm(:ngrdcol,:nzm),brunt_vaisala_freq_sqd(:ngrdcol,:nzm),em(:ngrdcol,:nzm),lambda0_stability(:ngrdcol,:nzm))
    349, Generating exit data delete(lambda0_stability(:,:),brunt_vaisala_freq_sqd_smth(:,:),brunt_vaisala_freq_sqd_moist(:,:),brunt_vaisala_freq_sqd(:,:),brunt_vaisala_freq_sqd_mixed(:,:),brunt_vaisala_freq_sqd_dry(:,:))
calc_brunt_vaisala_freq_sqd:
    468, Generating create(rsat_zm(:,:),t_in_k(:,:),ice_supersat_frac_zm(:,:),rsat(:,:),t_in_k_zm(:,:),thm(:,:),ddzt_rtm(:,:),ddzt_thlm(:,:),brunt_vaisala_freq_clipped(:,:),ddzt_rsat(:,:),thm_zm(:,:),thvm_zm(:,:),ddzt_thm(:,:),ddzt_thvm(:,:)) [if not already present]
    472, Generating enter data create(tmp_calc(:,:))
    482, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        483, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        484,   ! blockidx%x threadidx%x collapsed
    482, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm))
    492, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        493, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        494,   ! blockidx%x threadidx%x collapsed
    492, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm))
    494, Generating implicit firstprivate(t0)
    508, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        509, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        510,   ! blockidx%x threadidx%x collapsed
    508, Generating default present(thlm(:ngrdcol,:nzt),rcm(:ngrdcol,:nzt),exner(:ngrdcol,:nzt))
    520, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        521, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        522,   ! blockidx%x threadidx%x collapsed
    520, Generating default present(brunt_vaisala_freq_sqd_dry(:ngrdcol,:nzm))
    528, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        529, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        530,   ! blockidx%x threadidx%x collapsed
    528, Generating default present(brunt_vaisala_freq_sqd_moist(:ngrdcol,:nzm))
    544, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        545, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        546,   ! blockidx%x threadidx%x collapsed
    544, Generating default present(brunt_vaisala_freq_sqd_dry(:ngrdcol,:nzm),bv_efold(:ngrdcol),brunt_vaisala_freq_sqd_moist(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_mixed(:ngrdcol,:nzm))
    582, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        583, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        584,   ! blockidx%x threadidx%x collapsed
    582, Generating default present(brunt_vaisala_freq_sqd_mixed(:ngrdcol,:nzm))
    603, Generating exit data delete(tmp_calc(:,:))
diffusion_zm_lhs:
    813, Generating create(drhokdz_zm(:,:),ddzt_rho_k_zt_nu(:,:),lhs_upwind(:,:,:),rho_k_zt_nu(:,:)) [if not already present]
    815, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        816, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        817,   ! blockidx%x threadidx%x collapsed
    815, Generating default present(rho_ds_zt(:ngrdcol,:nzt),nu(:ngrdcol),k_zt(:ngrdcol,:nzt))
    826, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        827, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        828,   ! blockidx%x threadidx%x collapsed
    826, Generating default present(invrs_rho_ds_zm(:ngrdcol,:nzm))
    836, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        837, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    836, Generating default present(gr%invrs_dzt(1:ngrdcol,1),gr)
    845, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        846, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        847,   ! blockidx%x threadidx%x collapsed
    845, Generating default present(gr%invrs_dzt(1:ngrdcol,1:nzm-1),gr)
    861, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        862, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    861, Generating default present(gr%invrs_dzt(1:ngrdcol,nzt),gr)
    862, Generating implicit firstprivate(nzt,nzm)
    877, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        878, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    877, Generating default present(gr%invrs_dzm(1:ngrdcol,1),rho_ds_zt(:ngrdcol,:1),nu(:ngrdcol),lhs(:,:ngrdcol,:1),invrs_rho_ds_zm(:ngrdcol,:1),gr%invrs_dzt(1:ngrdcol,1),gr,k_zt(:ngrdcol,:1))
    918, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        919, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        920,   ! blockidx%x threadidx%x collapsed
    918, Generating default present(k_zt(:ngrdcol,:nzm-1),gr,gr%invrs_dzt(1:ngrdcol,1:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),lhs(:,:ngrdcol,2:nzm-1),rho_ds_zt(:ngrdcol,:nzm-1),nu(:ngrdcol),gr%invrs_dzm(1:ngrdcol,2:nzm-1))
    974, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        975, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    974, Generating default present(k_zt(:ngrdcol,nzt),gr%invrs_dzm(1:ngrdcol,nzm),rho_ds_zt(:ngrdcol,nzt),nu(:ngrdcol),lhs(:,:ngrdcol,nzm),invrs_rho_ds_zm(:ngrdcol,nzm),gr%invrs_dzt(1:ngrdcol,nzt),gr)
    975, Generating implicit firstprivate(nzt,nzm)
compute_cx_fnc_richardson:
    732, Generating enter data create(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm_cx(:,:),fnc_richardson_smooth(:,:))
    748, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        749, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        750,   ! blockidx%x threadidx%x collapsed
    748, Generating default present(brunt_vaisala_freq_sqd(:ngrdcol,:nzm),ri_zm_cx(:ngrdcol,:nzm))
    763, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        764, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        765,   ! blockidx%x threadidx%x collapsed
    763, Generating default present(clubb_params(:ngrdcol,96:97),fnc_richardson(:ngrdcol,:nzm),ri_zm_cx(:ngrdcol,:nzm))
    765, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max)
    785, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        786, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        787,   ! blockidx%x threadidx%x collapsed
    785, Generating default present(clubb_params(:ngrdcol,94:95),fnc_richardson_smooth(:ngrdcol,:nzm),cx_fnc_interp(:ngrdcol,:nzm))
    787, Generating implicit firstprivate(cx_min,cx_max)
    800, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        801, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        802,   ! blockidx%x threadidx%x collapsed
    800, Generating default present(clubb_params(:ngrdcol,94:97),ri_zm_cx(:ngrdcol,:nzm),cx_fnc_richardson(:ngrdcol,:nzm))
    802, Generating implicit firstprivate(invrs_min_max_diff,richardson_num_min,richardson_num_max,cx_max,cx_min)
    836, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        837, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        838,   ! blockidx%x threadidx%x collapsed
    836, Generating default present(cx_fnc_richardson(:ngrdcol,:nzm))
    844, Generating exit data delete(fnc_richardson_clipped(:,:),fnc_richardson(:,:),cx_fnc_richardson_avg(:,:),cx_fnc_interp(:,:),ri_zm_cx(:,:),fnc_richardson_smooth(:,:))
calc_ri_zm:
    889, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        890, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        891,   ! blockidx%x threadidx%x collapsed
    889, Generating default present(bv_freq_sqd(:ngrdcol,:nzm),shear(:ngrdcol,:nzm),ri_zm(:ngrdcol,:nzm))
    891, Generating implicit firstprivate(lim_shear,lim_bv)
fill_holes_vertical:
    127, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
        129, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
             Generating reduction(.or.:l_field_below_threshold)
        130,   ! blockidx%x threadidx%x collapsed
    127, Generating default present(field(:ngrdcol,:nz))
         Generating implicit copy(l_field_below_threshold) [if not already present]
    130, Generating implicit firstprivate(threshold)
    143, Generating enter data create(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),numer_integral_global(:),rho_ds_dz(:,:),field_avg_global(:),field_clipped(:,:))
    147, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
        148, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        149,   ! blockidx%x threadidx%x collapsed
    147, Generating default present(rho_ds(:ngrdcol,:nz),rho_ds_dz(:ngrdcol,:nz),dz(:ngrdcol,:nz))
    158, Generating implicit firstprivate(ngrdcol,upper_hf_level,lower_hf_level)
         Generating NVIDIA GPU code
        159, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        160,   ! blockidx%x threadidx%x collapsed
        170, !$acc loop seq
             Generating implicit reduction(+:rho_k_sum)
    158, Generating default present(rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2))
    160, Generating implicit firstprivate(j,rho_k_sum)
    170, Loop is parallelizable
    179, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level)
         Generating NVIDIA GPU code
        180, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        189, !$acc loop seq
        198, !$acc loop seq
             Generating implicit reduction(+:field$r1)
        204, !$acc loop seq
        208, !$acc loop seq
        214, !$acc loop seq
             Generating implicit reduction(+:rho_ds_dz$r)
        225, !$acc loop seq
    179, Generating default present(field(:ngrdcol,:),field_clipped(:ngrdcol,:),rho_ds_dz(:ngrdcol,:),invrs_denom_integral(:ngrdcol,lower_hf_level+2:upper_hf_level-2))
    189, Loop carried dependence of field,field_clipped prevents parallelization
         Loop carried backward dependence of field_clipped,field prevents vectorization
         Generating implicit firstprivate(k_end,field_clipped_avg,threshold,mass_fraction,field_avg,k_start)
         Loop carried dependence of field,field_clipped prevents parallelization
         Loop carried backward dependence of field_clipped prevents vectorization
         Loop carried dependence of field_clipped prevents parallelization
    198, Loop is parallelizable
    204, Loop is parallelizable
    208, Loop is parallelizable
    214, Loop is parallelizable
    225, Loop is parallelizable
    238, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
        240, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
             Generating reduction(.or.:l_field_below_threshold)
        241,   ! blockidx%x threadidx%x collapsed
    238, Generating default present(field(:ngrdcol,:nz))
         Generating implicit copy(l_field_below_threshold) [if not already present]
    241, Generating implicit firstprivate(threshold)
    251, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:))
    264, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        265, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    264, Generating default present(numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol))
    271, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level)
         Generating NVIDIA GPU code
        272, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        273, !$acc loop seq
    271, Generating default present(field(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),denom_integral_global(:ngrdcol))
    273, Complex loop carried dependence of numer_integral_global prevents parallelization
         Loop carried dependence of numer_integral_global prevents parallelization
         Loop carried backward dependence of numer_integral_global prevents vectorization
         Complex loop carried dependence of denom_integral_global prevents parallelization
         Loop carried dependence of denom_integral_global prevents parallelization
         Loop carried backward dependence of denom_integral_global prevents vectorization
    282, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level)
         Generating NVIDIA GPU code
        283, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        292, !$acc loop seq
        297, !$acc loop seq
    282, Generating default present(field_avg_global(:ngrdcol),denom_integral_global(:ngrdcol),field(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level))
    283, Generating implicit firstprivate(threshold)
    292, Loop is parallelizable
    297, Loop is parallelizable
    305, Generating implicit firstprivate(upper_hf_level,ngrdcol,lower_hf_level)
         Generating NVIDIA GPU code
        306, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        308, !$acc loop seq
    305, Generating default present(field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),rho_ds_dz(:ngrdcol,lower_hf_level:upper_hf_level),numer_integral_global(:ngrdcol))
    308, Complex loop carried dependence of numer_integral_global prevents parallelization
         Loop carried reuse of numer_integral_global prevents parallelization
    314, Generating implicit firstprivate(ngrdcol,lower_hf_level,upper_hf_level)
         Generating NVIDIA GPU code
        315, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        334, !$acc loop seq
    314, Generating default present(denom_integral_global(:ngrdcol),field_clipped(:ngrdcol,lower_hf_level:upper_hf_level),field(:ngrdcol,lower_hf_level:upper_hf_level),field_avg_global(:ngrdcol),numer_integral_global(:ngrdcol),mass_fraction_global(:ngrdcol))
    315, Generating implicit firstprivate(threshold,field_clipped_avg)
    334, Loop is parallelizable
    343, Generating exit data delete(invrs_denom_integral(:,:),denom_integral_global(:),mass_fraction_global(:),rho_ds_dz(:,:),numer_integral_global(:),field_avg_global(:),field_clipped(:,:))
lscale_width_vert_avg:
    963, Generating enter data create(denom_terms(:,:),numer_terms(:,:),one_half_avg_width(:,:))
    966, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        967, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        968,   ! blockidx%x threadidx%x collapsed
    966, Generating default present(lscale_zm(:ngrdcol,:nzm),one_half_avg_width(:ngrdcol,:nzm))
    973, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        974, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        975,   ! blockidx%x threadidx%x collapsed
    973, Generating default present(one_half_avg_width(:ngrdcol,:nzm))
    982, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        983, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        984,   ! blockidx%x threadidx%x collapsed
    982, Generating default present(gr%dzm(1:ngrdcol,1:nzm),numer_terms(:ngrdcol,:nzm),denom_terms(:ngrdcol,:nzm),gr,var_profile(:ngrdcol,:nzm),rho_ds_zm(:ngrdcol,:nzm))
    991, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        992, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        993,   ! blockidx%x threadidx%x collapsed
       1051, !$acc loop seq
             Generating implicit reduction(+:numer_integral,denom_integral)
    991, Generating default present(gr%zm(1:ngrdcol,:),denom_terms(:ngrdcol,:),gr,one_half_avg_width(:ngrdcol,:nzm),numer_terms(:ngrdcol,:))
    993, Generating implicit firstprivate(k_avg_lower,k_avg,n_below_ground_levels,k_avg_upper,var_below_ground_value,numer_integral,denom_integral)
   1013, Accelerator restriction: induction variable live-out from loop: k_avg_upper
   1016, Accelerator restriction: induction variable live-out from loop: k_avg_upper
   1020, Accelerator restriction: induction variable live-out from loop: k_avg_lower
   1023, Accelerator restriction: induction variable live-out from loop: k_avg_lower
   1051, Loop is parallelizable
   1063, Generating exit data delete(denom_terms(:,:),one_half_avg_width(:,:),numer_terms(:,:))
wp2_term_splat_lhs:
   1121, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_smooth(:,:))
   1123, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1124, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1125,   ! blockidx%x threadidx%x collapsed
   1123, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm))
   1135, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       1136, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1137,   ! blockidx%x threadidx%x collapsed
   1135, Generating default present(lhs_splat_wp2(:ngrdcol,:nzm),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_smooth(:ngrdcol,:nzm))
   1143, Generating exit data delete(brunt_vaisala_freq_splat_smooth(:,:),brunt_vaisala_freq_splat_clipped(:,:))
wp3_term_splat_lhs:
   1204, Generating enter data create(brunt_vaisala_freq_splat_clipped(:,:),brunt_vaisala_freq_splat_clipped_zt(:,:))
   1206, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1207, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1208,   ! blockidx%x threadidx%x collapsed
   1206, Generating default present(brunt_vaisala_freq_splat_clipped(:ngrdcol,:nzm),brunt_vaisala_freq_sqd_splat(:ngrdcol,:nzm))
   1218, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1219, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1220,   ! blockidx%x threadidx%x collapsed
   1218, Generating default present(lhs_splat_wp3(:ngrdcol,:nzt),c_wp2_splat(:ngrdcol),brunt_vaisala_freq_splat_clipped_zt(:ngrdcol,:nzt))
   1227, Generating exit data delete(brunt_vaisala_freq_splat_clipped_zt(:,:),brunt_vaisala_freq_splat_clipped(:,:))
smooth_min_sclr_idx:
   1275, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1276, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1277,   ! blockidx%x threadidx%x collapsed
   1275, Generating default present(input_var2(:ngrdcol,:nz))
   1277, Generating implicit firstprivate(smth_coef,input_var1)
fill_holes_driver:
    844, Generating copyin(gr,rho_ds_zt(:)) [if not already present]
         Generating copy(hydromet(:,i)) [if not already present]
         Generating copyin(gr%dzt(:,:)) [if not already present]
smooth_min_array_scalar:
   1330, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1331, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1332,   ! blockidx%x threadidx%x collapsed
   1330, Generating default present(input_var1(:ngrdcol,:nz))
   1332, Generating implicit firstprivate(smth_coef,input_var2)
smooth_min_arrays:
   1385, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1386, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1387,   ! blockidx%x threadidx%x collapsed
   1385, Generating default present(input_var2(:ngrdcol,:nz),input_var1(:ngrdcol,:nz))
   1387, Generating implicit firstprivate(smth_coef)
smooth_max_sclr_idx:
   1479, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1480, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1481,   ! blockidx%x threadidx%x collapsed
   1479, Generating default present(input_var2(:ngrdcol,:nz))
   1481, Generating implicit firstprivate(smth_coef,input_var1)
smooth_max_array_scalar:
   1534, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1535, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1536,   ! blockidx%x threadidx%x collapsed
   1534, Generating default present(input_var1(:ngrdcol,:nz))
   1536, Generating implicit firstprivate(smth_coef,input_var2)
smooth_max_array_1d_scalar:
   1588, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1589, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1588, Generating default present(input_var1(:ngrdcol))
   1589, Generating implicit firstprivate(smth_coef,input_var2)
smooth_max_arrays:
   1641, Generating implicit firstprivate(nz,ngrdcol)
         Generating NVIDIA GPU code
       1642, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1643,   ! blockidx%x threadidx%x collapsed
   1641, Generating default present(input_var2(:ngrdcol,:nz),input_var1(:ngrdcol,:nz))
   1643, Generating implicit firstprivate(smth_coef)
smooth_heaviside_peskin:
   1737, Generating implicit firstprivate(ngrdcol,nz)
         Generating NVIDIA GPU code
       1738, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1739,   ! blockidx%x threadidx%x collapsed
   1737, Generating default present(input(:ngrdcol,:nz))
   1739, Generating implicit firstprivate(smth_range,input_over_smth_range)
calc_xpwp_2d:
   1849, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       1850, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1851,   ! blockidx%x threadidx%x collapsed
   1849, Generating default present(xm(:ngrdcol,:nzm-1),xpwp(:ngrdcol,2:nzm-1),gr%invrs_dzm(1:ngrdcol,2:nzm-1),gr,km_zm(:ngrdcol,2:nzm-1))
clip_covars_denom:
    156, Generating enter data create(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:))
    157, Generating enter data create(wpsclrp_chnge(:,:,:))
    414, Generating exit data delete(upwp_chnge(:,:),wprtp_chnge(:,:),vpwp_chnge(:,:),wpthlp_chnge(:,:))
    415, Generating exit data delete(wpsclrp_chnge(:,:,:))
clip_covar:
    566, Generating update self(xpyp(:,:))
    599, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        600, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        601,   ! blockidx%x threadidx%x collapsed
    599, Generating default present(xp2(:ngrdcol,2:nzm-1),yp2(:ngrdcol,2:nzm-1),xpyp_chnge(:ngrdcol,2:nzm-1),xpyp(:ngrdcol,2:nzm-1))
    601, Generating implicit firstprivate(xpyp_bound,max_mag_corr)
    629, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        630, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    629, Generating default present(xpyp_chnge(:ngrdcol,:))
    630, Generating implicit firstprivate(nzm)
    638, Generating update self(xpyp(:,:))
clip_variance:
    929, Generating copy(xp2(:,:)) [if not already present]
         Generating copyin(threshold(:,:)) [if not already present]
    949, Generating update self(xp2(:,:))
    967, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        968, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        969,   ! blockidx%x threadidx%x collapsed
    978, Generating update self(xp2(:,:))
clip_skewness:
   1093, Generating copyin(gr,gr%zt(:,:),sfc_elevation(:)) [if not already present]
         Generating copy(wp3(:,:)) [if not already present]
         Generating copyin(wp2_zt(:,:)) [if not already present]
   1099, Generating update self(wp3(:,:))
   1114, Generating update self(wp3(:,:))
clip_skewness_core:
   1184, Generating enter data create(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:))
   1203, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1204, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1205,   ! blockidx%x threadidx%x collapsed
   1203, Generating default present(wp2_zt(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt))
   1214, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1215, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1216,   ! blockidx%x threadidx%x collapsed
   1214, Generating default present(sfc_elevation(:ngrdcol),zagl_thresh(:ngrdcol,:nzt),gr%zt(1:ngrdcol,1:nzt),gr)
   1226, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1227, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1228,   ! blockidx%x threadidx%x collapsed
   1226, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt),skw_max_mag(:ngrdcol),h_zagl(:ngrdcol,:nzt))
   1239, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1240, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1241,   ! blockidx%x threadidx%x collapsed
   1239, Generating default present(gr%zt(1:ngrdcol,1:nzt),gr,skw_max_mag(:ngrdcol),sfc_elevation(:ngrdcol),wp3_lim_sqd(:ngrdcol,:nzt),wp2_zt_cubed(:ngrdcol,:nzt))
   1259, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1260, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1261,   ! blockidx%x threadidx%x collapsed
   1259, Generating default present(wp3_lim_sqd(:ngrdcol,:nzt),wp3(:ngrdcol,:nzt))
   1272, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1273, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1274,   ! blockidx%x threadidx%x collapsed
   1272, Generating default present(wp3(:ngrdcol,:nzt))
   1282, Generating exit data delete(zagl_thresh(:,:),wp3_lim_sqd(:,:),wp2_zt_cubed(:,:),h_zagl(:,:))
monotonic_turbulent_flux_limit:
    466, Generating enter data create(wpxp_net_adjust(:,:),wpxp_mfl_min(:,:),wpxp_mfl_max(:,:),xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_adjustment_needed(:),wpxp_mfl_max_term(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min_term(:,:),xm_mfl(:,:),wpxp_thresh(:,:),xp2_zt(:,:),xm_without_ta(:,:))
    497, Generating update self(wpxp(:,:),xm(:,:))
    506, Generating update self(xm_old(:,:),xm(:,:),wpxp(:,:))
    516, Generating update self(xm(:,:),xm_old(:,:),wpxp(:,:))
    529, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
        530, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        531,   ! blockidx%x threadidx%x collapsed
    529, Generating default present(wpxp_net_adjust(:ngrdcol,:nzm))
    538, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        539, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        540,   ! blockidx%x threadidx%x collapsed
    538, Generating default present(xm(:ngrdcol,:nzt),xm_enter_mfl(:ngrdcol,:nzt))
    556, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        557, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        558,   ! blockidx%x threadidx%x collapsed
    556, Generating default present(xp2_zt(:ngrdcol,:nzt))
    558, Generating implicit firstprivate(xp2_threshold,max_xp2)
    567, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        568, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        569,   ! blockidx%x threadidx%x collapsed
    567, Generating default present(xp2_zt(:ngrdcol,:nzt),xm_without_ta(:ngrdcol,:nzt),min_x_allowable_lev(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt),xm_old(:ngrdcol,:nzt),max_x_allowable_lev(:ngrdcol,:nzt))
    569, Generating implicit firstprivate(xm_tol,solve_type,dt,max_dev)
    632, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        633, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        634,   ! blockidx%x threadidx%x collapsed
        642, !$acc loop seq
             Generating implicit reduction(min:min_tmp)
             Generating implicit reduction(max:max_tmp)
    632, Generating default present(low_lev_effect(:ngrdcol,:nzt-1),max_x_allowable_lev(:ngrdcol,:),min_x_allowable_lev(:ngrdcol,:),min_x_allowable(:ngrdcol,:nzt-1),max_x_allowable(:ngrdcol,:nzt-1),high_lev_effect(:ngrdcol,:nzt-1))
    634, Generating implicit firstprivate(j,min_tmp,max_tmp,low_lev,high_lev)
    642, Loop is parallelizable
    654, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        655, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        656,   ! blockidx%x threadidx%x collapsed
    654, Generating default present(wpxp_mfl_max_term(:ngrdcol,:nzm-2),gr%dzt(1:ngrdcol,1:nzm-2),rho_ds_zt(:ngrdcol,:nzm-2),min_x_allowable(:ngrdcol,:nzm-2),wpxp_mfl_min_term(:ngrdcol,:nzm-2),gr,max_x_allowable(:ngrdcol,:nzm-2),xm_without_ta(:ngrdcol,:nzm-2),wpxp_thresh(:ngrdcol,:nzm-2))
    656, Generating implicit firstprivate(invrs_dt)
    665, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        666, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        667, !$acc loop seq
    665, Generating default present(wpxp_mfl_min(:ngrdcol,2:nzm-1),invrs_rho_ds_zm(:ngrdcol,2:nzm-1),wpxp_mfl_max(:ngrdcol,2:nzm-1),wpxp_thresh(:ngrdcol,:nzm-2),wpxp_net_adjust(:ngrdcol,2:nzm-1),rho_ds_zm(:ngrdcol,:nzm-2),wpxp(:ngrdcol,:nzm-1),wpxp_mfl_min_term(:ngrdcol,:nzm-2),wpxp_mfl_max_term(:ngrdcol,:nzm-2))
    667, Loop carried dependence of wpxp prevents parallelization
         Loop carried backward dependence of wpxp prevents vectorization
         Generating implicit firstprivate(solve_type,l_mono_flux_lim_spikefix)
         Loop carried dependence of wpxp prevents parallelization
    721, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        722, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    721, Generating default present(max_x_allowable(:ngrdcol,nzt),wpxp_mfl_min(:ngrdcol,:),wpxp_mfl_max(:ngrdcol,:),min_x_allowable(:ngrdcol,nzt))
    722, Generating implicit firstprivate(nzt,nzm)
    737, Generating update self(min_x_allowable(:,:),wpxp_mfl_max(:,:),max_x_allowable(:,:),xm_without_ta(:,:),wpxp_mfl_min(:,:))
    752, Generating update self(min_x_allowable(:,:),wpxp_mfl_max(:,:),max_x_allowable(:,:),xm_without_ta(:,:),wpxp_mfl_min(:,:))
    770, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
        771, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
    770, Generating default present(l_adjustment_needed(:ngrdcol))
    776, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
        778, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
             Generating reduction(.or.:l_any_adjustment_needed)
        779,   ! blockidx%x threadidx%x collapsed
    776, Generating default present(wpxp_net_adjust(:ngrdcol,:nzm),l_adjustment_needed(:ngrdcol))
         Generating implicit copy(l_any_adjustment_needed) [if not already present]
    814, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
        815, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
        816,   ! blockidx%x threadidx%x collapsed
    814, Generating default present(xm_mfl(:ngrdcol,:nzt),xm(:ngrdcol,:nzt),l_adjustment_needed(:ngrdcol))
    861, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
        862, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
        871, !$acc loop seq
             Generating implicit reduction(+:rho_ds_zt$r)
        896, !$acc loop seq
    861, Generating default present(xm_enter_mfl(:ngrdcol,nzt),xm(:ngrdcol,:),rho_ds_zt(:ngrdcol,:nzt),gr,gr%dzt(1:ngrdcol,1:nzt-1),gr%zm(1:ngrdcol,nzm-1:nzm))
    862, Generating implicit firstprivate(xm_density_weighted,dz,xm_adj_coef,xm_vert_integral,xm_tol,nzm)
    871, Loop is parallelizable
    896, Loop is parallelizable
    927, Generating update self(xm(:,:),wpxp(:,:))
    950, Generating exit data delete(wpxp_net_adjust(:,:),wpxp_mfl_min(:,:),wpxp_mfl_max(:,:),xm_enter_mfl(:,:),min_x_allowable_lev(:,:),l_adjustment_needed(:),wpxp_mfl_max_term(:,:),rhs_mfl_xm(:,:),lhs_mfl_xm(:,:,:),max_x_allowable_lev(:,:),max_x_allowable(:,:),min_x_allowable(:,:),wpxp_mfl_min_term(:,:),xm_mfl(:,:),wpxp_thresh(:,:),xp2_zt(:,:),xm_without_ta(:,:))
mfl_xm_lhs:
   1043, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1044, !$acc loop gang, vector(128) collapse(3) ! blockidx%x threadidx%x
       1045,   ! blockidx%x threadidx%x collapsed
       1046,   ! blockidx%x threadidx%x collapsed
   1043, Generating default present(lhs(:,:ngrdcol,:nzt))
   1055, Generating implicit firstprivate(nzt,ngrdcol)
         Generating NVIDIA GPU code
       1056, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1057,   ! blockidx%x threadidx%x collapsed
   1055, Generating default present(lhs(2,:ngrdcol,:nzt))
   1057, Generating implicit firstprivate(dt)
mfl_xm_rhs:
   1118, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1119, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1120,   ! blockidx%x threadidx%x collapsed
   1118, Generating default present(wpxp(:ngrdcol,:nzt+1),invrs_dzt(:ngrdcol,:nzt),invrs_rho_ds_zt(:ngrdcol,:nzt),rhs(:ngrdcol,:nzt),rho_ds_zm(:ngrdcol,:nzt+1),xm_old(:ngrdcol,:nzt),xm_forcing(:ngrdcol,:nzt))
   1120, Generating implicit firstprivate(dt)
calc_turb_adv_range:
   1341, Generating enter data create(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:))
   1444, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1445, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1446,   ! blockidx%x threadidx%x collapsed
   1444, Generating default present(w_min(:ngrdcol,:nzm),gr%dzm(1:ngrdcol,1:nzm),gr)
   1446, Generating implicit firstprivate(invrs_dt)
   1465, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1466, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1467,   ! blockidx%x threadidx%x collapsed
   1465, Generating default present(gr,gr%dzm(1:ngrdcol,:),low_lev_effect(:ngrdcol,2:nzt-2),vert_vel_up_zm(:ngrdcol,:))
   1467, Generating implicit firstprivate(j,dt_all_grid_levs)
   1478, Loop carried reuse of low_lev_effect prevents parallelization
         Loop carried scalar dependence for dt_all_grid_levs at line 1491
         Generating implicit firstprivate(dt_one_grid_lev,dt)
         Loop carried reuse of low_lev_effect prevents parallelization
   1480, Accelerator restriction: induction variable live-out from loop: j
   1483, Accelerator restriction: induction variable live-out from loop: j
   1487, Accelerator restriction: induction variable live-out from loop: j
   1514, Accelerator restriction: induction variable live-out from loop: j
   1525, Generating implicit firstprivate(ngrdcol,nzt)
         Generating NVIDIA GPU code
       1526, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1527,   ! blockidx%x threadidx%x collapsed
   1525, Generating default present(gr,gr%dzm(1:ngrdcol,:),vert_vel_down_zm(:ngrdcol,:),high_lev_effect(:ngrdcol,2:nzt-2))
   1527, Generating implicit firstprivate(j,dt_all_grid_levs)
   1534, Loop carried reuse of high_lev_effect prevents parallelization
         Loop carried scalar dependence for dt_all_grid_levs at line 1551
         Generating implicit firstprivate(dt_one_grid_lev,dt)
         Loop carried reuse of high_lev_effect prevents parallelization
   1536, Accelerator restriction: induction variable live-out from loop: j
   1539, Accelerator restriction: induction variable live-out from loop: j
   1547, Accelerator restriction: induction variable live-out from loop: j
   1574, Accelerator restriction: induction variable live-out from loop: j
   1586, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       1587, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   1586, Generating default present(low_lev_effect(:ngrdcol,:),high_lev_effect(:ngrdcol,:))
   1587, Generating implicit firstprivate(nzt)
   1597, Generating exit data delete(w_min(:,:),vert_vel_up_zm(:,:),vert_vel_down_zm(:,:))
mean_vert_vel_up_down:
   1853, Generating enter data create(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:))
   1866, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1867, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1868,   ! blockidx%x threadidx%x collapsed
   1866, Generating default present(mean_w_down(:ngrdcol,:nzm),mean_w_down_2nd(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_down_1st(:ngrdcol,:nzm))
   1876, Generating implicit firstprivate(nzm,ngrdcol)
         Generating NVIDIA GPU code
       1877, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1878,   ! blockidx%x threadidx%x collapsed
   1876, Generating default present(mean_w_up(:ngrdcol,:nzm),mean_w_up_1st(:ngrdcol,:nzm),mixt_frac_zm(:ngrdcol,:nzm),mean_w_up_2nd(:ngrdcol,:nzm))
   1886, Generating update self(mean_w_up(:,:),mean_w_down(:,:))
   1896, Generating exit data delete(mean_w_up_2nd(:,:),mean_w_up_1st(:,:),mean_w_down_2nd(:,:),mean_w_down_1st(:,:))
calc_mean_w_up_down_component:
   1978, Generating implicit firstprivate(ngrdcol,nzm)
         Generating NVIDIA GPU code
       1979, !$acc loop gang, vector(128) collapse(2) ! blockidx%x threadidx%x
       1980,   ! blockidx%x threadidx%x collapsed
   1978, Generating default present(w_min(:ngrdcol,2:nzm-1),w_i_zm(:ngrdcol,2:nzm-1),varnce_w_i_zm(:ngrdcol,2:nzm-1),mean_w_up_i(:ngrdcol,2:nzm-1),mean_w_down_i(:ngrdcol,2:nzm-1))
   1980, Generating implicit firstprivate(exp_cache,w_ref,sigma_w_i_zm,erf_cache)
   2024, Generating implicit firstprivate(ngrdcol)
         Generating NVIDIA GPU code
       2025, !$acc loop gang, vector(128) ! blockidx%x threadidx%x
   2024, Generating default present(mean_w_up_i(:ngrdcol,:),mean_w_down_i(:ngrdcol,:))
   2025, Generating implicit firstprivate(nzm)
cleaning up after signal(15)...
make[1]: *** [Make.clubb_param:121: pdf_parameter_module.o] Error 127
make[1]: *** Waiting for unfinished jobs....
cleaning up after signal(15)...
make[1]: *** [Make.clubb_param:163: stats_zt_module.o] Error 127
make[1]: *** Deleting file 'clip_explicit.o'
cleaning up after signal(15)...
cleaning up after signal(15)...
make[1]: *** [Make.clubb_param:43: clip_explicit.o] Error 127
make: *** [Makefile:14: libclubb_param.a] Terminated
make[1]: *** [Make.clubb_param:93: mono_flux_limiter.o] Error 127
Terminated
script returned exit code 143
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
org.jenkinsci.plugins.workflow.actions.ErrorAction$ErrorId: e73d600c-3032-4efb-a8fc-02f083158473
Finished: ABORTED