Started by an SCM change
Obtained jenkins_tests/cam_ne5_gpu_test/Jenkinsfile from git <a href='https://github.com/larson-group/cam.git'>https://github.com/larson-group/cam.git</a>
<span class="pipeline-new-node" nodeId="2" startId="2">[Pipeline] Start of Pipeline
</span><span class="pipeline-new-node" nodeId="3" startId="3" enclosingId="2">[Pipeline] node
</span><span class="pipeline-node-3">Running on <a href='/jenkins/computer/mitch/' class='jenkins-table__link model-link model-link--float'>mitch</a> in /home/jenkins/workspace/cam_ne5_gpu_test
</span><span class="pipeline-new-node" nodeId="4" startId="4" enclosingId="3">[Pipeline] {
</span><span class="pipeline-new-node" nodeId="5" startId="5" enclosingId="4">[Pipeline] stage
</span><span class="pipeline-new-node" nodeId="6" startId="6" enclosingId="5" label="Declarative: Checkout SCM">[Pipeline] { (Declarative: Checkout SCM)
</span><span class="pipeline-new-node" nodeId="7" enclosingId="6">[Pipeline] checkout
</span><span class="pipeline-node-7">The recommended git tool is: git
Cloning the remote Git repository
Cloning repository <a href='https://github.com/larson-group/cam.git'>https://github.com/larson-group/cam.git</a>
 &gt; git init /home/jenkins/workspace/cam_ne5_gpu_test # timeout=10
Fetching upstream changes from <a href='https://github.com/larson-group/cam.git'>https://github.com/larson-group/cam.git</a>
 &gt; git --version # timeout=10
 &gt; git --version # 'git version 2.34.1'
using GIT_ASKPASS to set credentials A token based key used by Jenkins to preform Github actions, created 6/21/2021
 &gt; git fetch --tags --force --progress -- <a href='https://github.com/larson-group/cam.git'>https://github.com/larson-group/cam.git</a> +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
Checking out Revision f71a1437455d331a142dd305e80a6c402008e756 (refs/remotes/origin/clubb_silhs_devel)
Commit message: "Autoupdated CLUBB_core Commit 7e33d718280afab43dd3d8fcdc45f1c749ae7292 Author: domkesteffen Date: Thu Aug 29 13:33:02 2024 -0500 Ri_zm calc (Part 4) - Implementing calc_Ri_zm (#1160) * Ri_zm calc (Part 4) - Implementing calc_Ri_zm CLUBB tocket #1145"
 &gt; git config remote.origin.url <a href='https://github.com/larson-group/cam.git'>https://github.com/larson-group/cam.git</a> # timeout=10
 &gt; git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 &gt; git rev-parse refs/remotes/origin/clubb_silhs_devel^{commit} # timeout=10
 &gt; git config core.sparsecheckout # timeout=10
 &gt; git checkout -f f71a1437455d331a142dd305e80a6c402008e756 # timeout=10
 &gt; git rev-list --no-walk 432761245424477fab7613acd59ad4053e070e8e # timeout=10
</span><span class="pipeline-new-node" nodeId="8" startId="6">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="9" startId="5">[Pipeline] // stage
</span><span class="pipeline-new-node" nodeId="10" startId="10" enclosingId="4">[Pipeline] withEnv
</span><span class="pipeline-new-node" nodeId="11" startId="11" enclosingId="10">[Pipeline] {
</span><span class="pipeline-new-node" nodeId="12" startId="12" enclosingId="11">[Pipeline] stage
</span><span class="pipeline-new-node" nodeId="13" startId="13" enclosingId="12" label="Checkout Externals and Copy Custom Files">[Pipeline] { (Checkout Externals and Copy Custom Files)
</span><span class="pipeline-new-node" nodeId="14" enclosingId="13">[Pipeline] sh
</span><span class="pipeline-node-14">+ python run_scripts/set_up_cam_coarse_res.py .
Checking out externals...
Copying ccs_config files
</span><span class="pipeline-new-node" nodeId="15" startId="13">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="16" startId="12">[Pipeline] // stage
</span><span class="pipeline-new-node" nodeId="17" startId="17" enclosingId="11">[Pipeline] stage
</span><span class="pipeline-new-node" nodeId="18" startId="18" enclosingId="17" label="Remove Old Output">[Pipeline] { (Remove Old Output)
</span><span class="pipeline-new-node" nodeId="19" enclosingId="18">[Pipeline] sh
</span><span class="pipeline-node-19">+ rm -rf /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/ /home/jenkins/cam_output/caseroot/UWM_ne5_gpu_no_stats_larson-group_nvhpc/
</span><span class="pipeline-new-node" nodeId="20" startId="18">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="21" startId="17">[Pipeline] // stage
</span><span class="pipeline-new-node" nodeId="22" startId="22" enclosingId="11">[Pipeline] stage
</span><span class="pipeline-new-node" nodeId="23" startId="23" enclosingId="22" label="Running ne5 with OpenACC">[Pipeline] { (Running ne5 with OpenACC)
</span><span class="pipeline-new-node" nodeId="24" enclosingId="23">[Pipeline] sh
</span><span class="pipeline-node-24">+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ run_scripts/run_cesm_uwm_coarse_res_gpu_no_silhs.sh
----- Case Setup -----
Compset longname is 2000_CAM%DEV_CLM50%SP_CICE%PRES_DOCN%DOM_MOSART_SGLC_SWAV
Compset specification file is /home/jenkins/workspace/cam_ne5_gpu_test/cime_config/config_compsets.xml
Automatically adding SESP to compset
Compset forcing is 1972-2004
ATM component is CAM7 development physics:
LND component is clm5.0:Satellite phenology:
ICE component is Sea ICE (cice) model version 6 :prescribed cice
OCN component is DOCN   prescribed ocean mode
ROF component is MOSART: MOdel for Scale Adaptive River Transport
GLC component is Stub glacier (land ice) component
WAV component is Stub wave component
ESP component is Stub external system processing (ESP) component
Pes     specification file is /home/jenkins/workspace/cam_ne5_gpu_test/cime_config/config_pes.xml
Machine is larson-group
Pes setting: grid          is a%ne5np4.pg3_l%ne5np4.pg3_oi%ne5np4.pg3_r%r05_g%null_w%null_z%null_m%gx3v7 
Pes setting: compset       is 2000_CAM%DEV_CLM50%SP_CICE%PRES_DOCN%DOM_MOSART_SGLC_SWAV_SESP 
Pes setting: tasks       is {'NTASKS_ATM': -1, 'NTASKS_LND': -1, 'NTASKS_ROF': -1, 'NTASKS_ICE': -1, 'NTASKS_OCN': -1, 'NTASKS_GLC': -1, 'NTASKS_WAV': -1, 'NTASKS_CPL': -1} 
Pes setting: threads     is {'NTHRDS_ATM': 1, 'NTHRDS_LND': 1, 'NTHRDS_ROF': 1, 'NTHRDS_ICE': 1, 'NTHRDS_OCN': 1, 'NTHRDS_GLC': 1, 'NTHRDS_WAV': 1, 'NTHRDS_CPL': 1} 
Pes setting: rootpe      is {'ROOTPE_ATM': 0, 'ROOTPE_LND': 0, 'ROOTPE_ROF': 0, 'ROOTPE_ICE': 0, 'ROOTPE_OCN': 0, 'ROOTPE_GLC': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0} 
Pes setting: pstrid      is {} 
Pes other settings: {}
Pes comments: none
setting additional fields from config_pes: {}
 Compset is: 2000_CAM%DEV_CLM50%SP_CICE%PRES_DOCN%DOM_MOSART_SGLC_SWAV_SESP 
 Grid is: a%ne5np4.pg3_l%ne5np4.pg3_oi%ne5np4.pg3_r%r05_g%null_w%null_z%null_m%gx3v7 
 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'mosart', 'sglc', 'swav', 'sesp'] 
No project info available
No charge_account info available, using value from PROJECT
cesm model version found: cam_4ncar_20240605_2f3c896-57-gf71a1437
Batch_system_type is none
 Creating Case directory /home/jenkins/cam_output/caseroot/UWM_ne5_gpu_no_stats_larson-group_nvhpc
ERROR: Unknown Job Queue specified use --force to set
Creating batch scripts
Writing case.run script from input template /home/jenkins/workspace/cam_ne5_gpu_test/ccs_config/machines/template.case.run
Creating file .case.run
Writing case.st_archive script from input template /home/jenkins/workspace/cam_ne5_gpu_test/ccs_config/machines/template.st_archive
Creating file case.st_archive
Creating user_nl_xxx files for components and cpl
Running cam.case_setup.py
If an old case build already exists, might want to run 'case.build --clean' before building
You can now run './preview_run' to get more info on how your case will be run
----- Compile Configuration -----
----- Compile -----
Building case in directory /home/jenkins/cam_output/caseroot/UWM_ne5_gpu_no_stats_larson-group_nvhpc
sharedlib_only is False
model_only is False
Generating component namelists as part of build
  2024-08-30 03:53:19 atm 
Create namelist for component cam
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime_config/buildnml
     ...calling cam buildcpp to set build time options
CAM namelist copy: file1 /home/jenkins/cam_output/caseroot/UWM_ne5_gpu_no_stats_larson-group_nvhpc/Buildconf/camconf/atm_in file2 /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/run/atm_in 
  2024-08-30 03:53:20 lnd 
Create namelist for component clm
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/clm//cime_config/buildnml
  2024-08-30 03:53:20 ice 
Create namelist for component cice
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/cice//cime_config/buildnml
RUN: /home/jenkins/workspace/cam_ne5_gpu_test/components/cice/bld/generate_cice_decomp.pl -ccsmroot /home/jenkins/workspace/cam_ne5_gpu_test -res ne5np4.pg3 -nx 1350 -ny 1 -nproc 1 -thrds 1 -output all 
FROM: /home/jenkins/cam_output/caseroot/UWM_ne5_gpu_no_stats_larson-group_nvhpc
  output: 1350 1 1350 1 1 roundrobin square-ice

  2024-08-30 03:53:20 ocn 
Create namelist for component docn
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/cdeps/docn/cime_config/buildnml
docn_mode is prescribed
  2024-08-30 03:53:20 rof 
Create namelist for component mosart
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/mosart//cime_config/buildnml
  2024-08-30 03:53:20 glc 
Create namelist for component sglc
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/non_py/src/components/stub_comps_nuopc/sglc/cime_config/buildnml
  2024-08-30 03:53:20 wav 
Create namelist for component swav
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/non_py/src/components/stub_comps_nuopc/swav/cime_config/buildnml
  2024-08-30 03:53:20 esp 
Create namelist for component sesp
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/non_py/src/components/stub_comps_nuopc/sesp/cime_config/buildnml
  2024-08-30 03:53:20 cpl 
Create namelist for component drv
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/cmeps/cime_config/buildnml
Writing nuopc_runconfig for components ['CPL', 'ATM', 'LND', 'ICE', 'OCN', 'ROF']
Building gptl with output to file /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/gptl.bldlog.240830-035319
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/build_scripts/buildlib.gptl
Building mct with output to file /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/mct.bldlog.240830-035319
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/build_scripts/buildlib.mct
Building pio with output to file /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/pio.bldlog.240830-035319
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/cime/CIME/build_scripts/buildlib.pio
Building csm_share with output to file /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/csm_share.bldlog.240830-035319
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/share/buildlib.csm_share
Building CDEPS with output to file /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/CDEPS.bldlog.240830-035319
   Calling /home/jenkins/workspace/cam_ne5_gpu_test/components/cdeps/cime_config/buildlib
         - Building clm library 
Building lnd with output to /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/lnd.bldlog.240830-035319
clm built in 658.914493 seconds
         - Building atm Library 
Building atm with output to /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/atm.bldlog.240830-035319
         - Building ice Library 
Building ice with output to /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/ice.bldlog.240830-035319
         - Building ocn Library 
Building ocn with output to /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/ocn.bldlog.240830-035319
         - Building rof Library 
Building rof with output to /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/rof.bldlog.240830-035319
docn built in 0.533389 seconds
cam built in 73.342011 seconds
mosart built in 76.916507 seconds
cice built in 157.566843 seconds
ERROR: BUILD FAIL: cam.buildlib failed, cat /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/atm.bldlog.240830-035319
Error building CAM
</span><span class="pipeline-new-node" nodeId="25" startId="23">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="26" startId="22">[Pipeline] // stage
</span><span class="pipeline-new-node" nodeId="27" startId="27" enclosingId="11">[Pipeline] stage
</span><span class="pipeline-new-node" nodeId="28" startId="28" enclosingId="27" label="Declarative: Post Actions">[Pipeline] { (Declarative: Post Actions)
</span><span class="pipeline-new-node" nodeId="29" startId="29" enclosingId="28">[Pipeline] script
</span><span class="pipeline-new-node" nodeId="30" startId="30" enclosingId="29">[Pipeline] {
</span><span class="pipeline-new-node" nodeId="31" enclosingId="30">[Pipeline] cleanWs
</span><span class="pipeline-node-31">[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is used...
[WS-CLEANUP] done
</span><span class="pipeline-new-node" nodeId="32" enclosingId="30">[Pipeline] sh
</span><span class="pipeline-node-32">+ chmod -R 755 /home/jenkins/cam_output/
</span><span class="pipeline-new-node" nodeId="33" enclosingId="30">[Pipeline] sh
</span><span class="pipeline-node-33">+ gzip -d '/home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/atm.bldlog.*.gz'
gzip: /home/jenkins/cam_output/scratch/UWM_ne5_gpu_no_stats_larson-group_nvhpc/bld/atm.bldlog.*.gz: No such file or directory
</span><span class="pipeline-new-node" nodeId="34" enclosingId="30">[Pipeline] echo
</span><span class="pipeline-node-34">Not all logs were compressed, this indicates a failure.
</span><span class="pipeline-new-node" nodeId="35" startId="30">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="36" startId="29">[Pipeline] // script
</span><span class="pipeline-new-node" nodeId="37" startId="37" enclosingId="28">[Pipeline] script
</span><span class="pipeline-new-node" nodeId="38" startId="38" enclosingId="37">[Pipeline] {
</span><span class="pipeline-new-node" nodeId="39" enclosingId="38">[Pipeline] emailext
</span><span class="pipeline-node-39">Sending email to: messnermet@uwm.edu
</span><span class="pipeline-new-node" nodeId="40" startId="38">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="41" startId="37">[Pipeline] // script
</span><span class="pipeline-new-node" nodeId="42" startId="28">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="43" startId="27">[Pipeline] // stage
</span><span class="pipeline-new-node" nodeId="44" startId="11">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="45" startId="10">[Pipeline] // withEnv
</span><span class="pipeline-new-node" nodeId="46" startId="4">[Pipeline] }
</span><span class="pipeline-new-node" nodeId="47" startId="3">[Pipeline] // node
</span><span class="pipeline-new-node" nodeId="48" startId="2">[Pipeline] End of Pipeline
</span>ERROR: script returned exit code 1
Finished: FAILURE