Console Output

Started by an SCM change
Obtained jenkins_tests/cam_clubb_generalized_grid_scam_test/Jenkinsfile from git https://github.com/larson-group/cam.git
[Pipeline] Start of Pipeline
[Pipeline] node
Running on mitch in /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Declarative: Checkout SCM)
[Pipeline] checkout
The recommended git tool is: git
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/larson-group/cam.git
 > git init /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test # timeout=10
Fetching upstream changes from https://github.com/larson-group/cam.git
 > git --version # timeout=10
 > git --version # 'git version 2.34.1'
 > git fetch --tags --force --progress -- https://github.com/larson-group/cam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
Checking out Revision 3435d5ba58c9bd61872a20bdde6ee02674328708 (refs/remotes/origin/clubb_silhs_devel)
Commit message: "Autoupdated CLUBB_core Commit cfd36718c8a48ad02f35a4805ebab6108914d470 Author: Benjamin A. Stephens Date: Tue Sep 23 09:54:36 2025 -0600 Adding expldiff budget terms for thlm and rtm (#1252) * Adding expldiff budget terms for thlm and rtm"
 > git config remote.origin.url https://github.com/larson-group/cam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git rev-parse refs/remotes/origin/clubb_silhs_devel^{commit} # timeout=10
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 3435d5ba58c9bd61872a20bdde6ee02674328708 # timeout=10
 > git rev-list --no-walk 1644e80604055cf7a4910e9ace4213ac15f38fbf # timeout=10
[Pipeline] }
[Pipeline] // stage
[Pipeline] withEnv
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Checkout Externals and Copy Custom Files)
[Pipeline] sh
+ python run_scripts/set_up_repo.py .
Checking out externals...
Copying ccs_config files
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Remove Old Output)
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ATEX
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ARM97
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ATEX_ascending
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ARM97_ascending
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ATEX_descending
[Pipeline] sh
+ rm -rf /home/jenkins/cam_output/scratch/test_scam_ARM97_descending
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Generalized Grid Test for ATEX and ARM97 with SILHS)
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ ulimit -s 8388608
+ run_scripts/run_generalized_grid_scam_test.bash
----- Case Setup -----
Compset longname is 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV
Compset specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_compsets.xml
Automatically adding SESP to compset
Compset forcing is 1972-2004
ATM component is CAM cam6 physics:
LND component is clm5.0:Satellite phenology:
ICE component is Sea ICE (cice) model version 6 :prescribed cice
OCN component is DOCN   prescribed ocean mode
ROF component is Stub river component
GLC component is Stub glacier (land ice) component
WAV component is Stub wave component
ESP component is Stub external system processing (ESP) component
Pes     specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_pes.xml
Compset specific settings: name is RUN_STARTDATE and value is 1969-02-15
Compset specific settings: name is STOP_N and value is 47
Compset specific settings: name is STOP_OPTION and value is nhours
Compset specific settings: name is START_TOD and value is 0
Compset specific settings: name is PTS_MODE and value is TRUE
Compset specific settings: name is PTS_LAT and value is 15.0
Compset specific settings: name is PTS_LON and value is 345.0
Machine is larson-group
vid is comment
vid is ntasks
vid is nthrds
vid is rootpe
Pes setting: grid          is a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
Pes setting: compset       is 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
Pes setting: tasks       is {'NTASKS_ATM': 1, 'NTASKS_LND': 1, 'NTASKS_ROF': 1, 'NTASKS_ICE': 1, 'NTASKS_OCN': 1, 'NTASKS_GLC': 1, 'NTASKS_WAV': 1, 'NTASKS_CPL': 1} 
Pes setting: threads     is {'NTHRDS_ATM': 1, 'NTHRDS_LND': 1, 'NTHRDS_ROF': 1, 'NTHRDS_ICE': 1, 'NTHRDS_OCN': 1, 'NTHRDS_GLC': 1, 'NTHRDS_WAV': 1, 'NTHRDS_CPL': 1} 
Pes setting: rootpe      is {'ROOTPE_ATM': 0, 'ROOTPE_LND': 0, 'ROOTPE_ROF': 0, 'ROOTPE_ICE': 0, 'ROOTPE_OCN': 0, 'ROOTPE_GLC': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0} 
Pes setting: pstrid      is {} 
Pes other settings: {}
Pes comments: none
setting additional fields from config_pes: {}
 Compset is: 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
 Grid is: a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'sesp'] 

This is a CESM scientifically supported compset at this resolution.

No project info available
No charge_account info available, using value from PROJECT
cesm model version found: cam_4ncar_20240605_2f3c896-830-g3435d5ba5
Batch_system_type is none
 Creating Case directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX
This component includes user_mods /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
Adding user mods directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
RUN: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX/shell_commands
FROM: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX
Invalid permissions to create /home/pub/cam_inputdata
ERROR: inputdata root is not a directory or is not readable: /home/pub/cam_inputdata
----- Case Setup -----
Compset longname is 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV
Compset specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_compsets.xml
Automatically adding SESP to compset
Compset forcing is 1972-2004
ATM component is CAM cam6 physics:
LND component is clm5.0:Satellite phenology:
ICE component is Sea ICE (cice) model version 6 :prescribed cice
OCN component is DOCN   prescribed ocean mode
ROF component is Stub river component
GLC component is Stub glacier (land ice) component
WAV component is Stub wave component
ESP component is Stub external system processing (ESP) component
Pes     specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_pes.xml
Compset specific settings: name is RUN_STARTDATE and value is 1997-06-18
Compset specific settings: name is STOP_N and value is 695
Compset specific settings: name is STOP_OPTION and value is nhours
Compset specific settings: name is START_TOD and value is 84585
Compset specific settings: name is PTS_MODE and value is TRUE
Compset specific settings: name is PTS_LAT and value is 36.6
Compset specific settings: name is PTS_LON and value is 262.5
Machine is larson-group
vid is comment
vid is ntasks
vid is nthrds
vid is rootpe
Pes setting: grid          is a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
Pes setting: compset       is 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
Pes setting: tasks       is {'NTASKS_ATM': 1, 'NTASKS_LND': 1, 'NTASKS_ROF': 1, 'NTASKS_ICE': 1, 'NTASKS_OCN': 1, 'NTASKS_GLC': 1, 'NTASKS_WAV': 1, 'NTASKS_CPL': 1} 
Pes setting: threads     is {'NTHRDS_ATM': 1, 'NTHRDS_LND': 1, 'NTHRDS_ROF': 1, 'NTHRDS_ICE': 1, 'NTHRDS_OCN': 1, 'NTHRDS_GLC': 1, 'NTHRDS_WAV': 1, 'NTHRDS_CPL': 1} 
Pes setting: rootpe      is {'ROOTPE_ATM': 0, 'ROOTPE_LND': 0, 'ROOTPE_ROF': 0, 'ROOTPE_ICE': 0, 'ROOTPE_OCN': 0, 'ROOTPE_GLC': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0} 
Pes setting: pstrid      is {} 
Pes other settings: {}
Pes comments: none
setting additional fields from config_pes: {}
 Compset is: 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
 Grid is: a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'sesp'] 

This is a CESM scientifically supported compset at this resolution.

No project info available
No charge_account info available, using value from PROJECT
cesm model version found: cam_4ncar_20240605_2f3c896-830-g3435d5ba5
Batch_system_type is none
 Creating Case directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97
This component includes user_mods /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
Adding user mods directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
RUN: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97/shell_commands
FROM: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97
Invalid permissions to create /home/pub/cam_inputdata
ERROR: inputdata root is not a directory or is not readable: /home/pub/cam_inputdata
mv: cannot stat '/home/jenkins/cam_output/scratch/test_scam_ATEX': No such file or directory
mv: cannot stat '/home/jenkins/cam_output/scratch/test_scam_ARM97': No such file or directory
----- Case Setup -----
Compset longname is 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV
Compset specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_compsets.xml
Automatically adding SESP to compset
Compset forcing is 1972-2004
ATM component is CAM cam6 physics:
LND component is clm5.0:Satellite phenology:
ICE component is Sea ICE (cice) model version 6 :prescribed cice
OCN component is DOCN   prescribed ocean mode
ROF component is Stub river component
GLC component is Stub glacier (land ice) component
WAV component is Stub wave component
ESP component is Stub external system processing (ESP) component
Pes     specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_pes.xml
Compset specific settings: name is RUN_STARTDATE and value is 1969-02-15
Compset specific settings: name is STOP_N and value is 47
Compset specific settings: name is STOP_OPTION and value is nhours
Compset specific settings: name is START_TOD and value is 0
Compset specific settings: name is PTS_MODE and value is TRUE
Compset specific settings: name is PTS_LAT and value is 15.0
Compset specific settings: name is PTS_LON and value is 345.0
Machine is larson-group
vid is comment
vid is ntasks
vid is nthrds
vid is rootpe
Pes setting: grid          is a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
Pes setting: compset       is 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
Pes setting: tasks       is {'NTASKS_ATM': 1, 'NTASKS_LND': 1, 'NTASKS_ROF': 1, 'NTASKS_ICE': 1, 'NTASKS_OCN': 1, 'NTASKS_GLC': 1, 'NTASKS_WAV': 1, 'NTASKS_CPL': 1} 
Pes setting: threads     is {'NTHRDS_ATM': 1, 'NTHRDS_LND': 1, 'NTHRDS_ROF': 1, 'NTHRDS_ICE': 1, 'NTHRDS_OCN': 1, 'NTHRDS_GLC': 1, 'NTHRDS_WAV': 1, 'NTHRDS_CPL': 1} 
Pes setting: rootpe      is {'ROOTPE_ATM': 0, 'ROOTPE_LND': 0, 'ROOTPE_ROF': 0, 'ROOTPE_ICE': 0, 'ROOTPE_OCN': 0, 'ROOTPE_GLC': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0} 
Pes setting: pstrid      is {} 
Pes other settings: {}
Pes comments: none
setting additional fields from config_pes: {}
 Compset is: 2000_CAM60%SCAMATEX_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
 Grid is: a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'sesp'] 

This is a CESM scientifically supported compset at this resolution.

No project info available
No charge_account info available, using value from PROJECT
cesm model version found: cam_4ncar_20240605_2f3c896-830-g3435d5ba5
Batch_system_type is none
 Creating Case directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX
This component includes user_mods /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
Adding user mods directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
RUN: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX/shell_commands
FROM: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ATEX
Invalid permissions to create /home/pub/cam_inputdata
ERROR: inputdata root is not a directory or is not readable: /home/pub/cam_inputdata
----- Case Setup -----
Compset longname is 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV
Compset specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_compsets.xml
Automatically adding SESP to compset
Compset forcing is 1972-2004
ATM component is CAM cam6 physics:
LND component is clm5.0:Satellite phenology:
ICE component is Sea ICE (cice) model version 6 :prescribed cice
OCN component is DOCN   prescribed ocean mode
ROF component is Stub river component
GLC component is Stub glacier (land ice) component
WAV component is Stub wave component
ESP component is Stub external system processing (ESP) component
Pes     specification file is /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/config_pes.xml
Compset specific settings: name is RUN_STARTDATE and value is 1997-06-18
Compset specific settings: name is STOP_N and value is 695
Compset specific settings: name is STOP_OPTION and value is nhours
Compset specific settings: name is START_TOD and value is 84585
Compset specific settings: name is PTS_MODE and value is TRUE
Compset specific settings: name is PTS_LAT and value is 36.6
Compset specific settings: name is PTS_LON and value is 262.5
Machine is larson-group
vid is comment
vid is ntasks
vid is nthrds
vid is rootpe
Pes setting: grid          is a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
Pes setting: compset       is 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
Pes setting: tasks       is {'NTASKS_ATM': 1, 'NTASKS_LND': 1, 'NTASKS_ROF': 1, 'NTASKS_ICE': 1, 'NTASKS_OCN': 1, 'NTASKS_GLC': 1, 'NTASKS_WAV': 1, 'NTASKS_CPL': 1} 
Pes setting: threads     is {'NTHRDS_ATM': 1, 'NTHRDS_LND': 1, 'NTHRDS_ROF': 1, 'NTHRDS_ICE': 1, 'NTHRDS_OCN': 1, 'NTHRDS_GLC': 1, 'NTHRDS_WAV': 1, 'NTHRDS_CPL': 1} 
Pes setting: rootpe      is {'ROOTPE_ATM': 0, 'ROOTPE_LND': 0, 'ROOTPE_ROF': 0, 'ROOTPE_ICE': 0, 'ROOTPE_OCN': 0, 'ROOTPE_GLC': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0} 
Pes setting: pstrid      is {} 
Pes other settings: {}
Pes comments: none
setting additional fields from config_pes: {}
 Compset is: 2000_CAM60%SCAMARM97_CLM50%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SESP 
 Grid is: a%T42_l%T42_oi%T42_r%null_g%null_w%null_z%null_m%gx1v7 
 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'sesp'] 

This is a CESM scientifically supported compset at this resolution.

No project info available
No charge_account info available, using value from PROJECT
cesm model version found: cam_4ncar_20240605_2f3c896-830-g3435d5ba5
Batch_system_type is none
 Creating Case directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97
This component includes user_mods /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
Adding user mods directory /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime_config/usermods_dirs/scam_mandatory
RUN: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97/shell_commands
FROM: /home/jenkins/workspace/cam_clubb_generalized_grid_scam_test/cime/scripts/test_scam_ARM97
Invalid permissions to create /home/pub/cam_inputdata
ERROR: inputdata root is not a directory or is not readable: /home/pub/cam_inputdata
mv: cannot stat '/home/jenkins/cam_output/scratch/test_scam_ATEX': No such file or directory
mv: cannot stat '/home/jenkins/cam_output/scratch/test_scam_ARM97': No such file or directory
run_scripts/run_generalized_grid_scam_test.bash: line 62: /home/jenkins/cam_output/scratch/test_scam_ATEX_ascending/run/ATEX_ascending_output.txt: No such file or directory
run_scripts/run_generalized_grid_scam_test.bash: line 64: /home/jenkins/cam_output/scratch/test_scam_ARM97_ascending/run/ARM97_ascending_output.txt: No such file or directory
run_scripts/run_generalized_grid_scam_test.bash: line 66: /home/jenkins/cam_output/scratch/test_scam_ATEX_descending/run/ATEX_descending_output.txt: No such file or directory
run_scripts/run_generalized_grid_scam_test.bash: line 68: /home/jenkins/cam_output/scratch/test_scam_ARM97_descending/run/ARM97_descending_output.txt: No such file or directory
diff: /home/jenkins/cam_output/scratch/test_scam_ATEX_ascending/run/ATEX_ascending_output.txt: No such file or directory
diff: /home/jenkins/cam_output/scratch/test_scam_ATEX_descending/run/ATEX_descending_output.txt: No such file or directory
diff: /home/jenkins/cam_output/scratch/test_scam_ARM97_ascending/run/ARM97_ascending_output.txt: No such file or directory
diff: /home/jenkins/cam_output/scratch/test_scam_ARM97_descending/run/ARM97_descending_output.txt: No such file or directory

There were no differences detected!
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] cleanWs
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is used...
[WS-CLEANUP] done
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS