Started by an SCM change Obtained jenkins_tests/cam_BFB_coarse_res_r8029_flags_gfortran_test/Jenkinsfile from git https://github.com/larson-group/cam.git [Pipeline] Start of Pipeline [Pipeline] node Running on Jenkins in /home/jenkins/workspace/cam_BFB_coarse_res_r8029_flags_gfortran_test [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/larson-group/cam.git > git init /home/jenkins/workspace/cam_BFB_coarse_res_r8029_flags_gfortran_test # timeout=10 Fetching upstream changes from https://github.com/larson-group/cam.git > git --version # timeout=10 > git --version # 'git version 2.34.1' > git fetch --tags --force --progress -- https://github.com/larson-group/cam.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/larson-group/cam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/clubb_silhs_devel^{commit} # timeout=10 Checking out Revision 1be51d053905fea48cebe2371a516e113a496312 (refs/remotes/origin/clubb_silhs_devel) > git config core.sparsecheckout # timeout=10 > git checkout -f 1be51d053905fea48cebe2371a516e113a496312 # timeout=10 Commit message: "Autoupdated SILHS Commit 9fed3afd3153c67a4c38a1f11d741cea5cac1df0 Author: Gunther Huebler Date: Tue Sep 30 22:39:59 2025 -0500 SILHS reproducibility (#1258) * Making the SILHS random number generator on GPUs more reproducible by relying on the lh_seed input every call, which is the same as how the CPU randoms work. Also ensuring that the seed changes each timestep, just to prevent generating the same randoms on different timesteps. Since this does change the randoms, it is BIT_CHANGING for silhs enabled runs." > git rev-list --no-walk aa62f2a748b177007297c0f42dc08bc7539f7cc0 # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Update sys_admin Repo) [Pipeline] sh + git -C /home/pub/jenkins_BFB_test_configs/sys_admin pull Already up to date. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run Python Test) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export LMOD_ROOT=/opt/lmod/ ++ LMOD_ROOT=/opt/lmod/ ++ source /opt/lmod//lmod/lmod/init/bash +++ '[' -z '' ']' +++ case "$-" in +++ __lmod_vx=x +++ '[' -n x ']' +++ set +x Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash) Shell debugging restarted +++ unset __lmod_vx +++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core + rm -rf /home/jenkins/cam_output/scratch/UWM_debug_r8029_flags_f10_f10_mg37 + ulimit -s 8388608 + python3 /home/pub/jenkins_BFB_test_configs/sys_admin/python_nightly_test_suite/run_test.py -c /home/pub/jenkins_BFB_test_configs/cam_BFB_coarse_res_r8029_flags_gfortran_test_config ERROR: Unknown Job Queue specified use --force to set submit_jobs case.run Submit job case.run No timing file found in run directory check for resubmit dout_s False mach larson-group resubmit_num 0 ERROR: Unknown Job Queue specified use --force to set submit_jobs case.run Submit job case.run No timing file found in run directory check for resubmit dout_s False mach larson-group resubmit_num 0 PASS: All 3D output vars are zero. =============================== Configuring Test =============================== Working directory set to: /home/jenkins/workspace/cam_BFB_coarse_res_r8029_flags_gfortran_test Checking specified repo: /home/jenkins/workspace/cam_BFB_coarse_res_r8029_flags_gfortran_test Using /home/jenkins/workspace/cam_BFB_coarse_res_r8029_flags_gfortran_test with origin https://github.com/larson-group/cam.git Output Save Mode: none Using branch: clubb_silhs_devel Making list from 'UnresolvedCommits': CheckRange = False: only comparing baseline to final commit. Run Output Path: /home/jenkins/cam_output/scratch/UWM_debug_r8029_flags_f10_f10_mg37/run/UWM_debug_r8029_flags_f10_f10_mg37.cam.rh0.0001-01-02-00000.nc Run commands: ['rm -rf /home/jenkins/cam_output/scratch/UWM_debug_r8029_flags_f10_f10_mg37', '\nrun_scripts/set_up_repo.py --caseroot /home/$USER/cam_output/caseroot/$CASE --reuse_build .', '\nrun_scripts/run_cesm_uwm_coarse_res_r8029_flags.sh'] Diffing command: python3 run_scripts/netcdf_3D_vars_diff.py =============================== Running Test =============================== Parsing message from commit: 1be51d053905fea48cebe2371a516e113a496312 Found: BIT_CHANGING Checking Commit: 1be51d053905fea48cebe2371a516e113a496312 Checking out 1be51d053905fea48cebe2371a516e113a496312 Running: 'rm -rf /home/jenkins/cam_output/scratch/UWM_debug_r8029_flags_f10_f10_mg37' Running: 'run_scripts/set_up_repo.py --caseroot /home/$USER/cam_output/caseroot/$CASE --reuse_build .' Running: 'run_scripts/run_cesm_uwm_coarse_res_r8029_flags.sh' Checking out aa62f2a748b177007297c0f42dc08bc7539f7cc0 Running: 'rm -rf /home/jenkins/cam_output/scratch/UWM_debug_r8029_flags_f10_f10_mg37' Running: 'run_scripts/set_up_repo.py --caseroot /home/$USER/cam_output/caseroot/$CASE --reuse_build .' Running: 'run_scripts/run_cesm_uwm_coarse_res_r8029_flags.sh' Diffing: 'python3 run_scripts/netcdf_3D_vars_diff.py 1be51d053905fea48cebe2371a516e113a496312 aa62f2a748b177007297c0f42dc08bc7539f7cc0' WARNING: commit '1be51d053905fea48cebe2371a516e113a496312' was supposed to be BIT_CHANGING, but is not. =============================== Test Results =============================== Commit Range Checked = aa62f2a748b177007297c0f42dc08bc7539f7cc0...1be51d053905fea48cebe2371a516e113a496312 -- CheckRange was set to False, no intermediate commits checked No new Unresolved commits found. Fake BIT_CHANGING Commits: 1be51d053905fea48cebe2371a516e113a496312 No remaining Unresolved Commits. =============================== Updating Config File =============================== Saving into UnresolvedCommits: Saving into BaselineCommit: 1be51d053905fea48cebe2371a516e113a496312 =============================== Cleanup =============================== Removing all generated output REMOVING: aa62f2a748b177007297c0f42dc08bc7539f7cc0 REMOVING: 1be51d053905fea48cebe2371a516e113a496312 ================== Unresolved Commit Status ================== No remaining Unresolved Commits. Exiting with code: 0 [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] script [Pipeline] { [Pipeline] sh + chmod -R 755 /home/jenkins/cam_output [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline Finished: SUCCESS