Started by an SCM change Obtained jenkins_tests/clubb_bin_diff_regression_gfortran_test_new/Jenkinsfile from git https://github.com/larson-group/clubb.git Running in Durability level: MAX_SURVIVABILITY [Pipeline] Start of Pipeline [Pipeline] node Running on Jenkins in /home/jenkins/workspace/clubb_bin_diff_regression_gfortran_test_new [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git Cloning the remote Git repository Cloning repository https://github.com/larson-group/clubb.git > git init /home/jenkins/workspace/clubb_bin_diff_regression_gfortran_test_new # timeout=10 Fetching upstream changes from https://github.com/larson-group/clubb.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' using GIT_ASKPASS to set credentials A token based key used by Jenkins to preform Github actions, created 6/21/2021 > git fetch --tags --progress https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision 33d475588c4881dee6e4bed10d36c8a26cd2a8dd (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 33d475588c4881dee6e4bed10d36c8a26cd2a8dd # timeout=10 Commit message: "Removing line to trigger the nightly tests for all repos." > git rev-list --no-walk 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Clone SysAdmin to tmp) [Pipeline] sh + rm -rf /home/jenkins/clubb_bit_diff_test_workspace/sys_admin + git clone https://github.com/larson-group/sys_admin.git /home/jenkins/clubb_bit_diff_test_workspace/sys_admin Cloning into '/home/jenkins/clubb_bit_diff_test_workspace/sys_admin'... [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run Python Test) [Pipeline] sh + python3 /home/jenkins/clubb_bit_diff_test_workspace/sys_admin/python_nightly_test_suite/run_test.py -c /home/jenkins/clubb_bit_diff_test_workspace/bit_diff_clubb_config .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_gfdlact.a /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../src/CLUBB_core/input_reader.F90:498:28: 491 | do i=1, dim_grid | 2 ...... 498 | if ( grid(i) < grid(i-1) ) then | 1 Warning: Array reference at (1) out of bounds (0 < 1) in loop beginning at (2) [-Wdo-subscript] /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../src/CLUBB_core/parameters_tunable.F90:2535:32: 2535 | subroutine init_parameters_999( ) | ^ Warning: ‘init_parameters_999’ defined but not used [-Wunused-function] /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../src/CLUBB_core/advance_clubb_core_module.F90:132:23: 132 | hydromet, & ! Unused | 1 Warning: Unused dummy argument ‘hydromet’ at (1) [-Wunused-dummy-argument] ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_param.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_lapack.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libmicrophys_utils.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_parabolic.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_KK_microphys.a /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../src/SILHS/silhs_importance_sample_module.F90:638:62: 633 | do category=1, num_importance_categories | 2 ...... 638 | rand_vect(sample) < category_cumulative_probs(category+1) ) then | 1 Warning: Array reference at (1) out of bounds (9 > 8) in loop beginning at (2) [-Wdo-subscript] ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_bugsrad.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_coamps.a /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../src/SILHS/silhs_api_module.F90:315:13: 315 | rho_ds_zt, & ! Unused | 1 Warning: Unused dummy argument ‘rho_ds_zt’ at (1) [-Wunused-dummy-argument] ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_morrison.a ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libsilhs.a ../src/Benchmark_cases/cloud_sed_module.F90:168:44: 168 | if ( zt2zm( gr, rcm, k) > zero .AND. zt2zm( gr, Ncm, k ) > zero ) then | 1 Warning: Impure function ‘redirect_interpolated_azmk’ at (1) might not be evaluated [-Wfunction-elimination] ../src/KK_microphys_module.F90:43:35: 43 | subroutine KK_local_microphys( gr, dt, nz, l_latin_hypercube, & ! In | 1 Warning: Unused dummy argument ‘gr’ at (1) [-Wunused-dummy-argument] ar: creating /home/jenkins/clubb_bit_diff_test_workspace/repo/compile/../lib/libclubb_other.a CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. CLUBBStandardsCheck.pl has begun. CLUBBStandardsCheck.pl has finished. Directory 1 is /home/jenkins/clubb_bit_diff_test_workspace/33d475588c4881dee6e4bed10d36c8a26cd2a8dd. Directory 2 is /home/jenkins/clubb_bit_diff_test_workspace/latest_revision_validated_8a4711c32fc8851f00d5f1d5dd66d164d3408a8c. Diffing arm netCDF (*.nc) files Diffing arm_97 netCDF (*.nc) files *** Differences detected in arm_97_zt.nc! *** *** Differences detected in arm_97_zm.nc! *** *** Differences detected in arm_97_sfc.nc! *** Diffing atex netCDF (*.nc) files Diffing bomex netCDF (*.nc) files Diffing dycoms2_rf01 netCDF (*.nc) files Diffing dycoms2_rf02_ds netCDF (*.nc) files *** Differences detected in dycoms2_rf02_ds_zt.nc! *** *** Differences detected in dycoms2_rf02_ds_zm.nc! *** *** Differences detected in dycoms2_rf02_ds_sfc.nc! *** Diffing gabls3_night netCDF (*.nc) files Diffing lba netCDF (*.nc) files *** Differences detected in lba_zt.nc! *** *** Differences detected in lba_zm.nc! *** *** Differences detected in lba_sfc.nc! *** Diffing rico netCDF (*.nc) files *** Differences detected in rico_zt.nc! *** *** Differences detected in rico_zm.nc! *** *** Differences detected in rico_sfc.nc! *** Diffing twp_ice netCDF (*.nc) files *** Differences detected in twp_ice_zt.nc! *** *** Differences detected in twp_ice_zm.nc! *** *** Differences detected in twp_ice_sfc.nc! *** Diffing wangara netCDF (*.nc) files There were some differences detected! There were differences detected in netCDF (*.nc) files. Directory 1 is /home/jenkins/clubb_bit_diff_test_workspace/33d475588c4881dee6e4bed10d36c8a26cd2a8dd. Directory 2 is /home/jenkins/clubb_bit_diff_test_workspace/latest_revision_validated_8a4711c32fc8851f00d5f1d5dd66d164d3408a8c. Diffing arm netCDF (*.nc) files Diffing arm_97 netCDF (*.nc) files *** Differences detected in arm_97_zt.nc! *** *** Differences detected in arm_97_zm.nc! *** *** Differences detected in arm_97_sfc.nc! *** Diffing atex netCDF (*.nc) files Diffing bomex netCDF (*.nc) files Diffing dycoms2_rf01 netCDF (*.nc) files Diffing dycoms2_rf02_ds netCDF (*.nc) files *** Differences detected in dycoms2_rf02_ds_zt.nc! *** *** Differences detected in dycoms2_rf02_ds_zm.nc! *** *** Differences detected in dycoms2_rf02_ds_sfc.nc! *** Diffing gabls3_night netCDF (*.nc) files Diffing lba netCDF (*.nc) files *** Differences detected in lba_zt.nc! *** *** Differences detected in lba_zm.nc! *** *** Differences detected in lba_sfc.nc! *** Diffing rico netCDF (*.nc) files *** Differences detected in rico_zt.nc! *** *** Differences detected in rico_zm.nc! *** *** Differences detected in rico_sfc.nc! *** Diffing twp_ice netCDF (*.nc) files *** Differences detected in twp_ice_zt.nc! *** *** Differences detected in twp_ice_zm.nc! *** *** Differences detected in twp_ice_sfc.nc! *** Diffing wangara netCDF (*.nc) files There were some differences detected! There were differences detected in netCDF (*.nc) files. =============================== Configuring Test =============================== Working directory set to: /home/jenkins/clubb_bit_diff_test_workspace Trying to clone repo... Cloned repo location: /home/jenkins/clubb_bit_diff_test_workspace/repo Output Save Mode: last Using branch: master Commits to test vs the baseline (8a4711c32fc8851f00d5f1d5dd66d164d3408a8c) 33d475588c4881dee6e4bed10d36c8a26cd2a8dd Making list from 'UnresolvedCommits': - 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c Run Output Path: repo/output Run commands: ['repo/compile/compile.bash', 'rm -rf repo/output', 'mkdir repo/output', 'repo/run_scripts/run_scm_all.bash --min-cases'] Diffing command: repo/run_scripts/run_bindiff_all.bash =============================== Running Test =============================== Parsing message from commit: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd Checking Commit: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd Running: final commit to check, not labelled BIT_CHANGING Checking out 33d475588c4881dee6e4bed10d36c8a26cd2a8dd Running: 'repo/compile/compile.bash' Running: 'rm -rf repo/output' Running: 'mkdir repo/output' Running: 'repo/run_scripts/run_scm_all.bash --min-cases' Output from 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c already saved Diffing: 'repo/run_scripts/run_bindiff_all.bash 33d475588c4881dee6e4bed10d36c8a26cd2a8dd latest_revision_validated_8a4711c32fc8851f00d5f1d5dd66d164d3408a8c'  ISSUE WITH COMMIT DETECTED: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd differs from 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c Finding all BIT_CHANGING commits in range: 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c...33d475588c4881dee6e4bed10d36c8a26cd2a8dd Output from 33d475588c4881dee6e4bed10d36c8a26cd2a8dd already saved Output from 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c already saved Diffing: 'repo/run_scripts/run_bindiff_all.bash 33d475588c4881dee6e4bed10d36c8a26cd2a8dd latest_revision_validated_8a4711c32fc8851f00d5f1d5dd66d164d3408a8c' Found: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd =============================== Test Results =============================== Commit Range Checked = 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c...33d475588c4881dee6e4bed10d36c8a26cd2a8dd New Unresolved Commits: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd No fake BIT_CHANGING commits found. Remaining Unresolved Commits: 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c 33d475588c4881dee6e4bed10d36c8a26cd2a8dd =============================== Updating Config File =============================== Saving into UnresolvedCommits: 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c 33d475588c4881dee6e4bed10d36c8a26cd2a8dd Saving into BaselineCommit: 33d475588c4881dee6e4bed10d36c8a26cd2a8dd =============================== Cleanup =============================== Removed repo. Removing all but final generated output. REMOVING: 8a4711c32fc8851f00d5f1d5dd66d164d3408a8c RENAMING 33d475588c4881dee6e4bed10d36c8a26cd2a8dd to latest_revision_validated_33d475588c4881dee6e4bed10d36c8a26cd2a8dd Exiting with code: 1 [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] script [Pipeline] { [Pipeline] cleanWs [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is used... [WS-CLEANUP] done [Pipeline] } [Pipeline] // script [Pipeline] script [Pipeline] { [Pipeline] emailext Sending email to: messnermet@uwm.edu [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline ERROR: script returned exit code 1 Finished: FAILURE