Skip to content
Sign in

Console Output

+ ulimit -s 8388608
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-skylake_avx512/gcc-12.2.0/lmod-8.7.37-fq24mybyn2li6got2bxzk62ejh5d3p4z/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load nvhpc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ python3 /home/pub/jenkins_BFB_test_configs/sys_admin/python_nightly_test_suite/run_test.py -c /home/pub/jenkins_BFB_test_configs/clubb_BFB_multi_col_gpu_nvhpc_test_config
CMake Warning:
  Manually-specified variables were not used by the project:

    NetCDF_C_INCLUDE_DIR
    NetCDF_C_LIBRARY
    NetCDF_Fortran_INCLUDE_DIR
    NetCDF_Fortran_LIBRARY


Traceback (most recent call last):
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 841, in <module>
    main()
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 812, in main
    clubb_input_namelist = create_case_namelist_file(
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 465, in create_case_namelist_file
    clubb_in = apply_namelist_overrides(args, clubb_in, model_file, output_dir_abs)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 356, in apply_namelist_overrides
    clubb_in = override_value(args.override, clubb_in)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 251, in override_value
    raise ValueError(
ValueError: Override setting 'lh_straight_mc' is not present in the selected namelists
create_case_namelist failed (exit 1). Command was:
  /usr/bin/python /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py -out_dir /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/output -multicol 4 -override lh_straight_mc=true arm
Traceback (most recent call last):
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 841, in <module>
    main()
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 812, in main
    clubb_input_namelist = create_case_namelist_file(
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 465, in create_case_namelist_file
    clubb_in = apply_namelist_overrides(args, clubb_in, model_file, output_dir_abs)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 356, in apply_namelist_overrides
    clubb_in = override_value(args.override, clubb_in)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 251, in override_value
    raise ValueError(
ValueError: Override setting 'lh_straight_mc' is not present in the selected namelists
create_case_namelist failed (exit 1). Command was:
  /usr/bin/python /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py -out_dir /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/output -multicol 4 -override lh_straight_mc=true rico_silhs
Traceback (most recent call last):
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 841, in <module>
    main()
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 812, in main
    clubb_input_namelist = create_case_namelist_file(
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 465, in create_case_namelist_file
    clubb_in = apply_namelist_overrides(args, clubb_in, model_file, output_dir_abs)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 356, in apply_namelist_overrides
    clubb_in = override_value(args.override, clubb_in)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 251, in override_value
    raise ValueError(
ValueError: Override setting 'lh_straight_mc' is not present in the selected namelists
create_case_namelist failed (exit 1). Command was:
  /usr/bin/python /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py -out_dir /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/output -multicol 4 -override lh_straight_mc=true cobra
Traceback (most recent call last):
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 841, in <module>
    main()
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 812, in main
    clubb_input_namelist = create_case_namelist_file(
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 465, in create_case_namelist_file
    clubb_in = apply_namelist_overrides(args, clubb_in, model_file, output_dir_abs)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 356, in apply_namelist_overrides
    clubb_in = override_value(args.override, clubb_in)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 251, in override_value
    raise ValueError(
ValueError: Override setting 'lh_straight_mc' is not present in the selected namelists
create_case_namelist failed (exit 1). Command was:
  /usr/bin/python /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py -out_dir /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/output -multicol 4 -override lh_straight_mc=true mpace_b
Traceback (most recent call last):
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 841, in <module>
    main()
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 812, in main
    clubb_input_namelist = create_case_namelist_file(
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 465, in create_case_namelist_file
    clubb_in = apply_namelist_overrides(args, clubb_in, model_file, output_dir_abs)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 356, in apply_namelist_overrides
    clubb_in = override_value(args.override, clubb_in)
  File "/home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py", line 251, in override_value
    raise ValueError(
ValueError: Override setting 'lh_straight_mc' is not present in the selected namelists
create_case_namelist failed (exit 1). Command was:
  /usr/bin/python /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/run_scripts/../utilities/create_case_namelist.py -out_dir /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test/output -multicol 4 -override lh_straight_mc=true gabls3
Directory 1 is 1db1e01971bca05b2e95037f97c94aae0a827a50
Directory 2 is e0ffe41f4e282a8f1686d43a2d7c881327408fe1
Using reporting threshold:  0.0 


The following cases will be compared: []

No comparable netCDF files were found in the provided directories.
Directory 1 is 1db1e01971bca05b2e95037f97c94aae0a827a50
Directory 2 is e0ffe41f4e282a8f1686d43a2d7c881327408fe1
Using reporting threshold:  0.0 


The following cases will be compared: []

No comparable netCDF files were found in the provided directories.

=============================== Configuring Test ===============================


Working directory set to: /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test
Checking specified repo: /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test

Using /home/jenkins/workspace/clubb_BFB_multi_col_gpu_nvhpc_test with origin https://github.com/larson-group/clubb.git

Output Save Mode: all

Using branch: master

Making list from 'UnresolvedCommits':

CheckRange = True: Getting commit range

Run Output Path: output

Run commands: ['python compile.py -gpu openacc -debug', '\nrm -rf output', '\nmkdir output', '\npython run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 arm', '\npython run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 rico_silhs', '\npython run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 cobra', '\npython run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 mpace_b', '\npython run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 gabls3']

Diffing command: run_scripts/run_bindiff_all.py

=============================== Running Test ===============================

Parsing message from commit: 1db1e01971bca05b2e95037f97c94aae0a827a50

Checking Commit: 1db1e01971bca05b2e95037f97c94aae0a827a50
	Running: final commit to check, not labelled BIT_CHANGING
	Checking out 1db1e01971bca05b2e95037f97c94aae0a827a50
	Running: 'python compile.py -gpu openacc -debug'
	Running: 'rm -rf output'
	Running: 'mkdir output'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 arm'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 rico_silhs'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 cobra'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 mpace_b'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 gabls3'
	Checking out e0ffe41f4e282a8f1686d43a2d7c881327408fe1
	Running: 'python compile.py -gpu openacc -debug'
	Running: 'rm -rf output'
	Running: 'mkdir output'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 arm'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 rico_silhs'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 cobra'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 mpace_b'
	Running: 'python run_scripts/run_scm.py -override lh_straight_mc=true -multicol 4 gabls3'
	Diffing: 'run_scripts/run_bindiff_all.py 1db1e01971bca05b2e95037f97c94aae0a827a50 e0ffe41f4e282a8f1686d43a2d7c881327408fe1'
	ISSUE WITH COMMIT DETECTED: 1db1e01971bca05b2e95037f97c94aae0a827a50 differs from e0ffe41f4e282a8f1686d43a2d7c881327408fe1

Finding all BIT_CHANGING commits in range: e0ffe41f4e282a8f1686d43a2d7c881327408fe1...1db1e01971bca05b2e95037f97c94aae0a827a50
	Output from 1db1e01971bca05b2e95037f97c94aae0a827a50 already saved
	Output from e0ffe41f4e282a8f1686d43a2d7c881327408fe1 already saved
	Diffing: 'run_scripts/run_bindiff_all.py 1db1e01971bca05b2e95037f97c94aae0a827a50 e0ffe41f4e282a8f1686d43a2d7c881327408fe1'
	Found:
		1db1e01971bca05b2e95037f97c94aae0a827a50

=============================== Test Results ===============================

Commit Range Checked = e0ffe41f4e282a8f1686d43a2d7c881327408fe1...1db1e01971bca05b2e95037f97c94aae0a827a50

New Unresolved Commits:
	1db1e01971bca05b2e95037f97c94aae0a827a50

No fake BIT_CHANGING commits found.

Remaining Unresolved Commits (oldest commit is listed first):
	1db1e01971bca05b2e95037f97c94aae0a827a50

=============================== Updating Config File ===============================


Saving into UnresolvedCommits: 1db1e01971bca05b2e95037f97c94aae0a827a50


Saving into BaselineCommit: 1db1e01971bca05b2e95037f97c94aae0a827a50

=============================== Cleanup ===============================

Not removing any generated output.
	RENAMING 1db1e01971bca05b2e95037f97c94aae0a827a50 to latest_revision_validated_1db1e01971bca05b2e95037f97c94aae0a827a50

================== Unresolved Commit Status ==================

Remaining Unresolved Commits (oldest commit is listed first):
	1db1e01971bca05b2e95037f97c94aae0a827a50

Exiting with code: 1