Started by user unknown or anonymous Checking out git https://github.com/larson-group/clubb.git into /home/jenkins/workspace/branch_clubb_test@script/05bf1b9ccde5d7fdda9b78893a3cf36477d0cb064cc71594a43c33c536a726b4 to read jenkins_tests/clubb_nvhpc_gpu_vs_cpu_diffness/Jenkinsfile The recommended git tool is: git > git rev-parse --resolve-git-dir /home/jenkins/workspace/branch_clubb_test@script/05bf1b9ccde5d7fdda9b78893a3cf36477d0cb064cc71594a43c33c536a726b4/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from https://github.com/larson-group/clubb.git > git --version # timeout=10 > git --version # 'git version 2.34.1' using GIT_ASKPASS to set credentials A token based key used by Jenkins to preform Github actions, created 6/21/2021 > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/spack_updates^{commit} # timeout=10 Checking out Revision 4b09c80bd92745c917a7be20ae69087b4c8bc3b4 (refs/remotes/origin/spack_updates) > git config core.sparsecheckout # timeout=10 > git checkout -f 4b09c80bd92745c917a7be20ae69087b4c8bc3b4 # timeout=10 Commit message: "test" > git rev-list --no-walk ed20f0a9c88d80ece1e1f8a7fef4b2f867ea374b # timeout=10 [Pipeline] Start of Pipeline [Pipeline] node Running on Jenkins in /home/jenkins/workspace/branch_clubb_test [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git > git rev-parse --resolve-git-dir /home/jenkins/workspace/branch_clubb_test/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from https://github.com/larson-group/clubb.git > git --version # timeout=10 > git --version # 'git version 2.34.1' using GIT_ASKPASS to set credentials A token based key used by Jenkins to preform Github actions, created 6/21/2021 > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/spack_updates^{commit} # timeout=10 Checking out Revision 4b09c80bd92745c917a7be20ae69087b4c8bc3b4 (refs/remotes/origin/spack_updates) > git config core.sparsecheckout # timeout=10 > git checkout -f 4b09c80bd92745c917a7be20ae69087b4c8bc3b4 # timeout=10 Commit message: "test" [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Modify Config Flags) [Pipeline] sh + sed -i 's:penta_solve_method.*:penta_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:tridiag_solve_method.*:tridiag_solve_method = 2:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:num_standalone_columns.*:num_standalone_columns = 32:g' input/tunable_parameters/configurable_model_flags.in [Pipeline] sh + sed -i 's:time_final.*:time_final = 87600:g' input/case_setups/mpace_b_model.in [Pipeline] sh + sed -i 's:time_final.*:time_final = 76200:g' input/case_setups/cobra_model.in [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile CPU) [Pipeline] sh + source /etc/profile.d/larson-group.sh ++ export PATH MANPATH LD_LIBRARY_PATH ++ export SVNROOT=http://carson.math.uwm.edu/repos ++ SVNROOT=http://carson.math.uwm.edu/repos ++ export GIT_EDITOR=vi ++ GIT_EDITOR=vi ++ export SVN_EDITOR=vi ++ SVN_EDITOR=vi ++ export OMP_STACKSIZE=1048579 ++ OMP_STACKSIZE=1048579 ++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib' ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-C-4.8.0-gfortran/lib' ++ export GFORTRAN_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-gfortran ++ GFORTRAN_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-gfortran ++ export GFORTRAN_NETCDF_C=/usr/local/NETCDF-C-4.8.0-gfortran ++ GFORTRAN_NETCDF_C=/usr/local/NETCDF-C-4.8.0-gfortran ++ export GFORTRAN_MPICH=/usr/local/mpi/MPICH-3.3.1-gfortran ++ GFORTRAN_MPICH=/usr/local/mpi/MPICH-3.3.1-gfortran ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-C-4.8.0-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib' ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-C-4.8.0-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-C-4.8.0-ifort/lib' ++ export IFORT_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-ifort ++ IFORT_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-ifort ++ export IFORT_NETCDF_C=/usr/local/NETCDF-C-4.8.0-ifort ++ IFORT_NETCDF_C=/usr/local/NETCDF-C-4.8.0-ifort ++ export IFORT_MPICH=/usr/local/mpi/MPICH-3.3.1-intel ++ IFORT_MPICH=/usr/local/mpi/MPICH-3.3.1-intel ++ '[' -e /opt/intel/oneapi/setvars.sh ']' +++ echo /opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin +++ sed s:/opt/intel/oneapi/intelpython/latest/bin::g ++ export PATH=/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin ++ PATH=/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-C-4.8.0-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-C-4.8.0-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib' ++ LD_LIBRARY_PATH='$LD_LIBRARY_PATH:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:/usr/local/lib:/usr/local/NETCDF-Fortran-4.5.3-gfortran/lib:/usr/local/NETCDF-C-4.8.0-gfortran/lib:/usr/local/NETCDF-Fortran-4.5.3-ifort/lib:/usr/local/NETCDF-C-4.8.0-ifort/lib:/usr/local/NETCDF-Fortran-4.5.3-pgi/lib:/usr/local/NETCDF-C-4.8.0-pgi/lib' +++ uname -s +++ uname -m ++ export NVARCH=Linux_x86_64 ++ NVARCH=Linux_x86_64 ++ export NVCOMPILERS=/opt/nvidia/hpc_sdk ++ NVCOMPILERS=/opt/nvidia/hpc_sdk ++ export 'MANPATH=$MANPATH:/opt/oracle/developerstudio12.6/man:$NVCOMPILERS/$NVARCH/21.3/compilers/man:/opt/oracle/developerstudio12.6/man:$NVCOMPILERS/Linux_x86_64/21.3/compilers/man:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/man' ++ MANPATH='$MANPATH:/opt/oracle/developerstudio12.6/man:$NVCOMPILERS/$NVARCH/21.3/compilers/man:/opt/oracle/developerstudio12.6/man:$NVCOMPILERS/Linux_x86_64/21.3/compilers/man:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/man' ++ export CUDADIR=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/cuda/ ++ CUDADIR=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/cuda/ ++ export PGIFORTRAN_MPICH=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/comm_libs/openmpi/openmpi-3.1.5/ ++ PGIFORTRAN_MPICH=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/comm_libs/openmpi/openmpi-3.1.5/ ++ export PGI_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-pgi ++ PGI_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-pgi ++ export PGI_NETCDF_C=/usr/local/NETCDF-C-4.8.0-pgi ++ PGI_NETCDF_C=/usr/local/NETCDF-C-4.8.0-pgi ++ export PATH=/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin ++ PATH=/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin ++ export PATH=/usr/lib/cuda/bin:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin ++ PATH=/usr/lib/cuda/bin:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/opt/rh/devtoolset-10/root/bin:/opt/oracle/developerstudio12.6/bin:/opt/open64/bin:/opt/Canopy:/usr/local/ncl-5.2.1/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin:/opt/intel/oneapi/compiler/2023.2.1/linux/bin/intel64:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/opt/nvidia/hpc_sdk/Linux_x86_64/2024/compilers/bin ++ export GNU_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-gfortran ++ GNU_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-gfortran ++ export GNU_NETCDF_C=/usr/local/NETCDF-C-4.8.0-gfortran ++ GNU_NETCDF_C=/usr/local/NETCDF-C-4.8.0-gfortran ++ export GNU_MPICH=/usr/local/mpi/MPICH-3.3.1-gfortran ++ GNU_MPICH=/usr/local/mpi/MPICH-3.3.1-gfortran ++ export INTEL_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-ifort ++ INTEL_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-ifort ++ export INTEL_NETCDF_C=/usr/local/NETCDF-C-4.8.0-ifort ++ INTEL_NETCDF_C=/usr/local/NETCDF-C-4.8.0-ifort ++ export INTEL_MPICH=/usr/local/mpi/MPICH-3.3.1-intel ++ INTEL_MPICH=/usr/local/mpi/MPICH-3.3.1-intel ++ export NVHPC_MPICH=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/comm_libs/openmpi/openmpi-3.1.5/ ++ NVHPC_MPICH=/opt/nvidia/hpc_sdk/Linux_x86_64/2024/comm_libs/openmpi/openmpi-3.1.5/ ++ export NVHPC_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-pgi ++ NVHPC_NETCDF_FORTRAN=/usr/local/NETCDF-Fortran-4.5.3-pgi ++ export NVHPC_NETCDF_C=/usr/local/NETCDF-C-4.8.0-pgi ++ NVHPC_NETCDF_C=/usr/local/NETCDF-C-4.8.0-pgi + module load nvhpc netcdf-fortran /home/jenkins/workspace/branch_clubb_test@tmp/durable-4cec52b1/script.sh.copy: line 2: module: command not found [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run CPU) Stage "Run CPU" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile GPU_ACC) Stage "Compile GPU_ACC" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run GPU_ACC) Stage "Run GPU_ACC" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compile GPU_OMP) Stage "Compile GPU_OMP" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run GPU_OMP) Stage "Run GPU_OMP" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compare CPU vs ACC) Stage "Compare CPU vs ACC" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Compare CPU vs OMP) Stage "Compare CPU vs OMP" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] script [Pipeline] { [Pipeline] } [Pipeline] // script [Pipeline] script [Pipeline] { [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline ERROR: script returned exit code 127 Finished: FAILURE