![[Jenkins]](/jenkins/static/57c8a776/images/svgs/logo.svg){kind=logo}
Started by an SCM change Obtained Jenkinsfile from git https://github.com/larson-group/e3sm.git Running in Durability level: MAX_SURVIVABILITY [Pipeline] Start of Pipeline [Pipeline] node Still waiting to schedule task Waiting for next available executor Running on Jenkins in /home/jenkins/workspace/e3sm_run_test [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout The recommended git tool is: git Cloning the remote Git repository Cloning repository https://github.com/larson-group/e3sm.git > git init /home/jenkins/workspace/e3sm_run_test # timeout=10 Fetching upstream changes from https://github.com/larson-group/e3sm.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' using GIT_ASKPASS to set credentials THe key used by the system for the tests > git fetch --tags --progress https://github.com/larson-group/e3sm.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/larson-group/e3sm.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/clubb_silhs_devel^{commit} # timeout=10 Checking out Revision de54c68d60736837a45ba934d8d2b55e8b71cd5d (refs/remotes/origin/clubb_silhs_devel) > git config core.sparsecheckout # timeout=10 > git checkout -f de54c68d60736837a45ba934d8d2b55e8b71cd5d # timeout=10 Commit message: "Autoupdated CLUBB_core" > git rev-list --no-walk 2dfd53861676d0edc188f7e932e3747a2db3235c # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Checkout Branch and Submodules) [Pipeline] sh + git submodule init Submodule 'components/cam/src/physics/rrtmgp/external' (https://github.com/RobertPincus/rte-rrtmgp.git) registered for path 'components/cam/src/physics/rrtmgp/external' Submodule 'components/clm/src/external_models/fates' (https://github.com/NGEET/fates.git) registered for path 'components/clm/src/external_models/fates' Submodule 'alm-mpp' (https://github.com/MPP-LSM/MPP.git) registered for path 'components/clm/src/external_models/mpp' Submodule 'sbetr' (https://github.com/BeTR-biogeochemistry-modeling/sbetr.git) registered for path 'components/clm/src/external_models/sbetr' Submodule 'components/mpas-source' (https://github.com/MPAS-Dev/MPAS-Model.git) registered for path 'components/mpas-source' Submodule 'externals/scorpio_classic' (https://github.com/E3SM-Project/scorpio.git) registered for path 'externals/scorpio_classic' + git submodule update Cloning into 'components/cam/src/physics/rrtmgp/external'... Submodule path 'components/cam/src/physics/rrtmgp/external': checked out '0b1cffdd51a35045c28aae314e2b29e2a663b5e6' Cloning into 'components/clm/src/external_models/fates'... Submodule path 'components/clm/src/external_models/fates': checked out '1ad93c311ed1a5d45df656b9031c8714a7071e64' Cloning into 'components/clm/src/external_models/mpp'... Submodule path 'components/clm/src/external_models/mpp': checked out '82ef0c1a37ffd469e9a6ce84dbf487c6ef8762b2' Cloning into 'components/clm/src/external_models/sbetr'... Submodule path 'components/clm/src/external_models/sbetr': checked out 'd71fb2df928099bacc4e9a3a9f4b8a1f2a6e37a1' Cloning into 'components/mpas-source'... Submodule path 'components/mpas-source': checked out 'bb1ea15299544e2b25144c06c621ff40fa482760' Cloning into 'externals/scorpio_classic'... Submodule path 'externals/scorpio_classic': checked out '1e538b56fa7cfa209c119e866a95669875eb200d' [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Modify Run Scripts) [Pipeline] sh + sed -i s/carson/nelson/g nightly_test/nightly_e3sm_scm_BOMEX.csh + sed -i s/carson/nelson/g nightly_test/nightly_e3sm_scm_DYCOMSrf01.csh + sed -i s/carson/nelson/g nightly_test/nightly_e3sm_scm_RICO.csh [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run BOMEX) [Pipeline] sh + bash -c 'export e3smSource=/home/jenkins/workspace/e3sm_run_test; csh nightly_test/nightly_e3sm_scm_BOMEX.csh; exit 0' Compset longname is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV Compset specification file is /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/config_compsets.xml Automatically adding SIAC to compset Automatically adding SESP to compset Compset forcing is ATM component is cam5 physics: LND component is clm4.5 physics:clm4.5 Satellite phenology: ICE component is prescribed cice: OCN component is DOCN prescribed ocean mode ROF component is Stub river component GLC component is Stub glacier (land ice) component WAV component is Stub wave component IAC component is Stub iac component ESP component is Stub external system processing (ESP) component Pes specification file is /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/allactive/config_pesall.xml Machine is nelson Pes setting: grid match is a%ne16np4_ Pes setting: grid is a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Pes setting: compset is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Pes setting: tasks is {'NTASKS_ATM': 64, 'NTASKS_ICE': 64, 'NTASKS_CPL': 64, 'NTASKS_LND': 64, 'NTASKS_WAV': 64, 'NTASKS_ROF': 64, 'NTASKS_OCN': 64, 'NTASKS_GLC': 64} Pes setting: threads is {'NTHRDS_ICE': 1, 'NTHRDS_ATM': 1, 'NTHRDS_ROF': 1, 'NTHRDS_LND': 1, 'NTHRDS_WAV': 1, 'NTHRDS_OCN': 1, 'NTHRDS_CPL': 1, 'NTHRDS_GLC': 1} Pes setting: rootpe is {'ROOTPE_OCN': 0, 'ROOTPE_LND': 0, 'ROOTPE_ATM': 0, 'ROOTPE_ICE': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0, 'ROOTPE_ROF': 0, 'ROOTPE_GLC': 0} Pes setting: pstrid is {} Pes other settings: {} Pes comments: none Compset is: SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Grid is: a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'siac', 'sesp', 'drv'] No charge_account info available, using value from PROJECT e3sm model version found: de54c68 Batch_system_type is none Creating Case directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/case_scripts ERROR: No variable BASELINE_ROOT found in case ERROR: No variable CCSM_CPRNC found in case setting case file to env_batch.xml ERROR: No queues found /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/case_scripts/env_mach_specific.xml already exists, delete to replace /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/case_scripts/env_mach_specific.xml already exists, delete to replace Creating batch scripts Writing case.run script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.case.run Creating file .case.run Writing case.st_archive script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.st_archive Creating file case.st_archive Creating file .case.run.sh Creating user_nl_xxx files for components and cpl If an old case build already exists, might want to run 'case.build --clean' before building Generating component namelists as part of setup Creating component namelists 2021-01-21 04:55:06 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:55:06 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:55:07 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:55:07 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:55:07 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:55:07 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:55:07 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:55:07 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:55:07 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:55:07 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists You can now run './preview_run' to get more info on how your case will be run Building case in directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/case_scripts sharedlib_only is False model_only is False Generating component namelists as part of build Creating component namelists 2021-01-21 04:55:09 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:55:10 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:55:10 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:55:10 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:55:10 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:55:10 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:55:10 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:55:10 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:55:10 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:55:10 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Building gptl with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/gptl.bldlog.210121-045509 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.gptl Component gptl build complete with 1 warnings Building mct with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/mct.bldlog.210121-045509 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.mct Building pio with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/pio.bldlog.210121-045509 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.pio Building csm_share with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/csm_share.bldlog.210121-045509 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.csm_share Component csm_share build complete with 4 warnings - Building atm Library Building atm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/atm.bldlog.210121-045509 - Building lnd Library Building lnd with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/lnd.bldlog.210121-045509 - Building ice Library Building ice with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/ice.bldlog.210121-045509 - Building ocn Library Building ocn with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/ocn.bldlog.210121-045509 - Building rof Library Building rof with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/rof.bldlog.210121-045509 - Building glc Library - Building wav Library Building glc with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/glc.bldlog.210121-045509 Building wav with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/wav.bldlog.210121-045509 - Building iac Library - Building esp Library Building iac with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/iac.bldlog.210121-045509 Building esp with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/esp.bldlog.210121-045509 sesp built in 0.510501 seconds sglc built in 0.529066 seconds siac built in 0.528680 seconds srof built in 0.545125 seconds swav built in 0.606236 seconds docn built in 1.167982 seconds Component ice build complete with 9 warnings Component ice build complete with 9 warnings cice built in 22.056581 seconds Component lnd build complete with 6 warnings Component lnd build complete with 6 warnings clm built in 99.824661 seconds Component atm build complete with 5 warnings Component atm build complete with 5 warnings cam built in 108.054747 seconds Building e3sm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/e3sm.bldlog.210121-045509 Component e3sm exe build complete with 3 warnings Time spent not building: 1.080689 sec Time spent building: 153.804427 sec MODEL BUILD HAS FINISHED SUCCESSFULLY Creating component namelists 2021-01-21 04:57:44 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:57:45 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:57:45 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:57:45 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:57:45 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:57:45 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:57:45 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:57:45 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:57:45 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:57:45 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Checking that inputdata is available as part of case submission Loading input file list: 'Buildconf/cpl.input_data_list' Loading input file list: 'Buildconf/docn.input_data_list' Loading input file list: 'Buildconf/clm.input_data_list' Model clm no file specified for finidat Loading input file list: 'Buildconf/cam.input_data_list' Loading input file list: 'Buildconf/cice.input_data_list' Check case OK submit_jobs case.run Submit job case.run Starting job script case.run 2021-01-21 04:57:45 CASE.RUN BEGINS HERE 2021-01-21 04:57:45 RUN_MODEL BEGINS HERE 2021-01-21 04:57:45 PRE_RUN_CHECK BEGINS HERE 2021-01-21 04:57:46 NAMELIST CREATION BEGINS HERE Generating namelists for /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/case_scripts Creating component namelists 2021-01-21 04:57:46 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:57:46 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:57:46 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:57:46 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:57:46 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:57:46 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:57:46 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:57:46 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:57:46 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:57:46 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists 2021-01-21 04:57:46 NAMELIST CREATION HAS FINISHED ------------------------------------------------------------------------- - Prestage required restarts into /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/run - Case input data directory (DIN_LOC_ROOT) is /home/pub/cam_inputdata - Checking for required input datasets in DIN_LOC_ROOT ------------------------------------------------------------------------- 2021-01-21 04:57:46 PRE_RUN_CHECK HAS FINISHED run command is /usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/e3sm.exe >> e3sm.log.$LID 2>&1 2021-01-21 04:57:46 SAVE_PRERUN_PROVENANCE BEGINS HERE 2021-01-21 04:57:46 SAVE_PRERUN_PROVENANCE HAS FINISHED 2021-01-21 04:57:46 MODEL EXECUTION BEGINS HERE 2021-01-21 04:57:46 MODEL EXECUTION HAS FINISHED Exception from case_run: ERROR: RUN FAIL: Command '/usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/build/e3sm.exe >> e3sm.log.$LID 2>&1 ' failed See log file for details: /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_BOMEX/run/e3sm.log.210121-045745 Submitted job case.run with id None BOMEX was successful. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run DYCOMSrf01) [Pipeline] sh + bash -c 'export e3smSource=/home/jenkins/workspace/e3sm_run_test; csh nightly_test/nightly_e3sm_scm_DYCOMSrf01.csh; exit 0' Compset longname is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV Compset specification file is /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/config_compsets.xml Automatically adding SIAC to compset Automatically adding SESP to compset Compset forcing is ATM component is cam5 physics: LND component is clm4.5 physics:clm4.5 Satellite phenology: ICE component is prescribed cice: OCN component is DOCN prescribed ocean mode ROF component is Stub river component GLC component is Stub glacier (land ice) component WAV component is Stub wave component IAC component is Stub iac component ESP component is Stub external system processing (ESP) component Pes specification file is /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/allactive/config_pesall.xml Machine is nelson Pes setting: grid match is a%ne16np4_ Pes setting: grid is a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Pes setting: compset is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Pes setting: tasks is {'NTASKS_ATM': 64, 'NTASKS_ICE': 64, 'NTASKS_CPL': 64, 'NTASKS_LND': 64, 'NTASKS_WAV': 64, 'NTASKS_ROF': 64, 'NTASKS_OCN': 64, 'NTASKS_GLC': 64} Pes setting: threads is {'NTHRDS_ICE': 1, 'NTHRDS_ATM': 1, 'NTHRDS_ROF': 1, 'NTHRDS_LND': 1, 'NTHRDS_WAV': 1, 'NTHRDS_OCN': 1, 'NTHRDS_CPL': 1, 'NTHRDS_GLC': 1} Pes setting: rootpe is {'ROOTPE_OCN': 0, 'ROOTPE_LND': 0, 'ROOTPE_ATM': 0, 'ROOTPE_ICE': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0, 'ROOTPE_ROF': 0, 'ROOTPE_GLC': 0} Pes setting: pstrid is {} Pes other settings: {} Pes comments: none Compset is: SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Grid is: a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'siac', 'sesp', 'drv'] No charge_account info available, using value from PROJECT e3sm model version found: de54c68 Batch_system_type is none Creating Case directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/case_scripts ERROR: No variable BASELINE_ROOT found in case ERROR: No variable CCSM_CPRNC found in case setting case file to env_batch.xml ERROR: No queues found /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/case_scripts/env_mach_specific.xml already exists, delete to replace /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/case_scripts/env_mach_specific.xml already exists, delete to replace Creating batch scripts Writing case.run script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.case.run Creating file .case.run Writing case.st_archive script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.st_archive Creating file case.st_archive Creating file .case.run.sh Creating user_nl_xxx files for components and cpl If an old case build already exists, might want to run 'case.build --clean' before building Generating component namelists as part of setup Creating component namelists 2021-01-21 04:57:53 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:57:54 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:57:54 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:57:54 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:57:54 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:57:54 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:57:54 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:57:54 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:57:54 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:57:54 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists You can now run './preview_run' to get more info on how your case will be run Building case in directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/case_scripts sharedlib_only is False model_only is False Generating component namelists as part of build Creating component namelists 2021-01-21 04:57:56 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 04:57:57 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 04:57:57 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 04:57:57 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 04:57:57 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 04:57:57 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 04:57:57 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 04:57:57 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 04:57:57 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 04:57:57 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Building gptl with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/gptl.bldlog.210121-045756 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.gptl Component gptl build complete with 1 warnings Building mct with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/mct.bldlog.210121-045756 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.mct Building pio with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/pio.bldlog.210121-045756 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.pio Building csm_share with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/csm_share.bldlog.210121-045756 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.csm_share Component csm_share build complete with 4 warnings - Building atm Library Building atm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/atm.bldlog.210121-045756 - Building lnd Library Building lnd with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/lnd.bldlog.210121-045756 - Building ice Library Building ice with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/ice.bldlog.210121-045756 - Building ocn Library Building ocn with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/ocn.bldlog.210121-045756 - Building rof Library Building rof with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/rof.bldlog.210121-045756 - Building glc Library Building glc with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/glc.bldlog.210121-045756 - Building wav Library Building wav with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/wav.bldlog.210121-045756 - Building iac Library - Building esp Library Building iac with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/iac.bldlog.210121-045756 Building esp with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/esp.bldlog.210121-045756 sesp built in 0.525248 seconds swav built in 0.553710 seconds srof built in 0.595402 seconds siac built in 0.582908 seconds sglc built in 0.603647 seconds docn built in 1.274878 seconds Component ice build complete with 9 warnings Component ice build complete with 9 warnings cice built in 21.565945 seconds Component lnd build complete with 6 warnings Component lnd build complete with 6 warnings clm built in 99.479028 seconds Component atm build complete with 5 warnings Component atm build complete with 5 warnings cam built in 107.301450 seconds Building e3sm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/e3sm.bldlog.210121-045756 Component e3sm exe build complete with 3 warnings Time spent not building: 1.038028 sec Time spent building: 154.144677 sec MODEL BUILD HAS FINISHED SUCCESSFULLY Creating component namelists 2021-01-21 05:00:32 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:00:32 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:00:32 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:00:32 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:00:32 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:00:32 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:00:32 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:00:32 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:00:32 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:00:32 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Checking that inputdata is available as part of case submission Loading input file list: 'Buildconf/cpl.input_data_list' Loading input file list: 'Buildconf/docn.input_data_list' Loading input file list: 'Buildconf/clm.input_data_list' Model clm no file specified for finidat Loading input file list: 'Buildconf/cam.input_data_list' Loading input file list: 'Buildconf/cice.input_data_list' Check case OK submit_jobs case.run Submit job case.run Starting job script case.run 2021-01-21 05:00:33 CASE.RUN BEGINS HERE 2021-01-21 05:00:33 RUN_MODEL BEGINS HERE 2021-01-21 05:00:33 PRE_RUN_CHECK BEGINS HERE 2021-01-21 05:00:33 NAMELIST CREATION BEGINS HERE Generating namelists for /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/case_scripts Creating component namelists 2021-01-21 05:00:33 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:00:33 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:00:33 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:00:33 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:00:33 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:00:33 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:00:33 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:00:33 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:00:33 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:00:33 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists 2021-01-21 05:00:34 NAMELIST CREATION HAS FINISHED ------------------------------------------------------------------------- - Prestage required restarts into /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/run - Case input data directory (DIN_LOC_ROOT) is /home/pub/cam_inputdata - Checking for required input datasets in DIN_LOC_ROOT ------------------------------------------------------------------------- 2021-01-21 05:00:34 PRE_RUN_CHECK HAS FINISHED run command is /usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/e3sm.exe >> e3sm.log.$LID 2>&1 2021-01-21 05:00:34 SAVE_PRERUN_PROVENANCE BEGINS HERE 2021-01-21 05:00:34 SAVE_PRERUN_PROVENANCE HAS FINISHED 2021-01-21 05:00:34 MODEL EXECUTION BEGINS HERE 2021-01-21 05:00:34 MODEL EXECUTION HAS FINISHED Exception from case_run: ERROR: RUN FAIL: Command '/usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/build/e3sm.exe >> e3sm.log.$LID 2>&1 ' failed See log file for details: /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_DYCOMSrf01/run/e3sm.log.210121-050033 Submitted job case.run with id None DYCOMSrf01 was successful. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Run RICO) [Pipeline] sh + bash -c 'export e3smSource=/home/jenkins/workspace/e3sm_run_test; csh nightly_test/nightly_e3sm_scm_RICO.csh; exit 0' Compset longname is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV Compset specification file is /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/config_compsets.xml Automatically adding SIAC to compset Automatically adding SESP to compset Compset forcing is ATM component is cam5 physics: LND component is clm4.5 physics:clm4.5 Satellite phenology: ICE component is prescribed cice: OCN component is DOCN prescribed ocean mode ROF component is Stub river component GLC component is Stub glacier (land ice) component WAV component is Stub wave component IAC component is Stub iac component ESP component is Stub external system processing (ESP) component Pes specification file is /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/allactive/config_pesall.xml Machine is nelson Pes setting: grid match is a%ne16np4_ Pes setting: grid is a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Pes setting: compset is SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Pes setting: tasks is {'NTASKS_ATM': 64, 'NTASKS_ICE': 64, 'NTASKS_CPL': 64, 'NTASKS_LND': 64, 'NTASKS_WAV': 64, 'NTASKS_ROF': 64, 'NTASKS_OCN': 64, 'NTASKS_GLC': 64} Pes setting: threads is {'NTHRDS_ICE': 1, 'NTHRDS_ATM': 1, 'NTHRDS_ROF': 1, 'NTHRDS_LND': 1, 'NTHRDS_WAV': 1, 'NTHRDS_OCN': 1, 'NTHRDS_CPL': 1, 'NTHRDS_GLC': 1} Pes setting: rootpe is {'ROOTPE_OCN': 0, 'ROOTPE_LND': 0, 'ROOTPE_ATM': 0, 'ROOTPE_ICE': 0, 'ROOTPE_WAV': 0, 'ROOTPE_CPL': 0, 'ROOTPE_ROF': 0, 'ROOTPE_GLC': 0} Pes setting: pstrid is {} Pes other settings: {} Pes comments: none Compset is: SCAM_CAM5%SCAM_CLM45%SP_CICE%PRES_DOCN%DOM_SROF_SGLC_SWAV_SIAC_SESP Grid is: a%ne16np4_l%ne16np4_oi%ne16np4_r%null_g%null_w%null_z%null_m%gx3v7 Components in compset are: ['cam', 'clm', 'cice', 'docn', 'srof', 'sglc', 'swav', 'siac', 'sesp', 'drv'] No charge_account info available, using value from PROJECT e3sm model version found: de54c68 Batch_system_type is none Creating Case directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/case_scripts ERROR: No variable BASELINE_ROOT found in case ERROR: No variable CCSM_CPRNC found in case setting case file to env_batch.xml ERROR: No queues found /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/case_scripts/env_mach_specific.xml already exists, delete to replace /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/case_scripts/env_mach_specific.xml already exists, delete to replace Creating batch scripts Writing case.run script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.case.run Creating file .case.run Writing case.st_archive script from input template /home/jenkins/workspace/e3sm_run_test/cime/config/e3sm/machines/template.st_archive Creating file case.st_archive Creating file .case.run.sh Creating user_nl_xxx files for components and cpl If an old case build already exists, might want to run 'case.build --clean' before building Generating component namelists as part of setup Creating component namelists 2021-01-21 05:00:41 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:00:41 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:00:41 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:00:41 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:00:41 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:00:41 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:00:41 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:00:41 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:00:41 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:00:41 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists You can now run './preview_run' to get more info on how your case will be run Building case in directory /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/case_scripts sharedlib_only is False model_only is False Generating component namelists as part of build Creating component namelists 2021-01-21 05:00:44 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:00:44 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:00:44 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:00:44 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:00:44 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:00:44 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:00:44 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:00:44 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:00:44 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:00:44 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Building gptl with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/gptl.bldlog.210121-050044 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.gptl Component gptl build complete with 1 warnings Building mct with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/mct.bldlog.210121-050044 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.mct Building pio with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/pio.bldlog.210121-050044 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.pio Building csm_share with output to file /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/csm_share.bldlog.210121-050044 Calling /home/jenkins/workspace/e3sm_run_test/cime/src/build_scripts/buildlib.csm_share Component csm_share build complete with 4 warnings - Building atm Library Building atm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/atm.bldlog.210121-050044 - Building lnd Library Building lnd with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/lnd.bldlog.210121-050044 - Building ice Library Building ice with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/ice.bldlog.210121-050044 - Building ocn Library Building ocn with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/ocn.bldlog.210121-050044 - Building rof Library Building rof with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/rof.bldlog.210121-050044 - Building glc Library Building glc with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/glc.bldlog.210121-050044 - Building wav Library Building wav with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/wav.bldlog.210121-050044 - Building iac Library - Building esp Library Building iac with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/iac.bldlog.210121-050044 Building esp with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/esp.bldlog.210121-050044 sesp built in 0.535251 seconds siac built in 0.558137 seconds sglc built in 0.590054 seconds srof built in 0.610941 seconds swav built in 0.647347 seconds docn built in 1.265623 seconds Component ice build complete with 9 warnings Component ice build complete with 9 warnings cice built in 20.588057 seconds Component lnd build complete with 6 warnings Component lnd build complete with 6 warnings clm built in 98.782691 seconds Component atm build complete with 5 warnings Component atm build complete with 5 warnings cam built in 108.241790 seconds Building e3sm with output to /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/e3sm.bldlog.210121-050044 Component e3sm exe build complete with 3 warnings Time spent not building: 1.108348 sec Time spent building: 154.845063 sec MODEL BUILD HAS FINISHED SUCCESSFULLY Creating component namelists 2021-01-21 05:03:20 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:03:20 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:03:20 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:03:20 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:03:21 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:03:21 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:03:21 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:03:21 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:03:21 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:03:21 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists Checking that inputdata is available as part of case submission Loading input file list: 'Buildconf/cpl.input_data_list' Loading input file list: 'Buildconf/docn.input_data_list' Loading input file list: 'Buildconf/clm.input_data_list' Model clm no file specified for finidat Loading input file list: 'Buildconf/cam.input_data_list' Loading input file list: 'Buildconf/cice.input_data_list' Check case OK submit_jobs case.run Submit job case.run Starting job script case.run 2021-01-21 05:03:21 CASE.RUN BEGINS HERE 2021-01-21 05:03:21 RUN_MODEL BEGINS HERE 2021-01-21 05:03:21 PRE_RUN_CHECK BEGINS HERE 2021-01-21 05:03:21 NAMELIST CREATION BEGINS HERE Generating namelists for /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/case_scripts Creating component namelists 2021-01-21 05:03:21 atm Calling /home/jenkins/workspace/e3sm_run_test/components/cam/cime_config/buildnml 2021-01-21 05:03:21 lnd Calling /home/jenkins/workspace/e3sm_run_test/components/clm/cime_config/buildnml 2021-01-21 05:03:21 ice Calling /home/jenkins/workspace/e3sm_run_test/components/cice/cime_config/buildnml 2021-01-21 05:03:22 ocn Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/data_comps/docn/cime_config/buildnml 2021-01-21 05:03:22 rof Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/srof/cime_config/buildnml 2021-01-21 05:03:22 glc Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sglc/cime_config/buildnml 2021-01-21 05:03:22 wav Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/swav/cime_config/buildnml 2021-01-21 05:03:22 iac Running /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/siac/cime_config/buildnml 2021-01-21 05:03:22 esp Calling /home/jenkins/workspace/e3sm_run_test/cime/src/components/stub_comps/sesp/cime_config/buildnml 2021-01-21 05:03:22 cpl Calling /home/jenkins/workspace/e3sm_run_test/cime/src/drivers/mct/cime_config/buildnml Finished creating component namelists 2021-01-21 05:03:22 NAMELIST CREATION HAS FINISHED ------------------------------------------------------------------------- - Prestage required restarts into /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/run - Case input data directory (DIN_LOC_ROOT) is /home/pub/cam_inputdata - Checking for required input datasets in DIN_LOC_ROOT ------------------------------------------------------------------------- 2021-01-21 05:03:22 PRE_RUN_CHECK HAS FINISHED run command is /usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/e3sm.exe >> e3sm.log.$LID 2>&1 2021-01-21 05:03:22 SAVE_PRERUN_PROVENANCE BEGINS HERE 2021-01-21 05:03:22 SAVE_PRERUN_PROVENANCE HAS FINISHED 2021-01-21 05:03:22 MODEL EXECUTION BEGINS HERE 2021-01-21 05:03:22 MODEL EXECUTION HAS FINISHED Exception from case_run: ERROR: RUN FAIL: Command '/usr/local/mpi/MPICH-3.3.1-gfortran/bin/mpirun -np 1 -prepend-rank /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/build/e3sm.exe >> e3sm.log.$LID 2>&1 ' failed See log file for details: /home/jenkins/workspace/e3sm_run_test/projects/scratch/SCM_runs/test_RICO/run/e3sm.log.210121-050321 Submitted job case.run with id None RICO was successful. [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Clean up) [Pipeline] cleanWs [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is used... [WS-CLEANUP] done [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] End of Pipeline Finished: SUCCESS