Console Output
+ python tests/run_loss_output_consistency.py bomex
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/utilities/create_multi_col_params.py -param_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in -out_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/bomex_shared_multicol_params.in -hr C8/0.2:0.8/4 -batch_size 4
Creating a custom hypergrid of parameters
- Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in'
- Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/bomex_shared_multicol_params.in':
- ngrdcol = 4
- batch_size = 4
======================== Test Setup ========================
Case: bomex
Fields: cloud_frac
Loss window: [10800.0, 21600.0]
Shared params: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/bomex_shared_multicol_params.in
Output root: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex
======================== Run Phase ========================
Running normal CLUBB
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/bomex_shared_multicol_params.in -stats /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/stats/all_tuning_stats.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/normal -tout 10800 -stats_tstart 10800.0 -stats_tend 21600.0 -override stats_tsamp=60.0,time_final=21600.0,debug_level=-1 bomex
/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/normal/bomex.in
- using install dir (latest): /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/install/gcc_DEBUG_PRECdouble
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone
=================== Running bomex ===================
Program exited normally
--------------------------------------------------
run_scm.py total runtime: 1.73 s
--------------------------------------------------
[PASS] normal_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/normal/bomex_stats.nc
Running loss driver
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm_loss.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/bomex_shared_multicol_params.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/loss -fields cloud_frac bomex
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone_loss
- normalized benchmark: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/loss/bomex_normalized_benchmark.nc
- loss timing: absolute_window=[10800, 21600] s, model_time_initial=0 s, model_time_final=21600 s, stats_tstart=10800 s, stats_tend=21600 s, stats_tsamp=60 s, stats_tout=10800 s, num_time_windows=1
=================== Running bomex loss ===================
benchmark timing:window 1 records 181 360 absolute_window 10800 21600 benchmark_window 10800.000000000000 21600.000000000000 matched_window 10860.000000000000 21600.000000000000
closing 131072
variable scaled_rmse_col1 scaled_rmse_col2 scaled_rmse_col3 scaled_rmse_col4 corr_col1 corr_col2 corr_col3 corr_col4 std_ratio_col1 std_ratio_col2 std_ratio_col3 std_ratio_col4 crmse_norm_col1 crmse_norm_col2 crmse_norm_col3 crmse_norm_col4 bias_norm_col1 bias_norm_col2 bias_norm_col3 bias_norm_col4 best_col
cloud_frac 2.49055369E+00 2.08000959E+00 1.57965946E+00 1.06938087E+00 9.23274637E-01 9.37761424E-01 9.41572742E-01 9.29902062E-01 4.36703716E-01 4.96866653E-01 5.87526982E-01 7.28899724E-01 6.19931613E-01 5.61241223E-01 4.88660589E-01 4.19146866E-01 -4.58085654E-01 -4.25704964E-01 -3.71566256E-01 -2.81837200E-01 col4
[PASS] loss_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/bomex/loss/bomex_stats.nc
======================== Comparison ========================
[PASS] loss_vs_equivalent_normal: cloud_frac(max_abs=0.000000e+00, max_rel=0.000000e+00)
[PASS] reported_loss_metrics_vs_netcdf: cloud_frac(scaled_rmse(max_abs=4.045551e-09, max_rel=1.944967e-09); corr(max_abs=4.295486e-10, max_rel=4.652447e-10); std_ratio(max_abs=4.652371e-10, max_rel=1.065338e-09); crmse_norm(max_abs=4.074638e-10, max_rel=9.721265e-10); bias_norm(max_abs=2.853958e-10, max_rel=6.704075e-10))
======================== Summary ========================
Loss-driver stats output and reported metrics are internally consistent.
