Console Output
+ python tests/run_loss_output_consistency.py wangara
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/utilities/create_multi_col_params.py -param_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in -out_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/wangara_shared_multicol_params.in -hr C8/0.2:0.8/4 -batch_size 4
Creating a custom hypergrid of parameters
- Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in'
- Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/wangara_shared_multicol_params.in':
- ngrdcol = 4
- batch_size = 4
======================== Test Setup ========================
Case: wangara
Fields: cloud_frac
Loss window: [86400.0, 88620.0]
Shared params: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/wangara_shared_multicol_params.in
Output root: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara
======================== Run Phase ========================
Running normal CLUBB
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/wangara_shared_multicol_params.in -stats /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/stats/all_tuning_stats.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/normal -tout 2220 -stats_tstart 86400.0 -stats_tend 88620.0 -override stats_tsamp=60.0,time_final=88620.0,debug_level=-1 wangara
/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/normal/wangara.in
- using install dir (latest): /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/install/gcc_DEBUG_PRECdouble
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone
=================== Running wangara ===================
Program exited normally
--------------------------------------------------
run_scm.py total runtime: 0.38 s
--------------------------------------------------
[PASS] normal_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/normal/wangara_stats.nc
Running loss driver
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm_loss.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/wangara_shared_multicol_params.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/loss -fields cloud_frac wangara
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone_loss
- normalized benchmark: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/loss/wangara_normalized_benchmark.nc
- loss timing: absolute_window=[86400, 88620] s, model_time_initial=82800 s, model_time_final=88620 s, stats_tstart=86400 s, stats_tend=88620 s, stats_tsamp=60 s, stats_tout=2220 s, num_time_windows=1
=================== Running wangara loss ===================
benchmark timing:window 1 records 14 20 absolute_window 86400 88620 benchmark_window 86400.000000000000 88620.000000000000 matched_window 86700.000000000000 88500.000000000000
closing 131072
variable scaled_rmse_col1 scaled_rmse_col2 scaled_rmse_col3 scaled_rmse_col4 corr_col1 corr_col2 corr_col3 corr_col4 std_ratio_col1 std_ratio_col2 std_ratio_col3 std_ratio_col4 crmse_norm_col1 crmse_norm_col2 crmse_norm_col3 crmse_norm_col4 bias_norm_col1 bias_norm_col2 bias_norm_col3 bias_norm_col4 best_col
cloud_frac 1.66750133E-11 1.82018260E-14 2.62406835E-20 0.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 1.00000000E+00 5.60358588E-07 1.86345806E-08 2.29040409E-11 0.00000000E+00 1.62187075E-07 4.92120334E-09 3.30591354E-12 0.00000000E+00 col4
[PASS] loss_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/wangara/loss/wangara_stats.nc
======================== Comparison ========================
[PASS] loss_vs_equivalent_normal: cloud_frac(max_abs=0.000000e+00, max_rel=0.000000e+00)
[PASS] reported_loss_metrics_vs_netcdf: cloud_frac(scaled_rmse(max_abs=8.713385e-21, max_rel=1.006496e-09); corr(max_abs=0.000000e+00, max_rel=0.000000e+00); std_ratio(max_abs=0.000000e+00, max_rel=0.000000e+00); crmse_norm(max_abs=2.700826e-16, max_rel=1.093311e-09); bias_norm(max_abs=2.600326e-16, max_rel=1.603288e-09))
======================== Summary ========================
Loss-driver stats output and reported metrics are internally consistent.
