Console Output
+ python tests/run_loss_output_consistency.py atex
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/utilities/create_multi_col_params.py -param_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in -out_file /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/atex_shared_multicol_params.in -hr C8/0.2:0.8/4 -batch_size 4
Creating a custom hypergrid of parameters
- Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/parameter_and_flag_configs/default/tunable_parameters.in'
- Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/atex_shared_multicol_params.in':
- ngrdcol = 4
- batch_size = 4
======================== Test Setup ========================
Case: atex
Fields: cloud_frac
Loss window: [21600.0, 28800.0]
Shared params: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/atex_shared_multicol_params.in
Output root: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex
======================== Run Phase ========================
Running normal CLUBB
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/atex_shared_multicol_params.in -stats /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/input/stats/all_tuning_stats.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/normal -tout 7200 -stats_tstart 21600.0 -stats_tend 28800.0 -override stats_tsamp=60.0,time_final=28800.0,debug_level=-1 atex
/home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/normal/atex.in
- using install dir (latest): /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/install/gcc_DEBUG_PRECdouble
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone
=================== Running atex ===================
Program exited normally
--------------------------------------------------
run_scm.py total runtime: 4.24 s
--------------------------------------------------
[PASS] normal_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/normal/atex_stats.nc
Running loss driver
+ /usr/bin/python /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/run_scm_loss.py -params /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/atex_shared_multicol_params.in -out_dir /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/loss -fields cloud_frac atex
- using executable: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/run_scripts/../install/latest/clubb_standalone_loss
- normalized benchmark: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/loss/atex_normalized_benchmark.nc
- loss timing: absolute_window=[21600, 28800] s, model_time_initial=0 s, model_time_final=28800 s, stats_tstart=21600 s, stats_tend=28800 s, stats_tsamp=60 s, stats_tout=7200 s, num_time_windows=1
=================== Running atex loss ===================
benchmark timing:window 1 records 361 480 absolute_window 21600 28800 benchmark_window 21600.000000000000 28800.000000000000 matched_window 21660.000000000000 28800.000000000000
closing 131072
variable scaled_rmse_col1 scaled_rmse_col2 scaled_rmse_col3 scaled_rmse_col4 corr_col1 corr_col2 corr_col3 corr_col4 std_ratio_col1 std_ratio_col2 std_ratio_col3 std_ratio_col4 crmse_norm_col1 crmse_norm_col2 crmse_norm_col3 crmse_norm_col4 bias_norm_col1 bias_norm_col2 bias_norm_col3 bias_norm_col4 best_col
cloud_frac 1.13312929E+01 4.54342357E+00 6.12240940E+00 6.15015306E+00 7.85016335E-01 9.63582268E-01 9.67602377E-01 9.44037369E-01 1.99138367E+00 1.76779679E+00 1.95542534E+00 1.91374511E+00 1.35612370E+00 8.47508236E-01 1.01957827E+00 1.02426878E+00 4.48215643E-01 3.15722617E-01 2.50350558E-01 2.41004973E-01 col2
[PASS] loss_run: /home/jenkins/workspace/clubb_stats_output_consistency_gfortran_test/output/loss_output_consistency/atex/loss/atex_stats.nc
======================== Comparison ========================
[PASS] loss_vs_equivalent_normal: cloud_frac(max_abs=0.000000e+00, max_rel=0.000000e+00)
[PASS] reported_loss_metrics_vs_netcdf: cloud_frac(scaled_rmse(max_abs=4.475612e-09, max_rel=9.066588e-10); corr(max_abs=4.119810e-10, max_rel=4.275515e-10); std_ratio(max_abs=4.532003e-09, max_rel=2.317656e-09); crmse_norm(max_abs=4.627862e-09, max_rel=4.518211e-09); bias_norm(max_abs=4.064959e-10, max_rel=1.514367e-09))
======================== Summary ========================
Loss-driver stats output and reported metrics are internally consistent.
