Skipping 1,982 KB.. Full Log

Creating a custom hypergrid of parameters
 - Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency/input/parameter_and_flag_configs/default/tunable_parameters.in'
 - Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300/bomex_multicol_params.in':
 - ngrdcol = 4
 - batch_size = 4
/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300/bomex.in
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300
 - using executable: /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/../clubb_jax/run_jax.py
=================== Running bomex ===================
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency/.venv-jax (Python 3.12)
  Accelerator: cpu
Warning: missing correlation input file(s): /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_cloud.in and/or /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_below.in
The default correlation arrays will be used.
nzm = 88 -- nzt = 87
--------------------------------------------------
&microphysics_setting
--------------------------------------------------
microphys_scheme = none
l_cloud_sed = False
sigma_g = 1.5
l_graupel = False
l_hail = False
l_seifert_beheng = False
l_predict_Nc = False
l_const_Nc_in_cloud = False
specify_aerosol = morrison_lognormal
l_subgrid_w = True
l_arctic_nucl = False
l_cloud_edge_activation = False
l_fix_pgam = False
l_in_cloud_Nc_diff = True
l_var_covar_src = False
l_upwind_diff_sed = False
lh_microphys_type = disabled
lh_num_samples = 2
lh_sequence_length = 1
lh_seed = 5489
l_fix_w_chi_eta_correlations = True
l_silhs_KK_convergence_adj_mean = False
importance_prob_thresh = 1e-08
host_dx = 1000000.0
host_dy = 1000000.0
hmp2_ip_on_hmm2_ip_slope%rr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%ri = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rs = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rg = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Nr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ng = 2.12e-05
hmp2_ip_on_hmm2_ip_intrcpt%rr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%ri = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rs = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rg = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Nr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ng = 0.54
Ncnp2_on_Ncnm2 = 1.0
C_evap = 0.86
r_0 = 2.5e-05
microphys_start_time = 0.0
Nc0_in_cloud = 100000000.0
ccnconst = 120.0
ccnexpnt = 0.4000000059604645
aer_rm1 = 1.1000000021965661e-08
aer_rm2 = 5.99999978589949e-08
aer_n1 = 125000000.0
aer_n2 = 65000000.0
aer_sig1 = 1.2000000476837158
aer_sig2 = 1.7000000476837158
pgam_fixed = 5.0
precip_frac_calc_type = 2
--------------------------------------------------
&SILHS_setting
--------------------------------------------------
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
iteration:        1 /      360 -- time =       60.0 /    21600.0
iteration:        2 /      360 -- time =      120.0 /    21600.0
iteration:        3 /      360 -- time =      180.0 /    21600.0
iteration:        4 /      360 -- time =      240.0 /    21600.0
iteration:        5 /      360 -- time =      300.0 /    21600.0
iteration:        6 /      360 -- time =      360.0 /    21600.0
iteration:        7 /      360 -- time =      420.0 /    21600.0
iteration:        8 /      360 -- time =      480.0 /    21600.0
iteration:        9 /      360 -- time =      540.0 /    21600.0
iteration:       10 /      360 -- time =      600.0 /    21600.0
iteration:       11 /      360 -- time =      660.0 /    21600.0
iteration:       12 /      360 -- time =      720.0 /    21600.0
iteration:       13 /      360 -- time =      780.0 /    21600.0
iteration:       14 /      360 -- time =      840.0 /    21600.0
iteration:       15 /      360 -- time =      900.0 /    21600.0
iteration:       16 /      360 -- time =      960.0 /    21600.0
iteration:       17 /      360 -- time =     1020.0 /    21600.0
iteration:       18 /      360 -- time =     1080.0 /    21600.0
iteration:       19 /      360 -- time =     1140.0 /    21600.0
iteration:       20 /      360 -- time =     1200.0 /    21600.0
iteration:       21 /      360 -- time =     1260.0 /    21600.0
iteration:       22 /      360 -- time =     1320.0 /    21600.0
iteration:       23 /      360 -- time =     1380.0 /    21600.0
iteration:       24 /      360 -- time =     1440.0 /    21600.0
iteration:       25 /      360 -- time =     1500.0 /    21600.0
iteration:       26 /      360 -- time =     1560.0 /    21600.0
iteration:       27 /      360 -- time =     1620.0 /    21600.0
iteration:       28 /      360 -- time =     1680.0 /    21600.0
iteration:       29 /      360 -- time =     1740.0 /    21600.0
iteration:       30 /      360 -- time =     1800.0 /    21600.0
iteration:       31 /      360 -- time =     1860.0 /    21600.0
iteration:       32 /      360 -- time =     1920.0 /    21600.0
iteration:       33 /      360 -- time =     1980.0 /    21600.0
iteration:       34 /      360 -- time =     2040.0 /    21600.0
iteration:       35 /      360 -- time =     2100.0 /    21600.0
iteration:       36 /      360 -- time =     2160.0 /    21600.0
iteration:       37 /      360 -- time =     2220.0 /    21600.0
iteration:       38 /      360 -- time =     2280.0 /    21600.0
iteration:       39 /      360 -- time =     2340.0 /    21600.0
iteration:       40 /      360 -- time =     2400.0 /    21600.0
iteration:       41 /      360 -- time =     2460.0 /    21600.0
iteration:       42 /      360 -- time =     2520.0 /    21600.0
iteration:       43 /      360 -- time =     2580.0 /    21600.0
iteration:       44 /      360 -- time =     2640.0 /    21600.0
iteration:       45 /      360 -- time =     2700.0 /    21600.0
iteration:       46 /      360 -- time =     2760.0 /    21600.0
iteration:       47 /      360 -- time =     2820.0 /    21600.0
iteration:       48 /      360 -- time =     2880.0 /    21600.0
iteration:       49 /      360 -- time =     2940.0 /    21600.0
iteration:       50 /      360 -- time =     3000.0 /    21600.0
iteration:       51 /      360 -- time =     3060.0 /    21600.0
iteration:       52 /      360 -- time =     3120.0 /    21600.0
iteration:       53 /      360 -- time =     3180.0 /    21600.0
iteration:       54 /      360 -- time =     3240.0 /    21600.0
iteration:       55 /      360 -- time =     3300.0 /    21600.0
iteration:       56 /      360 -- time =     3360.0 /    21600.0
iteration:       57 /      360 -- time =     3420.0 /    21600.0
iteration:       58 /      360 -- time =     3480.0 /    21600.0
iteration:       59 /      360 -- time =     3540.0 /    21600.0
iteration:       60 /      360 -- time =     3600.0 /    21600.0
iteration:       61 /      360 -- time =     3660.0 /    21600.0
iteration:       62 /      360 -- time =     3720.0 /    21600.0
iteration:       63 /      360 -- time =     3780.0 /    21600.0
iteration:       64 /      360 -- time =     3840.0 /    21600.0
iteration:       65 /      360 -- time =     3900.0 /    21600.0
iteration:       66 /      360 -- time =     3960.0 /    21600.0
iteration:       67 /      360 -- time =     4020.0 /    21600.0
iteration:       68 /      360 -- time =     4080.0 /    21600.0
iteration:       69 /      360 -- time =     4140.0 /    21600.0
iteration:       70 /      360 -- time =     4200.0 /    21600.0
iteration:       71 /      360 -- time =     4260.0 /    21600.0
iteration:       72 /      360 -- time =     4320.0 /    21600.0
iteration:       73 /      360 -- time =     4380.0 /    21600.0
iteration:       74 /      360 -- time =     4440.0 /    21600.0
iteration:       75 /      360 -- time =     4500.0 /    21600.0
iteration:       76 /      360 -- time =     4560.0 /    21600.0
iteration:       77 /      360 -- time =     4620.0 /    21600.0
iteration:       78 /      360 -- time =     4680.0 /    21600.0
iteration:       79 /      360 -- time =     4740.0 /    21600.0
iteration:       80 /      360 -- time =     4800.0 /    21600.0
iteration:       81 /      360 -- time =     4860.0 /    21600.0
iteration:       82 /      360 -- time =     4920.0 /    21600.0
iteration:       83 /      360 -- time =     4980.0 /    21600.0
iteration:       84 /      360 -- time =     5040.0 /    21600.0
iteration:       85 /      360 -- time =     5100.0 /    21600.0
iteration:       86 /      360 -- time =     5160.0 /    21600.0
iteration:       87 /      360 -- time =     5220.0 /    21600.0
iteration:       88 /      360 -- time =     5280.0 /    21600.0
iteration:       89 /      360 -- time =     5340.0 /    21600.0
iteration:       90 /      360 -- time =     5400.0 /    21600.0
iteration:       91 /      360 -- time =     5460.0 /    21600.0
iteration:       92 /      360 -- time =     5520.0 /    21600.0
iteration:       93 /      360 -- time =     5580.0 /    21600.0
iteration:       94 /      360 -- time =     5640.0 /    21600.0
iteration:       95 /      360 -- time =     5700.0 /    21600.0
iteration:       96 /      360 -- time =     5760.0 /    21600.0
iteration:       97 /      360 -- time =     5820.0 /    21600.0
iteration:       98 /      360 -- time =     5880.0 /    21600.0
iteration:       99 /      360 -- time =     5940.0 /    21600.0
iteration:      100 /      360 -- time =     6000.0 /    21600.0
iteration:      101 /      360 -- time =     6060.0 /    21600.0
iteration:      102 /      360 -- time =     6120.0 /    21600.0
iteration:      103 /      360 -- time =     6180.0 /    21600.0
iteration:      104 /      360 -- time =     6240.0 /    21600.0
iteration:      105 /      360 -- time =     6300.0 /    21600.0
iteration:      106 /      360 -- time =     6360.0 /    21600.0
iteration:      107 /      360 -- time =     6420.0 /    21600.0
iteration:      108 /      360 -- time =     6480.0 /    21600.0
iteration:      109 /      360 -- time =     6540.0 /    21600.0
iteration:      110 /      360 -- time =     6600.0 /    21600.0
iteration:      111 /      360 -- time =     6660.0 /    21600.0
iteration:      112 /      360 -- time =     6720.0 /    21600.0
iteration:      113 /      360 -- time =     6780.0 /    21600.0
iteration:      114 /      360 -- time =     6840.0 /    21600.0
iteration:      115 /      360 -- time =     6900.0 /    21600.0
iteration:      116 /      360 -- time =     6960.0 /    21600.0
iteration:      117 /      360 -- time =     7020.0 /    21600.0
iteration:      118 /      360 -- time =     7080.0 /    21600.0
iteration:      119 /      360 -- time =     7140.0 /    21600.0
iteration:      120 /      360 -- time =     7200.0 /    21600.0
iteration:      121 /      360 -- time =     7260.0 /    21600.0
iteration:      122 /      360 -- time =     7320.0 /    21600.0
iteration:      123 /      360 -- time =     7380.0 /    21600.0
iteration:      124 /      360 -- time =     7440.0 /    21600.0
iteration:      125 /      360 -- time =     7500.0 /    21600.0
iteration:      126 /      360 -- time =     7560.0 /    21600.0
iteration:      127 /      360 -- time =     7620.0 /    21600.0
iteration:      128 /      360 -- time =     7680.0 /    21600.0
iteration:      129 /      360 -- time =     7740.0 /    21600.0
iteration:      130 /      360 -- time =     7800.0 /    21600.0
iteration:      131 /      360 -- time =     7860.0 /    21600.0
iteration:      132 /      360 -- time =     7920.0 /    21600.0
iteration:      133 /      360 -- time =     7980.0 /    21600.0
iteration:      134 /      360 -- time =     8040.0 /    21600.0
iteration:      135 /      360 -- time =     8100.0 /    21600.0
iteration:      136 /      360 -- time =     8160.0 /    21600.0
iteration:      137 /      360 -- time =     8220.0 /    21600.0
iteration:      138 /      360 -- time =     8280.0 /    21600.0
iteration:      139 /      360 -- time =     8340.0 /    21600.0
iteration:      140 /      360 -- time =     8400.0 /    21600.0
iteration:      141 /      360 -- time =     8460.0 /    21600.0
iteration:      142 /      360 -- time =     8520.0 /    21600.0
iteration:      143 /      360 -- time =     8580.0 /    21600.0
iteration:      144 /      360 -- time =     8640.0 /    21600.0
iteration:      145 /      360 -- time =     8700.0 /    21600.0
iteration:      146 /      360 -- time =     8760.0 /    21600.0
iteration:      147 /      360 -- time =     8820.0 /    21600.0
iteration:      148 /      360 -- time =     8880.0 /    21600.0
iteration:      149 /      360 -- time =     8940.0 /    21600.0
iteration:      150 /      360 -- time =     9000.0 /    21600.0
iteration:      151 /      360 -- time =     9060.0 /    21600.0
iteration:      152 /      360 -- time =     9120.0 /    21600.0
iteration:      153 /      360 -- time =     9180.0 /    21600.0
iteration:      154 /      360 -- time =     9240.0 /    21600.0
iteration:      155 /      360 -- time =     9300.0 /    21600.0
iteration:      156 /      360 -- time =     9360.0 /    21600.0
iteration:      157 /      360 -- time =     9420.0 /    21600.0
iteration:      158 /      360 -- time =     9480.0 /    21600.0
iteration:      159 /      360 -- time =     9540.0 /    21600.0
iteration:      160 /      360 -- time =     9600.0 /    21600.0
iteration:      161 /      360 -- time =     9660.0 /    21600.0
iteration:      162 /      360 -- time =     9720.0 /    21600.0
iteration:      163 /      360 -- time =     9780.0 /    21600.0
iteration:      164 /      360 -- time =     9840.0 /    21600.0
iteration:      165 /      360 -- time =     9900.0 /    21600.0
iteration:      166 /      360 -- time =     9960.0 /    21600.0
iteration:      167 /      360 -- time =    10020.0 /    21600.0
iteration:      168 /      360 -- time =    10080.0 /    21600.0
iteration:      169 /      360 -- time =    10140.0 /    21600.0
iteration:      170 /      360 -- time =    10200.0 /    21600.0
iteration:      171 /      360 -- time =    10260.0 /    21600.0
iteration:      172 /      360 -- time =    10320.0 /    21600.0
iteration:      173 /      360 -- time =    10380.0 /    21600.0
iteration:      174 /      360 -- time =    10440.0 /    21600.0
iteration:      175 /      360 -- time =    10500.0 /    21600.0
iteration:      176 /      360 -- time =    10560.0 /    21600.0
iteration:      177 /      360 -- time =    10620.0 /    21600.0
iteration:      178 /      360 -- time =    10680.0 /    21600.0
iteration:      179 /      360 -- time =    10740.0 /    21600.0
iteration:      180 /      360 -- time =    10800.0 /    21600.0
iteration:      181 /      360 -- time =    10860.0 /    21600.0
iteration:      182 /      360 -- time =    10920.0 /    21600.0
iteration:      183 /      360 -- time =    10980.0 /    21600.0
iteration:      184 /      360 -- time =    11040.0 /    21600.0
iteration:      185 /      360 -- time =    11100.0 /    21600.0
iteration:      186 /      360 -- time =    11160.0 /    21600.0
iteration:      187 /      360 -- time =    11220.0 /    21600.0
iteration:      188 /      360 -- time =    11280.0 /    21600.0
iteration:      189 /      360 -- time =    11340.0 /    21600.0
iteration:      190 /      360 -- time =    11400.0 /    21600.0
iteration:      191 /      360 -- time =    11460.0 /    21600.0
iteration:      192 /      360 -- time =    11520.0 /    21600.0
iteration:      193 /      360 -- time =    11580.0 /    21600.0
iteration:      194 /      360 -- time =    11640.0 /    21600.0
iteration:      195 /      360 -- time =    11700.0 /    21600.0
iteration:      196 /      360 -- time =    11760.0 /    21600.0
iteration:      197 /      360 -- time =    11820.0 /    21600.0
iteration:      198 /      360 -- time =    11880.0 /    21600.0
iteration:      199 /      360 -- time =    11940.0 /    21600.0
iteration:      200 /      360 -- time =    12000.0 /    21600.0
iteration:      201 /      360 -- time =    12060.0 /    21600.0
iteration:      202 /      360 -- time =    12120.0 /    21600.0
iteration:      203 /      360 -- time =    12180.0 /    21600.0
iteration:      204 /      360 -- time =    12240.0 /    21600.0
iteration:      205 /      360 -- time =    12300.0 /    21600.0
iteration:      206 /      360 -- time =    12360.0 /    21600.0
iteration:      207 /      360 -- time =    12420.0 /    21600.0
iteration:      208 /      360 -- time =    12480.0 /    21600.0
iteration:      209 /      360 -- time =    12540.0 /    21600.0
iteration:      210 /      360 -- time =    12600.0 /    21600.0
iteration:      211 /      360 -- time =    12660.0 /    21600.0
iteration:      212 /      360 -- time =    12720.0 /    21600.0
iteration:      213 /      360 -- time =    12780.0 /    21600.0
iteration:      214 /      360 -- time =    12840.0 /    21600.0
iteration:      215 /      360 -- time =    12900.0 /    21600.0
iteration:      216 /      360 -- time =    12960.0 /    21600.0
iteration:      217 /      360 -- time =    13020.0 /    21600.0
iteration:      218 /      360 -- time =    13080.0 /    21600.0
iteration:      219 /      360 -- time =    13140.0 /    21600.0
iteration:      220 /      360 -- time =    13200.0 /    21600.0
iteration:      221 /      360 -- time =    13260.0 /    21600.0
iteration:      222 /      360 -- time =    13320.0 /    21600.0
iteration:      223 /      360 -- time =    13380.0 /    21600.0
iteration:      224 /      360 -- time =    13440.0 /    21600.0
iteration:      225 /      360 -- time =    13500.0 /    21600.0
iteration:      226 /      360 -- time =    13560.0 /    21600.0
iteration:      227 /      360 -- time =    13620.0 /    21600.0
iteration:      228 /      360 -- time =    13680.0 /    21600.0
iteration:      229 /      360 -- time =    13740.0 /    21600.0
iteration:      230 /      360 -- time =    13800.0 /    21600.0
iteration:      231 /      360 -- time =    13860.0 /    21600.0
iteration:      232 /      360 -- time =    13920.0 /    21600.0
iteration:      233 /      360 -- time =    13980.0 /    21600.0
iteration:      234 /      360 -- time =    14040.0 /    21600.0
iteration:      235 /      360 -- time =    14100.0 /    21600.0
iteration:      236 /      360 -- time =    14160.0 /    21600.0
iteration:      237 /      360 -- time =    14220.0 /    21600.0
iteration:      238 /      360 -- time =    14280.0 /    21600.0
iteration:      239 /      360 -- time =    14340.0 /    21600.0
iteration:      240 /      360 -- time =    14400.0 /    21600.0
iteration:      241 /      360 -- time =    14460.0 /    21600.0
iteration:      242 /      360 -- time =    14520.0 /    21600.0
iteration:      243 /      360 -- time =    14580.0 /    21600.0
iteration:      244 /      360 -- time =    14640.0 /    21600.0
iteration:      245 /      360 -- time =    14700.0 /    21600.0
iteration:      246 /      360 -- time =    14760.0 /    21600.0
iteration:      247 /      360 -- time =    14820.0 /    21600.0
iteration:      248 /      360 -- time =    14880.0 /    21600.0
iteration:      249 /      360 -- time =    14940.0 /    21600.0
iteration:      250 /      360 -- time =    15000.0 /    21600.0
iteration:      251 /      360 -- time =    15060.0 /    21600.0
iteration:      252 /      360 -- time =    15120.0 /    21600.0
iteration:      253 /      360 -- time =    15180.0 /    21600.0
iteration:      254 /      360 -- time =    15240.0 /    21600.0
iteration:      255 /      360 -- time =    15300.0 /    21600.0
iteration:      256 /      360 -- time =    15360.0 /    21600.0
iteration:      257 /      360 -- time =    15420.0 /    21600.0
iteration:      258 /      360 -- time =    15480.0 /    21600.0
iteration:      259 /      360 -- time =    15540.0 /    21600.0
iteration:      260 /      360 -- time =    15600.0 /    21600.0
iteration:      261 /      360 -- time =    15660.0 /    21600.0
iteration:      262 /      360 -- time =    15720.0 /    21600.0
iteration:      263 /      360 -- time =    15780.0 /    21600.0
iteration:      264 /      360 -- time =    15840.0 /    21600.0
iteration:      265 /      360 -- time =    15900.0 /    21600.0
iteration:      266 /      360 -- time =    15960.0 /    21600.0
iteration:      267 /      360 -- time =    16020.0 /    21600.0
iteration:      268 /      360 -- time =    16080.0 /    21600.0
iteration:      269 /      360 -- time =    16140.0 /    21600.0
iteration:      270 /      360 -- time =    16200.0 /    21600.0
iteration:      271 /      360 -- time =    16260.0 /    21600.0
iteration:      272 /      360 -- time =    16320.0 /    21600.0
iteration:      273 /      360 -- time =    16380.0 /    21600.0
iteration:      274 /      360 -- time =    16440.0 /    21600.0
iteration:      275 /      360 -- time =    16500.0 /    21600.0
iteration:      276 /      360 -- time =    16560.0 /    21600.0
iteration:      277 /      360 -- time =    16620.0 /    21600.0
iteration:      278 /      360 -- time =    16680.0 /    21600.0
iteration:      279 /      360 -- time =    16740.0 /    21600.0
iteration:      280 /      360 -- time =    16800.0 /    21600.0
iteration:      281 /      360 -- time =    16860.0 /    21600.0
iteration:      282 /      360 -- time =    16920.0 /    21600.0
iteration:      283 /      360 -- time =    16980.0 /    21600.0
iteration:      284 /      360 -- time =    17040.0 /    21600.0
iteration:      285 /      360 -- time =    17100.0 /    21600.0
iteration:      286 /      360 -- time =    17160.0 /    21600.0
iteration:      287 /      360 -- time =    17220.0 /    21600.0
iteration:      288 /      360 -- time =    17280.0 /    21600.0
iteration:      289 /      360 -- time =    17340.0 /    21600.0
iteration:      290 /      360 -- time =    17400.0 /    21600.0
iteration:      291 /      360 -- time =    17460.0 /    21600.0
iteration:      292 /      360 -- time =    17520.0 /    21600.0
iteration:      293 /      360 -- time =    17580.0 /    21600.0
iteration:      294 /      360 -- time =    17640.0 /    21600.0
iteration:      295 /      360 -- time =    17700.0 /    21600.0
iteration:      296 /      360 -- time =    17760.0 /    21600.0
iteration:      297 /      360 -- time =    17820.0 /    21600.0
iteration:      298 /      360 -- time =    17880.0 /    21600.0
iteration:      299 /      360 -- time =    17940.0 /    21600.0
iteration:      300 /      360 -- time =    18000.0 /    21600.0
iteration:      301 /      360 -- time =    18060.0 /    21600.0
iteration:      302 /      360 -- time =    18120.0 /    21600.0
iteration:      303 /      360 -- time =    18180.0 /    21600.0
iteration:      304 /      360 -- time =    18240.0 /    21600.0
iteration:      305 /      360 -- time =    18300.0 /    21600.0
iteration:      306 /      360 -- time =    18360.0 /    21600.0
iteration:      307 /      360 -- time =    18420.0 /    21600.0
iteration:      308 /      360 -- time =    18480.0 /    21600.0
iteration:      309 /      360 -- time =    18540.0 /    21600.0
iteration:      310 /      360 -- time =    18600.0 /    21600.0
iteration:      311 /      360 -- time =    18660.0 /    21600.0
iteration:      312 /      360 -- time =    18720.0 /    21600.0
iteration:      313 /      360 -- time =    18780.0 /    21600.0
iteration:      314 /      360 -- time =    18840.0 /    21600.0
iteration:      315 /      360 -- time =    18900.0 /    21600.0
iteration:      316 /      360 -- time =    18960.0 /    21600.0
iteration:      317 /      360 -- time =    19020.0 /    21600.0
iteration:      318 /      360 -- time =    19080.0 /    21600.0
iteration:      319 /      360 -- time =    19140.0 /    21600.0
iteration:      320 /      360 -- time =    19200.0 /    21600.0
iteration:      321 /      360 -- time =    19260.0 /    21600.0
iteration:      322 /      360 -- time =    19320.0 /    21600.0
iteration:      323 /      360 -- time =    19380.0 /    21600.0
iteration:      324 /      360 -- time =    19440.0 /    21600.0
iteration:      325 /      360 -- time =    19500.0 /    21600.0
iteration:      326 /      360 -- time =    19560.0 /    21600.0
iteration:      327 /      360 -- time =    19620.0 /    21600.0
iteration:      328 /      360 -- time =    19680.0 /    21600.0
iteration:      329 /      360 -- time =    19740.0 /    21600.0
iteration:      330 /      360 -- time =    19800.0 /    21600.0
iteration:      331 /      360 -- time =    19860.0 /    21600.0
iteration:      332 /      360 -- time =    19920.0 /    21600.0
iteration:      333 /      360 -- time =    19980.0 /    21600.0
iteration:      334 /      360 -- time =    20040.0 /    21600.0
iteration:      335 /      360 -- time =    20100.0 /    21600.0
iteration:      336 /      360 -- time =    20160.0 /    21600.0
iteration:      337 /      360 -- time =    20220.0 /    21600.0
iteration:      338 /      360 -- time =    20280.0 /    21600.0
iteration:      339 /      360 -- time =    20340.0 /    21600.0
iteration:      340 /      360 -- time =    20400.0 /    21600.0
iteration:      341 /      360 -- time =    20460.0 /    21600.0
iteration:      342 /      360 -- time =    20520.0 /    21600.0
iteration:      343 /      360 -- time =    20580.0 /    21600.0
iteration:      344 /      360 -- time =    20640.0 /    21600.0
iteration:      345 /      360 -- time =    20700.0 /    21600.0
iteration:      346 /      360 -- time =    20760.0 /    21600.0
iteration:      347 /      360 -- time =    20820.0 /    21600.0
iteration:      348 /      360 -- time =    20880.0 /    21600.0
iteration:      349 /      360 -- time =    20940.0 /    21600.0
iteration:      350 /      360 -- time =    21000.0 /    21600.0
iteration:      351 /      360 -- time =    21060.0 /    21600.0
iteration:      352 /      360 -- time =    21120.0 /    21600.0
iteration:      353 /      360 -- time =    21180.0 /    21600.0
iteration:      354 /      360 -- time =    21240.0 /    21600.0
iteration:      355 /      360 -- time =    21300.0 /    21600.0
iteration:      356 /      360 -- time =    21360.0 /    21600.0
iteration:      357 /      360 -- time =    21420.0 /    21600.0
iteration:      358 /      360 -- time =    21480.0 /    21600.0
iteration:      359 /      360 -- time =    21540.0 /    21600.0
iteration:      360 /      360 -- time =    21600.0 /    21600.0
CLUBB cleanup complete.
Completed 360 timesteps in 73.4s
--------------------------------------------------
run_scm.py total runtime: 75.94 s
--------------------------------------------------
[PASS] bs4_tout300: stats file: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300/bomex_stats.nc
Running bs4_tout600
+ /home/jenkins/workspace/clubb_stats_output_consistency/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/run_scm.py -stats /home/jenkins/workspace/clubb_stats_output_consistency/input/stats/standard_stats.in -output_dir /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout600 -multicol C8/0.2:0.8/4 -batch_size 4 -tout 600 -jax=cpu bomex
Creating a custom hypergrid of parameters
 - Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency/input/parameter_and_flag_configs/default/tunable_parameters.in'
 - Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout600/bomex_multicol_params.in':
 - ngrdcol = 4
 - batch_size = 4
/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout600/bomex.in
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout600
 - using executable: /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/../clubb_jax/run_jax.py
=================== Running bomex ===================
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency/.venv-jax (Python 3.12)
  Accelerator: cpu
Warning: missing correlation input file(s): /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_cloud.in and/or /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_below.in
The default correlation arrays will be used.
nzm = 88 -- nzt = 87
--------------------------------------------------
&microphysics_setting
--------------------------------------------------
microphys_scheme = none
l_cloud_sed = False
sigma_g = 1.5
l_graupel = False
l_hail = False
l_seifert_beheng = False
l_predict_Nc = False
l_const_Nc_in_cloud = False
specify_aerosol = morrison_lognormal
l_subgrid_w = True
l_arctic_nucl = False
l_cloud_edge_activation = False
l_fix_pgam = False
l_in_cloud_Nc_diff = True
l_var_covar_src = False
l_upwind_diff_sed = False
lh_microphys_type = disabled
lh_num_samples = 2
lh_sequence_length = 1
lh_seed = 5489
l_fix_w_chi_eta_correlations = True
l_silhs_KK_convergence_adj_mean = False
importance_prob_thresh = 1e-08
host_dx = 1000000.0
host_dy = 1000000.0
hmp2_ip_on_hmm2_ip_slope%rr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%ri = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rs = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rg = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Nr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ng = 2.12e-05
hmp2_ip_on_hmm2_ip_intrcpt%rr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%ri = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rs = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rg = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Nr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ng = 0.54
Ncnp2_on_Ncnm2 = 1.0
C_evap = 0.86
r_0 = 2.5e-05
microphys_start_time = 0.0
Nc0_in_cloud = 100000000.0
ccnconst = 120.0
ccnexpnt = 0.4000000059604645
aer_rm1 = 1.1000000021965661e-08
aer_rm2 = 5.99999978589949e-08
aer_n1 = 125000000.0
aer_n2 = 65000000.0
aer_sig1 = 1.2000000476837158
aer_sig2 = 1.7000000476837158
pgam_fixed = 5.0
precip_frac_calc_type = 2
--------------------------------------------------
&SILHS_setting
--------------------------------------------------
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
iteration:        1 /      360 -- time =       60.0 /    21600.0
iteration:        2 /      360 -- time =      120.0 /    21600.0
iteration:        3 /      360 -- time =      180.0 /    21600.0
iteration:        4 /      360 -- time =      240.0 /    21600.0
iteration:        5 /      360 -- time =      300.0 /    21600.0
iteration:        6 /      360 -- time =      360.0 /    21600.0
iteration:        7 /      360 -- time =      420.0 /    21600.0
iteration:        8 /      360 -- time =      480.0 /    21600.0
iteration:        9 /      360 -- time =      540.0 /    21600.0
iteration:       10 /      360 -- time =      600.0 /    21600.0
iteration:       11 /      360 -- time =      660.0 /    21600.0
iteration:       12 /      360 -- time =      720.0 /    21600.0
iteration:       13 /      360 -- time =      780.0 /    21600.0
iteration:       14 /      360 -- time =      840.0 /    21600.0
iteration:       15 /      360 -- time =      900.0 /    21600.0
iteration:       16 /      360 -- time =      960.0 /    21600.0
iteration:       17 /      360 -- time =     1020.0 /    21600.0
iteration:       18 /      360 -- time =     1080.0 /    21600.0
iteration:       19 /      360 -- time =     1140.0 /    21600.0
iteration:       20 /      360 -- time =     1200.0 /    21600.0
iteration:       21 /      360 -- time =     1260.0 /    21600.0
iteration:       22 /      360 -- time =     1320.0 /    21600.0
iteration:       23 /      360 -- time =     1380.0 /    21600.0
iteration:       24 /      360 -- time =     1440.0 /    21600.0
iteration:       25 /      360 -- time =     1500.0 /    21600.0
iteration:       26 /      360 -- time =     1560.0 /    21600.0
iteration:       27 /      360 -- time =     1620.0 /    21600.0
iteration:       28 /      360 -- time =     1680.0 /    21600.0
iteration:       29 /      360 -- time =     1740.0 /    21600.0
iteration:       30 /      360 -- time =     1800.0 /    21600.0
iteration:       31 /      360 -- time =     1860.0 /    21600.0
iteration:       32 /      360 -- time =     1920.0 /    21600.0
iteration:       33 /      360 -- time =     1980.0 /    21600.0
iteration:       34 /      360 -- time =     2040.0 /    21600.0
iteration:       35 /      360 -- time =     2100.0 /    21600.0
iteration:       36 /      360 -- time =     2160.0 /    21600.0
iteration:       37 /      360 -- time =     2220.0 /    21600.0
iteration:       38 /      360 -- time =     2280.0 /    21600.0
iteration:       39 /      360 -- time =     2340.0 /    21600.0
iteration:       40 /      360 -- time =     2400.0 /    21600.0
iteration:       41 /      360 -- time =     2460.0 /    21600.0
iteration:       42 /      360 -- time =     2520.0 /    21600.0
iteration:       43 /      360 -- time =     2580.0 /    21600.0
iteration:       44 /      360 -- time =     2640.0 /    21600.0
iteration:       45 /      360 -- time =     2700.0 /    21600.0
iteration:       46 /      360 -- time =     2760.0 /    21600.0
iteration:       47 /      360 -- time =     2820.0 /    21600.0
iteration:       48 /      360 -- time =     2880.0 /    21600.0
iteration:       49 /      360 -- time =     2940.0 /    21600.0
iteration:       50 /      360 -- time =     3000.0 /    21600.0
iteration:       51 /      360 -- time =     3060.0 /    21600.0
iteration:       52 /      360 -- time =     3120.0 /    21600.0
iteration:       53 /      360 -- time =     3180.0 /    21600.0
iteration:       54 /      360 -- time =     3240.0 /    21600.0
iteration:       55 /      360 -- time =     3300.0 /    21600.0
iteration:       56 /      360 -- time =     3360.0 /    21600.0
iteration:       57 /      360 -- time =     3420.0 /    21600.0
iteration:       58 /      360 -- time =     3480.0 /    21600.0
iteration:       59 /      360 -- time =     3540.0 /    21600.0
iteration:       60 /      360 -- time =     3600.0 /    21600.0
iteration:       61 /      360 -- time =     3660.0 /    21600.0
iteration:       62 /      360 -- time =     3720.0 /    21600.0
iteration:       63 /      360 -- time =     3780.0 /    21600.0
iteration:       64 /      360 -- time =     3840.0 /    21600.0
iteration:       65 /      360 -- time =     3900.0 /    21600.0
iteration:       66 /      360 -- time =     3960.0 /    21600.0
iteration:       67 /      360 -- time =     4020.0 /    21600.0
iteration:       68 /      360 -- time =     4080.0 /    21600.0
iteration:       69 /      360 -- time =     4140.0 /    21600.0
iteration:       70 /      360 -- time =     4200.0 /    21600.0
iteration:       71 /      360 -- time =     4260.0 /    21600.0
iteration:       72 /      360 -- time =     4320.0 /    21600.0
iteration:       73 /      360 -- time =     4380.0 /    21600.0
iteration:       74 /      360 -- time =     4440.0 /    21600.0
iteration:       75 /      360 -- time =     4500.0 /    21600.0
iteration:       76 /      360 -- time =     4560.0 /    21600.0
iteration:       77 /      360 -- time =     4620.0 /    21600.0
iteration:       78 /      360 -- time =     4680.0 /    21600.0
iteration:       79 /      360 -- time =     4740.0 /    21600.0
iteration:       80 /      360 -- time =     4800.0 /    21600.0
iteration:       81 /      360 -- time =     4860.0 /    21600.0
iteration:       82 /      360 -- time =     4920.0 /    21600.0
iteration:       83 /      360 -- time =     4980.0 /    21600.0
iteration:       84 /      360 -- time =     5040.0 /    21600.0
iteration:       85 /      360 -- time =     5100.0 /    21600.0
iteration:       86 /      360 -- time =     5160.0 /    21600.0
iteration:       87 /      360 -- time =     5220.0 /    21600.0
iteration:       88 /      360 -- time =     5280.0 /    21600.0
iteration:       89 /      360 -- time =     5340.0 /    21600.0
iteration:       90 /      360 -- time =     5400.0 /    21600.0
iteration:       91 /      360 -- time =     5460.0 /    21600.0
iteration:       92 /      360 -- time =     5520.0 /    21600.0
iteration:       93 /      360 -- time =     5580.0 /    21600.0
iteration:       94 /      360 -- time =     5640.0 /    21600.0
iteration:       95 /      360 -- time =     5700.0 /    21600.0
iteration:       96 /      360 -- time =     5760.0 /    21600.0
iteration:       97 /      360 -- time =     5820.0 /    21600.0
iteration:       98 /      360 -- time =     5880.0 /    21600.0
iteration:       99 /      360 -- time =     5940.0 /    21600.0
iteration:      100 /      360 -- time =     6000.0 /    21600.0
iteration:      101 /      360 -- time =     6060.0 /    21600.0
iteration:      102 /      360 -- time =     6120.0 /    21600.0
iteration:      103 /      360 -- time =     6180.0 /    21600.0
iteration:      104 /      360 -- time =     6240.0 /    21600.0
iteration:      105 /      360 -- time =     6300.0 /    21600.0
iteration:      106 /      360 -- time =     6360.0 /    21600.0
iteration:      107 /      360 -- time =     6420.0 /    21600.0
iteration:      108 /      360 -- time =     6480.0 /    21600.0
iteration:      109 /      360 -- time =     6540.0 /    21600.0
iteration:      110 /      360 -- time =     6600.0 /    21600.0
iteration:      111 /      360 -- time =     6660.0 /    21600.0
iteration:      112 /      360 -- time =     6720.0 /    21600.0
iteration:      113 /      360 -- time =     6780.0 /    21600.0
iteration:      114 /      360 -- time =     6840.0 /    21600.0
iteration:      115 /      360 -- time =     6900.0 /    21600.0
iteration:      116 /      360 -- time =     6960.0 /    21600.0
iteration:      117 /      360 -- time =     7020.0 /    21600.0
iteration:      118 /      360 -- time =     7080.0 /    21600.0
iteration:      119 /      360 -- time =     7140.0 /    21600.0
iteration:      120 /      360 -- time =     7200.0 /    21600.0
iteration:      121 /      360 -- time =     7260.0 /    21600.0
iteration:      122 /      360 -- time =     7320.0 /    21600.0
iteration:      123 /      360 -- time =     7380.0 /    21600.0
iteration:      124 /      360 -- time =     7440.0 /    21600.0
iteration:      125 /      360 -- time =     7500.0 /    21600.0
iteration:      126 /      360 -- time =     7560.0 /    21600.0
iteration:      127 /      360 -- time =     7620.0 /    21600.0
iteration:      128 /      360 -- time =     7680.0 /    21600.0
iteration:      129 /      360 -- time =     7740.0 /    21600.0
iteration:      130 /      360 -- time =     7800.0 /    21600.0
iteration:      131 /      360 -- time =     7860.0 /    21600.0
iteration:      132 /      360 -- time =     7920.0 /    21600.0
iteration:      133 /      360 -- time =     7980.0 /    21600.0
iteration:      134 /      360 -- time =     8040.0 /    21600.0
iteration:      135 /      360 -- time =     8100.0 /    21600.0
iteration:      136 /      360 -- time =     8160.0 /    21600.0
iteration:      137 /      360 -- time =     8220.0 /    21600.0
iteration:      138 /      360 -- time =     8280.0 /    21600.0
iteration:      139 /      360 -- time =     8340.0 /    21600.0
iteration:      140 /      360 -- time =     8400.0 /    21600.0
iteration:      141 /      360 -- time =     8460.0 /    21600.0
iteration:      142 /      360 -- time =     8520.0 /    21600.0
iteration:      143 /      360 -- time =     8580.0 /    21600.0
iteration:      144 /      360 -- time =     8640.0 /    21600.0
iteration:      145 /      360 -- time =     8700.0 /    21600.0
iteration:      146 /      360 -- time =     8760.0 /    21600.0
iteration:      147 /      360 -- time =     8820.0 /    21600.0
iteration:      148 /      360 -- time =     8880.0 /    21600.0
iteration:      149 /      360 -- time =     8940.0 /    21600.0
iteration:      150 /      360 -- time =     9000.0 /    21600.0
iteration:      151 /      360 -- time =     9060.0 /    21600.0
iteration:      152 /      360 -- time =     9120.0 /    21600.0
iteration:      153 /      360 -- time =     9180.0 /    21600.0
iteration:      154 /      360 -- time =     9240.0 /    21600.0
iteration:      155 /      360 -- time =     9300.0 /    21600.0
iteration:      156 /      360 -- time =     9360.0 /    21600.0
iteration:      157 /      360 -- time =     9420.0 /    21600.0
iteration:      158 /      360 -- time =     9480.0 /    21600.0
iteration:      159 /      360 -- time =     9540.0 /    21600.0
iteration:      160 /      360 -- time =     9600.0 /    21600.0
iteration:      161 /      360 -- time =     9660.0 /    21600.0
iteration:      162 /      360 -- time =     9720.0 /    21600.0
iteration:      163 /      360 -- time =     9780.0 /    21600.0
iteration:      164 /      360 -- time =     9840.0 /    21600.0
iteration:      165 /      360 -- time =     9900.0 /    21600.0
iteration:      166 /      360 -- time =     9960.0 /    21600.0
iteration:      167 /      360 -- time =    10020.0 /    21600.0
iteration:      168 /      360 -- time =    10080.0 /    21600.0
iteration:      169 /      360 -- time =    10140.0 /    21600.0
iteration:      170 /      360 -- time =    10200.0 /    21600.0
iteration:      171 /      360 -- time =    10260.0 /    21600.0
iteration:      172 /      360 -- time =    10320.0 /    21600.0
iteration:      173 /      360 -- time =    10380.0 /    21600.0
iteration:      174 /      360 -- time =    10440.0 /    21600.0
iteration:      175 /      360 -- time =    10500.0 /    21600.0
iteration:      176 /      360 -- time =    10560.0 /    21600.0
iteration:      177 /      360 -- time =    10620.0 /    21600.0
iteration:      178 /      360 -- time =    10680.0 /    21600.0
iteration:      179 /      360 -- time =    10740.0 /    21600.0
iteration:      180 /      360 -- time =    10800.0 /    21600.0
iteration:      181 /      360 -- time =    10860.0 /    21600.0
iteration:      182 /      360 -- time =    10920.0 /    21600.0
iteration:      183 /      360 -- time =    10980.0 /    21600.0
iteration:      184 /      360 -- time =    11040.0 /    21600.0
iteration:      185 /      360 -- time =    11100.0 /    21600.0
iteration:      186 /      360 -- time =    11160.0 /    21600.0
iteration:      187 /      360 -- time =    11220.0 /    21600.0
iteration:      188 /      360 -- time =    11280.0 /    21600.0
iteration:      189 /      360 -- time =    11340.0 /    21600.0
iteration:      190 /      360 -- time =    11400.0 /    21600.0
iteration:      191 /      360 -- time =    11460.0 /    21600.0
iteration:      192 /      360 -- time =    11520.0 /    21600.0
iteration:      193 /      360 -- time =    11580.0 /    21600.0
iteration:      194 /      360 -- time =    11640.0 /    21600.0
iteration:      195 /      360 -- time =    11700.0 /    21600.0
iteration:      196 /      360 -- time =    11760.0 /    21600.0
iteration:      197 /      360 -- time =    11820.0 /    21600.0
iteration:      198 /      360 -- time =    11880.0 /    21600.0
iteration:      199 /      360 -- time =    11940.0 /    21600.0
iteration:      200 /      360 -- time =    12000.0 /    21600.0
iteration:      201 /      360 -- time =    12060.0 /    21600.0
iteration:      202 /      360 -- time =    12120.0 /    21600.0
iteration:      203 /      360 -- time =    12180.0 /    21600.0
iteration:      204 /      360 -- time =    12240.0 /    21600.0
iteration:      205 /      360 -- time =    12300.0 /    21600.0
iteration:      206 /      360 -- time =    12360.0 /    21600.0
iteration:      207 /      360 -- time =    12420.0 /    21600.0
iteration:      208 /      360 -- time =    12480.0 /    21600.0
iteration:      209 /      360 -- time =    12540.0 /    21600.0
iteration:      210 /      360 -- time =    12600.0 /    21600.0
iteration:      211 /      360 -- time =    12660.0 /    21600.0
iteration:      212 /      360 -- time =    12720.0 /    21600.0
iteration:      213 /      360 -- time =    12780.0 /    21600.0
iteration:      214 /      360 -- time =    12840.0 /    21600.0
iteration:      215 /      360 -- time =    12900.0 /    21600.0
iteration:      216 /      360 -- time =    12960.0 /    21600.0
iteration:      217 /      360 -- time =    13020.0 /    21600.0
iteration:      218 /      360 -- time =    13080.0 /    21600.0
iteration:      219 /      360 -- time =    13140.0 /    21600.0
iteration:      220 /      360 -- time =    13200.0 /    21600.0
iteration:      221 /      360 -- time =    13260.0 /    21600.0
iteration:      222 /      360 -- time =    13320.0 /    21600.0
iteration:      223 /      360 -- time =    13380.0 /    21600.0
iteration:      224 /      360 -- time =    13440.0 /    21600.0
iteration:      225 /      360 -- time =    13500.0 /    21600.0
iteration:      226 /      360 -- time =    13560.0 /    21600.0
iteration:      227 /      360 -- time =    13620.0 /    21600.0
iteration:      228 /      360 -- time =    13680.0 /    21600.0
iteration:      229 /      360 -- time =    13740.0 /    21600.0
iteration:      230 /      360 -- time =    13800.0 /    21600.0
iteration:      231 /      360 -- time =    13860.0 /    21600.0
iteration:      232 /      360 -- time =    13920.0 /    21600.0
iteration:      233 /      360 -- time =    13980.0 /    21600.0
iteration:      234 /      360 -- time =    14040.0 /    21600.0
iteration:      235 /      360 -- time =    14100.0 /    21600.0
iteration:      236 /      360 -- time =    14160.0 /    21600.0
iteration:      237 /      360 -- time =    14220.0 /    21600.0
iteration:      238 /      360 -- time =    14280.0 /    21600.0
iteration:      239 /      360 -- time =    14340.0 /    21600.0
iteration:      240 /      360 -- time =    14400.0 /    21600.0
iteration:      241 /      360 -- time =    14460.0 /    21600.0
iteration:      242 /      360 -- time =    14520.0 /    21600.0
iteration:      243 /      360 -- time =    14580.0 /    21600.0
iteration:      244 /      360 -- time =    14640.0 /    21600.0
iteration:      245 /      360 -- time =    14700.0 /    21600.0
iteration:      246 /      360 -- time =    14760.0 /    21600.0
iteration:      247 /      360 -- time =    14820.0 /    21600.0
iteration:      248 /      360 -- time =    14880.0 /    21600.0
iteration:      249 /      360 -- time =    14940.0 /    21600.0
iteration:      250 /      360 -- time =    15000.0 /    21600.0
iteration:      251 /      360 -- time =    15060.0 /    21600.0
iteration:      252 /      360 -- time =    15120.0 /    21600.0
iteration:      253 /      360 -- time =    15180.0 /    21600.0
iteration:      254 /      360 -- time =    15240.0 /    21600.0
iteration:      255 /      360 -- time =    15300.0 /    21600.0
iteration:      256 /      360 -- time =    15360.0 /    21600.0
iteration:      257 /      360 -- time =    15420.0 /    21600.0
iteration:      258 /      360 -- time =    15480.0 /    21600.0
iteration:      259 /      360 -- time =    15540.0 /    21600.0
iteration:      260 /      360 -- time =    15600.0 /    21600.0
iteration:      261 /      360 -- time =    15660.0 /    21600.0
iteration:      262 /      360 -- time =    15720.0 /    21600.0
iteration:      263 /      360 -- time =    15780.0 /    21600.0
iteration:      264 /      360 -- time =    15840.0 /    21600.0
iteration:      265 /      360 -- time =    15900.0 /    21600.0
iteration:      266 /      360 -- time =    15960.0 /    21600.0
iteration:      267 /      360 -- time =    16020.0 /    21600.0
iteration:      268 /      360 -- time =    16080.0 /    21600.0
iteration:      269 /      360 -- time =    16140.0 /    21600.0
iteration:      270 /      360 -- time =    16200.0 /    21600.0
iteration:      271 /      360 -- time =    16260.0 /    21600.0
iteration:      272 /      360 -- time =    16320.0 /    21600.0
iteration:      273 /      360 -- time =    16380.0 /    21600.0
iteration:      274 /      360 -- time =    16440.0 /    21600.0
iteration:      275 /      360 -- time =    16500.0 /    21600.0
iteration:      276 /      360 -- time =    16560.0 /    21600.0
iteration:      277 /      360 -- time =    16620.0 /    21600.0
iteration:      278 /      360 -- time =    16680.0 /    21600.0
iteration:      279 /      360 -- time =    16740.0 /    21600.0
iteration:      280 /      360 -- time =    16800.0 /    21600.0
iteration:      281 /      360 -- time =    16860.0 /    21600.0
iteration:      282 /      360 -- time =    16920.0 /    21600.0
iteration:      283 /      360 -- time =    16980.0 /    21600.0
iteration:      284 /      360 -- time =    17040.0 /    21600.0
iteration:      285 /      360 -- time =    17100.0 /    21600.0
iteration:      286 /      360 -- time =    17160.0 /    21600.0
iteration:      287 /      360 -- time =    17220.0 /    21600.0
iteration:      288 /      360 -- time =    17280.0 /    21600.0
iteration:      289 /      360 -- time =    17340.0 /    21600.0
iteration:      290 /      360 -- time =    17400.0 /    21600.0
iteration:      291 /      360 -- time =    17460.0 /    21600.0
iteration:      292 /      360 -- time =    17520.0 /    21600.0
iteration:      293 /      360 -- time =    17580.0 /    21600.0
iteration:      294 /      360 -- time =    17640.0 /    21600.0
iteration:      295 /      360 -- time =    17700.0 /    21600.0
iteration:      296 /      360 -- time =    17760.0 /    21600.0
iteration:      297 /      360 -- time =    17820.0 /    21600.0
iteration:      298 /      360 -- time =    17880.0 /    21600.0
iteration:      299 /      360 -- time =    17940.0 /    21600.0
iteration:      300 /      360 -- time =    18000.0 /    21600.0
iteration:      301 /      360 -- time =    18060.0 /    21600.0
iteration:      302 /      360 -- time =    18120.0 /    21600.0
iteration:      303 /      360 -- time =    18180.0 /    21600.0
iteration:      304 /      360 -- time =    18240.0 /    21600.0
iteration:      305 /      360 -- time =    18300.0 /    21600.0
iteration:      306 /      360 -- time =    18360.0 /    21600.0
iteration:      307 /      360 -- time =    18420.0 /    21600.0
iteration:      308 /      360 -- time =    18480.0 /    21600.0
iteration:      309 /      360 -- time =    18540.0 /    21600.0
iteration:      310 /      360 -- time =    18600.0 /    21600.0
iteration:      311 /      360 -- time =    18660.0 /    21600.0
iteration:      312 /      360 -- time =    18720.0 /    21600.0
iteration:      313 /      360 -- time =    18780.0 /    21600.0
iteration:      314 /      360 -- time =    18840.0 /    21600.0
iteration:      315 /      360 -- time =    18900.0 /    21600.0
iteration:      316 /      360 -- time =    18960.0 /    21600.0
iteration:      317 /      360 -- time =    19020.0 /    21600.0
iteration:      318 /      360 -- time =    19080.0 /    21600.0
iteration:      319 /      360 -- time =    19140.0 /    21600.0
iteration:      320 /      360 -- time =    19200.0 /    21600.0
iteration:      321 /      360 -- time =    19260.0 /    21600.0
iteration:      322 /      360 -- time =    19320.0 /    21600.0
iteration:      323 /      360 -- time =    19380.0 /    21600.0
iteration:      324 /      360 -- time =    19440.0 /    21600.0
iteration:      325 /      360 -- time =    19500.0 /    21600.0
iteration:      326 /      360 -- time =    19560.0 /    21600.0
iteration:      327 /      360 -- time =    19620.0 /    21600.0
iteration:      328 /      360 -- time =    19680.0 /    21600.0
iteration:      329 /      360 -- time =    19740.0 /    21600.0
iteration:      330 /      360 -- time =    19800.0 /    21600.0
iteration:      331 /      360 -- time =    19860.0 /    21600.0
iteration:      332 /      360 -- time =    19920.0 /    21600.0
iteration:      333 /      360 -- time =    19980.0 /    21600.0
iteration:      334 /      360 -- time =    20040.0 /    21600.0
iteration:      335 /      360 -- time =    20100.0 /    21600.0
iteration:      336 /      360 -- time =    20160.0 /    21600.0
iteration:      337 /      360 -- time =    20220.0 /    21600.0
iteration:      338 /      360 -- time =    20280.0 /    21600.0
iteration:      339 /      360 -- time =    20340.0 /    21600.0
iteration:      340 /      360 -- time =    20400.0 /    21600.0
iteration:      341 /      360 -- time =    20460.0 /    21600.0
iteration:      342 /      360 -- time =    20520.0 /    21600.0
iteration:      343 /      360 -- time =    20580.0 /    21600.0
iteration:      344 /      360 -- time =    20640.0 /    21600.0
iteration:      345 /      360 -- time =    20700.0 /    21600.0
iteration:      346 /      360 -- time =    20760.0 /    21600.0
iteration:      347 /      360 -- time =    20820.0 /    21600.0
iteration:      348 /      360 -- time =    20880.0 /    21600.0
iteration:      349 /      360 -- time =    20940.0 /    21600.0
iteration:      350 /      360 -- time =    21000.0 /    21600.0
iteration:      351 /      360 -- time =    21060.0 /    21600.0
iteration:      352 /      360 -- time =    21120.0 /    21600.0
iteration:      353 /      360 -- time =    21180.0 /    21600.0
iteration:      354 /      360 -- time =    21240.0 /    21600.0
iteration:      355 /      360 -- time =    21300.0 /    21600.0
iteration:      356 /      360 -- time =    21360.0 /    21600.0
iteration:      357 /      360 -- time =    21420.0 /    21600.0
iteration:      358 /      360 -- time =    21480.0 /    21600.0
iteration:      359 /      360 -- time =    21540.0 /    21600.0
iteration:      360 /      360 -- time =    21600.0 /    21600.0
CLUBB cleanup complete.
Completed 360 timesteps in 69.6s
--------------------------------------------------
run_scm.py total runtime: 72.45 s
--------------------------------------------------
[PASS] bs4_tout600: stats file: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout600/bomex_stats.nc
Running bs4_tout60_window5400_16200
+ /home/jenkins/workspace/clubb_stats_output_consistency/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/run_scm.py -stats /home/jenkins/workspace/clubb_stats_output_consistency/input/stats/standard_stats.in -output_dir /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout60_window5400_16200 -multicol C8/0.2:0.8/4 -batch_size 4 -tout 60 -jax=cpu -stats_tstart 5400 -stats_tend 16200 bomex
Creating a custom hypergrid of parameters
 - Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency/input/parameter_and_flag_configs/default/tunable_parameters.in'
 - Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout60_window5400_16200/bomex_multicol_params.in':
 - ngrdcol = 4
 - batch_size = 4
/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout60_window5400_16200/bomex.in
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout60_window5400_16200
 - using executable: /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/../clubb_jax/run_jax.py
=================== Running bomex ===================
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency/.venv-jax (Python 3.12)
  Accelerator: cpu
Warning: missing correlation input file(s): /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_cloud.in and/or /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_below.in
The default correlation arrays will be used.
nzm = 88 -- nzt = 87
--------------------------------------------------
&microphysics_setting
--------------------------------------------------
microphys_scheme = none
l_cloud_sed = False
sigma_g = 1.5
l_graupel = False
l_hail = False
l_seifert_beheng = False
l_predict_Nc = False
l_const_Nc_in_cloud = False
specify_aerosol = morrison_lognormal
l_subgrid_w = True
l_arctic_nucl = False
l_cloud_edge_activation = False
l_fix_pgam = False
l_in_cloud_Nc_diff = True
l_var_covar_src = False
l_upwind_diff_sed = False
lh_microphys_type = disabled
lh_num_samples = 2
lh_sequence_length = 1
lh_seed = 5489
l_fix_w_chi_eta_correlations = True
l_silhs_KK_convergence_adj_mean = False
importance_prob_thresh = 1e-08
host_dx = 1000000.0
host_dy = 1000000.0
hmp2_ip_on_hmm2_ip_slope%rr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%ri = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rs = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rg = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Nr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ng = 2.12e-05
hmp2_ip_on_hmm2_ip_intrcpt%rr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%ri = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rs = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rg = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Nr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ng = 0.54
Ncnp2_on_Ncnm2 = 1.0
C_evap = 0.86
r_0 = 2.5e-05
microphys_start_time = 0.0
Nc0_in_cloud = 100000000.0
ccnconst = 120.0
ccnexpnt = 0.4000000059604645
aer_rm1 = 1.1000000021965661e-08
aer_rm2 = 5.99999978589949e-08
aer_n1 = 125000000.0
aer_n2 = 65000000.0
aer_sig1 = 1.2000000476837158
aer_sig2 = 1.7000000476837158
pgam_fixed = 5.0
precip_frac_calc_type = 2
--------------------------------------------------
&SILHS_setting
--------------------------------------------------
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
iteration:        1 /      360 -- time =       60.0 /    21600.0
iteration:        2 /      360 -- time =      120.0 /    21600.0
iteration:        3 /      360 -- time =      180.0 /    21600.0
iteration:        4 /      360 -- time =      240.0 /    21600.0
iteration:        5 /      360 -- time =      300.0 /    21600.0
iteration:        6 /      360 -- time =      360.0 /    21600.0
iteration:        7 /      360 -- time =      420.0 /    21600.0
iteration:        8 /      360 -- time =      480.0 /    21600.0
iteration:        9 /      360 -- time =      540.0 /    21600.0
iteration:       10 /      360 -- time =      600.0 /    21600.0
iteration:       11 /      360 -- time =      660.0 /    21600.0
iteration:       12 /      360 -- time =      720.0 /    21600.0
iteration:       13 /      360 -- time =      780.0 /    21600.0
iteration:       14 /      360 -- time =      840.0 /    21600.0
iteration:       15 /      360 -- time =      900.0 /    21600.0
iteration:       16 /      360 -- time =      960.0 /    21600.0
iteration:       17 /      360 -- time =     1020.0 /    21600.0
iteration:       18 /      360 -- time =     1080.0 /    21600.0
iteration:       19 /      360 -- time =     1140.0 /    21600.0
iteration:       20 /      360 -- time =     1200.0 /    21600.0
iteration:       21 /      360 -- time =     1260.0 /    21600.0
iteration:       22 /      360 -- time =     1320.0 /    21600.0
iteration:       23 /      360 -- time =     1380.0 /    21600.0
iteration:       24 /      360 -- time =     1440.0 /    21600.0
iteration:       25 /      360 -- time =     1500.0 /    21600.0
iteration:       26 /      360 -- time =     1560.0 /    21600.0
iteration:       27 /      360 -- time =     1620.0 /    21600.0
iteration:       28 /      360 -- time =     1680.0 /    21600.0
iteration:       29 /      360 -- time =     1740.0 /    21600.0
iteration:       30 /      360 -- time =     1800.0 /    21600.0
iteration:       31 /      360 -- time =     1860.0 /    21600.0
iteration:       32 /      360 -- time =     1920.0 /    21600.0
iteration:       33 /      360 -- time =     1980.0 /    21600.0
iteration:       34 /      360 -- time =     2040.0 /    21600.0
iteration:       35 /      360 -- time =     2100.0 /    21600.0
iteration:       36 /      360 -- time =     2160.0 /    21600.0
iteration:       37 /      360 -- time =     2220.0 /    21600.0
iteration:       38 /      360 -- time =     2280.0 /    21600.0
iteration:       39 /      360 -- time =     2340.0 /    21600.0
iteration:       40 /      360 -- time =     2400.0 /    21600.0
iteration:       41 /      360 -- time =     2460.0 /    21600.0
iteration:       42 /      360 -- time =     2520.0 /    21600.0
iteration:       43 /      360 -- time =     2580.0 /    21600.0
iteration:       44 /      360 -- time =     2640.0 /    21600.0
iteration:       45 /      360 -- time =     2700.0 /    21600.0
iteration:       46 /      360 -- time =     2760.0 /    21600.0
iteration:       47 /      360 -- time =     2820.0 /    21600.0
iteration:       48 /      360 -- time =     2880.0 /    21600.0
iteration:       49 /      360 -- time =     2940.0 /    21600.0
iteration:       50 /      360 -- time =     3000.0 /    21600.0
iteration:       51 /      360 -- time =     3060.0 /    21600.0
iteration:       52 /      360 -- time =     3120.0 /    21600.0
iteration:       53 /      360 -- time =     3180.0 /    21600.0
iteration:       54 /      360 -- time =     3240.0 /    21600.0
iteration:       55 /      360 -- time =     3300.0 /    21600.0
iteration:       56 /      360 -- time =     3360.0 /    21600.0
iteration:       57 /      360 -- time =     3420.0 /    21600.0
iteration:       58 /      360 -- time =     3480.0 /    21600.0
iteration:       59 /      360 -- time =     3540.0 /    21600.0
iteration:       60 /      360 -- time =     3600.0 /    21600.0
iteration:       61 /      360 -- time =     3660.0 /    21600.0
iteration:       62 /      360 -- time =     3720.0 /    21600.0
iteration:       63 /      360 -- time =     3780.0 /    21600.0
iteration:       64 /      360 -- time =     3840.0 /    21600.0
iteration:       65 /      360 -- time =     3900.0 /    21600.0
iteration:       66 /      360 -- time =     3960.0 /    21600.0
iteration:       67 /      360 -- time =     4020.0 /    21600.0
iteration:       68 /      360 -- time =     4080.0 /    21600.0
iteration:       69 /      360 -- time =     4140.0 /    21600.0
iteration:       70 /      360 -- time =     4200.0 /    21600.0
iteration:       71 /      360 -- time =     4260.0 /    21600.0
iteration:       72 /      360 -- time =     4320.0 /    21600.0
iteration:       73 /      360 -- time =     4380.0 /    21600.0
iteration:       74 /      360 -- time =     4440.0 /    21600.0
iteration:       75 /      360 -- time =     4500.0 /    21600.0
iteration:       76 /      360 -- time =     4560.0 /    21600.0
iteration:       77 /      360 -- time =     4620.0 /    21600.0
iteration:       78 /      360 -- time =     4680.0 /    21600.0
iteration:       79 /      360 -- time =     4740.0 /    21600.0
iteration:       80 /      360 -- time =     4800.0 /    21600.0
iteration:       81 /      360 -- time =     4860.0 /    21600.0
iteration:       82 /      360 -- time =     4920.0 /    21600.0
iteration:       83 /      360 -- time =     4980.0 /    21600.0
iteration:       84 /      360 -- time =     5040.0 /    21600.0
iteration:       85 /      360 -- time =     5100.0 /    21600.0
iteration:       86 /      360 -- time =     5160.0 /    21600.0
iteration:       87 /      360 -- time =     5220.0 /    21600.0
iteration:       88 /      360 -- time =     5280.0 /    21600.0
iteration:       89 /      360 -- time =     5340.0 /    21600.0
iteration:       90 /      360 -- time =     5400.0 /    21600.0
iteration:       91 /      360 -- time =     5460.0 /    21600.0
iteration:       92 /      360 -- time =     5520.0 /    21600.0
iteration:       93 /      360 -- time =     5580.0 /    21600.0
iteration:       94 /      360 -- time =     5640.0 /    21600.0
iteration:       95 /      360 -- time =     5700.0 /    21600.0
iteration:       96 /      360 -- time =     5760.0 /    21600.0
iteration:       97 /      360 -- time =     5820.0 /    21600.0
iteration:       98 /      360 -- time =     5880.0 /    21600.0
iteration:       99 /      360 -- time =     5940.0 /    21600.0
iteration:      100 /      360 -- time =     6000.0 /    21600.0
iteration:      101 /      360 -- time =     6060.0 /    21600.0
iteration:      102 /      360 -- time =     6120.0 /    21600.0
iteration:      103 /      360 -- time =     6180.0 /    21600.0
iteration:      104 /      360 -- time =     6240.0 /    21600.0
iteration:      105 /      360 -- time =     6300.0 /    21600.0
iteration:      106 /      360 -- time =     6360.0 /    21600.0
iteration:      107 /      360 -- time =     6420.0 /    21600.0
iteration:      108 /      360 -- time =     6480.0 /    21600.0
iteration:      109 /      360 -- time =     6540.0 /    21600.0
iteration:      110 /      360 -- time =     6600.0 /    21600.0
iteration:      111 /      360 -- time =     6660.0 /    21600.0
iteration:      112 /      360 -- time =     6720.0 /    21600.0
iteration:      113 /      360 -- time =     6780.0 /    21600.0
iteration:      114 /      360 -- time =     6840.0 /    21600.0
iteration:      115 /      360 -- time =     6900.0 /    21600.0
iteration:      116 /      360 -- time =     6960.0 /    21600.0
iteration:      117 /      360 -- time =     7020.0 /    21600.0
iteration:      118 /      360 -- time =     7080.0 /    21600.0
iteration:      119 /      360 -- time =     7140.0 /    21600.0
iteration:      120 /      360 -- time =     7200.0 /    21600.0
iteration:      121 /      360 -- time =     7260.0 /    21600.0
iteration:      122 /      360 -- time =     7320.0 /    21600.0
iteration:      123 /      360 -- time =     7380.0 /    21600.0
iteration:      124 /      360 -- time =     7440.0 /    21600.0
iteration:      125 /      360 -- time =     7500.0 /    21600.0
iteration:      126 /      360 -- time =     7560.0 /    21600.0
iteration:      127 /      360 -- time =     7620.0 /    21600.0
iteration:      128 /      360 -- time =     7680.0 /    21600.0
iteration:      129 /      360 -- time =     7740.0 /    21600.0
iteration:      130 /      360 -- time =     7800.0 /    21600.0
iteration:      131 /      360 -- time =     7860.0 /    21600.0
iteration:      132 /      360 -- time =     7920.0 /    21600.0
iteration:      133 /      360 -- time =     7980.0 /    21600.0
iteration:      134 /      360 -- time =     8040.0 /    21600.0
iteration:      135 /      360 -- time =     8100.0 /    21600.0
iteration:      136 /      360 -- time =     8160.0 /    21600.0
iteration:      137 /      360 -- time =     8220.0 /    21600.0
iteration:      138 /      360 -- time =     8280.0 /    21600.0
iteration:      139 /      360 -- time =     8340.0 /    21600.0
iteration:      140 /      360 -- time =     8400.0 /    21600.0
iteration:      141 /      360 -- time =     8460.0 /    21600.0
iteration:      142 /      360 -- time =     8520.0 /    21600.0
iteration:      143 /      360 -- time =     8580.0 /    21600.0
iteration:      144 /      360 -- time =     8640.0 /    21600.0
iteration:      145 /      360 -- time =     8700.0 /    21600.0
iteration:      146 /      360 -- time =     8760.0 /    21600.0
iteration:      147 /      360 -- time =     8820.0 /    21600.0
iteration:      148 /      360 -- time =     8880.0 /    21600.0
iteration:      149 /      360 -- time =     8940.0 /    21600.0
iteration:      150 /      360 -- time =     9000.0 /    21600.0
iteration:      151 /      360 -- time =     9060.0 /    21600.0
iteration:      152 /      360 -- time =     9120.0 /    21600.0
iteration:      153 /      360 -- time =     9180.0 /    21600.0
iteration:      154 /      360 -- time =     9240.0 /    21600.0
iteration:      155 /      360 -- time =     9300.0 /    21600.0
iteration:      156 /      360 -- time =     9360.0 /    21600.0
iteration:      157 /      360 -- time =     9420.0 /    21600.0
iteration:      158 /      360 -- time =     9480.0 /    21600.0
iteration:      159 /      360 -- time =     9540.0 /    21600.0
iteration:      160 /      360 -- time =     9600.0 /    21600.0
iteration:      161 /      360 -- time =     9660.0 /    21600.0
iteration:      162 /      360 -- time =     9720.0 /    21600.0
iteration:      163 /      360 -- time =     9780.0 /    21600.0
iteration:      164 /      360 -- time =     9840.0 /    21600.0
iteration:      165 /      360 -- time =     9900.0 /    21600.0
iteration:      166 /      360 -- time =     9960.0 /    21600.0
iteration:      167 /      360 -- time =    10020.0 /    21600.0
iteration:      168 /      360 -- time =    10080.0 /    21600.0
iteration:      169 /      360 -- time =    10140.0 /    21600.0
iteration:      170 /      360 -- time =    10200.0 /    21600.0
iteration:      171 /      360 -- time =    10260.0 /    21600.0
iteration:      172 /      360 -- time =    10320.0 /    21600.0
iteration:      173 /      360 -- time =    10380.0 /    21600.0
iteration:      174 /      360 -- time =    10440.0 /    21600.0
iteration:      175 /      360 -- time =    10500.0 /    21600.0
iteration:      176 /      360 -- time =    10560.0 /    21600.0
iteration:      177 /      360 -- time =    10620.0 /    21600.0
iteration:      178 /      360 -- time =    10680.0 /    21600.0
iteration:      179 /      360 -- time =    10740.0 /    21600.0
iteration:      180 /      360 -- time =    10800.0 /    21600.0
iteration:      181 /      360 -- time =    10860.0 /    21600.0
iteration:      182 /      360 -- time =    10920.0 /    21600.0
iteration:      183 /      360 -- time =    10980.0 /    21600.0
iteration:      184 /      360 -- time =    11040.0 /    21600.0
iteration:      185 /      360 -- time =    11100.0 /    21600.0
iteration:      186 /      360 -- time =    11160.0 /    21600.0
iteration:      187 /      360 -- time =    11220.0 /    21600.0
iteration:      188 /      360 -- time =    11280.0 /    21600.0
iteration:      189 /      360 -- time =    11340.0 /    21600.0
iteration:      190 /      360 -- time =    11400.0 /    21600.0
iteration:      191 /      360 -- time =    11460.0 /    21600.0
iteration:      192 /      360 -- time =    11520.0 /    21600.0
iteration:      193 /      360 -- time =    11580.0 /    21600.0
iteration:      194 /      360 -- time =    11640.0 /    21600.0
iteration:      195 /      360 -- time =    11700.0 /    21600.0
iteration:      196 /      360 -- time =    11760.0 /    21600.0
iteration:      197 /      360 -- time =    11820.0 /    21600.0
iteration:      198 /      360 -- time =    11880.0 /    21600.0
iteration:      199 /      360 -- time =    11940.0 /    21600.0
iteration:      200 /      360 -- time =    12000.0 /    21600.0
iteration:      201 /      360 -- time =    12060.0 /    21600.0
iteration:      202 /      360 -- time =    12120.0 /    21600.0
iteration:      203 /      360 -- time =    12180.0 /    21600.0
iteration:      204 /      360 -- time =    12240.0 /    21600.0
iteration:      205 /      360 -- time =    12300.0 /    21600.0
iteration:      206 /      360 -- time =    12360.0 /    21600.0
iteration:      207 /      360 -- time =    12420.0 /    21600.0
iteration:      208 /      360 -- time =    12480.0 /    21600.0
iteration:      209 /      360 -- time =    12540.0 /    21600.0
iteration:      210 /      360 -- time =    12600.0 /    21600.0
iteration:      211 /      360 -- time =    12660.0 /    21600.0
iteration:      212 /      360 -- time =    12720.0 /    21600.0
iteration:      213 /      360 -- time =    12780.0 /    21600.0
iteration:      214 /      360 -- time =    12840.0 /    21600.0
iteration:      215 /      360 -- time =    12900.0 /    21600.0
iteration:      216 /      360 -- time =    12960.0 /    21600.0
iteration:      217 /      360 -- time =    13020.0 /    21600.0
iteration:      218 /      360 -- time =    13080.0 /    21600.0
iteration:      219 /      360 -- time =    13140.0 /    21600.0
iteration:      220 /      360 -- time =    13200.0 /    21600.0
iteration:      221 /      360 -- time =    13260.0 /    21600.0
iteration:      222 /      360 -- time =    13320.0 /    21600.0
iteration:      223 /      360 -- time =    13380.0 /    21600.0
iteration:      224 /      360 -- time =    13440.0 /    21600.0
iteration:      225 /      360 -- time =    13500.0 /    21600.0
iteration:      226 /      360 -- time =    13560.0 /    21600.0
iteration:      227 /      360 -- time =    13620.0 /    21600.0
iteration:      228 /      360 -- time =    13680.0 /    21600.0
iteration:      229 /      360 -- time =    13740.0 /    21600.0
iteration:      230 /      360 -- time =    13800.0 /    21600.0
iteration:      231 /      360 -- time =    13860.0 /    21600.0
iteration:      232 /      360 -- time =    13920.0 /    21600.0
iteration:      233 /      360 -- time =    13980.0 /    21600.0
iteration:      234 /      360 -- time =    14040.0 /    21600.0
iteration:      235 /      360 -- time =    14100.0 /    21600.0
iteration:      236 /      360 -- time =    14160.0 /    21600.0
iteration:      237 /      360 -- time =    14220.0 /    21600.0
iteration:      238 /      360 -- time =    14280.0 /    21600.0
iteration:      239 /      360 -- time =    14340.0 /    21600.0
iteration:      240 /      360 -- time =    14400.0 /    21600.0
iteration:      241 /      360 -- time =    14460.0 /    21600.0
iteration:      242 /      360 -- time =    14520.0 /    21600.0
iteration:      243 /      360 -- time =    14580.0 /    21600.0
iteration:      244 /      360 -- time =    14640.0 /    21600.0
iteration:      245 /      360 -- time =    14700.0 /    21600.0
iteration:      246 /      360 -- time =    14760.0 /    21600.0
iteration:      247 /      360 -- time =    14820.0 /    21600.0
iteration:      248 /      360 -- time =    14880.0 /    21600.0
iteration:      249 /      360 -- time =    14940.0 /    21600.0
iteration:      250 /      360 -- time =    15000.0 /    21600.0
iteration:      251 /      360 -- time =    15060.0 /    21600.0
iteration:      252 /      360 -- time =    15120.0 /    21600.0
iteration:      253 /      360 -- time =    15180.0 /    21600.0
iteration:      254 /      360 -- time =    15240.0 /    21600.0
iteration:      255 /      360 -- time =    15300.0 /    21600.0
iteration:      256 /      360 -- time =    15360.0 /    21600.0
iteration:      257 /      360 -- time =    15420.0 /    21600.0
iteration:      258 /      360 -- time =    15480.0 /    21600.0
iteration:      259 /      360 -- time =    15540.0 /    21600.0
iteration:      260 /      360 -- time =    15600.0 /    21600.0
iteration:      261 /      360 -- time =    15660.0 /    21600.0
iteration:      262 /      360 -- time =    15720.0 /    21600.0
iteration:      263 /      360 -- time =    15780.0 /    21600.0
iteration:      264 /      360 -- time =    15840.0 /    21600.0
iteration:      265 /      360 -- time =    15900.0 /    21600.0
iteration:      266 /      360 -- time =    15960.0 /    21600.0
iteration:      267 /      360 -- time =    16020.0 /    21600.0
iteration:      268 /      360 -- time =    16080.0 /    21600.0
iteration:      269 /      360 -- time =    16140.0 /    21600.0
iteration:      270 /      360 -- time =    16200.0 /    21600.0
iteration:      271 /      360 -- time =    16260.0 /    21600.0
iteration:      272 /      360 -- time =    16320.0 /    21600.0
iteration:      273 /      360 -- time =    16380.0 /    21600.0
iteration:      274 /      360 -- time =    16440.0 /    21600.0
iteration:      275 /      360 -- time =    16500.0 /    21600.0
iteration:      276 /      360 -- time =    16560.0 /    21600.0
iteration:      277 /      360 -- time =    16620.0 /    21600.0
iteration:      278 /      360 -- time =    16680.0 /    21600.0
iteration:      279 /      360 -- time =    16740.0 /    21600.0
iteration:      280 /      360 -- time =    16800.0 /    21600.0
iteration:      281 /      360 -- time =    16860.0 /    21600.0
iteration:      282 /      360 -- time =    16920.0 /    21600.0
iteration:      283 /      360 -- time =    16980.0 /    21600.0
iteration:      284 /      360 -- time =    17040.0 /    21600.0
iteration:      285 /      360 -- time =    17100.0 /    21600.0
iteration:      286 /      360 -- time =    17160.0 /    21600.0
iteration:      287 /      360 -- time =    17220.0 /    21600.0
iteration:      288 /      360 -- time =    17280.0 /    21600.0
iteration:      289 /      360 -- time =    17340.0 /    21600.0
iteration:      290 /      360 -- time =    17400.0 /    21600.0
iteration:      291 /      360 -- time =    17460.0 /    21600.0
iteration:      292 /      360 -- time =    17520.0 /    21600.0
iteration:      293 /      360 -- time =    17580.0 /    21600.0
iteration:      294 /      360 -- time =    17640.0 /    21600.0
iteration:      295 /      360 -- time =    17700.0 /    21600.0
iteration:      296 /      360 -- time =    17760.0 /    21600.0
iteration:      297 /      360 -- time =    17820.0 /    21600.0
iteration:      298 /      360 -- time =    17880.0 /    21600.0
iteration:      299 /      360 -- time =    17940.0 /    21600.0
iteration:      300 /      360 -- time =    18000.0 /    21600.0
iteration:      301 /      360 -- time =    18060.0 /    21600.0
iteration:      302 /      360 -- time =    18120.0 /    21600.0
iteration:      303 /      360 -- time =    18180.0 /    21600.0
iteration:      304 /      360 -- time =    18240.0 /    21600.0
iteration:      305 /      360 -- time =    18300.0 /    21600.0
iteration:      306 /      360 -- time =    18360.0 /    21600.0
iteration:      307 /      360 -- time =    18420.0 /    21600.0
iteration:      308 /      360 -- time =    18480.0 /    21600.0
iteration:      309 /      360 -- time =    18540.0 /    21600.0
iteration:      310 /      360 -- time =    18600.0 /    21600.0
iteration:      311 /      360 -- time =    18660.0 /    21600.0
iteration:      312 /      360 -- time =    18720.0 /    21600.0
iteration:      313 /      360 -- time =    18780.0 /    21600.0
iteration:      314 /      360 -- time =    18840.0 /    21600.0
iteration:      315 /      360 -- time =    18900.0 /    21600.0
iteration:      316 /      360 -- time =    18960.0 /    21600.0
iteration:      317 /      360 -- time =    19020.0 /    21600.0
iteration:      318 /      360 -- time =    19080.0 /    21600.0
iteration:      319 /      360 -- time =    19140.0 /    21600.0
iteration:      320 /      360 -- time =    19200.0 /    21600.0
iteration:      321 /      360 -- time =    19260.0 /    21600.0
iteration:      322 /      360 -- time =    19320.0 /    21600.0
iteration:      323 /      360 -- time =    19380.0 /    21600.0
iteration:      324 /      360 -- time =    19440.0 /    21600.0
iteration:      325 /      360 -- time =    19500.0 /    21600.0
iteration:      326 /      360 -- time =    19560.0 /    21600.0
iteration:      327 /      360 -- time =    19620.0 /    21600.0
iteration:      328 /      360 -- time =    19680.0 /    21600.0
iteration:      329 /      360 -- time =    19740.0 /    21600.0
iteration:      330 /      360 -- time =    19800.0 /    21600.0
iteration:      331 /      360 -- time =    19860.0 /    21600.0
iteration:      332 /      360 -- time =    19920.0 /    21600.0
iteration:      333 /      360 -- time =    19980.0 /    21600.0
iteration:      334 /      360 -- time =    20040.0 /    21600.0
iteration:      335 /      360 -- time =    20100.0 /    21600.0
iteration:      336 /      360 -- time =    20160.0 /    21600.0
iteration:      337 /      360 -- time =    20220.0 /    21600.0
iteration:      338 /      360 -- time =    20280.0 /    21600.0
iteration:      339 /      360 -- time =    20340.0 /    21600.0
iteration:      340 /      360 -- time =    20400.0 /    21600.0
iteration:      341 /      360 -- time =    20460.0 /    21600.0
iteration:      342 /      360 -- time =    20520.0 /    21600.0
iteration:      343 /      360 -- time =    20580.0 /    21600.0
iteration:      344 /      360 -- time =    20640.0 /    21600.0
iteration:      345 /      360 -- time =    20700.0 /    21600.0
iteration:      346 /      360 -- time =    20760.0 /    21600.0
iteration:      347 /      360 -- time =    20820.0 /    21600.0
iteration:      348 /      360 -- time =    20880.0 /    21600.0
iteration:      349 /      360 -- time =    20940.0 /    21600.0
iteration:      350 /      360 -- time =    21000.0 /    21600.0
iteration:      351 /      360 -- time =    21060.0 /    21600.0
iteration:      352 /      360 -- time =    21120.0 /    21600.0
iteration:      353 /      360 -- time =    21180.0 /    21600.0
iteration:      354 /      360 -- time =    21240.0 /    21600.0
iteration:      355 /      360 -- time =    21300.0 /    21600.0
iteration:      356 /      360 -- time =    21360.0 /    21600.0
iteration:      357 /      360 -- time =    21420.0 /    21600.0
iteration:      358 /      360 -- time =    21480.0 /    21600.0
iteration:      359 /      360 -- time =    21540.0 /    21600.0
iteration:      360 /      360 -- time =    21600.0 /    21600.0
CLUBB cleanup complete.
Completed 360 timesteps in 113.9s
--------------------------------------------------
run_scm.py total runtime: 116.67 s
--------------------------------------------------
[PASS] bs4_tout60_window5400_16200: stats file: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout60_window5400_16200/bomex_stats.nc
Running bs4_tout300_window5400_16200
+ /home/jenkins/workspace/clubb_stats_output_consistency/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/run_scm.py -stats /home/jenkins/workspace/clubb_stats_output_consistency/input/stats/standard_stats.in -output_dir /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300_window5400_16200 -multicol C8/0.2:0.8/4 -batch_size 4 -tout 300 -jax=cpu -stats_tstart 5400 -stats_tend 16200 bomex
Creating a custom hypergrid of parameters
 - Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency/input/parameter_and_flag_configs/default/tunable_parameters.in'
 - Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300_window5400_16200/bomex_multicol_params.in':
 - ngrdcol = 4
 - batch_size = 4
/home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300_window5400_16200/bomex.in
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300_window5400_16200
 - using executable: /home/jenkins/workspace/clubb_stats_output_consistency/run_scripts/../clubb_jax/run_jax.py
=================== Running bomex ===================
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency/.venv-jax (Python 3.12)
  Accelerator: cpu
Warning: missing correlation input file(s): /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_cloud.in and/or /home/jenkins/workspace/clubb_stats_output_consistency/input/case_setups/bomex_corr_array_below.in
The default correlation arrays will be used.
nzm = 88 -- nzt = 87
--------------------------------------------------
&microphysics_setting
--------------------------------------------------
microphys_scheme = none
l_cloud_sed = False
sigma_g = 1.5
l_graupel = False
l_hail = False
l_seifert_beheng = False
l_predict_Nc = False
l_const_Nc_in_cloud = False
specify_aerosol = morrison_lognormal
l_subgrid_w = True
l_arctic_nucl = False
l_cloud_edge_activation = False
l_fix_pgam = False
l_in_cloud_Nc_diff = True
l_var_covar_src = False
l_upwind_diff_sed = False
lh_microphys_type = disabled
lh_num_samples = 2
lh_sequence_length = 1
lh_seed = 5489
l_fix_w_chi_eta_correlations = True
l_silhs_KK_convergence_adj_mean = False
importance_prob_thresh = 1e-08
host_dx = 1000000.0
host_dy = 1000000.0
hmp2_ip_on_hmm2_ip_slope%rr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%ri = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rs = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%rg = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Nr = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ni = 2.12e-05
hmp2_ip_on_hmm2_ip_slope%Ng = 2.12e-05
hmp2_ip_on_hmm2_ip_intrcpt%rr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%ri = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rs = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%rg = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Nr = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ni = 0.54
hmp2_ip_on_hmm2_ip_intrcpt%Ng = 0.54
Ncnp2_on_Ncnm2 = 1.0
C_evap = 0.86
r_0 = 2.5e-05
microphys_start_time = 0.0
Nc0_in_cloud = 100000000.0
ccnconst = 120.0
ccnexpnt = 0.4000000059604645
aer_rm1 = 1.1000000021965661e-08
aer_rm2 = 5.99999978589949e-08
aer_n1 = 125000000.0
aer_n2 = 65000000.0
aer_sig1 = 1.2000000476837158
aer_sig2 = 1.7000000476837158
pgam_fixed = 5.0
precip_frac_calc_type = 2
--------------------------------------------------
&SILHS_setting
--------------------------------------------------
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
iteration:        1 /      360 -- time =       60.0 /    21600.0
iteration:        2 /      360 -- time =      120.0 /    21600.0
iteration:        3 /      360 -- time =      180.0 /    21600.0
iteration:        4 /      360 -- time =      240.0 /    21600.0
iteration:        5 /      360 -- time =      300.0 /    21600.0
iteration:        6 /      360 -- time =      360.0 /    21600.0
iteration:        7 /      360 -- time =      420.0 /    21600.0
iteration:        8 /      360 -- time =      480.0 /    21600.0
iteration:        9 /      360 -- time =      540.0 /    21600.0
iteration:       10 /      360 -- time =      600.0 /    21600.0
iteration:       11 /      360 -- time =      660.0 /    21600.0
iteration:       12 /      360 -- time =      720.0 /    21600.0
iteration:       13 /      360 -- time =      780.0 /    21600.0
iteration:       14 /      360 -- time =      840.0 /    21600.0
iteration:       15 /      360 -- time =      900.0 /    21600.0
iteration:       16 /      360 -- time =      960.0 /    21600.0
iteration:       17 /      360 -- time =     1020.0 /    21600.0
iteration:       18 /      360 -- time =     1080.0 /    21600.0
iteration:       19 /      360 -- time =     1140.0 /    21600.0
iteration:       20 /      360 -- time =     1200.0 /    21600.0
iteration:       21 /      360 -- time =     1260.0 /    21600.0
iteration:       22 /      360 -- time =     1320.0 /    21600.0
iteration:       23 /      360 -- time =     1380.0 /    21600.0
iteration:       24 /      360 -- time =     1440.0 /    21600.0
iteration:       25 /      360 -- time =     1500.0 /    21600.0
iteration:       26 /      360 -- time =     1560.0 /    21600.0
iteration:       27 /      360 -- time =     1620.0 /    21600.0
iteration:       28 /      360 -- time =     1680.0 /    21600.0
iteration:       29 /      360 -- time =     1740.0 /    21600.0
iteration:       30 /      360 -- time =     1800.0 /    21600.0
iteration:       31 /      360 -- time =     1860.0 /    21600.0
iteration:       32 /      360 -- time =     1920.0 /    21600.0
iteration:       33 /      360 -- time =     1980.0 /    21600.0
iteration:       34 /      360 -- time =     2040.0 /    21600.0
iteration:       35 /      360 -- time =     2100.0 /    21600.0
iteration:       36 /      360 -- time =     2160.0 /    21600.0
iteration:       37 /      360 -- time =     2220.0 /    21600.0
iteration:       38 /      360 -- time =     2280.0 /    21600.0
iteration:       39 /      360 -- time =     2340.0 /    21600.0
iteration:       40 /      360 -- time =     2400.0 /    21600.0
iteration:       41 /      360 -- time =     2460.0 /    21600.0
iteration:       42 /      360 -- time =     2520.0 /    21600.0
iteration:       43 /      360 -- time =     2580.0 /    21600.0
iteration:       44 /      360 -- time =     2640.0 /    21600.0
iteration:       45 /      360 -- time =     2700.0 /    21600.0
iteration:       46 /      360 -- time =     2760.0 /    21600.0
iteration:       47 /      360 -- time =     2820.0 /    21600.0
iteration:       48 /      360 -- time =     2880.0 /    21600.0
iteration:       49 /      360 -- time =     2940.0 /    21600.0
iteration:       50 /      360 -- time =     3000.0 /    21600.0
iteration:       51 /      360 -- time =     3060.0 /    21600.0
iteration:       52 /      360 -- time =     3120.0 /    21600.0
iteration:       53 /      360 -- time =     3180.0 /    21600.0
iteration:       54 /      360 -- time =     3240.0 /    21600.0
iteration:       55 /      360 -- time =     3300.0 /    21600.0
iteration:       56 /      360 -- time =     3360.0 /    21600.0
iteration:       57 /      360 -- time =     3420.0 /    21600.0
iteration:       58 /      360 -- time =     3480.0 /    21600.0
iteration:       59 /      360 -- time =     3540.0 /    21600.0
iteration:       60 /      360 -- time =     3600.0 /    21600.0
iteration:       61 /      360 -- time =     3660.0 /    21600.0
iteration:       62 /      360 -- time =     3720.0 /    21600.0
iteration:       63 /      360 -- time =     3780.0 /    21600.0
iteration:       64 /      360 -- time =     3840.0 /    21600.0
iteration:       65 /      360 -- time =     3900.0 /    21600.0
iteration:       66 /      360 -- time =     3960.0 /    21600.0
iteration:       67 /      360 -- time =     4020.0 /    21600.0
iteration:       68 /      360 -- time =     4080.0 /    21600.0
iteration:       69 /      360 -- time =     4140.0 /    21600.0
iteration:       70 /      360 -- time =     4200.0 /    21600.0
iteration:       71 /      360 -- time =     4260.0 /    21600.0
iteration:       72 /      360 -- time =     4320.0 /    21600.0
iteration:       73 /      360 -- time =     4380.0 /    21600.0
iteration:       74 /      360 -- time =     4440.0 /    21600.0
iteration:       75 /      360 -- time =     4500.0 /    21600.0
iteration:       76 /      360 -- time =     4560.0 /    21600.0
iteration:       77 /      360 -- time =     4620.0 /    21600.0
iteration:       78 /      360 -- time =     4680.0 /    21600.0
iteration:       79 /      360 -- time =     4740.0 /    21600.0
iteration:       80 /      360 -- time =     4800.0 /    21600.0
iteration:       81 /      360 -- time =     4860.0 /    21600.0
iteration:       82 /      360 -- time =     4920.0 /    21600.0
iteration:       83 /      360 -- time =     4980.0 /    21600.0
iteration:       84 /      360 -- time =     5040.0 /    21600.0
iteration:       85 /      360 -- time =     5100.0 /    21600.0
iteration:       86 /      360 -- time =     5160.0 /    21600.0
iteration:       87 /      360 -- time =     5220.0 /    21600.0
iteration:       88 /      360 -- time =     5280.0 /    21600.0
iteration:       89 /      360 -- time =     5340.0 /    21600.0
iteration:       90 /      360 -- time =     5400.0 /    21600.0
iteration:       91 /      360 -- time =     5460.0 /    21600.0
iteration:       92 /      360 -- time =     5520.0 /    21600.0
iteration:       93 /      360 -- time =     5580.0 /    21600.0
iteration:       94 /      360 -- time =     5640.0 /    21600.0
iteration:       95 /      360 -- time =     5700.0 /    21600.0
iteration:       96 /      360 -- time =     5760.0 /    21600.0
iteration:       97 /      360 -- time =     5820.0 /    21600.0
iteration:       98 /      360 -- time =     5880.0 /    21600.0
iteration:       99 /      360 -- time =     5940.0 /    21600.0
iteration:      100 /      360 -- time =     6000.0 /    21600.0
iteration:      101 /      360 -- time =     6060.0 /    21600.0
iteration:      102 /      360 -- time =     6120.0 /    21600.0
iteration:      103 /      360 -- time =     6180.0 /    21600.0
iteration:      104 /      360 -- time =     6240.0 /    21600.0
iteration:      105 /      360 -- time =     6300.0 /    21600.0
iteration:      106 /      360 -- time =     6360.0 /    21600.0
iteration:      107 /      360 -- time =     6420.0 /    21600.0
iteration:      108 /      360 -- time =     6480.0 /    21600.0
iteration:      109 /      360 -- time =     6540.0 /    21600.0
iteration:      110 /      360 -- time =     6600.0 /    21600.0
iteration:      111 /      360 -- time =     6660.0 /    21600.0
iteration:      112 /      360 -- time =     6720.0 /    21600.0
iteration:      113 /      360 -- time =     6780.0 /    21600.0
iteration:      114 /      360 -- time =     6840.0 /    21600.0
iteration:      115 /      360 -- time =     6900.0 /    21600.0
iteration:      116 /      360 -- time =     6960.0 /    21600.0
iteration:      117 /      360 -- time =     7020.0 /    21600.0
iteration:      118 /      360 -- time =     7080.0 /    21600.0
iteration:      119 /      360 -- time =     7140.0 /    21600.0
iteration:      120 /      360 -- time =     7200.0 /    21600.0
iteration:      121 /      360 -- time =     7260.0 /    21600.0
iteration:      122 /      360 -- time =     7320.0 /    21600.0
iteration:      123 /      360 -- time =     7380.0 /    21600.0
iteration:      124 /      360 -- time =     7440.0 /    21600.0
iteration:      125 /      360 -- time =     7500.0 /    21600.0
iteration:      126 /      360 -- time =     7560.0 /    21600.0
iteration:      127 /      360 -- time =     7620.0 /    21600.0
iteration:      128 /      360 -- time =     7680.0 /    21600.0
iteration:      129 /      360 -- time =     7740.0 /    21600.0
iteration:      130 /      360 -- time =     7800.0 /    21600.0
iteration:      131 /      360 -- time =     7860.0 /    21600.0
iteration:      132 /      360 -- time =     7920.0 /    21600.0
iteration:      133 /      360 -- time =     7980.0 /    21600.0
iteration:      134 /      360 -- time =     8040.0 /    21600.0
iteration:      135 /      360 -- time =     8100.0 /    21600.0
iteration:      136 /      360 -- time =     8160.0 /    21600.0
iteration:      137 /      360 -- time =     8220.0 /    21600.0
iteration:      138 /      360 -- time =     8280.0 /    21600.0
iteration:      139 /      360 -- time =     8340.0 /    21600.0
iteration:      140 /      360 -- time =     8400.0 /    21600.0
iteration:      141 /      360 -- time =     8460.0 /    21600.0
iteration:      142 /      360 -- time =     8520.0 /    21600.0
iteration:      143 /      360 -- time =     8580.0 /    21600.0
iteration:      144 /      360 -- time =     8640.0 /    21600.0
iteration:      145 /      360 -- time =     8700.0 /    21600.0
iteration:      146 /      360 -- time =     8760.0 /    21600.0
iteration:      147 /      360 -- time =     8820.0 /    21600.0
iteration:      148 /      360 -- time =     8880.0 /    21600.0
iteration:      149 /      360 -- time =     8940.0 /    21600.0
iteration:      150 /      360 -- time =     9000.0 /    21600.0
iteration:      151 /      360 -- time =     9060.0 /    21600.0
iteration:      152 /      360 -- time =     9120.0 /    21600.0
iteration:      153 /      360 -- time =     9180.0 /    21600.0
iteration:      154 /      360 -- time =     9240.0 /    21600.0
iteration:      155 /      360 -- time =     9300.0 /    21600.0
iteration:      156 /      360 -- time =     9360.0 /    21600.0
iteration:      157 /      360 -- time =     9420.0 /    21600.0
iteration:      158 /      360 -- time =     9480.0 /    21600.0
iteration:      159 /      360 -- time =     9540.0 /    21600.0
iteration:      160 /      360 -- time =     9600.0 /    21600.0
iteration:      161 /      360 -- time =     9660.0 /    21600.0
iteration:      162 /      360 -- time =     9720.0 /    21600.0
iteration:      163 /      360 -- time =     9780.0 /    21600.0
iteration:      164 /      360 -- time =     9840.0 /    21600.0
iteration:      165 /      360 -- time =     9900.0 /    21600.0
iteration:      166 /      360 -- time =     9960.0 /    21600.0
iteration:      167 /      360 -- time =    10020.0 /    21600.0
iteration:      168 /      360 -- time =    10080.0 /    21600.0
iteration:      169 /      360 -- time =    10140.0 /    21600.0
iteration:      170 /      360 -- time =    10200.0 /    21600.0
iteration:      171 /      360 -- time =    10260.0 /    21600.0
iteration:      172 /      360 -- time =    10320.0 /    21600.0
iteration:      173 /      360 -- time =    10380.0 /    21600.0
iteration:      174 /      360 -- time =    10440.0 /    21600.0
iteration:      175 /      360 -- time =    10500.0 /    21600.0
iteration:      176 /      360 -- time =    10560.0 /    21600.0
iteration:      177 /      360 -- time =    10620.0 /    21600.0
iteration:      178 /      360 -- time =    10680.0 /    21600.0
iteration:      179 /      360 -- time =    10740.0 /    21600.0
iteration:      180 /      360 -- time =    10800.0 /    21600.0
iteration:      181 /      360 -- time =    10860.0 /    21600.0
iteration:      182 /      360 -- time =    10920.0 /    21600.0
iteration:      183 /      360 -- time =    10980.0 /    21600.0
iteration:      184 /      360 -- time =    11040.0 /    21600.0
iteration:      185 /      360 -- time =    11100.0 /    21600.0
iteration:      186 /      360 -- time =    11160.0 /    21600.0
iteration:      187 /      360 -- time =    11220.0 /    21600.0
iteration:      188 /      360 -- time =    11280.0 /    21600.0
iteration:      189 /      360 -- time =    11340.0 /    21600.0
iteration:      190 /      360 -- time =    11400.0 /    21600.0
iteration:      191 /      360 -- time =    11460.0 /    21600.0
iteration:      192 /      360 -- time =    11520.0 /    21600.0
iteration:      193 /      360 -- time =    11580.0 /    21600.0
iteration:      194 /      360 -- time =    11640.0 /    21600.0
iteration:      195 /      360 -- time =    11700.0 /    21600.0
iteration:      196 /      360 -- time =    11760.0 /    21600.0
iteration:      197 /      360 -- time =    11820.0 /    21600.0
iteration:      198 /      360 -- time =    11880.0 /    21600.0
iteration:      199 /      360 -- time =    11940.0 /    21600.0
iteration:      200 /      360 -- time =    12000.0 /    21600.0
iteration:      201 /      360 -- time =    12060.0 /    21600.0
iteration:      202 /      360 -- time =    12120.0 /    21600.0
iteration:      203 /      360 -- time =    12180.0 /    21600.0
iteration:      204 /      360 -- time =    12240.0 /    21600.0
iteration:      205 /      360 -- time =    12300.0 /    21600.0
iteration:      206 /      360 -- time =    12360.0 /    21600.0
iteration:      207 /      360 -- time =    12420.0 /    21600.0
iteration:      208 /      360 -- time =    12480.0 /    21600.0
iteration:      209 /      360 -- time =    12540.0 /    21600.0
iteration:      210 /      360 -- time =    12600.0 /    21600.0
iteration:      211 /      360 -- time =    12660.0 /    21600.0
iteration:      212 /      360 -- time =    12720.0 /    21600.0
iteration:      213 /      360 -- time =    12780.0 /    21600.0
iteration:      214 /      360 -- time =    12840.0 /    21600.0
iteration:      215 /      360 -- time =    12900.0 /    21600.0
iteration:      216 /      360 -- time =    12960.0 /    21600.0
iteration:      217 /      360 -- time =    13020.0 /    21600.0
iteration:      218 /      360 -- time =    13080.0 /    21600.0
iteration:      219 /      360 -- time =    13140.0 /    21600.0
iteration:      220 /      360 -- time =    13200.0 /    21600.0
iteration:      221 /      360 -- time =    13260.0 /    21600.0
iteration:      222 /      360 -- time =    13320.0 /    21600.0
iteration:      223 /      360 -- time =    13380.0 /    21600.0
iteration:      224 /      360 -- time =    13440.0 /    21600.0
iteration:      225 /      360 -- time =    13500.0 /    21600.0
iteration:      226 /      360 -- time =    13560.0 /    21600.0
iteration:      227 /      360 -- time =    13620.0 /    21600.0
iteration:      228 /      360 -- time =    13680.0 /    21600.0
iteration:      229 /      360 -- time =    13740.0 /    21600.0
iteration:      230 /      360 -- time =    13800.0 /    21600.0
iteration:      231 /      360 -- time =    13860.0 /    21600.0
iteration:      232 /      360 -- time =    13920.0 /    21600.0
iteration:      233 /      360 -- time =    13980.0 /    21600.0
iteration:      234 /      360 -- time =    14040.0 /    21600.0
iteration:      235 /      360 -- time =    14100.0 /    21600.0
iteration:      236 /      360 -- time =    14160.0 /    21600.0
iteration:      237 /      360 -- time =    14220.0 /    21600.0
iteration:      238 /      360 -- time =    14280.0 /    21600.0
iteration:      239 /      360 -- time =    14340.0 /    21600.0
iteration:      240 /      360 -- time =    14400.0 /    21600.0
iteration:      241 /      360 -- time =    14460.0 /    21600.0
iteration:      242 /      360 -- time =    14520.0 /    21600.0
iteration:      243 /      360 -- time =    14580.0 /    21600.0
iteration:      244 /      360 -- time =    14640.0 /    21600.0
iteration:      245 /      360 -- time =    14700.0 /    21600.0
iteration:      246 /      360 -- time =    14760.0 /    21600.0
iteration:      247 /      360 -- time =    14820.0 /    21600.0
iteration:      248 /      360 -- time =    14880.0 /    21600.0
iteration:      249 /      360 -- time =    14940.0 /    21600.0
iteration:      250 /      360 -- time =    15000.0 /    21600.0
iteration:      251 /      360 -- time =    15060.0 /    21600.0
iteration:      252 /      360 -- time =    15120.0 /    21600.0
iteration:      253 /      360 -- time =    15180.0 /    21600.0
iteration:      254 /      360 -- time =    15240.0 /    21600.0
iteration:      255 /      360 -- time =    15300.0 /    21600.0
iteration:      256 /      360 -- time =    15360.0 /    21600.0
iteration:      257 /      360 -- time =    15420.0 /    21600.0
iteration:      258 /      360 -- time =    15480.0 /    21600.0
iteration:      259 /      360 -- time =    15540.0 /    21600.0
iteration:      260 /      360 -- time =    15600.0 /    21600.0
iteration:      261 /      360 -- time =    15660.0 /    21600.0
iteration:      262 /      360 -- time =    15720.0 /    21600.0
iteration:      263 /      360 -- time =    15780.0 /    21600.0
iteration:      264 /      360 -- time =    15840.0 /    21600.0
iteration:      265 /      360 -- time =    15900.0 /    21600.0
iteration:      266 /      360 -- time =    15960.0 /    21600.0
iteration:      267 /      360 -- time =    16020.0 /    21600.0
iteration:      268 /      360 -- time =    16080.0 /    21600.0
iteration:      269 /      360 -- time =    16140.0 /    21600.0
iteration:      270 /      360 -- time =    16200.0 /    21600.0
iteration:      271 /      360 -- time =    16260.0 /    21600.0
iteration:      272 /      360 -- time =    16320.0 /    21600.0
iteration:      273 /      360 -- time =    16380.0 /    21600.0
iteration:      274 /      360 -- time =    16440.0 /    21600.0
iteration:      275 /      360 -- time =    16500.0 /    21600.0
iteration:      276 /      360 -- time =    16560.0 /    21600.0
iteration:      277 /      360 -- time =    16620.0 /    21600.0
iteration:      278 /      360 -- time =    16680.0 /    21600.0
iteration:      279 /      360 -- time =    16740.0 /    21600.0
iteration:      280 /      360 -- time =    16800.0 /    21600.0
iteration:      281 /      360 -- time =    16860.0 /    21600.0
iteration:      282 /      360 -- time =    16920.0 /    21600.0
iteration:      283 /      360 -- time =    16980.0 /    21600.0
iteration:      284 /      360 -- time =    17040.0 /    21600.0
iteration:      285 /      360 -- time =    17100.0 /    21600.0
iteration:      286 /      360 -- time =    17160.0 /    21600.0
iteration:      287 /      360 -- time =    17220.0 /    21600.0
iteration:      288 /      360 -- time =    17280.0 /    21600.0
iteration:      289 /      360 -- time =    17340.0 /    21600.0
iteration:      290 /      360 -- time =    17400.0 /    21600.0
iteration:      291 /      360 -- time =    17460.0 /    21600.0
iteration:      292 /      360 -- time =    17520.0 /    21600.0
iteration:      293 /      360 -- time =    17580.0 /    21600.0
iteration:      294 /      360 -- time =    17640.0 /    21600.0
iteration:      295 /      360 -- time =    17700.0 /    21600.0
iteration:      296 /      360 -- time =    17760.0 /    21600.0
iteration:      297 /      360 -- time =    17820.0 /    21600.0
iteration:      298 /      360 -- time =    17880.0 /    21600.0
iteration:      299 /      360 -- time =    17940.0 /    21600.0
iteration:      300 /      360 -- time =    18000.0 /    21600.0
iteration:      301 /      360 -- time =    18060.0 /    21600.0
iteration:      302 /      360 -- time =    18120.0 /    21600.0
iteration:      303 /      360 -- time =    18180.0 /    21600.0
iteration:      304 /      360 -- time =    18240.0 /    21600.0
iteration:      305 /      360 -- time =    18300.0 /    21600.0
iteration:      306 /      360 -- time =    18360.0 /    21600.0
iteration:      307 /      360 -- time =    18420.0 /    21600.0
iteration:      308 /      360 -- time =    18480.0 /    21600.0
iteration:      309 /      360 -- time =    18540.0 /    21600.0
iteration:      310 /      360 -- time =    18600.0 /    21600.0
iteration:      311 /      360 -- time =    18660.0 /    21600.0
iteration:      312 /      360 -- time =    18720.0 /    21600.0
iteration:      313 /      360 -- time =    18780.0 /    21600.0
iteration:      314 /      360 -- time =    18840.0 /    21600.0
iteration:      315 /      360 -- time =    18900.0 /    21600.0
iteration:      316 /      360 -- time =    18960.0 /    21600.0
iteration:      317 /      360 -- time =    19020.0 /    21600.0
iteration:      318 /      360 -- time =    19080.0 /    21600.0
iteration:      319 /      360 -- time =    19140.0 /    21600.0
iteration:      320 /      360 -- time =    19200.0 /    21600.0
iteration:      321 /      360 -- time =    19260.0 /    21600.0
iteration:      322 /      360 -- time =    19320.0 /    21600.0
iteration:      323 /      360 -- time =    19380.0 /    21600.0
iteration:      324 /      360 -- time =    19440.0 /    21600.0
iteration:      325 /      360 -- time =    19500.0 /    21600.0
iteration:      326 /      360 -- time =    19560.0 /    21600.0
iteration:      327 /      360 -- time =    19620.0 /    21600.0
iteration:      328 /      360 -- time =    19680.0 /    21600.0
iteration:      329 /      360 -- time =    19740.0 /    21600.0
iteration:      330 /      360 -- time =    19800.0 /    21600.0
iteration:      331 /      360 -- time =    19860.0 /    21600.0
iteration:      332 /      360 -- time =    19920.0 /    21600.0
iteration:      333 /      360 -- time =    19980.0 /    21600.0
iteration:      334 /      360 -- time =    20040.0 /    21600.0
iteration:      335 /      360 -- time =    20100.0 /    21600.0
iteration:      336 /      360 -- time =    20160.0 /    21600.0
iteration:      337 /      360 -- time =    20220.0 /    21600.0
iteration:      338 /      360 -- time =    20280.0 /    21600.0
iteration:      339 /      360 -- time =    20340.0 /    21600.0
iteration:      340 /      360 -- time =    20400.0 /    21600.0
iteration:      341 /      360 -- time =    20460.0 /    21600.0
iteration:      342 /      360 -- time =    20520.0 /    21600.0
iteration:      343 /      360 -- time =    20580.0 /    21600.0
iteration:      344 /      360 -- time =    20640.0 /    21600.0
iteration:      345 /      360 -- time =    20700.0 /    21600.0
iteration:      346 /      360 -- time =    20760.0 /    21600.0
iteration:      347 /      360 -- time =    20820.0 /    21600.0
iteration:      348 /      360 -- time =    20880.0 /    21600.0
iteration:      349 /      360 -- time =    20940.0 /    21600.0
iteration:      350 /      360 -- time =    21000.0 /    21600.0
iteration:      351 /      360 -- time =    21060.0 /    21600.0
iteration:      352 /      360 -- time =    21120.0 /    21600.0
iteration:      353 /      360 -- time =    21180.0 /    21600.0
iteration:      354 /      360 -- time =    21240.0 /    21600.0
iteration:      355 /      360 -- time =    21300.0 /    21600.0
iteration:      356 /      360 -- time =    21360.0 /    21600.0
iteration:      357 /      360 -- time =    21420.0 /    21600.0
iteration:      358 /      360 -- time =    21480.0 /    21600.0
iteration:      359 /      360 -- time =    21540.0 /    21600.0
iteration:      360 /      360 -- time =    21600.0 /    21600.0
CLUBB cleanup complete.
Completed 360 timesteps in 56.2s
--------------------------------------------------
run_scm.py total runtime: 58.75 s
--------------------------------------------------
[PASS] bs4_tout300_window5400_16200: stats file: /home/jenkins/workspace/clubb_stats_output_consistency/output/stats_output_consistency/bomex/bs4_tout300_window5400_16200/bomex_stats.nc

======================== Batch-Size Checks ========================
[PASS] bs2_tout60_vs_bs4_tout60: checked 800 variables; floating tolerance=3e-09
[PASS] bs1_tout60_vs_bs4_tout60: checked 800 variables; floating tolerance=3e-09

======================== Tout Averaging Checks ========================
[PASS] bs4_tout300_manual_average_vs_bs4_tout60: checked 791 time-dependent variables, max_abs=2.980232e-08, max_rel=1.000000e+00
Running on Jenkins in /home/jenkins/workspace/clubb_stats_output_consistency@2
[Pipeline] {
[Pipeline] checkout
The recommended git tool is: git
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/larson-group/clubb.git
 > git init /home/jenkins/workspace/clubb_stats_output_consistency@2 # timeout=10
Fetching upstream changes from https://github.com/larson-group/clubb.git
 > git --version # timeout=10
 > git --version # 'git version 2.34.1'
using GIT_ASKPASS to set credentials larsongroupsysadmin github token
 > git fetch --tags --force --progress -- https://github.com/larson-group/clubb.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/larson-group/clubb.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision 4292a70f53a6b6c4eab864fe27b8fd9af5d86909 (refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4292a70f53a6b6c4eab864fe27b8fd9af5d86909 # timeout=10
Commit message: "Fix arm97+l do expldiff rtm thlm+set edsclrm f early (#1386)"
[Pipeline] withEnv
[Pipeline] {
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ python3 tests/run_loss_output_consistency.py bomex -jax -fields thlm wp2 -output_root output/jax_loss_consistency
Installing uv 0.11.32 in /home/jenkins/workspace/clubb_stats_output_consistency@2/.clubb-python-tools/bin
downloading uv 0.11.32 x86_64-unknown-linux-gnu
installing to /home/jenkins/workspace/clubb_stats_output_consistency@2/.clubb-python-tools/bin
  uv
  uvx
everything's installed!
Creating CLUBB virtualenv: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python
Downloading cpython-3.12.13-linux-x86_64-gnu (download) (32.6MiB)
 Downloaded cpython-3.12.13-linux-x86_64-gnu (download)
Using CPython 3.12.13
Creating virtual environment at: .venv-python
Activate with: source .venv-python/bin/activate
Installing python requirements into /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python
Using Python 3.12.13 environment at: .venv-python
Resolved 12 packages in 329ms
Downloading pygments (1.2MiB)
Downloading meson (1.1MiB)
Downloading netcdf4 (9.7MiB)
Downloading numpy (16.0MiB)
Downloading cftime (1.6MiB)
 Downloaded cftime
 Downloaded netcdf4
 Downloaded meson
 Downloaded pygments
 Downloaded numpy
Prepared 12 packages in 696ms
Installed 12 packages in 40ms
 + certifi==2026.7.22
 + cftime==1.6.6
 + iniconfig==2.3.1
 + meson==1.12.1
 + netcdf4==1.7.4
 + ninja==1.13.2
 + numpy==2.5.4
 + packaging==26.3
 + pluggy==1.6.0
 + pygments==2.21.0
 + pytest==9.1.1
 + tabulate==0.10.0
Ready: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python/bin/python
+ /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency@2/utilities/create_multi_col_params.py -params_file /home/jenkins/workspace/clubb_stats_output_consistency@2/input/parameter_and_flag_configs/default/tunable_parameters.in -output_file /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/bomex_shared_multicol_params.in -multicol C8/0.2:0.8/4 -batch_size 4
Creating a custom hypergrid of parameters
 - Initial values file: '/home/jenkins/workspace/clubb_stats_output_consistency@2/input/parameter_and_flag_configs/default/tunable_parameters.in'
 - Spec: C8/0.2:0.8/4
Writing to '/home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/bomex_shared_multicol_params.in':
 - ngrdcol = 4
 - batch_size = 4

======================== Test Setup ========================
Case: bomex
Fields: thlm, wp2
Loss window: [10800.0, 21600.0]
Shared params: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/bomex_shared_multicol_params.in
Output root: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex

======================== Run Phase ========================
Running normal CLUBB
+ /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency@2/run_scripts/run_scm.py -jax -params_file /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/bomex_shared_multicol_params.in -stats /home/jenkins/workspace/clubb_stats_output_consistency@2/input/stats/all_tuning_stats.in -output_dir /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/normal -tout 10800 -stats_tstart 10800.0 -stats_tend 21600.0 -override stats_tsamp=60.0,time_final=21600.0,debug_level=-1 bomex
/home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/normal/bomex.in
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/normal
 - using executable: /home/jenkins/workspace/clubb_stats_output_consistency@2/run_scripts/../clubb_jax/run_jax.py
=================== Running bomex ===================
==> No compatible Python found for cpu; uv will download Python 3.12
==> Installing uv 0.11.32 in /home/jenkins/workspace/clubb_stats_output_consistency@2/.clubb-jax-tools/bin
downloading uv 0.11.32 x86_64-unknown-linux-gnu
installing to /home/jenkins/workspace/clubb_stats_output_consistency@2/.clubb-jax-tools/bin
  uv
  uvx
everything's installed!
==> uv is ready: uv 0.11.32 (x86_64-unknown-linux-gnu)
Downloading cpython-3.12.13-linux-x86_64-gnu (download) (32.6MiB)
 Downloaded cpython-3.12.13-linux-x86_64-gnu (download)
Using CPython 3.12.13
Creating virtual environment at: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-jax
Activate with: source /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-jax/bin/activate
==> Installing JAX 0.11.0 (cpu) and requirements from /home/jenkins/workspace/clubb_stats_output_consistency@2/clubb_jax/requirements.txt
Using Python 3.12.13 environment at: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-jax
Resolved 15 packages in 370ms
Downloading pygments (1.2MiB)
Downloading scipy (33.7MiB)
Downloading numpy (16.0MiB)
Downloading jaxlib (83.2MiB)
Downloading jax (3.1MiB)
Downloading netcdf4 (9.7MiB)
Downloading cftime (1.6MiB)
 Downloaded cftime
 Downloaded pygments
 Downloaded netcdf4
 Downloaded jax
 Downloaded numpy
 Downloaded scipy
 Downloaded jaxlib
Prepared 15 packages in 2.76s
Installed 15 packages in 42ms
 + certifi==2026.7.22
 + cftime==1.6.6
 + iniconfig==2.3.1
 + jax==0.11.0
 + jaxlib==0.11.0
 + ml-dtypes==0.6.0
 + netcdf4==1.7.4
 + numpy==2.5.4
 + opt-einsum==3.4.0
 + packaging==26.3
 + pluggy==1.6.0
 + pygments==2.21.0
 + pytest==9.1.1
 + scipy==1.18.1
 + tabulate==0.10.0
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-jax (Python 3.12)
  Accelerator: cpu
nzm = 88 -- nzt = 87
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
iteration:        1 /      360 -- time =       60.0 /    21600.0
iteration:        2 /      360 -- time =      120.0 /    21600.0
iteration:        3 /      360 -- time =      180.0 /    21600.0
iteration:        4 /      360 -- time =      240.0 /    21600.0
iteration:        5 /      360 -- time =      300.0 /    21600.0
iteration:        6 /      360 -- time =      360.0 /    21600.0
iteration:        7 /      360 -- time =      420.0 /    21600.0
iteration:        8 /      360 -- time =      480.0 /    21600.0
iteration:        9 /      360 -- time =      540.0 /    21600.0
iteration:       10 /      360 -- time =      600.0 /    21600.0
iteration:       11 /      360 -- time =      660.0 /    21600.0
iteration:       12 /      360 -- time =      720.0 /    21600.0
iteration:       13 /      360 -- time =      780.0 /    21600.0
iteration:       14 /      360 -- time =      840.0 /    21600.0
iteration:       15 /      360 -- time =      900.0 /    21600.0
iteration:       16 /      360 -- time =      960.0 /    21600.0
iteration:       17 /      360 -- time =     1020.0 /    21600.0
iteration:       18 /      360 -- time =     1080.0 /    21600.0
iteration:       19 /      360 -- time =     1140.0 /    21600.0
iteration:       20 /      360 -- time =     1200.0 /    21600.0
iteration:       21 /      360 -- time =     1260.0 /    21600.0
iteration:       22 /      360 -- time =     1320.0 /    21600.0
iteration:       23 /      360 -- time =     1380.0 /    21600.0
iteration:       24 /      360 -- time =     1440.0 /    21600.0
iteration:       25 /      360 -- time =     1500.0 /    21600.0
iteration:       26 /      360 -- time =     1560.0 /    21600.0
iteration:       27 /      360 -- time =     1620.0 /    21600.0
iteration:       28 /      360 -- time =     1680.0 /    21600.0
iteration:       29 /      360 -- time =     1740.0 /    21600.0
iteration:       30 /      360 -- time =     1800.0 /    21600.0
iteration:       31 /      360 -- time =     1860.0 /    21600.0
iteration:       32 /      360 -- time =     1920.0 /    21600.0
iteration:       33 /      360 -- time =     1980.0 /    21600.0
iteration:       34 /      360 -- time =     2040.0 /    21600.0
iteration:       35 /      360 -- time =     2100.0 /    21600.0
iteration:       36 /      360 -- time =     2160.0 /    21600.0
iteration:       37 /      360 -- time =     2220.0 /    21600.0
iteration:       38 /      360 -- time =     2280.0 /    21600.0
iteration:       39 /      360 -- time =     2340.0 /    21600.0
iteration:       40 /      360 -- time =     2400.0 /    21600.0
iteration:       41 /      360 -- time =     2460.0 /    21600.0
iteration:       42 /      360 -- time =     2520.0 /    21600.0
iteration:       43 /      360 -- time =     2580.0 /    21600.0
iteration:       44 /      360 -- time =     2640.0 /    21600.0
iteration:       45 /      360 -- time =     2700.0 /    21600.0
iteration:       46 /      360 -- time =     2760.0 /    21600.0
iteration:       47 /      360 -- time =     2820.0 /    21600.0
iteration:       48 /      360 -- time =     2880.0 /    21600.0
iteration:       49 /      360 -- time =     2940.0 /    21600.0
iteration:       50 /      360 -- time =     3000.0 /    21600.0
iteration:       51 /      360 -- time =     3060.0 /    21600.0
iteration:       52 /      360 -- time =     3120.0 /    21600.0
iteration:       53 /      360 -- time =     3180.0 /    21600.0
iteration:       54 /      360 -- time =     3240.0 /    21600.0
iteration:       55 /      360 -- time =     3300.0 /    21600.0
iteration:       56 /      360 -- time =     3360.0 /    21600.0
iteration:       57 /      360 -- time =     3420.0 /    21600.0
iteration:       58 /      360 -- time =     3480.0 /    21600.0
iteration:       59 /      360 -- time =     3540.0 /    21600.0
iteration:       60 /      360 -- time =     3600.0 /    21600.0
iteration:       61 /      360 -- time =     3660.0 /    21600.0
iteration:       62 /      360 -- time =     3720.0 /    21600.0
iteration:       63 /      360 -- time =     3780.0 /    21600.0
iteration:       64 /      360 -- time =     3840.0 /    21600.0
iteration:       65 /      360 -- time =     3900.0 /    21600.0
iteration:       66 /      360 -- time =     3960.0 /    21600.0
iteration:       67 /      360 -- time =     4020.0 /    21600.0
iteration:       68 /      360 -- time =     4080.0 /    21600.0
iteration:       69 /      360 -- time =     4140.0 /    21600.0
iteration:       70 /      360 -- time =     4200.0 /    21600.0
iteration:       71 /      360 -- time =     4260.0 /    21600.0
iteration:       72 /      360 -- time =     4320.0 /    21600.0
iteration:       73 /      360 -- time =     4380.0 /    21600.0
iteration:       74 /      360 -- time =     4440.0 /    21600.0
iteration:       75 /      360 -- time =     4500.0 /    21600.0
iteration:       76 /      360 -- time =     4560.0 /    21600.0
iteration:       77 /      360 -- time =     4620.0 /    21600.0
iteration:       78 /      360 -- time =     4680.0 /    21600.0
iteration:       79 /      360 -- time =     4740.0 /    21600.0
iteration:       80 /      360 -- time =     4800.0 /    21600.0
iteration:       81 /      360 -- time =     4860.0 /    21600.0
iteration:       82 /      360 -- time =     4920.0 /    21600.0
iteration:       83 /      360 -- time =     4980.0 /    21600.0
iteration:       84 /      360 -- time =     5040.0 /    21600.0
iteration:       85 /      360 -- time =     5100.0 /    21600.0
iteration:       86 /      360 -- time =     5160.0 /    21600.0
iteration:       87 /      360 -- time =     5220.0 /    21600.0
iteration:       88 /      360 -- time =     5280.0 /    21600.0
iteration:       89 /      360 -- time =     5340.0 /    21600.0
iteration:       90 /      360 -- time =     5400.0 /    21600.0
iteration:       91 /      360 -- time =     5460.0 /    21600.0
iteration:       92 /      360 -- time =     5520.0 /    21600.0
iteration:       93 /      360 -- time =     5580.0 /    21600.0
iteration:       94 /      360 -- time =     5640.0 /    21600.0
iteration:       95 /      360 -- time =     5700.0 /    21600.0
iteration:       96 /      360 -- time =     5760.0 /    21600.0
iteration:       97 /      360 -- time =     5820.0 /    21600.0
iteration:       98 /      360 -- time =     5880.0 /    21600.0
iteration:       99 /      360 -- time =     5940.0 /    21600.0
iteration:      100 /      360 -- time =     6000.0 /    21600.0
iteration:      101 /      360 -- time =     6060.0 /    21600.0
iteration:      102 /      360 -- time =     6120.0 /    21600.0
iteration:      103 /      360 -- time =     6180.0 /    21600.0
iteration:      104 /      360 -- time =     6240.0 /    21600.0
iteration:      105 /      360 -- time =     6300.0 /    21600.0
iteration:      106 /      360 -- time =     6360.0 /    21600.0
iteration:      107 /      360 -- time =     6420.0 /    21600.0
iteration:      108 /      360 -- time =     6480.0 /    21600.0
iteration:      109 /      360 -- time =     6540.0 /    21600.0
iteration:      110 /      360 -- time =     6600.0 /    21600.0
iteration:      111 /      360 -- time =     6660.0 /    21600.0
iteration:      112 /      360 -- time =     6720.0 /    21600.0
iteration:      113 /      360 -- time =     6780.0 /    21600.0
iteration:      114 /      360 -- time =     6840.0 /    21600.0
iteration:      115 /      360 -- time =     6900.0 /    21600.0
iteration:      116 /      360 -- time =     6960.0 /    21600.0
iteration:      117 /      360 -- time =     7020.0 /    21600.0
iteration:      118 /      360 -- time =     7080.0 /    21600.0
iteration:      119 /      360 -- time =     7140.0 /    21600.0
iteration:      120 /      360 -- time =     7200.0 /    21600.0
iteration:      121 /      360 -- time =     7260.0 /    21600.0
iteration:      122 /      360 -- time =     7320.0 /    21600.0
iteration:      123 /      360 -- time =     7380.0 /    21600.0
iteration:      124 /      360 -- time =     7440.0 /    21600.0
iteration:      125 /      360 -- time =     7500.0 /    21600.0
iteration:      126 /      360 -- time =     7560.0 /    21600.0
iteration:      127 /      360 -- time =     7620.0 /    21600.0
iteration:      128 /      360 -- time =     7680.0 /    21600.0
iteration:      129 /      360 -- time =     7740.0 /    21600.0
iteration:      130 /      360 -- time =     7800.0 /    21600.0
iteration:      131 /      360 -- time =     7860.0 /    21600.0
iteration:      132 /      360 -- time =     7920.0 /    21600.0
iteration:      133 /      360 -- time =     7980.0 /    21600.0
iteration:      134 /      360 -- time =     8040.0 /    21600.0
iteration:      135 /      360 -- time =     8100.0 /    21600.0
iteration:      136 /      360 -- time =     8160.0 /    21600.0
iteration:      137 /      360 -- time =     8220.0 /    21600.0
iteration:      138 /      360 -- time =     8280.0 /    21600.0
iteration:      139 /      360 -- time =     8340.0 /    21600.0
iteration:      140 /      360 -- time =     8400.0 /    21600.0
iteration:      141 /      360 -- time =     8460.0 /    21600.0
iteration:      142 /      360 -- time =     8520.0 /    21600.0
iteration:      143 /      360 -- time =     8580.0 /    21600.0
iteration:      144 /      360 -- time =     8640.0 /    21600.0
iteration:      145 /      360 -- time =     8700.0 /    21600.0
iteration:      146 /      360 -- time =     8760.0 /    21600.0
iteration:      147 /      360 -- time =     8820.0 /    21600.0
iteration:      148 /      360 -- time =     8880.0 /    21600.0
iteration:      149 /      360 -- time =     8940.0 /    21600.0
iteration:      150 /      360 -- time =     9000.0 /    21600.0
iteration:      151 /      360 -- time =     9060.0 /    21600.0
iteration:      152 /      360 -- time =     9120.0 /    21600.0
iteration:      153 /      360 -- time =     9180.0 /    21600.0
iteration:      154 /      360 -- time =     9240.0 /    21600.0
iteration:      155 /      360 -- time =     9300.0 /    21600.0
iteration:      156 /      360 -- time =     9360.0 /    21600.0
iteration:      157 /      360 -- time =     9420.0 /    21600.0
iteration:      158 /      360 -- time =     9480.0 /    21600.0
iteration:      159 /      360 -- time =     9540.0 /    21600.0
iteration:      160 /      360 -- time =     9600.0 /    21600.0
iteration:      161 /      360 -- time =     9660.0 /    21600.0
iteration:      162 /      360 -- time =     9720.0 /    21600.0
iteration:      163 /      360 -- time =     9780.0 /    21600.0
iteration:      164 /      360 -- time =     9840.0 /    21600.0
iteration:      165 /      360 -- time =     9900.0 /    21600.0
iteration:      166 /      360 -- time =     9960.0 /    21600.0
iteration:      167 /      360 -- time =    10020.0 /    21600.0
iteration:      168 /      360 -- time =    10080.0 /    21600.0
iteration:      169 /      360 -- time =    10140.0 /    21600.0
iteration:      170 /      360 -- time =    10200.0 /    21600.0
iteration:      171 /      360 -- time =    10260.0 /    21600.0
iteration:      172 /      360 -- time =    10320.0 /    21600.0
iteration:      173 /      360 -- time =    10380.0 /    21600.0
iteration:      174 /      360 -- time =    10440.0 /    21600.0
iteration:      175 /      360 -- time =    10500.0 /    21600.0
iteration:      176 /      360 -- time =    10560.0 /    21600.0
iteration:      177 /      360 -- time =    10620.0 /    21600.0
iteration:      178 /      360 -- time =    10680.0 /    21600.0
iteration:      179 /      360 -- time =    10740.0 /    21600.0
iteration:      180 /      360 -- time =    10800.0 /    21600.0
iteration:      181 /      360 -- time =    10860.0 /    21600.0
iteration:      182 /      360 -- time =    10920.0 /    21600.0
iteration:      183 /      360 -- time =    10980.0 /    21600.0
iteration:      184 /      360 -- time =    11040.0 /    21600.0
iteration:      185 /      360 -- time =    11100.0 /    21600.0
iteration:      186 /      360 -- time =    11160.0 /    21600.0
iteration:      187 /      360 -- time =    11220.0 /    21600.0
iteration:      188 /      360 -- time =    11280.0 /    21600.0
iteration:      189 /      360 -- time =    11340.0 /    21600.0
iteration:      190 /      360 -- time =    11400.0 /    21600.0
iteration:      191 /      360 -- time =    11460.0 /    21600.0
iteration:      192 /      360 -- time =    11520.0 /    21600.0
iteration:      193 /      360 -- time =    11580.0 /    21600.0
iteration:      194 /      360 -- time =    11640.0 /    21600.0
iteration:      195 /      360 -- time =    11700.0 /    21600.0
iteration:      196 /      360 -- time =    11760.0 /    21600.0
iteration:      197 /      360 -- time =    11820.0 /    21600.0
iteration:      198 /      360 -- time =    11880.0 /    21600.0
iteration:      199 /      360 -- time =    11940.0 /    21600.0
iteration:      200 /      360 -- time =    12000.0 /    21600.0
iteration:      201 /      360 -- time =    12060.0 /    21600.0
iteration:      202 /      360 -- time =    12120.0 /    21600.0
iteration:      203 /      360 -- time =    12180.0 /    21600.0
iteration:      204 /      360 -- time =    12240.0 /    21600.0
iteration:      205 /      360 -- time =    12300.0 /    21600.0
iteration:      206 /      360 -- time =    12360.0 /    21600.0
iteration:      207 /      360 -- time =    12420.0 /    21600.0
iteration:      208 /      360 -- time =    12480.0 /    21600.0
iteration:      209 /      360 -- time =    12540.0 /    21600.0
iteration:      210 /      360 -- time =    12600.0 /    21600.0
iteration:      211 /      360 -- time =    12660.0 /    21600.0
iteration:      212 /      360 -- time =    12720.0 /    21600.0
iteration:      213 /      360 -- time =    12780.0 /    21600.0
iteration:      214 /      360 -- time =    12840.0 /    21600.0
iteration:      215 /      360 -- time =    12900.0 /    21600.0
iteration:      216 /      360 -- time =    12960.0 /    21600.0
iteration:      217 /      360 -- time =    13020.0 /    21600.0
iteration:      218 /      360 -- time =    13080.0 /    21600.0
iteration:      219 /      360 -- time =    13140.0 /    21600.0
iteration:      220 /      360 -- time =    13200.0 /    21600.0
iteration:      221 /      360 -- time =    13260.0 /    21600.0
iteration:      222 /      360 -- time =    13320.0 /    21600.0
iteration:      223 /      360 -- time =    13380.0 /    21600.0
iteration:      224 /      360 -- time =    13440.0 /    21600.0
iteration:      225 /      360 -- time =    13500.0 /    21600.0
iteration:      226 /      360 -- time =    13560.0 /    21600.0
iteration:      227 /      360 -- time =    13620.0 /    21600.0
iteration:      228 /      360 -- time =    13680.0 /    21600.0
iteration:      229 /      360 -- time =    13740.0 /    21600.0
iteration:      230 /      360 -- time =    13800.0 /    21600.0
iteration:      231 /      360 -- time =    13860.0 /    21600.0
iteration:      232 /      360 -- time =    13920.0 /    21600.0
iteration:      233 /      360 -- time =    13980.0 /    21600.0
iteration:      234 /      360 -- time =    14040.0 /    21600.0
iteration:      235 /      360 -- time =    14100.0 /    21600.0
iteration:      236 /      360 -- time =    14160.0 /    21600.0
iteration:      237 /      360 -- time =    14220.0 /    21600.0
iteration:      238 /      360 -- time =    14280.0 /    21600.0
iteration:      239 /      360 -- time =    14340.0 /    21600.0
iteration:      240 /      360 -- time =    14400.0 /    21600.0
iteration:      241 /      360 -- time =    14460.0 /    21600.0
iteration:      242 /      360 -- time =    14520.0 /    21600.0
iteration:      243 /      360 -- time =    14580.0 /    21600.0
iteration:      244 /      360 -- time =    14640.0 /    21600.0
iteration:      245 /      360 -- time =    14700.0 /    21600.0
iteration:      246 /      360 -- time =    14760.0 /    21600.0
iteration:      247 /      360 -- time =    14820.0 /    21600.0
iteration:      248 /      360 -- time =    14880.0 /    21600.0
iteration:      249 /      360 -- time =    14940.0 /    21600.0
iteration:      250 /      360 -- time =    15000.0 /    21600.0
iteration:      251 /      360 -- time =    15060.0 /    21600.0
iteration:      252 /      360 -- time =    15120.0 /    21600.0
iteration:      253 /      360 -- time =    15180.0 /    21600.0
iteration:      254 /      360 -- time =    15240.0 /    21600.0
iteration:      255 /      360 -- time =    15300.0 /    21600.0
iteration:      256 /      360 -- time =    15360.0 /    21600.0
iteration:      257 /      360 -- time =    15420.0 /    21600.0
iteration:      258 /      360 -- time =    15480.0 /    21600.0
iteration:      259 /      360 -- time =    15540.0 /    21600.0
iteration:      260 /      360 -- time =    15600.0 /    21600.0
iteration:      261 /      360 -- time =    15660.0 /    21600.0
iteration:      262 /      360 -- time =    15720.0 /    21600.0
iteration:      263 /      360 -- time =    15780.0 /    21600.0
iteration:      264 /      360 -- time =    15840.0 /    21600.0
iteration:      265 /      360 -- time =    15900.0 /    21600.0
iteration:      266 /      360 -- time =    15960.0 /    21600.0
iteration:      267 /      360 -- time =    16020.0 /    21600.0
iteration:      268 /      360 -- time =    16080.0 /    21600.0
iteration:      269 /      360 -- time =    16140.0 /    21600.0
iteration:      270 /      360 -- time =    16200.0 /    21600.0
iteration:      271 /      360 -- time =    16260.0 /    21600.0
iteration:      272 /      360 -- time =    16320.0 /    21600.0
iteration:      273 /      360 -- time =    16380.0 /    21600.0
iteration:      274 /      360 -- time =    16440.0 /    21600.0
iteration:      275 /      360 -- time =    16500.0 /    21600.0
iteration:      276 /      360 -- time =    16560.0 /    21600.0
iteration:      277 /      360 -- time =    16620.0 /    21600.0
iteration:      278 /      360 -- time =    16680.0 /    21600.0
iteration:      279 /      360 -- time =    16740.0 /    21600.0
iteration:      280 /      360 -- time =    16800.0 /    21600.0
iteration:      281 /      360 -- time =    16860.0 /    21600.0
iteration:      282 /      360 -- time =    16920.0 /    21600.0
iteration:      283 /      360 -- time =    16980.0 /    21600.0
iteration:      284 /      360 -- time =    17040.0 /    21600.0
iteration:      285 /      360 -- time =    17100.0 /    21600.0
iteration:      286 /      360 -- time =    17160.0 /    21600.0
iteration:      287 /      360 -- time =    17220.0 /    21600.0
iteration:      288 /      360 -- time =    17280.0 /    21600.0
iteration:      289 /      360 -- time =    17340.0 /    21600.0
iteration:      290 /      360 -- time =    17400.0 /    21600.0
iteration:      291 /      360 -- time =    17460.0 /    21600.0
iteration:      292 /      360 -- time =    17520.0 /    21600.0
iteration:      293 /      360 -- time =    17580.0 /    21600.0
iteration:      294 /      360 -- time =    17640.0 /    21600.0
iteration:      295 /      360 -- time =    17700.0 /    21600.0
iteration:      296 /      360 -- time =    17760.0 /    21600.0
iteration:      297 /      360 -- time =    17820.0 /    21600.0
iteration:      298 /      360 -- time =    17880.0 /    21600.0
iteration:      299 /      360 -- time =    17940.0 /    21600.0
iteration:      300 /      360 -- time =    18000.0 /    21600.0
iteration:      301 /      360 -- time =    18060.0 /    21600.0
iteration:      302 /      360 -- time =    18120.0 /    21600.0
iteration:      303 /      360 -- time =    18180.0 /    21600.0
iteration:      304 /      360 -- time =    18240.0 /    21600.0
iteration:      305 /      360 -- time =    18300.0 /    21600.0
iteration:      306 /      360 -- time =    18360.0 /    21600.0
iteration:      307 /      360 -- time =    18420.0 /    21600.0
iteration:      308 /      360 -- time =    18480.0 /    21600.0
iteration:      309 /      360 -- time =    18540.0 /    21600.0
iteration:      310 /      360 -- time =    18600.0 /    21600.0
iteration:      311 /      360 -- time =    18660.0 /    21600.0
iteration:      312 /      360 -- time =    18720.0 /    21600.0
iteration:      313 /      360 -- time =    18780.0 /    21600.0
iteration:      314 /      360 -- time =    18840.0 /    21600.0
iteration:      315 /      360 -- time =    18900.0 /    21600.0
iteration:      316 /      360 -- time =    18960.0 /    21600.0
iteration:      317 /      360 -- time =    19020.0 /    21600.0
iteration:      318 /      360 -- time =    19080.0 /    21600.0
iteration:      319 /      360 -- time =    19140.0 /    21600.0
iteration:      320 /      360 -- time =    19200.0 /    21600.0
iteration:      321 /      360 -- time =    19260.0 /    21600.0
iteration:      322 /      360 -- time =    19320.0 /    21600.0
iteration:      323 /      360 -- time =    19380.0 /    21600.0
iteration:      324 /      360 -- time =    19440.0 /    21600.0
iteration:      325 /      360 -- time =    19500.0 /    21600.0
iteration:      326 /      360 -- time =    19560.0 /    21600.0
iteration:      327 /      360 -- time =    19620.0 /    21600.0
iteration:      328 /      360 -- time =    19680.0 /    21600.0
iteration:      329 /      360 -- time =    19740.0 /    21600.0
iteration:      330 /      360 -- time =    19800.0 /    21600.0
iteration:      331 /      360 -- time =    19860.0 /    21600.0
iteration:      332 /      360 -- time =    19920.0 /    21600.0
iteration:      333 /      360 -- time =    19980.0 /    21600.0
iteration:      334 /      360 -- time =    20040.0 /    21600.0
iteration:      335 /      360 -- time =    20100.0 /    21600.0
iteration:      336 /      360 -- time =    20160.0 /    21600.0
iteration:      337 /      360 -- time =    20220.0 /    21600.0
iteration:      338 /      360 -- time =    20280.0 /    21600.0
iteration:      339 /      360 -- time =    20340.0 /    21600.0
iteration:      340 /      360 -- time =    20400.0 /    21600.0
iteration:      341 /      360 -- time =    20460.0 /    21600.0
iteration:      342 /      360 -- time =    20520.0 /    21600.0
iteration:      343 /      360 -- time =    20580.0 /    21600.0
iteration:      344 /      360 -- time =    20640.0 /    21600.0
iteration:      345 /      360 -- time =    20700.0 /    21600.0
iteration:      346 /      360 -- time =    20760.0 /    21600.0
iteration:      347 /      360 -- time =    20820.0 /    21600.0
iteration:      348 /      360 -- time =    20880.0 /    21600.0
iteration:      349 /      360 -- time =    20940.0 /    21600.0
iteration:      350 /      360 -- time =    21000.0 /    21600.0
iteration:      351 /      360 -- time =    21060.0 /    21600.0
iteration:      352 /      360 -- time =    21120.0 /    21600.0
iteration:      353 /      360 -- time =    21180.0 /    21600.0
iteration:      354 /      360 -- time =    21240.0 /    21600.0
iteration:      355 /      360 -- time =    21300.0 /    21600.0
iteration:      356 /      360 -- time =    21360.0 /    21600.0
iteration:      357 /      360 -- time =    21420.0 /    21600.0
iteration:      358 /      360 -- time =    21480.0 /    21600.0
iteration:      359 /      360 -- time =    21540.0 /    21600.0
iteration:      360 /      360 -- time =    21600.0 /    21600.0
CLUBB cleanup complete.
Completed 360 timesteps in 22.7s
--------------------------------------------------
run_scm.py total runtime: 32.87 s
--------------------------------------------------
[PASS] normal_run: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/normal/bomex_stats.nc

Running loss driver
+ /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-python/bin/python /home/jenkins/workspace/clubb_stats_output_consistency@2/run_scripts/run_scm_loss.py -jax -params_file /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/bomex_shared_multicol_params.in -output_dir /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/loss -fields thlm,wp2 -num_time_windows 1 bomex
Output directory: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/loss
 - normalized benchmark: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/loss/bomex_normalized_benchmark.nc
 - loss timing: absolute_window=[10800, 21600] s, model_time_initial=0 s, model_time_final=21600 s, stats_tstart=10800 s, stats_tend=21600 s, stats_tsamp=60 s, stats_tout=10800 s, num_time_windows=1
=================== Running bomex loss ===================
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_stats_output_consistency@2/.venv-jax (Python 3.12)
  Accelerator: cpu
nzm = 88 -- nzt = 87
Initialized bomex case: nzm=88, nzt=87, ngrdcol=4
  dt_main=60.0s, time=0.0s to 21600.0s, 360 steps
benchmark timing: window 1 records 181 360 absolute_window 10800 21600 benchmark_window 10800 21600 matched_window 10860.0 21600.0
CLUBB cleanup complete.
variable scaled_rmse_col1 scaled_rmse_col2 scaled_rmse_col3 scaled_rmse_col4 corr_col1 corr_col2 corr_col3 corr_col4 std_ratio_col1 std_ratio_col2 std_ratio_col3 std_ratio_col4 crmse_norm_col1 crmse_norm_col2 crmse_norm_col3 crmse_norm_col4 bias_norm_col1 bias_norm_col2 bias_norm_col3 bias_norm_col4 best_col
thlm   3.91956447E-02   3.53966409E-02   2.95646473E-02   2.25595021E-02   9.98580577E-01   9.98765702E-01   9.99060190E-01   9.99426315E-01   9.83254775E-01   9.85495711E-01   9.88536510E-01   9.92271089E-01   5.54230238E-02   5.14117206E-02   4.46036454E-02   3.46155667E-02   3.10104168E-02   3.16111189E-02   3.24470619E-02   3.35142902E-02 col4
wp2   7.24953523E+00   7.89413668E+00   8.69197406E+00   9.55540817E+00   7.35543498E-01   7.25392204E-01   7.11814778E-01   7.01292346E-01   1.33702698E+00   1.37319581E+00   1.41421878E+00   1.46451045E+00   9.05957029E-01   9.45227834E-01   9.93323262E-01   1.04436149E+00  -1.06869948E-01  -1.12773788E-01  -1.05198881E-01  -7.86206387E-02 col1
[PASS] loss_run: /home/jenkins/workspace/clubb_stats_output_consistency@2/output/jax_loss_consistency/bomex/loss/bomex_stats.nc


======================== Comparison ========================
[PASS] loss_vs_equivalent_normal: thlm(max_abs=0.000000e+00, max_rel=0.000000e+00); wp2(max_abs=0.000000e+00, max_rel=0.000000e+00)

[PASS] reported_loss_metrics_vs_netcdf: thlm(scaled_rmse(max_abs=3.627987e-11, max_rel=1.024952e-09); corr(max_abs=3.455519e-10, max_rel=3.457503e-10); std_ratio(max_abs=2.881491e-10, max_rel=2.930564e-10); crmse_norm(max_abs=3.955318e-11, max_rel=1.067515e-09); bias_norm(max_abs=4.445293e-11, max_rel=1.406243e-09)); wp2(scaled_rmse(max_abs=4.571335e-09, max_rel=5.790798e-10); corr(max_abs=3.960647e-10, max_rel=5.511205e-10); std_ratio(max_abs=2.824899e-09, max_rel=2.057172e-09); crmse_norm(max_abs=4.746117e-10, max_rel=4.544515e-10); bias_norm(max_abs=4.811295e-10, max_rel=4.573523e-09))


======================== Summary ========================
Loss-driver stats output and reported metrics are internally consistent.
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[PASS] bs4_tout600_manual_average_vs_bs4_tout60: checked 791 time-dependent variables, max_abs=2.980232e-08, max_rel=1.000000e+00

======================== Windowing Checks ========================
[PASS] bs4_tout60_window5400_16200_selected_window_vs_bs4_tout60: checked 800 variables against window (5400, 16200)
[PASS] bs4_tout300_window5400_16200_manual_average_vs_bs4_tout60: checked 791 time-dependent variables, max_abs=2.678344e-05, max_rel=1.110223e+13

======================== Summary ========================
All stats consistency checks passed.
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] End of Pipeline
Finished: SUCCESS