+ python tests/analyze_tuner_sample_history.py output/tuner/new_tuner_test -metric scaled_rmse -min_samples 2 --require_param_variation
Discovered 12 sample-history target(s).
=== Sample history 1/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260805_050808_472375_661406 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260805_050808_472375_661406
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260805_050808_472375_661406/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 2/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260814_042214_740451_549125 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260814_042214_740451_549125
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260814_042214_740451_549125/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 3/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260821_045734_330363_3851824 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260821_045734_330363_3851824
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260821_045734_330363_3851824/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 4/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260825_050141_635309_3299620 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260825_050141_635309_3299620
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260825_050141_635309_3299620/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 5/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260902_132623_422210_2852329 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260902_132623_422210_2852329
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260902_132623_422210_2852329/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 6/12: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260909_043811_455011_1487231 ===
Tuner Sample History
job: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260909_043811_455011_1487231
chunks: 1
first_chunk: output/tuner/new_tuner_test/complex/cli_arm_bomex_20260909_043811_455011_1487231/sample_history/sample_history_000001.npz
samples: 4
params: 102
cases: 2
fields: 2
observations: 10
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 4 samples x 10 retained columns
mode 1: singular=6.10319, explained=93.12%
strongest observations:
bomex/cloud_frac/w3:12600-15300s/scaled_rmse loading=-0.327
bomex/cloud_frac/w1:7200-9900s/scaled_rmse loading=-0.327
bomex/cloud_frac/w2:9900-12600s/scaled_rmse loading=-0.326
arm/rcm/w1:68400-72000s/scaled_rmse loading=-0.326
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=-0.324
strongest parameter correlations:
C8=+0.956
C11=+0.270
mode 2: singular=1.37261, explained=4.71%
strongest observations:
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.744
bomex/rcm/w1:7200-9900s/scaled_rmse loading=+0.458
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.343
arm/cloud_frac/w1:68400-72000s/scaled_rmse loading=+0.187
bomex/rcm/w4:15300-18000s/scaled_rmse loading=-0.155
strongest parameter correlations:
C11=-0.941
C8=+0.236
mode 3: singular=0.931153, explained=2.17%
strongest observations:
bomex/rcm/w1:7200-9900s/scaled_rmse loading=-0.746
bomex/rcm/w4:15300-18000s/scaled_rmse loading=+0.418
bomex/rcm/w3:12600-15300s/scaled_rmse loading=-0.331
bomex/cloud_frac/w4:15300-18000s/scaled_rmse loading=+0.244
bomex/rcm/w2:9900-12600s/scaled_rmse loading=-0.183
strongest parameter correlations:
C11=+0.206
C8=-0.176
=== Sample history 7/12: output/tuner/new_tuner_test/simple/cli_bomex_20260805_050759_747108_661221 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260805_050759_747108_661221
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260805_050759_747108_661221/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
=== Sample history 8/12: output/tuner/new_tuner_test/simple/cli_bomex_20260814_042206_042169_548846 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260814_042206_042169_548846
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260814_042206_042169_548846/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
=== Sample history 9/12: output/tuner/new_tuner_test/simple/cli_bomex_20260821_045724_414557_3851504 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260821_045724_414557_3851504
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260821_045724_414557_3851504/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
=== Sample history 10/12: output/tuner/new_tuner_test/simple/cli_bomex_20260825_050130_911468_3299398 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260825_050130_911468_3299398
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260825_050130_911468_3299398/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
=== Sample history 11/12: output/tuner/new_tuner_test/simple/cli_bomex_20260902_132613_763552_2852012 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260902_132613_763552_2852012
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260902_132613_763552_2852012/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
=== Sample history 12/12: output/tuner/new_tuner_test/simple/cli_bomex_20260909_043801_641961_1486977 ===
Tuner Sample History
job: output/tuner/new_tuner_test/simple/cli_bomex_20260909_043801_641961_1486977
chunks: 1
first_chunk: output/tuner/new_tuner_test/simple/cli_bomex_20260909_043801_641961_1486977/sample_history/sample_history_000001.npz
samples: 8
params: 102
cases: 1
fields: 1
observations: 1
metrics: scaled_rmse, correlation, std_ratio, centered_rmse_norm, bias_norm
Checks performed
- sample-history chunks exist and are sequentially numbered
- every chunk contains required metadata, sample, and loss arrays
- metadata arrays match exactly across chunks
- schema version matches the current observation-axis format
- sample IDs are unique and cover 0..sample_count-1
- parameter and loss arrays have the expected shapes and finite values
- observation metadata covers every case/field/window exactly once
- at least 2 sample(s) are present
- at least one tuned parameter varies across samples
checks: OK
SVD (scaled_rmse)
matrix_shape: 8 samples x 1 retained columns
mode 1: singular=2.82843, explained=100.00%
strongest observations:
bomex/cloud_frac/w1:10800-21600s/scaled_rmse loading=+1.000
strongest parameter correlations:
C8=-1.000
