Skip to content
Skipping 350 KB.. Full Log
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud1] PASSED [ 54%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud2] PASSED [ 63%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-mixture] PASSED [ 72%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud2] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_empty_sample_reports_source_stop PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_diagnostics.xml -
============================= slowest 15 durations =============================
0.50s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_empty_sample_reports_source_stop
0.49s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_weight_limiter_error_reaches_importance_driver
0.44s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-mixture]
0.25s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[-1]
0.11s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud2]
0.11s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud2]
0.10s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud1]
0.10s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-mixture]
0.09s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud1]

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 11 passed in 2.69s ==============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_driver.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_driver.xml -
============================= slowest 15 durations =============================
1.08s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 1.51s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_fortran_oracle.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_fortran_oracle.xml -
============================= slowest 15 durations =============================
1.16s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 1.59s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_port_structure.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_port_structure.py::test_silhs_inventory_excludes_mt95 PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_port_structure.xml -
============================= slowest 15 durations =============================

(3 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 0.04s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_sampling.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 42 items

clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse PASSED [  2%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[1] PASSED [  4%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[3] PASSED [  7%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_overlap_pool_is_independent_of_seed PASSED [  9%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation] PASSED [ 11%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip] PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp] PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-eight_cluster_allocation] PASSED [ 19%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-four_cluster_no_precip] PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-two_cluster_cp_nocp] PASSED [ 23%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-eight_cluster_allocation] PASSED [ 26%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-four_cluster_no_precip] PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-two_cluster_cp_nocp] PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-eight_cluster_allocation] PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-four_cluster_no_precip] PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-two_cluster_cp_nocp] PASSED [ 38%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-eight_cluster_allocation] PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-four_cluster_no_precip] PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-two_cluster_cp_nocp] PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-eight_cluster_allocation] PASSED [ 47%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-four_cluster_no_precip] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-two_cluster_cp_nocp] PASSED [ 52%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1] PASSED [ 54%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2] PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-3] PASSED [ 59%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1] PASSED [ 61%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2] PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3] PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference PASSED [ 69%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_vertical_overlap_matches_scalar_recurrence_and_maximum_overlap PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[False] PASSED [ 73%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[True] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_rms_uses_weighted_second_moment_and_real_probability PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-True] PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[False] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[True] PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_invalid_category_draw_is_reported_in_jit PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1] PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[-1] PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_sampling.xml -
============================= slowest 15 durations =============================
2.87s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation]
2.62s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse
2.29s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False]
2.19s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference
1.67s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip]
1.66s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp]
1.04s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1]
0.89s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True]
0.65s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1]
0.65s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1]
0.60s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False]
0.48s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2]
0.46s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3]
0.45s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-3]
0.43s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2]
============================= 42 passed in 22.82s ==============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_surface_schemes.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 4 items

clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97 PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_surface_schemes.xml -
============================= slowest 15 durations =============================
1.07s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback
0.95s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr
0.91s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr
0.11s call     clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97

(8 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 4 passed in 3.51s ===============================
JAX pytest module: auto_llm_generated_pytests/test_simple_rad_lba.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_simple_rad_lba.xml -
============================= slowest 15 durations =============================
0.59s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load
0.53s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal
0.38s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 3 passed in 1.97s ===============================
JAX pytest module: auto_llm_generated_pytests/test_simple_rad.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_simple_rad.xml -
============================= slowest 15 durations =============================
0.64s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean
0.23s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud
0.15s call     clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 3 passed in 1.46s ===============================
JAX pytest module: auto_llm_generated_pytests/test_soil_vegetation.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_soil_vegetation.xml -
============================= slowest 15 durations =============================
0.38s call     clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration
0.19s call     clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 2 passed in 1.02s ===============================
JAX pytest module: auto_llm_generated_pytests/test_solver.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_solver.xml -
============================= slowest 15 durations =============================
0.27s call     clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col
0.26s call     clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col
0.25s call     clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 3 passed in 1.22s ===============================
JAX pytest module: auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py::test_conversions PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.xml -
============================= slowest 15 durations =============================

(3 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 0.43s ===============================
JAX pytest module: auto_llm_generated_pytests/test_splatting_autodiff.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 6 items

clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0] PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25] PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25] PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25] PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_splatting_autodiff.xml -
============================= slowest 15 durations =============================
5.29s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0]
0.76s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0]
0.49s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25]
0.37s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25]
0.36s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0]
0.34s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25]

(9 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 6 passed in 8.06s ===============================
JAX pytest module: auto_llm_generated_pytests/test_sponge_damp_xp23.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_sponge_damp_xp23.xml -
============================= slowest 15 durations =============================
1.04s call     clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 1.51s ===============================
JAX pytest module: auto_llm_generated_pytests/test_spurious_source.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_spurious_source.xml -
============================= slowest 15 durations =============================
0.22s call     clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 0.67s ===============================
JAX pytest module: auto_llm_generated_pytests/test_stats_output_time.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_output_time.py::test_stats_timestamp_uses_end_of_current_model_step PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_stats_output_time.xml -
============================= slowest 15 durations =============================

(3 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 0.54s ===============================
JAX pytest module: auto_llm_generated_pytests/test_stats_writer.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 20 items

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_expansion_matches_source_families PASSED [  5%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt"-expected name | grid | units | long_name] PASSED [ 10%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | bad_grid | K | Profile"-Invalid stats grid] PASSED [ 15%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt | K | Profile-Malformed stats registry entry] PASSED [ 20%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = " | zt | K | Profile"-name and grid must be non-empty] PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_single_quoted_registry_entry_is_supported PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_sampling_uses_open_closed_absolute_time_window PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked PASSED [ 55%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps PASSED [ 60%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time PASSED [ 65%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary PASSED [ 70%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_config_metadata_data_and_source_grid_contract PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_radiation_registry_entries_require_radiation_grids PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record PASSED [100%]

=============================== warnings summary ===============================
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:500: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    self._time_bnds_varid[self._time_index - 1, :] = (

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:519: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    varid[t, :, col_start:col_end] = avg.T

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:876: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    pnv[i, :] = np.array(list(padded), dtype="S1")

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:882: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    cpv[:, :vals.shape[0]] = vals.T

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:739: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    varid[t, :, :, col] = samples[:, :, :, ivar].transpose(2, 1, 0)

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:766: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    self._lh_u_varids[ivar][t, :, :, col] = uniform_vals[:, :, :, ivar].transpose(2, 1, 0)

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:767: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    self._lh_u_varids[-2][t, :, :, col] = mixture_comp.transpose(2, 1, 0)

clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
  /home/jenkins/workspace/clubb_branch_jax@2/clubb_jax/src/CLUBB_core/stats_netcdf.py:768: DeprecationWarning: Setting the shape on a NumPy array has been deprecated in NumPy 2.5.
  As an alternative, you can create a new view using np.reshape (with copy=False if needed).
    self._lh_u_varids[-1][t, :, :, col] = sample_weights.transpose(2, 1, 0)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_stats_writer.xml -
============================= slowest 15 durations =============================
4.70s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
2.52s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts
0.36s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps
0.13s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample
0.12s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors
0.05s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time
0.04s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema
0.03s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
0.03s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary
0.01s setup    clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt | K | Profile-Malformed stats registry entry]
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked

(3 durations < 0.005s hidden.  Use -vv to show these durations.)
======================= 20 passed, 19 warnings in 8.48s ========================
JAX pytest module: auto_llm_generated_pytests/test_sunray_sw.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_sunray_sw.xml -
============================= slowest 15 durations =============================
0.45s call     clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 0.90s ===============================
JAX pytest module: auto_llm_generated_pytests/test_time_select.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_time_select.xml -
============================= slowest 15 durations =============================
0.92s call     clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere
0.16s call     clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 2 passed in 1.56s ===============================
JAX pytest module: auto_llm_generated_pytests/test_T_in_K.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_T_in_K.py::test_closed_form PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_T_in_K.py::test_exact_inverse PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_T_in_K.xml -
============================= slowest 15 durations =============================

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 2 passed in 0.46s ===============================
JAX pytest module: auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 4 items

clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.xml -
============================= slowest 15 durations =============================
1.35s call     clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo
0.97s call     clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad
0.88s call     clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives
0.55s call     clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients

(8 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 4 passed in 4.25s ===============================
JAX pytest module: auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 8 items

clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2 PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2 PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.xml -
============================= slowest 15 durations =============================
2.20s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2

(7 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 8 passed in 2.74s ===============================
JAX pytest module: auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 8 items

clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3 PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2 PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1 PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3 PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3 PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2 PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3 PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.xml -
============================= slowest 15 durations =============================
2.15s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2

(7 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 8 passed in 2.73s ===============================
JAX pytest module: auto_llm_generated_pytests/test_unsupported_config_guards.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 14 items

clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_baseline_and_supported_radiation_schemes_pass PASSED [  7%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg0-overrides0-microphys_scheme] PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg1-overrides1-l_gfdl_activation] PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg2-overrides2-rad_scheme] PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg3-overrides3-l_calc_thlp2_rad] PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg4-overrides4-Sponge damping] PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg5-overrides5-lh_microphys_type] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg6-overrides6-l_silhs_rad] PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg7-overrides7-l_restart] PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg8-overrides8-l_input_fields] PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg9-overrides9-l_test_grid_generalization] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg10-overrides10-grid_adapt_in_time_method] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_supported_microphysics_and_cloud_sedimentation_pass_initial_gate PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_unsupported_config_guards.xml -
============================= slowest 15 durations =============================
0.04s call     clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure

(14 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 14 passed in 0.56s ==============================
JAX pytest module: auto_llm_generated_pytests/test_update_xp2_mc.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_update_xp2_mc.xml -
============================= slowest 15 durations =============================
2.61s call     clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp
0.09s call     clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 2 passed in 3.23s ===============================
JAX pytest module: auto_llm_generated_pytests/test_validation_checks.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 6 items

clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_assert_corr_symmetric_behavior PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_sfc_varnce_check_behavior PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_length_check_behavior PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_rad_check_behavior PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_invalid_model_arrays_behavior PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_validation_checks.xml -
============================= slowest 15 durations =============================
0.09s call     clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior

(14 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 6 passed in 0.61s ===============================
JAX pytest module: auto_llm_generated_pytests/test_w_up_in_cloud.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item

clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_w_up_in_cloud.xml -
============================= slowest 15 durations =============================
2.21s call     clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants

(2 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 1 passed in 2.66s ===============================
JAX pytest commands: 143 modules selected, 0 module commands failed.
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Expected failure test)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_comparison_mutation_test.py
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
Mutation test artifacts: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_comparison_mutation_dvl6fqup
Control: running unmodified bomex comparison...
Control passed.
Mutation heating: running comparison...
PASS heating: thlm mean absolute difference 0.00015; failing columns [1, 2, 3, 4].
Mutation parameter_handling: running comparison...
PASS parameter_handling: wp3 mean absolute difference 9.25992e-07; failing columns [2, 3, 4].
Mutation first_column: running comparison...
PASS first_column: wp3 mean absolute difference 4.69019e-07; failing columns [2, 3, 4].
Mutation missing_stat: running comparison...
PASS missing_stat: wprtp absent only from JAX output; strict comparison rejected it.

==============================================================================
Expected failure test: PASS
==============================================================================
Case: bomex | 4 timesteps x 60 s | 4 columns | CPU/double
Statistics: input/stats/multi_col_stats.in
Tolerances: JAX-versus-Fortran harness defaults (absolute 1e-07; percentage 1e-07%)

[PASS] Unmodified control — JAX and Fortran matched.

[PASS] heating
  Add 1e-6 K/s of spurious heating to every column.
  Numerical difference detected; both models completed 4 timesteps.
  thlm: mean absolute difference 0.00015; mean percentage difference 4.91235e-05%
  Failing columns: 1, 2, 3, 4; first comparison failure: timestep 1.

[PASS] parameter_handling
  Load C8 as [0.2, 0.3, 0.4, 0.5] instead of [0.2, 0.4, 0.6, 0.8].
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 9.25992e-07; mean percentage difference 0.244887%
  Failing columns: 2, 3, 4; first comparison failure: timestep 1.

[PASS] first_column
  Use column 1's previous wp3 in every column's timestep equation.
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 4.69019e-07; mean percentage difference 0.118965%
  Failing columns: 2, 3, 4; first comparison failure: timestep 3.

[PASS] missing_stat
  Omit wprtp from JAX statistics output while keeping its calculation.
  wprtp is missing only from JAX output; both models completed 4 timesteps.
  Strict bindiff detected the missing variable; other stats were unchanged.

Result: PASS — 4/4 mutations verified | 110.9 s
Logs and outputs: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_comparison_mutation_dvl6fqup
==============================================================================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Jax vs Fortran: standard stats)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ ./tests/run_jax_vs_fortran_cases.py -workers 8
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: case default
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 1 flag set = 23 JAX/Fortran pairs
  Flag sets:
    default
  Cases:
    arm (360 iterations)
    atex (360 iterations)
    bomex (native duration)
    cobra (360 iterations)
    dycoms2_rf01 (native duration)
    dycoms2_rf01_fixed_sst (300 iterations)
    dycoms2_rf02_nd (native duration)
    fire (native duration)
    gabls2 (360 iterations)
    gabls3_night (360 iterations)
    jun25_altocu (180 iterations)
    neutral (native duration)
    wangara (native duration)
    dycoms2_rf02_do (native duration)
    dycoms2_rf02_ds (240 iterations)
    lba_kk (360 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (380 iterations)
      - dt_main: 60 s
    lba (93 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (73 iterations)
      - percentage limit: 0.001%
    nov11_altocu (62 iterations)
      - percentage limit: 0.001%
    rico_silhs (360 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (240 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (74 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-----------------------------------------------------------------------------------------------------------------
[match         ] default                  fire                       180 / 180      163.0          4.2      172.7
[match         ] default                  dycoms2_rf01_fixed_sst     300 / 300      209.9          3.4      219.7
[match         ] default                  dycoms2_rf02_nd            360 / 360      255.3          5.4      268.6
[match         ] default                  dycoms2_rf01               240 / 240      233.0         21.5      270.3
[match         ] default                  arm                        360 / 360      260.5         10.7      284.5
[match         ] default                  bomex                      360 / 360      270.6          8.0      291.6
[match         ] default                  cobra                      360 / 360      275.9         12.0      298.7
[match         ] default                  atex                       360 / 360      277.5         15.8      307.0
[match         ] default                  gabls3_night               360 / 360       93.7          5.3      104.7
[match         ] default                  gabls2                     360 / 360      134.7         21.6      163.6
[match         ] default                  jun25_altocu               180 / 180      186.8          8.9      203.2
[match         ] default                  neutral                    360 / 360      289.1          8.6      306.1
[match         ] default                  lba                          93 / 93      287.0          7.0      300.7
[match         ] default                  wangara                    480 / 480      334.5          9.5      353.0
[match         ] default                  rico                       380 / 380      338.9         10.8      353.9
[match         ] default                  clex9_oct14                  73 / 73      203.5          4.9      217.1
[match         ] default                  dycoms2_rf02_ds            240 / 240      440.3         23.6      473.3
[match         ] default                  nov11_altocu                 62 / 62      194.0          4.2      203.3
[match         ] default                  rico_silhs                 360 / 360      147.7          7.1      158.3
[match         ] default                  lba_kk                     360 / 360      571.3         18.0      597.9
[match         ] default                  lba_kk_silhs               240 / 240      245.8         25.0      276.3
[match         ] default                  dycoms2_rf02_do            360 / 360      609.8         29.0      647.6
[match         ] default                  lba_silhs                    74 / 74      331.2         18.1      354.0

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 18m 22.6s
Results JSON: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/final_bindiff.log [passed]
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Jax Python vs Fortran cases w varying flags)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_vs_fortran_cases.py -debug 0 -max_iters 5 -workers 8 -flag_config_file input/flag_sets/config_core_flags_wo_never_supported_jax_features.json
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: 0
  Forwarded to both runs: -debug 0 -max_iters 5
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 18 flag sets = 414 JAX/Fortran pairs
  Flag sets:
    default
    config_core_flags_wo_never_supported_jax_features_flag2
      - saturation_formula = 1
      - l_godunov_upwind_xpyp_ta = .true.
      - l_lh_importance_sampling = .false.
      - l_random_k_lh_start = .true.
      - l_max_overlap_in_cloud = .false.
    config_core_flags_wo_never_supported_jax_features_flag3
      - ipdf_call_placement = 1
      - l_ho_trad_coriolis = .true.
      - l_ho_nontrad_coriolis = .true.
    config_core_flags_wo_never_supported_jax_features_flag4
      - iiPDF_type = 7
    config_core_flags_wo_never_supported_jax_features_flag5
      - l_predict_upwp_vpwp = .false.
    config_core_flags_wo_never_supported_jax_features_flag6
      - l_wp2_fill_holes_tke = .false.
      - l_enable_relaxed_clipping = .true.
      - l_min_xp2_from_corr_wx = .false.
      - l_add_dycore_grid = .true.
      - l_lh_straight_mc = .true.
    config_core_flags_wo_never_supported_jax_features_flag7
      - l_diag_Lscale_from_tau = .true.
      - fill_holes_type = 3
    config_core_flags_wo_never_supported_jax_features_flag8
      - l_upwind_xpyp_ta = .false.
      - l_upwind_xm_ma = .false.
      - l_lh_clustered_sampling = .false.
      - l_lh_instant_var_covar_src = .false.
      - l_lh_limit_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag9
      - l_min_wp2_from_corr_wx = .true.
      - l_stability_correct_tau_zm = .true.
      - l_damp_wp2_using_em = .false.
      - l_use_C7_Richardson = .false.
    config_core_flags_wo_never_supported_jax_features_flag10
      - l_vert_avg_closure = .true.
      - l_use_cloud_cover = .true.
      - l_damp_wp3_Skw_squared = .false.
      - l_use_C11_Richardson = .true.
      - l_rcm_in_cloud_k_lh_start = .false.
    config_core_flags_wo_never_supported_jax_features_flag11
      - l_rcm_supersat_adj = .false.
      - l_C2_cloud_frac = .true.
      - l_use_precip_frac = .false.
      - l_do_expldiff_rtm_thlm = .true.
      - l_use_shear_Richardson = .true.
    config_core_flags_wo_never_supported_jax_features_flag12
      - l_prescribed_avg_deltaz = .true.
      - l_stability_correct_Kh_N2_zm = .true.
      - l_trapezoidal_rule_zt = .true.
      - l_trapezoidal_rule_zm = .true.
      - l_call_pdf_closure_twice = .true.
    config_core_flags_wo_never_supported_jax_features_flag13
      - l_brunt_vaisala_freq_moist = .true.
      - l_use_thvm_in_bv_freq = .true.
      - l_lmm_stepping = .true.
      - l_vary_convect_depth = .true.
    config_core_flags_wo_never_supported_jax_features_flag14
      - l_use_tke_in_wp3_pr_turb_term = .false.
      - l_use_tke_in_wp2_wp3_K_dfsn = .true.
      - l_use_wp3_lim_with_smth_Heaviside = .true.
      - l_smooth_Heaviside_tau_wpxp = .false.
      - l_modify_limiters_for_cnvg_test = .true.
    config_core_flags_wo_never_supported_jax_features_flag15
      - l_mono_flux_lim_rtm = .false.
      - l_mono_flux_lim_um = .false.
      - l_mono_flux_lim_vm = .false.
      - l_mono_flux_lim_spikefix = .false.
    config_core_flags_wo_never_supported_jax_features_flag16
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .false.
      - l_lh_var_frac = .true.
    config_core_flags_wo_never_supported_jax_features_flag17
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .true.
      - l_lh_normalize_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag18
      - ipdf_call_placement = 3
  Cases:
    arm (5 iterations)
    atex (5 iterations)
    bomex (5 iterations)
    cobra (5 iterations)
    dycoms2_rf01 (5 iterations)
    dycoms2_rf01_fixed_sst (5 iterations)
    dycoms2_rf02_nd (5 iterations)
    fire (5 iterations)
    gabls2 (5 iterations)
    gabls3_night (5 iterations)
    jun25_altocu (5 iterations)
    neutral (5 iterations)
    wangara (5 iterations)
    dycoms2_rf02_do (5 iterations)
    dycoms2_rf02_ds (5 iterations)
    lba_kk (5 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (5 iterations)
      - dt_main: 60 s
    lba (5 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (5 iterations)
      - percentage limit: 0.001%
    nov11_altocu (5 iterations)
      - percentage limit: 0.001%
    rico_silhs (5 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (5 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (5 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                                                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-------------------------------------------------------------------------------------------------------------------------------------------------
[match         ] default                                                  arm                            5 / 5       67.1          1.1       71.2
[match         ] default                                                  dycoms2_rf01_fixed_sst         5 / 5       68.7          1.0       72.5
[match         ] default                                                  bomex                          5 / 5       69.6          1.2       74.0
[match         ] default                                                  fire                           5 / 5       70.0          1.0       74.2
[match         ] default                                                  dycoms2_rf02_nd                5 / 5       70.9          1.5       75.6
[match         ] default                                                  atex                           5 / 5       71.0          1.6       75.7
[match         ] default                                                  cobra                          5 / 5       71.8          1.3       76.1
[match         ] default                                                  dycoms2_rf01                   5 / 5       71.9          1.5       76.4
[match         ] default                                                  gabls3_night                   5 / 5       27.2          1.0       30.2
[match         ] default                                                  neutral                        5 / 5       68.1          1.4       73.1
[match         ] default                                                  gabls2                         5 / 5       72.1          1.6       76.3
[match         ] default                                                  wangara                        5 / 5       67.8          1.4       72.5
[match         ] default                                                  jun25_altocu                   5 / 5       69.7          1.4       74.5
[match         ] default                                                  lba_kk                         5 / 5      116.6          1.4      125.3
[match         ] default                                                  dycoms2_rf02_ds                5 / 5      118.6          2.5      127.9
[match         ] default                                                  dycoms2_rf02_do                5 / 5      121.9          2.0      129.1
[match         ] default                                                  clex9_oct14                    5 / 5       84.4          1.4       90.1
[match         ] default                                                  nov11_altocu                   5 / 5       86.2          1.2       91.4
[match         ] default                                                  rico_silhs                     5 / 5       93.5          1.0       97.3
[match         ] default                                                  rico                           5 / 5      162.9          1.0      167.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  arm                            1 / 5       61.2          1.1       65.2
[match         ] default                                                  lba_kk_silhs                   5 / 5       75.8          1.5       82.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  atex                           1 / 5       61.0          1.5       66.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  bomex                          1 / 5       66.0          1.0       69.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  cobra                          1 / 5       64.7          1.1       69.0
[match         ] default                                                  lba                            5 / 5      166.2          1.3      175.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01_fixed_sst         1 / 5       59.3          0.9       65.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01                   1 / 5       61.0          1.3       67.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls3_night                   5 / 5       29.6          1.0       33.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_nd                1 / 5       62.0          1.0       67.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  fire                           1 / 5       60.9          1.0       64.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls2                         5 / 5       63.6          1.7       67.3
[match         ] default                                                  lba_silhs                      5 / 5      177.7          3.6      187.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  jun25_altocu                   1 / 5       64.4          1.6       69.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  neutral                        1 / 5       60.8          1.1       66.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  wangara                        1 / 5       61.3          1.1       66.9
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  rico_silhs                         -        7.8          1.0        8.7
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk_silhs                       -        6.4          0.9        7.2
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_silhs                          -        6.8          0.8        7.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_do                1 / 5      119.7          1.4      127.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_ds                1 / 5      120.2          1.6      127.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  clex9_oct14                    1 / 5       90.8          1.6       96.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk                         1 / 5      119.6          1.2      124.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  nov11_altocu                   1 / 5       87.7          1.2       92.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  arm                            5 / 5       64.6          1.0       68.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  rico                           5 / 5      154.2          1.0      159.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  atex                           5 / 5       56.6          1.2       64.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  bomex                          5 / 5       63.1          1.4       71.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  cobra                          5 / 5       67.7          1.2       71.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01_fixed_sst         5 / 5       61.8          0.9       65.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01                   5 / 5       64.0          1.5       68.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba                            1 / 5      164.6          1.2      170.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_nd                5 / 5       65.1          1.0       69.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls3_night                   5 / 5       27.0          0.9       29.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  fire                           5 / 5       61.3          0.9       65.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls2                         5 / 5       60.3          1.4       66.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  neutral                        5 / 5       64.3          1.0       68.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  jun25_altocu                   5 / 5       66.0          1.1       70.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  wangara                        5 / 5       64.8          1.0       68.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_do                5 / 5      112.6          1.2      120.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_ds                5 / 5      118.0          2.0      125.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk                         5 / 5      120.5          1.1      130.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  nov11_altocu                   5 / 5       87.6          1.2       92.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  clex9_oct14                    5 / 5       89.1          1.3       94.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico_silhs                     5 / 5       93.7          1.0       98.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico                           5 / 5      153.4          1.0      159.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk_silhs                   5 / 5       73.2          2.0       79.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  arm                                -       53.6          1.0       54.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba                            5 / 5      165.6          2.0      175.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  atex                               -       58.9          1.0       59.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  bomex                              -       59.5          1.8       61.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  cobra                              -       61.3          1.2       62.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls3_night                       -       29.3          1.4       30.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01_fixed_sst             -       59.3          1.1       60.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01                       -       59.5          1.5       61.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_nd                    -       60.5          1.0       61.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  fire                               -       54.1          1.4       55.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls2                             -       64.3          1.2       65.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  jun25_altocu                       -       58.1          1.0       59.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  neutral                            -       58.8          1.0       59.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  wangara                            -       55.3          1.1       56.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico                               -       30.2          1.3       31.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_silhs                      5 / 5      185.1          3.5      197.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_do                    -       65.7          1.6       67.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_ds                    -       62.5          1.6       64.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk                             -       58.5          1.2       59.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba                                -       61.6          1.2       62.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico_silhs                         -       32.8          1.0       33.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  clex9_oct14                        -       61.5          1.8       63.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk_silhs                       -       56.0          2.2       58.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  nov11_altocu                       -       67.1          1.9       69.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  arm                            5 / 5       62.4          1.0       66.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_silhs                          -       64.7          2.4       67.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  atex                           5 / 5       60.6          1.1       66.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  bomex                          5 / 5       61.1          1.0       64.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  cobra                          5 / 5       64.4          1.2       68.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls3_night                   5 / 5       30.2          1.3       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01                   5 / 5       60.7          1.3       67.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01_fixed_sst         5 / 5       57.1          1.4       63.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_nd                5 / 5       63.3          1.0       67.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  fire                           5 / 5       58.7          1.0       62.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls2                         5 / 5       61.3          1.3       64.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  jun25_altocu                   5 / 5       59.8          1.0       63.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  neutral                        5 / 5       59.0          1.1       65.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  wangara                        5 / 5       60.8          0.9       64.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_do                5 / 5      115.0          2.5      121.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_ds                5 / 5      118.2          1.4      123.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  clex9_oct14                    5 / 5       87.5          1.2       93.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk                         5 / 5      118.7          1.3      125.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  nov11_altocu                   5 / 5       86.0          1.3       93.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico_silhs                     5 / 5       92.4          1.3       96.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico                           5 / 5      149.3          1.0      155.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  arm                            1 / 5       62.3          1.6       65.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba                            5 / 5      173.9          1.2      179.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  bomex                              -       60.0          1.3       62.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  atex                               -       60.4          1.8       63.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk_silhs                   5 / 5       74.8          1.6       79.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  cobra                              -       63.9          1.4       67.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls3_night                       -       30.4          0.9       32.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01                       -       64.0          2.6       68.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01_fixed_sst             -       64.3          1.0       66.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_nd                    -       65.7          1.2       68.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  fire                               -       63.1          1.1       65.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls2                             -       65.3          1.4       68.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  jun25_altocu                   1 / 5       62.1          2.1       67.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  neutral                            -       64.7          1.1       67.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  wangara                            -       64.1          1.1       66.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_silhs                      5 / 5      186.5          3.4      195.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_do                    -      121.6          2.1      125.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_ds                    -      122.9          1.7      126.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk                             -      123.7          2.0      127.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  clex9_oct14                        -       91.9          1.7       95.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  nov11_altocu                       -       88.9          1.5       92.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  arm                                -       19.7          1.2       20.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  atex                               -       18.3          1.1       19.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  bomex                              -       19.8          1.0       20.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico_silhs                         -       96.9          1.0       99.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico                               -      158.5          1.1      161.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  cobra                              -       19.4          1.1       20.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01                       -       20.3          1.4       21.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01_fixed_sst             -       22.3          1.4       23.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_nd                    -       21.2          1.0       22.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  fire                               -       21.2          0.9       22.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls2                             -       21.0          1.3       22.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk_silhs                       -       68.4          2.4       72.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls3_night                       -       20.6          1.0       21.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba                                -      165.9          2.5      170.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  jun25_altocu                       -       18.6          1.3       20.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  neutral                            -       16.8          1.3       18.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  wangara                            -       19.2          1.0       20.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_do                    -       21.0          1.3       22.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk                             -       17.5          1.1       18.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico                               -       17.5          1.3       18.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_ds                    -       19.4          1.5       21.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  clex9_oct14                        -       21.1          1.2       22.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba                                -       23.6          1.2       24.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  nov11_altocu                       -       21.6          1.1       22.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico_silhs                         -       18.2          1.0       19.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk_silhs                       -       18.2          1.5       19.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_silhs                          -       21.7          2.4       24.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  arm                            5 / 5       54.9          1.3       58.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  atex                           5 / 5       55.6          1.3       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  bomex                          5 / 5       59.4          1.6       66.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  cobra                          5 / 5       68.0          1.2       72.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01_fixed_sst         5 / 5       64.2          1.0       68.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01                   5 / 5       65.4          1.4       69.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_silhs                          -      174.6          4.0      180.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_nd                5 / 5       64.7          1.0       68.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls3_night                   5 / 5       28.2          1.0       31.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  fire                           5 / 5       58.5          1.0       64.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls2                         5 / 5       58.8          2.0       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  jun25_altocu                   5 / 5       59.5          1.8       65.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  neutral                        5 / 5       62.8          1.1       66.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  wangara                        5 / 5       65.4          1.1       71.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_do                5 / 5      124.5          1.4      128.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_ds                5 / 5      124.0          1.5      128.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk                         5 / 5      116.0          1.2      124.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  clex9_oct14                    5 / 5       92.1          1.4       98.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  nov11_altocu                   5 / 5       92.0          1.1       97.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico_silhs                     5 / 5       98.9          1.0      102.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico                           5 / 5      162.6          1.2      167.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  arm                            5 / 5       63.0          1.1       67.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk_silhs                   5 / 5       86.7          2.1       92.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  atex                           5 / 5       63.0          1.1       67.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  bomex                          5 / 5       62.8          1.0       66.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba                            5 / 5      178.6          1.2      186.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  cobra                          5 / 5       70.2          1.1       74.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls3_night                   5 / 5       28.8          0.9       31.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01                   5 / 5       61.4          1.2       65.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01_fixed_sst         5 / 5       57.1          1.0       60.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  fire                           5 / 5       61.5          1.0       65.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_nd                5 / 5       65.7          1.1       69.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls2                         5 / 5       63.9          1.4       67.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  jun25_altocu                   5 / 5       63.5          1.1       67.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_silhs                      5 / 5      196.4          2.8      203.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  neutral                        5 / 5       67.7          1.0       71.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  wangara                        5 / 5       67.3          1.1       71.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_do                5 / 5      119.5          1.9      133.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_ds                5 / 5      122.4          1.4      128.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk                         5 / 5      123.3          1.2      129.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  nov11_altocu                   5 / 5       92.8          1.2       98.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  clex9_oct14                    5 / 5       94.9          1.3      100.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico_silhs                     5 / 5       95.8          1.0      100.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico                           5 / 5      151.3          1.0      156.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk_silhs                   5 / 5       76.8          1.7       85.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 arm                            1 / 5       57.9          1.1       66.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba                            5 / 5      168.8          1.8      179.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 bomex                          1 / 5       64.5          1.1       70.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 atex                           1 / 5       64.8          1.1       70.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 cobra                          1 / 5       66.9          1.2       71.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01                   1 / 5       56.9          1.3       61.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls3_night                   5 / 5       33.5          1.0       36.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01_fixed_sst         1 / 5       56.1          1.0       60.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 fire                           1 / 5       53.5          1.0       59.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_nd                1 / 5       60.9          1.1       70.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls2                         5 / 5       58.0          1.3       62.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 jun25_altocu                   1 / 5       59.0          1.1       63.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 neutral                        1 / 5       57.6          1.0       61.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_silhs                      5 / 5      185.3          2.8      192.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 wangara                        1 / 5       67.5          1.1       72.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_do                1 / 5      114.2          1.9      120.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 clex9_oct14                    1 / 5       87.8          1.4       96.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_ds                1 / 5      111.4          1.8      120.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk                         1 / 5      110.8          1.6      116.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 nov11_altocu                   1 / 5       81.3          1.2       88.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico_silhs                     5 / 5       94.1          1.0      101.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico                           5 / 5      142.4          1.2      152.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 arm                            5 / 5       59.0          1.1       63.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 atex                           5 / 5       61.9          1.1       66.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba                            1 / 5      163.5          1.3      169.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk_silhs                   1 / 5       71.5          1.5       76.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 bomex                          5 / 5       59.0          1.3       66.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01                   5 / 5       55.1          1.3       61.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 cobra                          5 / 5       60.7          1.3       66.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01_fixed_sst         5 / 5       56.9          1.4       63.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls3_night                   5 / 5       33.6          1.0       36.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 fire                           5 / 5       61.3          1.0       65.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_nd                5 / 5       65.1          1.0       68.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls2                         5 / 5       61.5          1.3       65.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 neutral                        5 / 5       59.7          1.2       65.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 jun25_altocu                   5 / 5       59.8          1.2       66.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_silhs                      1 / 5      179.3          3.8      192.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 wangara                        5 / 5       60.0          1.4       64.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_do                5 / 5      115.0          2.2      121.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_ds                5 / 5      118.7          1.6      124.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk                         5 / 5      117.7          1.3      122.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 clex9_oct14                    5 / 5       86.3          1.2       93.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 nov11_altocu                   5 / 5       90.4          1.1       95.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico_silhs                     5 / 5       93.7          0.9       97.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico                           5 / 5      149.4          1.0      153.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk_silhs                   5 / 5       70.1          1.5       74.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba                            5 / 5      168.3          1.9      177.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 cobra                          5 / 5       65.2          1.2       71.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 arm                            5 / 5       98.4          1.4      103.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 atex                           5 / 5       97.3          1.0      101.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 bomex                          5 / 5       97.8          1.0      101.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01                   5 / 5       96.2          1.3      100.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls3_night                   5 / 5       43.9          1.6       49.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01_fixed_sst         5 / 5       96.4          0.9       99.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls2                         5 / 5       70.1          1.5       76.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_silhs                      5 / 5      182.5          3.6      194.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_nd                5 / 5       99.1          1.0      102.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 fire                           5 / 5       95.8          1.0       99.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 jun25_altocu                   5 / 5       98.0          1.4      104.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 neutral                        5 / 5       97.1          1.3      102.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 wangara                        5 / 5       95.8          1.3      102.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_ds                5 / 5      146.6          1.4      151.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_do                5 / 5      166.2          1.3      170.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk                         5 / 5      152.2          2.1      160.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 nov11_altocu                   5 / 5      126.9          1.2      132.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico                           5 / 5      167.5          1.2      172.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 clex9_oct14                    5 / 5      129.1          1.2      134.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico_silhs                     5 / 5      115.6          0.9      120.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 arm                            5 / 5       63.0          1.4       69.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba                            5 / 5      213.2          1.5      222.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 atex                           5 / 5       59.5          1.4       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 bomex                          5 / 5       64.8          1.0       69.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 cobra                          5 / 5       66.7          1.1       72.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk_silhs                   5 / 5      108.6          1.5      113.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01                   5 / 5       65.0          1.3       69.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls3_night                   5 / 5       26.4          1.3       32.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01_fixed_sst         5 / 5       59.5          1.1       65.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_nd                5 / 5       61.1          1.4       65.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 fire                           5 / 5       57.3          1.4       62.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls2                         5 / 5       58.9          1.5       62.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 jun25_altocu                   5 / 5       59.2          1.1       63.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 neutral                        5 / 5       60.2          1.0       64.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 wangara                        5 / 5       58.7          1.0       63.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_silhs                      5 / 5      228.8          3.1      236.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk                         5 / 5      111.1          1.2      117.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 clex9_oct14                    5 / 5       91.6          1.3       98.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_ds                5 / 5      121.6          1.8      126.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_do                5 / 5      123.3          1.6      128.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 nov11_altocu                   5 / 5       83.8          1.1       88.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico                           5 / 5      144.7          1.0      152.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba                            5 / 5      162.3          1.6      171.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico_silhs                     5 / 5      101.9          1.4      106.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 arm                            5 / 5       64.7          1.0       68.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 atex                           5 / 5       65.6          1.1       69.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk_silhs                   5 / 5       71.2          1.5       75.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 bomex                          5 / 5       64.3          1.0       68.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 cobra                          5 / 5       60.6          1.1       64.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls3_night                   5 / 5       28.6          1.4       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01                   5 / 5       63.1          1.3       67.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01_fixed_sst         5 / 5       60.2          1.0       64.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls2                         5 / 5       59.1          1.5       62.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 fire                           5 / 5       61.7          1.1       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_nd                5 / 5       64.9          1.0       68.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 jun25_altocu                   5 / 5       64.1          1.0       68.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 neutral                        5 / 5       58.1          1.0       62.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_silhs                      5 / 5      185.7          3.1      195.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 wangara                        5 / 5       61.9          1.0       66.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_do                5 / 5      113.0          1.7      121.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_ds                5 / 5      110.6          1.5      120.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk                         5 / 5      115.1          1.9      120.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 clex9_oct14                    5 / 5       88.1          1.1       95.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 nov11_altocu                   5 / 5       89.7          1.1       95.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico                           5 / 5      148.6          1.2      153.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico_silhs                     5 / 5       93.8          0.9       97.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 arm                            5 / 5       60.8          1.3       64.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk_silhs                   5 / 5       72.9          1.5       78.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 atex                           5 / 5       57.8          1.4       62.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba                            5 / 5      168.1          1.6      182.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 bomex                          5 / 5       65.4          1.0       69.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 cobra                          5 / 5       65.5          1.2       69.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01                   5 / 5       64.8          1.3       69.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01_fixed_sst         5 / 5       53.0          1.0       61.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls3_night                   5 / 5       31.3          0.9       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_nd                5 / 5       62.4          1.4       66.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 fire                           5 / 5       66.2          1.2       72.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls2                         5 / 5       62.5          1.6       66.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 jun25_altocu                   5 / 5       58.2          1.1       62.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 neutral                        5 / 5       58.7          1.0       63.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 wangara                        5 / 5       56.7          1.0       61.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_silhs                      5 / 5      194.5          3.6      204.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 clex9_oct14                    5 / 5       77.2          1.4       86.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_do                5 / 5      124.9          1.3      129.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk                         5 / 5      115.1          1.4      119.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_ds                5 / 5      123.6          1.3      128.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 nov11_altocu                   5 / 5       81.8          1.2       88.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico_silhs                     5 / 5       88.2          1.0       92.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico                           5 / 5      140.6          1.1      144.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk_silhs                   5 / 5       69.1          1.4       73.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 arm                            5 / 5       61.3          1.1       65.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 atex                           5 / 5       59.9          1.0       63.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 bomex                          5 / 5       57.7          1.0       61.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba                            5 / 5      166.1          1.2      171.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 cobra                          5 / 5       65.1          1.1       69.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01                   5 / 5       57.8          1.2       62.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls3_night                   5 / 5       30.9          0.9       35.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01_fixed_sst         5 / 5       54.6          1.1       60.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 fire                           5 / 5       61.3          1.0       65.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_nd                5 / 5       64.1          1.0       67.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls2                         5 / 5       60.1          1.2       63.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 jun25_altocu                   5 / 5       62.1          1.1       66.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 neutral                        5 / 5       59.9          1.0       64.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 wangara                        5 / 5       62.1          1.0       68.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_silhs                      5 / 5      183.8          3.7      192.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_do                5 / 5      118.9          1.8      123.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_ds                5 / 5      119.3          1.6      126.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk                         5 / 5      118.1          1.6      124.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 clex9_oct14                    5 / 5       84.3          1.5       92.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 nov11_altocu                   5 / 5       89.0          1.6       97.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico                           5 / 5      152.2          1.0      156.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico_silhs                     5 / 5       98.1          0.9      102.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 arm                            5 / 5       62.6          1.1       67.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk_silhs                   5 / 5       78.1          1.6       83.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 atex                           5 / 5       70.3          1.2       75.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 bomex                          5 / 5       64.6          1.0       71.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba                            5 / 5      182.9          1.6      189.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 cobra                          5 / 5       65.3          1.1       69.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01                   5 / 5       65.6          1.3       69.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01_fixed_sst         5 / 5       51.9          1.2       60.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls3_night                   5 / 5       32.0          1.3       35.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 fire                           5 / 5       58.0          1.0       63.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_nd                5 / 5       67.1          1.1       73.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls2                         5 / 5       60.8          1.4       65.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 jun25_altocu                   5 / 5       56.3          1.0       60.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 neutral                        5 / 5       57.0          1.0       61.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 wangara                        5 / 5       59.2          1.0       64.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_silhs                      5 / 5      190.2          3.1      199.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_do                5 / 5      114.0          1.7      123.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_ds                5 / 5      116.9          1.6      121.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 clex9_oct14                    5 / 5       89.3          1.1       94.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk                         5 / 5      116.5          1.4      121.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 nov11_altocu                   5 / 5       86.4          1.2       92.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico_silhs                     5 / 5       93.6          1.0       99.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico                           5 / 5      148.2          1.0      152.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk_silhs                   5 / 5       67.7          1.8       72.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 atex                           5 / 5       58.2          1.2       62.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 arm                            5 / 5       67.0          1.1       71.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba                            5 / 5      177.5          1.2      185.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 bomex                          5 / 5       64.8          1.0       71.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01                   5 / 5       59.7          1.2       63.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 cobra                          5 / 5       70.0          1.2       76.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01_fixed_sst         5 / 5       58.7          1.0       63.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls3_night                   5 / 5       35.0          1.2       38.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_nd                5 / 5       58.6          1.0       62.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 fire                           5 / 5       62.7          1.0       66.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls2                         5 / 5       66.3          1.4       71.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 jun25_altocu                   5 / 5       59.6          1.1       63.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 neutral                        5 / 5       60.7          1.4       66.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 wangara                        5 / 5       61.0          1.4       67.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_silhs                      5 / 5      196.0          2.8      203.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_ds                5 / 5      106.7          1.4      111.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_do                5 / 5      121.7          1.4      129.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk                         5 / 5      119.6          1.7      125.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 clex9_oct14                    5 / 5       92.1          1.1       97.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 nov11_altocu                   5 / 5       84.2          1.1       88.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico_silhs                     5 / 5       96.0          1.1      100.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico                           5 / 5      149.0          1.1      152.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk_silhs                   5 / 5       71.6          1.4       75.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba                            5 / 5      153.2          1.1      159.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_silhs                      5 / 5      133.0          2.2      138.8

Overall cases:
  Match Diff Failed
  ----- ---- ------
    303   62     49

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag2:
  Match Diff Failed
  ----- ---- ------
      2   18      3

Flag set config_core_flags_wo_never_supported_jax_features_flag3:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag4:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag5:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag6:
  Match Diff Failed
  ----- ---- ------
      0   23      0

Flag set config_core_flags_wo_never_supported_jax_features_flag7:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag8:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag9:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag10:
  Match Diff Failed
  ----- ---- ------
      2   21      0

Flag set config_core_flags_wo_never_supported_jax_features_flag11:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag12:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag13:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag14:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag15:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag16:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag17:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag18:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 1h 19m 24.2s
Results JSON: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
Setting overall build result to FAILURE
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] junit
Recording test results
[Checks API] No suitable checks publisher found.
[Pipeline] script
[Pipeline] {
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: FAILURE