Skipping 389 KB..
Full LogTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTest
============================= slowest 15 durations =============================
0.46s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_weight_limiter_error_reaches_importance_driver
0.43s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_empty_sample_reports_source_stop
0.41s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-mixture]
0.23s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[-1]
0.11s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud2]
0.10s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud1]
0.10s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud1]
0.10s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud2]
0.09s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-mixture]
(6 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 11 passed in 2.52s ==============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_driver.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_driver.xml -
============================= slowest 15 durations =============================
1.05s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 1.49s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_fortran_oracle.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_fortran_oracle.xml -
============================= slowest 15 durations =============================
1.06s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 1.51s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_port_structure.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_port_structure.py::test_silhs_inventory_excludes_mt95 PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_port_structure.xml -
============================= slowest 15 durations =============================
(3 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 0.05s ===============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_sampling.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 42 items
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse PASSED [ 2%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[1] PASSED [ 4%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[3] PASSED [ 7%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_overlap_pool_is_independent_of_seed PASSED [ 9%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation] PASSED [ 11%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip] PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp] PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-eight_cluster_allocation] PASSED [ 19%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-four_cluster_no_precip] PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-two_cluster_cp_nocp] PASSED [ 23%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-eight_cluster_allocation] PASSED [ 26%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-four_cluster_no_precip] PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-two_cluster_cp_nocp] PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-eight_cluster_allocation] PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-four_cluster_no_precip] PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-two_cluster_cp_nocp] PASSED [ 38%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-eight_cluster_allocation] PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-four_cluster_no_precip] PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-two_cluster_cp_nocp] PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-eight_cluster_allocation] PASSED [ 47%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-four_cluster_no_precip] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-two_cluster_cp_nocp] PASSED [ 52%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1] PASSED [ 54%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2] PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-3] PASSED [ 59%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1] PASSED [ 61%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2] PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3] PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference PASSED [ 69%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_vertical_overlap_matches_scalar_recurrence_and_maximum_overlap PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[False] PASSED [ 73%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[True] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_rms_uses_weighted_second_moment_and_real_probability PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-True] PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[False] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[True] PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_invalid_category_draw_is_reported_in_jit PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1] PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[-1] PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_sampling.xml -
============================= slowest 15 durations =============================
2.53s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse
2.49s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation]
2.40s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False]
2.15s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference
1.47s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip]
1.46s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp]
1.11s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1]
0.90s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True]
0.64s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1]
0.63s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False]
0.63s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1]
0.51s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2]
0.49s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3]
0.47s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2]
0.38s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-eight_cluster_allocation]
============================= 42 passed in 22.24s ==============================
JAX pytest module: auto_llm_generated_pytests/test_silhs_surface_schemes.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 4 items
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97 PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_silhs_surface_schemes.xml -
============================= slowest 15 durations =============================
1.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr
1.00s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback
0.96s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr
0.12s call clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97
(8 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 4 passed in 3.57s ===============================
JAX pytest module: auto_llm_generated_pytests/test_simple_rad_lba.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_simple_rad_lba.xml -
============================= slowest 15 durations =============================
0.67s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal
0.60s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load
0.38s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal
(6 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 3 passed in 2.28s ===============================
JAX pytest module: auto_llm_generated_pytests/test_simple_rad.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_simple_rad.xml -
============================= slowest 15 durations =============================
0.66s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean
0.31s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud
0.11s call clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex
(6 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 3 passed in 1.64s ===============================
JAX pytest module: auto_llm_generated_pytests/test_soil_vegetation.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_soil_vegetation.xml -
============================= slowest 15 durations =============================
0.42s call clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration
0.21s call clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica
(4 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 2 passed in 1.25s ===============================
JAX pytest module: auto_llm_generated_pytests/test_solver.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 3 items
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_solver.xml -
============================= slowest 15 durations =============================
0.27s call clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col
0.25s call clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col
0.23s call clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual
(6 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 3 passed in 1.33s ===============================
JAX pytest module: auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py::test_conversions PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.xml -
============================= slowest 15 durations =============================
(3 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 0.56s ===============================
JAX pytest module: auto_llm_generated_pytests/test_splatting_autodiff.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 6 items
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0] PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25] PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25] PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25] PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_splatting_autodiff.xml -
============================= slowest 15 durations =============================
5.11s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0]
0.83s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0]
0.51s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25]
0.38s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25]
0.36s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0]
0.32s call clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25]
(9 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 6 passed in 8.07s ===============================
JAX pytest module: auto_llm_generated_pytests/test_sponge_damp_xp23.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_sponge_damp_xp23.xml -
============================= slowest 15 durations =============================
0.92s call clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 1.49s ===============================
JAX pytest module: auto_llm_generated_pytests/test_spurious_source.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_spurious_source.xml -
============================= slowest 15 durations =============================
0.22s call clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 0.78s ===============================
JAX pytest module: auto_llm_generated_pytests/test_stats_output_time.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_output_time.py::test_stats_timestamp_uses_end_of_current_model_step PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_stats_output_time.xml -
============================= slowest 15 durations =============================
(3 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 0.67s ===============================
JAX pytest module: auto_llm_generated_pytests/test_stats_writer.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 20 items
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_expansion_matches_source_families PASSED [ 5%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt"-expected name | grid | units | long_name] PASSED [ 10%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | bad_grid | K | Profile"-Invalid stats grid] PASSED [ 15%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt | K | Profile-Malformed stats registry entry] PASSED [ 20%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = " | zt | K | Profile"-name and grid must be non-empty] PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_single_quoted_registry_entry_is_supported PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_sampling_uses_open_closed_absolute_time_window PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked PASSED [ 55%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps PASSED [ 60%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time PASSED [ 65%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary PASSED [ 70%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_config_metadata_data_and_source_grid_contract PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_radiation_registry_entries_require_radiation_grids PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_stats_writer.xml -
============================= slowest 15 durations =============================
4.28s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
2.48s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts
0.36s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps
0.16s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample
0.14s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors
0.05s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file
0.03s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema
0.03s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record
0.03s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_radiation_registry_entries_require_radiation_grids
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked
(3 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 20 passed in 8.28s ==============================
JAX pytest module: auto_llm_generated_pytests/test_sunray_sw.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_sunray_sw.xml -
============================= slowest 15 durations =============================
0.54s call clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 1.12s ===============================
JAX pytest module: auto_llm_generated_pytests/test_time_select.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_time_select.xml -
============================= slowest 15 durations =============================
0.98s call clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere
0.14s call clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range
(4 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 2 passed in 1.64s ===============================
JAX pytest module: auto_llm_generated_pytests/test_T_in_K.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items
clubb_jax/pytests/auto_llm_generated_pytests/test_T_in_K.py::test_closed_form PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_T_in_K.py::test_exact_inverse PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_T_in_K.xml -
============================= slowest 15 durations =============================
(6 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 2 passed in 0.54s ===============================
JAX pytest module: auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 4 items
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.xml -
============================= slowest 15 durations =============================
0.97s call clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad
0.92s call clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives
0.88s call clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo
0.57s call clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients
(8 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 4 passed in 3.87s ===============================
JAX pytest module: auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 8 items
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2 PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2 PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.xml -
============================= slowest 15 durations =============================
2.30s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const
(7 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 8 passed in 2.93s ===============================
JAX pytest module: auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 8 items
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3 PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2 PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1 PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3 PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3 PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2 PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3 PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.xml -
============================= slowest 15 durations =============================
2.31s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base
0.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2
0.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3
0.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3
0.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1
0.02s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3
0.01s call clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2
(7 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 8 passed in 3.05s ===============================
JAX pytest module: auto_llm_generated_pytests/test_unsupported_config_guards.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 14 items
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_baseline_and_supported_radiation_schemes_pass PASSED [ 7%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg0-overrides0-microphys_scheme] PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg1-overrides1-l_gfdl_activation] PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg2-overrides2-rad_scheme] PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg3-overrides3-l_calc_thlp2_rad] PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg4-overrides4-Sponge damping] PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg5-overrides5-lh_microphys_type] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg6-overrides6-l_silhs_rad] PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg7-overrides7-l_input_fields] PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg8-overrides8-l_test_grid_generalization] PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg9-overrides9-grid_adapt_in_time_method] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_supported_microphysics_and_cloud_sedimentation_pass_initial_gate PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_restart_passes_initial_feature_gate PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_unsupported_config_guards.xml -
============================= slowest 15 durations =============================
0.06s call clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure
(14 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 14 passed in 0.65s ==============================
JAX pytest module: auto_llm_generated_pytests/test_update_xp2_mc.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 2 items
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_update_xp2_mc.xml -
============================= slowest 15 durations =============================
2.83s call clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp
0.13s call clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants
(4 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 2 passed in 3.49s ===============================
JAX pytest module: auto_llm_generated_pytests/test_validation_checks.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 6 items
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_assert_corr_symmetric_behavior PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_sfc_varnce_check_behavior PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_length_check_behavior PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_rad_check_behavior PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_invalid_model_arrays_behavior PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_validation_checks.xml -
============================= slowest 15 durations =============================
0.10s call clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior
(14 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 6 passed in 0.66s ===============================
JAX pytest module: auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 18 items
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices0] PASSED [ 5%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices1] PASSED [ 11%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices2] PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices3] PASSED [ 22%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[thl] PASSED [ 27%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[rt] PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[thl] PASSED [ 38%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[rt] PASSED [ 44%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices0] PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices1] PASSED [ 55%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices2] PASSED [ 61%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices3] PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[2-indices0-True] PASSED [ 72%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[4-indices1-True] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices2-False] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices3-True] PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[1-indices4-True] PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_disabled_option_keeps_all_forcing PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.xml -
============================= slowest 15 durations =============================
2.00s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices0]
0.84s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices2]
0.83s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices1]
0.78s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices3]
0.65s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_disabled_option_keeps_all_forcing
0.11s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices0]
0.10s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[thl]
0.06s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[thl]
0.04s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[rt]
0.04s call clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[rt]
(5 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 18 passed in 6.04s ==============================
JAX pytest module: auto_llm_generated_pytests/test_w_up_in_cloud.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_w_up_in_cloud.xml -
============================= slowest 15 durations =============================
2.25s call clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 2.80s ===============================
JAX pytest module: auto_llm_generated_pytests/test_xp2_error_diagnostics.py
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax@2
collecting ... collected 1 item
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_error_diagnostics.py::test_multiple_lhs_diagnostic_uses_runtime_parameters PASSED [100%]
- generated xml file: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/pytests/jax/auto_llm_generated_pytests/test_xp2_error_diagnostics.xml -
============================= slowest 15 durations =============================
1.81s call clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_error_diagnostics.py::test_multiple_lhs_diagnostic_uses_runtime_parameters
(2 durations < 0.005s hidden. Use -vv to show these durations.)
============================== 1 passed in 2.37s ===============================
JAX pytest commands: 158 modules selected, 0 module commands failed.
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Expected failure test)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_comparison_mutation_test.py
CLUBB JAX runtime:
Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
Accelerator: cpu
JAX: 0.11.0 (jaxlib 0.11.0)
Device: cpu:0
Mutation test artifacts: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_comparison_mutation_53pv_n1w
Control: running unmodified bomex comparison...
Control passed.
Mutation heating: running comparison...
PASS heating: thlm mean absolute difference 0.00015; failing columns [1, 2, 3, 4].
Mutation parameter_handling: running comparison...
PASS parameter_handling: wp3 mean absolute difference 9.25992e-07; failing columns [2, 3, 4].
Mutation first_column: running comparison...
PASS first_column: wp3 mean absolute difference 4.69019e-07; failing columns [2, 3, 4].
Mutation missing_stat: running comparison...
PASS missing_stat: wprtp absent only from JAX output; strict comparison rejected it.
==============================================================================
Expected failure test: PASS
==============================================================================
Case: bomex | 4 timesteps x 60 s | 4 columns | CPU/double
Statistics: input/stats/multi_col_stats.in
Tolerances: JAX-versus-Fortran harness defaults (absolute 1e-07; percentage 1e-07%)
[PASS] Unmodified control — JAX and Fortran matched.
[PASS] heating
Add 1e-6 K/s of spurious heating to every column.
Numerical difference detected; both models completed 4 timesteps.
thlm: mean absolute difference 0.00015; mean percentage difference 4.91235e-05%
Failing columns: 1, 2, 3, 4; first comparison failure: timestep 1.
[PASS] parameter_handling
Load C8 as [0.2, 0.3, 0.4, 0.5] instead of [0.2, 0.4, 0.6, 0.8].
Numerical difference detected; both models completed 4 timesteps.
wp3: mean absolute difference 9.25992e-07; mean percentage difference 0.244887%
Failing columns: 2, 3, 4; first comparison failure: timestep 1.
[PASS] first_column
Use column 1's previous wp3 in every column's timestep equation.
Numerical difference detected; both models completed 4 timesteps.
wp3: mean absolute difference 4.69019e-07; mean percentage difference 0.118965%
Failing columns: 2, 3, 4; first comparison failure: timestep 3.
[PASS] missing_stat
Omit wprtp from JAX statistics output while keeping its calculation.
wprtp is missing only from JAX output; both models completed 4 timesteps.
Strict bindiff detected the missing variable; other stats were unchanged.
Result: PASS — 4/4 mutations verified | 87.3 s
Logs and outputs: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_comparison_mutation_53pv_n1w
==============================================================================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Jax vs Fortran: standard stats)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ ./tests/run_jax_vs_fortran_cases.py -workers 8
CLUBB JAX runtime:
Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
Accelerator: cpu
JAX: 0.11.0 (jaxlib 0.11.0)
Device: cpu:0
Run settings:
Output: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results
Statistics: input/stats/standard_stats.in
Debug: case default
Columns: 4
Workers: 8
Comparison limits: absolute 1e-07; percentage 1e-07%
Cases and flag sets:
23 cases x 1 flag set = 23 JAX/Fortran pairs
Flag sets:
default
Cases:
arm (360 iterations)
atex (360 iterations)
bomex (native duration)
cobra (360 iterations)
dycoms2_rf01 (native duration)
dycoms2_rf01_fixed_sst (300 iterations)
dycoms2_rf02_nd (native duration)
fire (native duration)
gabls2 (360 iterations)
gabls3_night (360 iterations)
jun25_altocu (180 iterations)
neutral (native duration)
wangara (native duration)
dycoms2_rf02_do (native duration)
dycoms2_rf02_ds (240 iterations)
lba_kk (360 iterations)
- input case: lba
- microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
- microphysics_setting.lh_microphys_type = "disabled"
- microphysics_setting.l_ice_microphys = .false.
- microphysics_setting.l_graupel = .false.
rico (370 iterations)
- dt_main: 60 s
lba (93 iterations)
- percentage limit: 0.001%
- microphysics_setting.lh_microphys_type = "disabled"
clex9_oct14 (73 iterations)
- percentage limit: 0.001%
nov11_altocu (62 iterations)
- percentage limit: 0.001%
rico_silhs (360 iterations)
- dt_main: 60 s
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
lba_kk_silhs (240 iterations)
- input case: lba
- dt_main: 60 s
- microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
- microphysics_setting.lh_microphys_type = "interactive"
- microphysics_setting.l_local_kk = .true.
- microphysics_setting.l_ice_microphys = .false.
- microphysics_setting.l_graupel = .false.
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
lba_silhs (74 iterations)
- percentage limit: 0.001%
- input case: lba
- dt_main: 60 s
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
[Status ] Flag set Case Timesteps JAX (s) Fortran (s) Total (s)
-----------------------------------------------------------------------------------------------------------------
[match ] default fire 180 / 180 194.8 6.3 211.8
[match ] default dycoms2_rf01_fixed_sst 300 / 300 258.9 4.7 273.1
[match ] default dycoms2_rf01 240 / 240 284.7 23.8 336.5
[match ] default dycoms2_rf02_nd 360 / 360 334.5 6.9 352.8
[match ] default bomex 360 / 360 335.6 9.4 358.1
[match ] default gabls3_night 360 / 360 78.9 5.6 90.4
[match ] default cobra 360 / 360 346.9 10.6 371.9
[match ] default gabls2 360 / 360 130.6 23.2 161.8
[match ] default arm 360 / 360 349.4 11.0 376.7
[match ] default atex 360 / 360 351.5 16.1 385.3
[match ] default jun25_altocu 180 / 180 198.4 11.8 221.9
[match ] default neutral 360 / 360 334.5 9.1 355.8
[match ] default lba 93 / 93 322.8 6.0 340.6
[match ] default wangara 480 / 480 392.4 8.8 415.7
[diff ] default clex9_oct14 62 / 73 208.5 6.2 226.5
[diff ] default nov11_altocu 62 / 62 159.1 4.7 171.8
[diff ] default dycoms2_rf02_ds 2 / 240 501.8 24.0 538.7
[diff ] default lba_kk 92 / 360 628.3 19.4 663.3
[diff ] default dycoms2_rf02_do 2 / 360 686.1 32.1 733.7
[diff ] default lba_kk_silhs 162 / 240 301.6 26.6 338.0
[match ] default lba_silhs 74 / 74 324.7 20.4 352.6
[diff ] default rico 10 / 370 981.3 11.0 1002.3
[diff ] default rico_silhs 15 / 360 756.7 8.5 771.2
Flag set default:
Match Diff Failed
----- ---- ------
15 8 0
Total time: 26m 47.8s
Results JSON: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
Setting overall build result to FAILURE
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Jax Python vs Fortran cases w varying flags)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------
Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_vs_fortran_cases.py -debug 0 -max_iters 5 -workers 8 -flag_config_file input/flag_sets/config_core_flags_wo_never_supported_jax_features.json
CLUBB JAX runtime:
Environment: /home/jenkins/workspace/clubb_branch_jax@2/.venv-jax (Python 3.12)
Accelerator: cpu
JAX: 0.11.0 (jaxlib 0.11.0)
Device: cpu:0
Run settings:
Output: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results
Statistics: input/stats/standard_stats.in
Debug: 0
Forwarded to both runs: -debug 0 -max_iters 5
Columns: 4
Workers: 8
Comparison limits: absolute 1e-07; percentage 1e-07%
Cases and flag sets:
23 cases x 18 flag sets = 414 JAX/Fortran pairs
Flag sets:
default
config_core_flags_wo_never_supported_jax_features_flag2
- saturation_formula = 1
- l_godunov_upwind_xpyp_ta = .true.
- l_lh_importance_sampling = .false.
- l_random_k_lh_start = .true.
- l_max_overlap_in_cloud = .false.
config_core_flags_wo_never_supported_jax_features_flag3
- ipdf_call_placement = 1
- l_ho_trad_coriolis = .true.
- l_ho_nontrad_coriolis = .true.
config_core_flags_wo_never_supported_jax_features_flag4
- iiPDF_type = 7
config_core_flags_wo_never_supported_jax_features_flag5
- l_predict_upwp_vpwp = .false.
config_core_flags_wo_never_supported_jax_features_flag6
- l_wp2_fill_holes_tke = .false.
- l_enable_relaxed_clipping = .true.
- l_min_xp2_from_corr_wx = .false.
- l_add_dycore_grid = .true.
- l_lh_straight_mc = .true.
config_core_flags_wo_never_supported_jax_features_flag7
- l_diag_Lscale_from_tau = .true.
- fill_holes_type = 3
config_core_flags_wo_never_supported_jax_features_flag8
- l_upwind_xpyp_ta = .false.
- l_upwind_xm_ma = .false.
- l_lh_clustered_sampling = .false.
- l_lh_instant_var_covar_src = .false.
- l_lh_limit_weights = .false.
config_core_flags_wo_never_supported_jax_features_flag9
- l_min_wp2_from_corr_wx = .true.
- l_stability_correct_tau_zm = .true.
- l_damp_wp2_using_em = .false.
- l_use_C7_Richardson = .false.
config_core_flags_wo_never_supported_jax_features_flag10
- l_vert_avg_closure = .true.
- l_use_cloud_cover = .true.
- l_damp_wp3_Skw_squared = .false.
- l_use_C11_Richardson = .true.
- l_rcm_in_cloud_k_lh_start = .false.
config_core_flags_wo_never_supported_jax_features_flag11
- l_rcm_supersat_adj = .false.
- l_C2_cloud_frac = .true.
- l_use_precip_frac = .false.
- l_do_expldiff_rtm_thlm = .true.
- l_use_shear_Richardson = .true.
config_core_flags_wo_never_supported_jax_features_flag12
- l_prescribed_avg_deltaz = .true.
- l_stability_correct_Kh_N2_zm = .true.
- l_trapezoidal_rule_zt = .true.
- l_trapezoidal_rule_zm = .true.
- l_call_pdf_closure_twice = .true.
config_core_flags_wo_never_supported_jax_features_flag13
- l_brunt_vaisala_freq_moist = .true.
- l_use_thvm_in_bv_freq = .true.
- l_lmm_stepping = .true.
- l_vary_convect_depth = .true.
config_core_flags_wo_never_supported_jax_features_flag14
- l_use_tke_in_wp3_pr_turb_term = .false.
- l_use_tke_in_wp2_wp3_K_dfsn = .true.
- l_use_wp3_lim_with_smth_Heaviside = .true.
- l_smooth_Heaviside_tau_wpxp = .false.
- l_modify_limiters_for_cnvg_test = .true.
config_core_flags_wo_never_supported_jax_features_flag15
- l_mono_flux_lim_rtm = .false.
- l_mono_flux_lim_um = .false.
- l_mono_flux_lim_vm = .false.
- l_mono_flux_lim_spikefix = .false.
config_core_flags_wo_never_supported_jax_features_flag16
- l_standard_term_ta = .true.
- l_partial_upwind_wp3 = .false.
- l_lh_var_frac = .true.
config_core_flags_wo_never_supported_jax_features_flag17
- l_standard_term_ta = .true.
- l_partial_upwind_wp3 = .true.
- l_lh_normalize_weights = .false.
config_core_flags_wo_never_supported_jax_features_flag18
- ipdf_call_placement = 3
Cases:
arm (5 iterations)
atex (5 iterations)
bomex (5 iterations)
cobra (5 iterations)
dycoms2_rf01 (5 iterations)
dycoms2_rf01_fixed_sst (5 iterations)
dycoms2_rf02_nd (5 iterations)
fire (5 iterations)
gabls2 (5 iterations)
gabls3_night (5 iterations)
jun25_altocu (5 iterations)
neutral (5 iterations)
wangara (5 iterations)
dycoms2_rf02_do (5 iterations)
dycoms2_rf02_ds (5 iterations)
lba_kk (5 iterations)
- input case: lba
- microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
- microphysics_setting.lh_microphys_type = "disabled"
- microphysics_setting.l_ice_microphys = .false.
- microphysics_setting.l_graupel = .false.
rico (5 iterations)
- dt_main: 60 s
lba (5 iterations)
- percentage limit: 0.001%
- microphysics_setting.lh_microphys_type = "disabled"
clex9_oct14 (5 iterations)
- percentage limit: 0.001%
nov11_altocu (5 iterations)
- percentage limit: 0.001%
rico_silhs (5 iterations)
- dt_main: 60 s
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
lba_kk_silhs (5 iterations)
- input case: lba
- dt_main: 60 s
- microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
- microphysics_setting.lh_microphys_type = "interactive"
- microphysics_setting.l_local_kk = .true.
- microphysics_setting.l_ice_microphys = .false.
- microphysics_setting.l_graupel = .false.
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
lba_silhs (5 iterations)
- percentage limit: 0.001%
- input case: lba
- dt_main: 60 s
- configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
- configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
- configurable_silhs_flags_nl.l_random_k_lh_start = .false.
[Status ] Flag set Case Timesteps JAX (s) Fortran (s) Total (s)
-------------------------------------------------------------------------------------------------------------------------------------------------
[match ] default dycoms2_rf01_fixed_sst 5 / 5 42.8 1.3 49.4
[match ] default fire 5 / 5 43.1 1.4 49.5
[match ] default dycoms2_rf01 5 / 5 44.2 2.1 50.8
[match ] default atex 5 / 5 45.7 1.6 51.7
[match ] default arm 5 / 5 46.8 1.2 52.8
[match ] default bomex 5 / 5 47.2 1.2 53.1
[match ] default cobra 5 / 5 48.1 1.6 54.4
[match ] default dycoms2_rf02_nd 5 / 5 49.7 1.6 56.1
[match ] default gabls3_night 5 / 5 28.3 1.1 32.4
[match ] default gabls2 5 / 5 36.0 1.6 41.2
[match ] default wangara 5 / 5 39.2 1.5 44.7
[match ] default neutral 5 / 5 39.5 1.3 45.9
[match ] default jun25_altocu 5 / 5 41.5 1.8 47.9
[diff ] default dycoms2_rf02_do 2 / 5 59.3 1.4 65.7
[diff ] default dycoms2_rf02_ds 2 / 5 60.5 1.8 67.3
[match ] default lba_kk 5 / 5 59.9 1.3 65.7
[match ] default rico 5 / 5 66.8 1.4 72.7
[match ] default rico_silhs 5 / 5 51.9 1.1 57.6
[match ] default nov11_altocu 5 / 5 55.4 1.4 64.5
[match ] default clex9_oct14 5 / 5 56.7 1.5 65.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 arm 1 / 5 43.3 1.4 53.6
[match ] default lba_kk_silhs 5 / 5 48.6 3.3 58.6
[match ] default lba 5 / 5 104.3 1.3 112.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 atex 1 / 5 46.4 1.3 51.6
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 bomex 1 / 5 46.9 1.2 52.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 cobra 1 / 5 47.3 1.2 52.2
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 dycoms2_rf01 1 / 5 45.5 1.6 52.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 dycoms2_rf01_fixed_sst 1 / 5 42.0 1.2 46.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 dycoms2_rf02_nd 1 / 5 43.7 1.1 50.0
[match ] config_core_flags_wo_never_supported_jax_features_flag2 gabls3_night 5 / 5 28.6 1.2 33.6
[match ] default lba_silhs 5 / 5 114.5 3.6 128.5
[match ] config_core_flags_wo_never_supported_jax_features_flag2 gabls2 5 / 5 42.3 1.8 48.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 fire 1 / 5 48.0 1.4 54.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 neutral 1 / 5 46.7 1.3 53.6
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 jun25_altocu 1 / 5 48.3 1.6 56.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 wangara 1 / 5 51.9 1.1 57.9
[both_failed ] config_core_flags_wo_never_supported_jax_features_flag2 rico_silhs - 6.3 1.2 7.5
[both_failed ] config_core_flags_wo_never_supported_jax_features_flag2 lba_kk_silhs - 6.0 1.0 7.0
[both_failed ] config_core_flags_wo_never_supported_jax_features_flag2 lba_silhs - 6.2 1.1 7.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 dycoms2_rf02_do 1 / 5 74.0 2.1 83.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 lba_kk 1 / 5 70.3 1.4 76.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 dycoms2_rf02_ds 1 / 5 77.6 2.0 85.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 rico 5 / 5 81.7 1.5 87.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 nov11_altocu 1 / 5 63.1 1.6 73.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 clex9_oct14 1 / 5 65.4 1.7 75.8
[match ] config_core_flags_wo_never_supported_jax_features_flag3 arm 5 / 5 48.7 1.4 55.2
[match ] config_core_flags_wo_never_supported_jax_features_flag3 atex 5 / 5 46.5 1.6 53.7
[match ] config_core_flags_wo_never_supported_jax_features_flag3 bomex 5 / 5 47.8 1.6 55.1
[match ] config_core_flags_wo_never_supported_jax_features_flag3 cobra 5 / 5 47.4 2.1 55.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag2 lba 1 / 5 118.0 1.9 129.5
[match ] config_core_flags_wo_never_supported_jax_features_flag3 dycoms2_rf01_fixed_sst 5 / 5 44.0 1.4 50.8
[match ] config_core_flags_wo_never_supported_jax_features_flag3 dycoms2_rf02_nd 5 / 5 49.7 1.5 56.7
[match ] config_core_flags_wo_never_supported_jax_features_flag3 dycoms2_rf01 5 / 5 52.1 1.8 59.9
[match ] config_core_flags_wo_never_supported_jax_features_flag3 fire 5 / 5 45.7 1.4 51.7
[match ] config_core_flags_wo_never_supported_jax_features_flag3 gabls2 5 / 5 40.9 1.6 46.0
[match ] config_core_flags_wo_never_supported_jax_features_flag3 gabls3_night 5 / 5 32.4 1.4 37.5
[match ] config_core_flags_wo_never_supported_jax_features_flag3 jun25_altocu 5 / 5 47.6 1.4 53.6
[match ] config_core_flags_wo_never_supported_jax_features_flag3 neutral 5 / 5 45.6 1.4 52.9
[match ] config_core_flags_wo_never_supported_jax_features_flag3 wangara 5 / 5 46.7 1.2 53.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag3 dycoms2_rf02_do 2 / 5 65.6 1.6 73.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag3 dycoms2_rf02_ds 2 / 5 72.0 2.1 82.1
[match ] config_core_flags_wo_never_supported_jax_features_flag3 lba_kk 5 / 5 71.7 1.5 78.4
[match ] config_core_flags_wo_never_supported_jax_features_flag3 rico 5 / 5 76.2 1.2 82.6
[match ] config_core_flags_wo_never_supported_jax_features_flag3 clex9_oct14 5 / 5 70.9 1.7 80.4
[match ] config_core_flags_wo_never_supported_jax_features_flag3 nov11_altocu 5 / 5 68.7 1.6 78.2
[match ] config_core_flags_wo_never_supported_jax_features_flag3 rico_silhs 5 / 5 65.1 1.4 70.5
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 arm - 41.0 1.4 42.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 atex - 46.2 1.2 47.5
[match ] config_core_flags_wo_never_supported_jax_features_flag3 lba_kk_silhs 5 / 5 60.2 2.2 68.4
[match ] config_core_flags_wo_never_supported_jax_features_flag3 lba 5 / 5 120.7 1.5 133.7
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 cobra - 43.1 1.5 44.6
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 bomex - 44.2 1.4 45.6
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 dycoms2_rf01 - 46.8 1.7 48.5
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 dycoms2_rf01_fixed_sst - 40.7 1.1 41.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 dycoms2_rf02_nd - 43.6 1.4 45.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 fire - 42.8 1.3 44.1
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 gabls3_night - 33.0 1.3 34.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 gabls2 - 47.6 1.7 49.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 jun25_altocu - 46.8 1.4 48.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 neutral - 43.2 1.2 44.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 wangara - 41.6 1.3 42.9
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 dycoms2_rf02_do - 42.8 1.8 44.6
[match ] config_core_flags_wo_never_supported_jax_features_flag3 lba_silhs 5 / 5 134.7 3.4 148.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 rico - 30.7 1.3 32.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 dycoms2_rf02_ds - 48.2 1.8 50.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 lba_kk - 42.4 1.6 44.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 rico_silhs - 30.4 1.3 31.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 clex9_oct14 - 49.4 1.5 50.9
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 nov11_altocu - 49.3 1.6 50.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 lba - 56.7 1.6 58.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 lba_kk_silhs - 44.1 1.9 46.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 arm 5 / 5 43.1 1.5 50.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag4 lba_silhs - 53.6 3.9 57.5
[match ] config_core_flags_wo_never_supported_jax_features_flag5 atex 5 / 5 46.9 1.8 54.9
[match ] config_core_flags_wo_never_supported_jax_features_flag5 cobra 5 / 5 46.1 1.4 53.2
[match ] config_core_flags_wo_never_supported_jax_features_flag5 bomex 5 / 5 49.2 1.2 56.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 dycoms2_rf01_fixed_sst 5 / 5 43.9 1.2 50.4
[match ] config_core_flags_wo_never_supported_jax_features_flag5 dycoms2_rf01 5 / 5 49.1 1.8 57.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 gabls3_night 5 / 5 32.1 1.3 36.9
[match ] config_core_flags_wo_never_supported_jax_features_flag5 dycoms2_rf02_nd 5 / 5 49.7 1.4 55.7
[match ] config_core_flags_wo_never_supported_jax_features_flag5 gabls2 5 / 5 43.3 1.8 48.4
[match ] config_core_flags_wo_never_supported_jax_features_flag5 fire 5 / 5 45.9 1.4 53.1
[match ] config_core_flags_wo_never_supported_jax_features_flag5 jun25_altocu 5 / 5 46.7 1.3 53.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 wangara 5 / 5 45.6 1.3 51.9
[match ] config_core_flags_wo_never_supported_jax_features_flag5 neutral 5 / 5 47.3 1.3 54.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag5 dycoms2_rf02_do 2 / 5 71.9 2.0 80.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag5 dycoms2_rf02_ds 2 / 5 68.3 1.6 76.7
[match ] config_core_flags_wo_never_supported_jax_features_flag5 lba_kk 5 / 5 69.3 1.6 76.8
[match ] config_core_flags_wo_never_supported_jax_features_flag5 rico 5 / 5 76.9 1.3 84.4
[match ] config_core_flags_wo_never_supported_jax_features_flag5 rico_silhs 5 / 5 60.7 1.3 67.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 clex9_oct14 5 / 5 68.0 1.5 78.2
[match ] config_core_flags_wo_never_supported_jax_features_flag5 nov11_altocu 5 / 5 65.0 1.6 75.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 arm 1 / 5 47.7 2.0 51.7
[match ] config_core_flags_wo_never_supported_jax_features_flag5 lba_kk_silhs 5 / 5 61.1 2.1 69.3
[match ] config_core_flags_wo_never_supported_jax_features_flag5 lba 5 / 5 117.5 1.7 131.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 atex - 46.8 2.2 51.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 bomex - 49.2 1.7 53.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 cobra - 50.8 2.0 55.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 dycoms2_rf01 - 52.6 3.1 58.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 dycoms2_rf01_fixed_sst - 46.9 1.4 50.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 fire - 49.1 1.4 52.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 gabls2 - 45.8 1.8 50.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 dycoms2_rf02_nd - 50.9 1.6 55.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 gabls3_night - 31.4 1.4 35.0
[match ] config_core_flags_wo_never_supported_jax_features_flag5 lba_silhs 5 / 5 125.0 3.7 136.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 jun25_altocu 1 / 5 49.2 2.1 53.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 neutral - 47.7 1.5 51.2
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 wangara - 48.7 1.3 52.2
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 dycoms2_rf02_ds 2 / 5 70.9 2.4 75.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 lba_kk - 70.1 2.9 75.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 dycoms2_rf02_do 2 / 5 73.1 2.2 77.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 rico - 77.7 1.4 81.6
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 arm - 21.1 1.4 22.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 clex9_oct14 - 69.7 2.5 74.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 rico_silhs - 60.8 1.2 64.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 nov11_altocu - 68.7 2.4 75.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 atex - 22.6 1.5 24.2
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 bomex - 24.1 1.4 25.5
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 cobra - 24.9 1.6 26.5
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 dycoms2_rf01 - 24.5 1.8 26.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 dycoms2_rf01_fixed_sst - 25.1 1.3 26.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 dycoms2_rf02_nd - 27.1 1.3 28.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 lba - 112.1 3.5 119.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 lba_kk_silhs - 57.2 3.5 63.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 fire - 24.0 1.4 25.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 gabls2 - 22.7 1.7 24.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 jun25_altocu - 23.4 1.6 25.0
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 gabls3_night - 26.3 1.2 27.5
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 neutral - 24.4 1.4 25.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 wangara - 24.3 1.3 25.6
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 dycoms2_rf02_do - 27.4 1.8 29.2
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 dycoms2_rf02_ds - 29.9 2.0 31.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 lba_kk - 26.8 1.5 28.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 rico - 26.4 1.5 27.9
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 lba - 35.7 1.7 37.3
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 rico_silhs - 26.1 1.3 27.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 clex9_oct14 - 34.8 1.8 36.6
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 nov11_altocu - 32.8 1.6 34.4
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 lba_kk_silhs - 25.8 2.1 27.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag6 lba_silhs - 129.6 5.6 138.8
[jax_failed ] config_core_flags_wo_never_supported_jax_features_flag7 lba_silhs - 33.3 3.5 36.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 arm 5 / 5 47.3 1.1 53.5
[match ] config_core_flags_wo_never_supported_jax_features_flag8 bomex 5 / 5 49.4 1.5 55.2
[match ] config_core_flags_wo_never_supported_jax_features_flag8 atex 5 / 5 48.9 1.6 55.9
[match ] config_core_flags_wo_never_supported_jax_features_flag8 dycoms2_rf01 5 / 5 45.3 2.0 54.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 cobra 5 / 5 48.7 2.0 56.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 dycoms2_rf01_fixed_sst 5 / 5 45.9 1.4 52.7
[match ] config_core_flags_wo_never_supported_jax_features_flag8 dycoms2_rf02_nd 5 / 5 52.1 1.4 59.6
[match ] config_core_flags_wo_never_supported_jax_features_flag8 fire 5 / 5 48.6 1.4 55.2
[match ] config_core_flags_wo_never_supported_jax_features_flag8 gabls3_night 5 / 5 31.2 1.3 35.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 gabls2 5 / 5 44.4 1.8 49.3
[match ] config_core_flags_wo_never_supported_jax_features_flag8 jun25_altocu 5 / 5 45.7 1.2 51.6
[match ] config_core_flags_wo_never_supported_jax_features_flag8 neutral 5 / 5 45.8 1.2 51.9
[match ] config_core_flags_wo_never_supported_jax_features_flag8 wangara 5 / 5 48.7 1.6 55.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag8 dycoms2_rf02_do 2 / 5 73.1 2.0 82.1
[match ] config_core_flags_wo_never_supported_jax_features_flag8 lba_kk 5 / 5 71.1 1.4 77.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag8 dycoms2_rf02_ds 2 / 5 74.6 1.9 82.0
[match ] config_core_flags_wo_never_supported_jax_features_flag8 rico 5 / 5 81.9 1.2 87.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 rico_silhs 5 / 5 61.7 1.4 69.8
[match ] config_core_flags_wo_never_supported_jax_features_flag8 nov11_altocu 5 / 5 65.3 1.7 74.3
[match ] config_core_flags_wo_never_supported_jax_features_flag8 clex9_oct14 5 / 5 69.8 1.5 77.6
[match ] config_core_flags_wo_never_supported_jax_features_flag9 arm 5 / 5 44.3 1.2 50.1
[match ] config_core_flags_wo_never_supported_jax_features_flag8 lba_kk_silhs 5 / 5 57.3 2.3 66.0
[match ] config_core_flags_wo_never_supported_jax_features_flag8 lba 5 / 5 115.7 1.6 127.9
[match ] config_core_flags_wo_never_supported_jax_features_flag9 atex 5 / 5 49.5 1.8 56.9
[match ] config_core_flags_wo_never_supported_jax_features_flag9 dycoms2_rf01 5 / 5 46.3 1.8 54.2
[match ] config_core_flags_wo_never_supported_jax_features_flag9 cobra 5 / 5 47.7 1.4 54.8
[match ] config_core_flags_wo_never_supported_jax_features_flag9 bomex 5 / 5 50.6 1.3 57.7
[match ] config_core_flags_wo_never_supported_jax_features_flag9 dycoms2_rf01_fixed_sst 5 / 5 49.1 1.2 54.8
[match ] config_core_flags_wo_never_supported_jax_features_flag9 fire 5 / 5 47.0 1.4 53.7
[match ] config_core_flags_wo_never_supported_jax_features_flag9 gabls3_night 5 / 5 32.0 1.3 36.7
[match ] config_core_flags_wo_never_supported_jax_features_flag9 dycoms2_rf02_nd 5 / 5 54.4 1.2 60.8
[match ] config_core_flags_wo_never_supported_jax_features_flag9 gabls2 5 / 5 46.4 1.4 51.3
[match ] config_core_flags_wo_never_supported_jax_features_flag9 jun25_altocu 5 / 5 47.8 1.6 55.0
[match ] config_core_flags_wo_never_supported_jax_features_flag9 neutral 5 / 5 49.5 1.2 55.4
[match ] config_core_flags_wo_never_supported_jax_features_flag8 lba_silhs 5 / 5 133.3 3.5 147.6
[match ] config_core_flags_wo_never_supported_jax_features_flag9 wangara 5 / 5 47.2 1.3 53.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag9 dycoms2_rf02_do 2 / 5 74.8 1.7 82.6
[match ] config_core_flags_wo_never_supported_jax_features_flag9 lba_kk 5 / 5 75.1 1.3 81.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag9 dycoms2_rf02_ds 2 / 5 72.9 2.0 81.8
[match ] config_core_flags_wo_never_supported_jax_features_flag9 rico 5 / 5 78.6 1.4 85.1
[match ] config_core_flags_wo_never_supported_jax_features_flag9 clex9_oct14 5 / 5 65.9 1.2 75.3
[match ] config_core_flags_wo_never_supported_jax_features_flag9 nov11_altocu 5 / 5 68.2 1.4 79.7
[match ] config_core_flags_wo_never_supported_jax_features_flag9 rico_silhs 5 / 5 61.7 1.2 69.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 arm 1 / 5 47.2 1.4 56.7
[match ] config_core_flags_wo_never_supported_jax_features_flag9 lba_kk_silhs 5 / 5 56.0 2.5 65.5
[match ] config_core_flags_wo_never_supported_jax_features_flag9 lba 5 / 5 118.0 2.4 131.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 bomex 1 / 5 49.8 1.2 56.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 atex 1 / 5 49.0 1.4 56.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 cobra 1 / 5 48.3 1.5 55.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01 1 / 5 51.5 1.7 60.1
[match ] config_core_flags_wo_never_supported_jax_features_flag10 gabls3_night 5 / 5 31.0 1.2 35.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01_fixed_sst 1 / 5 49.9 1.3 56.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_nd 1 / 5 48.9 1.4 57.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 fire 1 / 5 46.5 1.4 55.0
[match ] config_core_flags_wo_never_supported_jax_features_flag10 gabls2 5 / 5 46.8 1.7 51.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 jun25_altocu 1 / 5 49.0 1.9 56.4
[match ] config_core_flags_wo_never_supported_jax_features_flag9 lba_silhs 5 / 5 132.7 3.7 145.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 neutral 1 / 5 47.0 1.4 55.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 wangara 1 / 5 50.7 1.5 60.3
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_do 1 / 5 81.0 1.8 91.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk 1 / 5 76.3 1.5 86.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_ds 1 / 5 79.8 2.1 89.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 rico 5 / 5 83.7 1.1 94.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 nov11_altocu 1 / 5 74.6 1.4 87.6
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 clex9_oct14 1 / 5 76.2 1.8 89.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 rico_silhs 5 / 5 64.3 1.4 72.5
[both_failed ] config_core_flags_wo_never_supported_jax_features_flag11 cobra - 6.1 1.7 7.8
[match ] config_core_flags_wo_never_supported_jax_features_flag11 arm 5 / 5 51.4 1.3 58.8
[match ] config_core_flags_wo_never_supported_jax_features_flag11 atex 5 / 5 49.4 1.5 56.9
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 lba 1 / 5 123.3 1.4 134.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk_silhs 1 / 5 64.7 2.0 75.0
[match ] config_core_flags_wo_never_supported_jax_features_flag11 bomex 5 / 5 47.4 1.4 54.7
[match ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01 5 / 5 52.3 1.7 60.4
[match ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01_fixed_sst 5 / 5 51.5 1.2 57.8
[match ] config_core_flags_wo_never_supported_jax_features_flag11 gabls3_night 5 / 5 31.6 1.2 36.2
[match ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_nd 5 / 5 49.8 1.0 56.1
[match ] config_core_flags_wo_never_supported_jax_features_flag11 gabls2 5 / 5 47.0 1.8 52.6
[match ] config_core_flags_wo_never_supported_jax_features_flag11 fire 5 / 5 52.1 1.3 58.7
[match ] config_core_flags_wo_never_supported_jax_features_flag11 jun25_altocu 5 / 5 48.4 1.3 56.5
[match ] config_core_flags_wo_never_supported_jax_features_flag11 neutral 5 / 5 48.7 1.4 54.7
[match ] config_core_flags_wo_never_supported_jax_features_flag11 wangara 5 / 5 50.0 1.3 56.8
[diff ] config_core_flags_wo_never_supported_jax_features_flag10 lba_silhs 1 / 5 135.5 3.5 152.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_do 2 / 5 71.5 1.6 81.4
[match ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk 5 / 5 68.5 1.4 75.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_ds 2 / 5 72.1 1.8 81.5
[match ] config_core_flags_wo_never_supported_jax_features_flag11 rico 5 / 5 78.5 1.3 85.9
[match ] config_core_flags_wo_never_supported_jax_features_flag11 clex9_oct14 5 / 5 66.9 1.7 75.1
[match ] config_core_flags_wo_never_supported_jax_features_flag11 rico_silhs 5 / 5 60.8 1.2 68.3
[match ] config_core_flags_wo_never_supported_jax_features_flag11 nov11_altocu 5 / 5 67.1 1.7 78.0
[match ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk_silhs 5 / 5 55.4 2.3 64.3
[match ] config_core_flags_wo_never_supported_jax_features_flag11 lba 5 / 5 112.7 1.7 124.3
[match ] config_core_flags_wo_never_supported_jax_features_flag12 arm 5 / 5 57.4 1.2 64.6
[match ] config_core_flags_wo_never_supported_jax_features_flag12 atex 5 / 5 57.6 1.3 63.9
[match ] config_core_flags_wo_never_supported_jax_features_flag12 cobra 5 / 5 49.2 1.4 55.4
[match ] config_core_flags_wo_never_supported_jax_features_flag12 bomex 5 / 5 56.9 1.2 65.2
[match ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01 5 / 5 61.3 1.8 69.1
[match ] config_core_flags_wo_never_supported_jax_features_flag12 gabls3_night 5 / 5 36.4 1.5 41.2
[match ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01_fixed_sst 5 / 5 59.2 1.5 65.6
[match ] config_core_flags_wo_never_supported_jax_features_flag12 gabls2 5 / 5 50.2 1.8 55.1
[match ] config_core_flags_wo_never_supported_jax_features_flag12 fire 5 / 5 64.1 1.5 70.7
[match ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_nd 5 / 5 67.0 1.1 73.0
[match ] config_core_flags_wo_never_supported_jax_features_flag11 lba_silhs 5 / 5 129.3 3.6 143.1
[match ] config_core_flags_wo_never_supported_jax_features_flag12 jun25_altocu 5 / 5 59.1 1.4 65.3
[match ] config_core_flags_wo_never_supported_jax_features_flag12 neutral 5 / 5 61.8 1.4 67.5
[match ] config_core_flags_wo_never_supported_jax_features_flag12 wangara 5 / 5 60.2 1.3 66.2
[diff ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_do 2 / 5 82.3 1.8 90.6
[match ] config_core_flags_wo_never_supported_jax_features_flag12 rico 5 / 5 81.1 1.5 88.0
[match ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk 5 / 5 82.8 1.7 89.6
[diff ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_ds 2 / 5 86.1 2.1 95.0
[match ] config_core_flags_wo_never_supported_jax_features_flag12 clex9_oct14 5 / 5 82.1 1.4 89.3
[match ] config_core_flags_wo_never_supported_jax_features_flag12 nov11_altocu 5 / 5 78.9 1.7 87.6
[match ] config_core_flags_wo_never_supported_jax_features_flag12 rico_silhs 5 / 5 65.7 1.3 73.3
[match ] config_core_flags_wo_never_supported_jax_features_flag12 lba 5 / 5 126.0 1.5 135.2
[match ] config_core_flags_wo_never_supported_jax_features_flag13 arm 5 / 5 47.0 1.5 53.9
[match ] config_core_flags_wo_never_supported_jax_features_flag13 atex 5 / 5 45.9 1.6 53.4
[match ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk_silhs 5 / 5 71.9 2.2 79.7
[match ] config_core_flags_wo_never_supported_jax_features_flag13 bomex 5 / 5 50.2 1.4 56.1
[match ] config_core_flags_wo_never_supported_jax_features_flag13 cobra 5 / 5 51.3 1.5 58.5
[match ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01 5 / 5 49.2 1.3 55.7
[match ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01_fixed_sst 5 / 5 47.5 1.0 53.5
[match ] config_core_flags_wo_never_supported_jax_features_flag13 fire 5 / 5 46.2 1.3 52.8
[match ] config_core_flags_wo_never_supported_jax_features_flag13 gabls3_night 5 / 5 28.6 1.2 33.5
[match ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_nd 5 / 5 52.8 1.5 60.2
[match ] config_core_flags_wo_never_supported_jax_features_flag13 gabls2 5 / 5 46.9 1.6 52.1
[match ] config_core_flags_wo_never_supported_jax_features_flag13 jun25_altocu 5 / 5 47.4 1.2 55.2
[match ] config_core_flags_wo_never_supported_jax_features_flag13 neutral 5 / 5 47.5 1.5 54.1
[match ] config_core_flags_wo_never_supported_jax_features_flag12 lba_silhs 5 / 5 136.3 2.9 148.1
[match ] config_core_flags_wo_never_supported_jax_features_flag13 wangara 5 / 5 49.5 1.4 54.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_do 2 / 5 71.0 1.9 79.9
[match ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk 5 / 5 68.6 1.8 75.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_ds 2 / 5 72.8 1.8 82.0
[match ] config_core_flags_wo_never_supported_jax_features_flag13 rico 5 / 5 76.1 1.0 82.1
[match ] config_core_flags_wo_never_supported_jax_features_flag13 rico_silhs 5 / 5 59.7 1.3 65.1
[match ] config_core_flags_wo_never_supported_jax_features_flag13 clex9_oct14 5 / 5 69.0 1.6 77.5
[match ] config_core_flags_wo_never_supported_jax_features_flag13 nov11_altocu 5 / 5 65.7 1.3 76.8
[match ] config_core_flags_wo_never_supported_jax_features_flag14 arm 5 / 5 43.1 1.2 49.4
[match ] config_core_flags_wo_never_supported_jax_features_flag14 atex 5 / 5 43.1 1.4 49.6
[match ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk_silhs 5 / 5 55.3 2.0 63.4
[match ] config_core_flags_wo_never_supported_jax_features_flag14 cobra 5 / 5 41.2 1.5 48.0
[match ] config_core_flags_wo_never_supported_jax_features_flag13 lba 5 / 5 118.1 1.8 130.0
[match ] config_core_flags_wo_never_supported_jax_features_flag14 bomex 5 / 5 45.2 1.4 51.8
[match ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01 5 / 5 51.7 2.0 59.9
[match ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01_fixed_sst 5 / 5 46.1 1.2 52.4
[match ] config_core_flags_wo_never_supported_jax_features_flag14 fire 5 / 5 47.9 1.3 53.9
[match ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_nd 5 / 5 48.9 1.2 54.5
[match ] config_core_flags_wo_never_supported_jax_features_flag14 gabls3_night 5 / 5 31.4 1.4 37.3
[match ] config_core_flags_wo_never_supported_jax_features_flag14 gabls2 5 / 5 40.4 1.8 45.8
[match ] config_core_flags_wo_never_supported_jax_features_flag13 lba_silhs 5 / 5 114.3 3.9 126.9
[match ] config_core_flags_wo_never_supported_jax_features_flag14 jun25_altocu 5 / 5 44.4 1.5 50.8
[match ] config_core_flags_wo_never_supported_jax_features_flag14 neutral 5 / 5 48.4 1.2 53.2
[match ] config_core_flags_wo_never_supported_jax_features_flag14 wangara 5 / 5 46.8 1.2 55.6
[diff ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_ds 2 / 5 65.3 1.8 74.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_do 2 / 5 69.3 1.8 77.6
[match ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk 5 / 5 67.4 1.4 73.9
[match ] config_core_flags_wo_never_supported_jax_features_flag14 clex9_oct14 5 / 5 62.7 1.7 71.3
[match ] config_core_flags_wo_never_supported_jax_features_flag14 rico 5 / 5 73.5 1.4 79.8
[match ] config_core_flags_wo_never_supported_jax_features_flag14 rico_silhs 5 / 5 58.5 1.4 65.6
[match ] config_core_flags_wo_never_supported_jax_features_flag14 nov11_altocu 5 / 5 70.5 1.6 80.6
[match ] config_core_flags_wo_never_supported_jax_features_flag15 arm 5 / 5 44.9 1.4 52.6
[match ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk_silhs 5 / 5 52.3 2.1 60.0
[match ] config_core_flags_wo_never_supported_jax_features_flag14 lba 5 / 5 112.0 1.8 123.1
[match ] config_core_flags_wo_never_supported_jax_features_flag15 atex 5 / 5 41.5 1.3 48.3
[match ] config_core_flags_wo_never_supported_jax_features_flag15 bomex 5 / 5 43.2 1.3 49.6
[match ] config_core_flags_wo_never_supported_jax_features_flag15 cobra 5 / 5 46.0 1.5 52.4
[match ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01 5 / 5 48.5 2.2 56.4
[match ] config_core_flags_wo_never_supported_jax_features_flag15 gabls3_night 5 / 5 28.7 1.6 33.5
[match ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01_fixed_sst 5 / 5 44.5 1.1 50.3
[match ] config_core_flags_wo_never_supported_jax_features_flag15 fire 5 / 5 44.3 1.1 50.1
[match ] config_core_flags_wo_never_supported_jax_features_flag15 gabls2 5 / 5 40.4 1.6 45.4
[match ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_nd 5 / 5 44.9 1.2 50.7
[match ] config_core_flags_wo_never_supported_jax_features_flag14 lba_silhs 5 / 5 120.6 3.2 133.7
[match ] config_core_flags_wo_never_supported_jax_features_flag15 jun25_altocu 5 / 5 46.1 1.3 53.5
[match ] config_core_flags_wo_never_supported_jax_features_flag15 neutral 5 / 5 41.6 1.2 47.1
[match ] config_core_flags_wo_never_supported_jax_features_flag15 wangara 5 / 5 40.3 1.1 45.9
[match ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk 5 / 5 56.4 1.3 62.4
[diff ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_ds 2 / 5 59.8 1.8 68.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_do 2 / 5 64.7 2.0 73.2
[match ] config_core_flags_wo_never_supported_jax_features_flag15 rico 5 / 5 65.5 1.5 71.0
[match ] config_core_flags_wo_never_supported_jax_features_flag15 rico_silhs 5 / 5 50.8 1.2 56.2
[match ] config_core_flags_wo_never_supported_jax_features_flag15 clex9_oct14 5 / 5 64.0 1.5 72.9
[match ] config_core_flags_wo_never_supported_jax_features_flag15 nov11_altocu 5 / 5 63.6 1.5 74.2
[match ] config_core_flags_wo_never_supported_jax_features_flag16 atex 5 / 5 39.0 1.2 45.0
[match ] config_core_flags_wo_never_supported_jax_features_flag16 arm 5 / 5 40.8 1.3 47.3
[match ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk_silhs 5 / 5 48.3 2.1 55.6
[match ] config_core_flags_wo_never_supported_jax_features_flag16 bomex 5 / 5 38.0 1.0 43.4
[match ] config_core_flags_wo_never_supported_jax_features_flag15 lba 5 / 5 105.1 1.6 116.9
[match ] config_core_flags_wo_never_supported_jax_features_flag16 cobra 5 / 5 46.6 1.4 53.9
[match ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01 5 / 5 43.3 1.7 50.9
[match ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01_fixed_sst 5 / 5 38.6 1.3 44.3
[match ] config_core_flags_wo_never_supported_jax_features_flag16 fire 5 / 5 44.8 1.1 50.7
[match ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_nd 5 / 5 48.9 1.4 55.6
[match ] config_core_flags_wo_never_supported_jax_features_flag16 gabls2 5 / 5 39.0 1.5 43.9
[match ] config_core_flags_wo_never_supported_jax_features_flag16 gabls3_night 5 / 5 30.8 1.1 35.8
[match ] config_core_flags_wo_never_supported_jax_features_flag15 lba_silhs 5 / 5 104.9 3.6 115.5
[match ] config_core_flags_wo_never_supported_jax_features_flag16 jun25_altocu 5 / 5 42.9 1.4 50.6
[match ] config_core_flags_wo_never_supported_jax_features_flag16 wangara 5 / 5 41.2 1.4 47.6
[match ] config_core_flags_wo_never_supported_jax_features_flag16 neutral 5 / 5 45.3 1.3 52.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_do 2 / 5 65.9 1.8 74.3
[match ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk 5 / 5 60.2 1.3 65.7
[diff ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_ds 2 / 5 66.5 1.9 75.0
[match ] config_core_flags_wo_never_supported_jax_features_flag16 rico 5 / 5 78.6 1.4 85.1
[match ] config_core_flags_wo_never_supported_jax_features_flag16 nov11_altocu 5 / 5 56.8 1.5 66.1
[match ] config_core_flags_wo_never_supported_jax_features_flag16 rico_silhs 5 / 5 60.2 1.2 67.0
[match ] config_core_flags_wo_never_supported_jax_features_flag16 clex9_oct14 5 / 5 70.2 1.8 79.0
[match ] config_core_flags_wo_never_supported_jax_features_flag16 lba 5 / 5 98.1 1.4 106.9
[match ] config_core_flags_wo_never_supported_jax_features_flag17 arm 5 / 5 42.1 1.3 48.2
[match ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk_silhs 5 / 5 51.4 1.8 58.0
[match ] config_core_flags_wo_never_supported_jax_features_flag17 atex 5 / 5 41.0 1.2 46.9
[match ] config_core_flags_wo_never_supported_jax_features_flag17 bomex 5 / 5 37.7 1.4 43.6
[match ] config_core_flags_wo_never_supported_jax_features_flag17 cobra 5 / 5 43.8 1.3 50.8
[match ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01_fixed_sst 5 / 5 35.7 1.0 40.3
[match ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01 5 / 5 41.4 1.6 48.3
[match ] config_core_flags_wo_never_supported_jax_features_flag17 gabls3_night 5 / 5 24.2 1.2 28.3
[match ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_nd 5 / 5 44.4 1.2 50.3
[match ] config_core_flags_wo_never_supported_jax_features_flag17 fire 5 / 5 42.3 1.3 48.4
[match ] config_core_flags_wo_never_supported_jax_features_flag16 lba_silhs 5 / 5 102.7 3.0 111.6
[match ] config_core_flags_wo_never_supported_jax_features_flag17 gabls2 5 / 5 43.0 1.4 47.7
[match ] config_core_flags_wo_never_supported_jax_features_flag17 neutral 5 / 5 37.7 1.2 43.2
[match ] config_core_flags_wo_never_supported_jax_features_flag17 jun25_altocu 5 / 5 43.5 1.2 48.6
[match ] config_core_flags_wo_never_supported_jax_features_flag17 wangara 5 / 5 40.7 1.1 46.5
[diff ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_do 2 / 5 57.5 1.6 65.0
[match ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk 5 / 5 59.2 1.4 66.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_ds 2 / 5 63.5 1.9 71.0
[match ] config_core_flags_wo_never_supported_jax_features_flag17 rico 5 / 5 61.4 1.2 66.2
[match ] config_core_flags_wo_never_supported_jax_features_flag17 clex9_oct14 5 / 5 52.2 1.4 59.2
[match ] config_core_flags_wo_never_supported_jax_features_flag17 nov11_altocu 5 / 5 54.5 1.1 60.0
[match ] config_core_flags_wo_never_supported_jax_features_flag17 rico_silhs 5 / 5 50.6 1.1 55.6
[match ] config_core_flags_wo_never_supported_jax_features_flag18 arm 5 / 5 33.3 1.1 37.8
[match ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk_silhs 5 / 5 41.6 1.7 46.9
[match ] config_core_flags_wo_never_supported_jax_features_flag17 lba 5 / 5 93.3 1.2 99.6
[match ] config_core_flags_wo_never_supported_jax_features_flag18 atex 5 / 5 33.0 1.2 37.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 bomex 5 / 5 31.6 1.0 35.8
[match ] config_core_flags_wo_never_supported_jax_features_flag18 cobra 5 / 5 32.6 1.2 37.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01 5 / 5 31.9 1.4 36.9
[match ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01_fixed_sst 5 / 5 29.6 1.0 34.1
[match ] config_core_flags_wo_never_supported_jax_features_flag18 gabls3_night 5 / 5 20.5 1.3 24.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 fire 5 / 5 30.0 1.0 34.5
[match ] config_core_flags_wo_never_supported_jax_features_flag18 gabls2 5 / 5 30.9 1.5 34.7
[match ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_nd 5 / 5 32.2 1.0 36.6
[match ] config_core_flags_wo_never_supported_jax_features_flag17 lba_silhs 5 / 5 83.7 2.5 94.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 jun25_altocu 5 / 5 30.6 1.2 37.3
[match ] config_core_flags_wo_never_supported_jax_features_flag18 neutral 5 / 5 30.4 1.3 38.3
[match ] config_core_flags_wo_never_supported_jax_features_flag18 wangara 5 / 5 32.4 1.0 37.0
[match ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk 5 / 5 46.6 1.1 52.1
[diff ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_do 2 / 5 49.2 1.5 57.0
[diff ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_ds 2 / 5 49.1 1.4 57.7
[match ] config_core_flags_wo_never_supported_jax_features_flag18 rico 5 / 5 58.1 1.0 62.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 clex9_oct14 5 / 5 44.9 1.2 50.3
[match ] config_core_flags_wo_never_supported_jax_features_flag18 nov11_altocu 5 / 5 44.4 1.2 49.6
[match ] config_core_flags_wo_never_supported_jax_features_flag18 rico_silhs 5 / 5 42.6 1.0 46.6
[match ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk_silhs 5 / 5 34.9 1.9 40.3
[match ] config_core_flags_wo_never_supported_jax_features_flag18 lba 5 / 5 72.8 1.2 78.2
[match ] config_core_flags_wo_never_supported_jax_features_flag18 lba_silhs 5 / 5 74.2 2.6 81.9
Overall cases:
Match Diff Failed
----- ---- ------
276 88 50
Flag set default:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag2:
Match Diff Failed
----- ---- ------
2 18 3
Flag set config_core_flags_wo_never_supported_jax_features_flag3:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag4:
Match Diff Failed
----- ---- ------
0 0 23
Flag set config_core_flags_wo_never_supported_jax_features_flag5:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag6:
Match Diff Failed
----- ---- ------
0 23 0
Flag set config_core_flags_wo_never_supported_jax_features_flag7:
Match Diff Failed
----- ---- ------
0 0 23
Flag set config_core_flags_wo_never_supported_jax_features_flag8:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag9:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag10:
Match Diff Failed
----- ---- ------
2 21 0
Flag set config_core_flags_wo_never_supported_jax_features_flag11:
Match Diff Failed
----- ---- ------
20 2 1
Flag set config_core_flags_wo_never_supported_jax_features_flag12:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag13:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag14:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag15:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag16:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag17:
Match Diff Failed
----- ---- ------
21 2 0
Flag set config_core_flags_wo_never_supported_jax_features_flag18:
Match Diff Failed
----- ---- ------
21 2 0
Total time: 57m 55.4s
Results JSON: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax@2/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] junit
Recording test results
[Checks API] No suitable checks publisher found.
[Pipeline] script
[Pipeline] {
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: FAILURE
