Skip to content
Skipping 623 KB.. Full Log
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_preserves_an_explicit_command_buffer_override PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_other_amd_targets_do_not_receive_the_gfx1151_workaround PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_preserves_an_explicit_cholesky_override PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[None] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_linalg] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_solver] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_sparse] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_rejects_an_old_driver PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_accepts_a_three_component_new_driver_version PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_rejects_an_old_compute_capability PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_query_retries_without_compute_capability PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_report_labels_expected_device_without_claiming_backend_ready PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_numeric_visible_device_resolves_to_its_nvidia_smi_uuid PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_missing_environment_requires_setup_but_remains_selectable PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_human_output_labels_planned_versions PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_preflight_fails_before_creating_an_environment PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-None-False-false-None] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-None-False-false-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-true-False-true-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-true-False-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-false-True-true-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-false-True-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-None-False-false-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-None-False-false-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-true-False-true-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-true-False-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-false-True-true-None] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-false-True-true-FASTEST_FIRST] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[-1] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[9] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[GPU-missing] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[GPU-test] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[0,0] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[1,,0] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_explicit_selection_preserves_order_and_expands_unique_prefix PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[0-False] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[1-True] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[1,0-False] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[-False] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_fastest_first_without_selector_does_not_guess_default PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_truncated_nvidia_row_returns_unavailable PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_metal_query_accepts_gpu_family_capability PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_metal_runtime_uses_plugin_requirements PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_dispatcher_matches_leaves PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_svp_reference_values PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_sat_mixrat_liq_consistency_and_grad PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_saturation_formula_enum_values PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_setter_var_params.py::test_moment_reconstruction PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_conversions_and_bulk_fluxes PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_ubar_and_momentum PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_ht_mostr_flux_interp PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_set_scalar_surface_fluxes_updates_surface_arrays_only PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_shared_surface_flux_path_jits_and_stays_on_device PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_compiled_dump_selects_fatal_columns_and_preserves_source_fields[0] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_compiled_dump_selects_fatal_columns_and_preserves_source_fields[2] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[-1] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[0] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[1] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_scalar_only_nan_and_existing_fatal_headers_use_column_order PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_large_field_dump_does_not_abbreviate_arrays PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[-1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[0] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[2] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_weight_limiter_error_reaches_importance_driver PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-mixture] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud2] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-mixture] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud2] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_empty_sample_reports_source_stop PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_port_structure.py::test_silhs_inventory_excludes_mt95 PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[1] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[3] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_overlap_pool_is_independent_of_seed PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-four_cluster_no_precip] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-two_cluster_cp_nocp] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-four_cluster_no_precip] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-eight_cluster_allocation] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-eight_cluster_allocation] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-eight_cluster_allocation] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-two_cluster_cp_nocp] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-3] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_vertical_overlap_matches_scalar_recurrence_and_maximum_overlap PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_rms_uses_weighted_second_moment_and_real_probability PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[True] PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_invalid_category_draw_is_reported_in_jit PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1] PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[-1] PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97 PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py::test_conversions PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_output_time.py::test_stats_timestamp_uses_end_of_current_model_step PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_expansion_matches_source_families PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt"-expected name | grid | units | long_name] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | bad_grid | K | Profile"-Invalid stats grid] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt | K | Profile-Malformed stats registry entry] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = " | zt | K | Profile"-name and grid must be non-empty] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_single_quoted_registry_entry_is_supported PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_sampling_uses_open_closed_absolute_time_window PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_config_metadata_data_and_source_grid_contract PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_radiation_registry_entries_require_radiation_grids PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2 PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2 PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3 PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_baseline_and_supported_radiation_schemes_pass PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg0-overrides0-microphys_scheme] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg1-overrides1-l_gfdl_activation] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg2-overrides2-rad_scheme] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg3-overrides3-l_calc_thlp2_rad] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg4-overrides4-Sponge damping] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg5-overrides5-lh_microphys_type] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg6-overrides6-l_silhs_rad] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg7-overrides7-l_input_fields] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg8-overrides8-l_test_grid_generalization] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg9-overrides9-grid_adapt_in_time_method] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_supported_microphysics_and_cloud_sedimentation_pass_initial_gate PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_restart_passes_initial_feature_gate PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_assert_corr_symmetric_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_sfc_varnce_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_length_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_rad_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_invalid_model_arrays_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices0] PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices1] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices2] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices3] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[thl] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[rt] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[thl] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[rt] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices0] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices1] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices2] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices3] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[2-indices0-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[4-indices1-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices2-False] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices3-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[1-indices4-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_disabled_option_keeps_all_forcing PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_error_diagnostics.py::test_multiple_lhs_diagnostic_uses_runtime_parameters PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax/output/tests/pytests/jax.xml -
============================= slowest 15 durations =============================
138.35s call     clubb_jax/pytests/auto_llm_generated_pytests/test_interpolation.py::test_lin_interp_between_grids
27.32s call     clubb_jax/pytests/auto_llm_generated_pytests/test_radiation_module.py::test_radiation_schedule_preserves_outputs_and_stats[dycoms2_rf01-False-True]
22.56s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_nested_jit_gradient_matches_unbatched_finite_difference
12.61s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_driver_matches_unbatched_integrals[True]
11.94s call     clubb_jax/pytests/auto_llm_generated_pytests/test_mixing_length.py::test_coherent_partial_launch_groups_preserve_columns_and_derivatives[False]
9.84s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_driver_matches_unbatched_integrals[False]
9.61s call     clubb_jax/pytests/auto_llm_generated_pytests/test_mixing_length.py::test_cpu_launch_groups_match_single_columns_and_transpose
8.93s call     clubb_jax/pytests/auto_llm_generated_pytests/test_remapping_ppm.py::test_mass_conservation_refined
8.91s call     clubb_jax/pytests/auto_llm_generated_pytests/test_mixing_length.py::test_coherent_partial_launch_groups_preserve_columns_and_derivatives[True]
8.16s call     clubb_jax/pytests/auto_llm_generated_pytests/test_Nc_Ncn_eqns.py::test_forward_vs_numpy_reference
7.22s call     clubb_jax/pytests/auto_llm_generated_pytests/test_multicolumn_microphys_adapters.py::test_hydrometeor_fill_uses_each_columns_metric[1-False]
6.75s call     clubb_jax/pytests/auto_llm_generated_pytests/test_mixing_length.py::test_three_methods_gradients_and_runtime_parameter_reuse[1]
6.15s call     clubb_jax/pytests/auto_llm_generated_pytests/test_remapping_module.py::test_remap_vals_to_target_two_grids
5.77s call     clubb_jax/pytests/auto_llm_generated_pytests/test_driver_lifecycle.py::test_batched_silhs_source_output_guard[False]
5.77s teardown clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_driver_matches_unbatched_integrals[False]
======================= 871 passed in 753.60s (0:12:33) ========================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (JAX F2PY unit tests)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ bash tests/run_pytests.sh -jax_f2py_unit_tests -include_generated -v --durations=15 --junitxml=/home/jenkins/workspace/clubb_branch_jax/output/tests/pytests/jax_f2py_unit_tests.xml
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_branch_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_branch_jax
collecting ... collected 104 items

clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_Nc_Ncn_eqns_vs_fortran.py::test_Ncnm_bit_to_bit_vs_f2py PASSED [  0%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_T_in_K_vs_fortran.py::test_f2py_oracle PASSED [  1%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_adg2_driver_vs_fortran.py::test_f2py_oracle PASSED [  2%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_smooth_min_f2py PASSED [  3%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_smooth_max_f2py PASSED [  4%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_compute_Cx_fnc_Richardson_f2py PASSED [  5%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_calc_xpwp_f2py PASSED [  6%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_stability_and_Ri_f2py PASSED [  7%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_vertical_avg_integral_f2py PASSED [  8%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_brunt_vaisala_f2py PASSED [  9%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_calculate_thlp2_rad_f2py PASSED [ 10%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_Lscale_width_vert_avg_f2py PASSED [ 11%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_wp23_term_splat_lhs_f2py PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_xp3_vs_fortran.py::test_f2py_oracle PASSED [ 13%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_binormal_moments_vs_fortran.py::test_f2py_oracle PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_comp_corrs_binormal_vs_fortran.py::test_f2py_oracle PASSED [ 15%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_comp_corrs_binormal_vs_fortran.py::test_smooth_corr_quotient_f2py PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_ddzt_umvm_sqd_vs_fortran.py::test_f2py_oracle PASSED [ 17%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_roots_vs_fortran.py::test_f2py_oracle PASSED [ 18%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_wp3_on_wp2_vs_fortran.py::test_f2py_oracle PASSED [ 19%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calculate_thvm_vs_fortran.py::test_f2py_oracle PASSED [ 20%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calculate_w_responder_params_vs_fortran.py::test_f2py_oracle PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calendar_vs_fortran.py::test_f2py_oracle PASSED [ 22%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_corr_mtx_approx_vs_fortran.py::test_f2py_oracle PASSED [ 23%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_factor_vs_fortran.py::test_f2py_oracle PASSED [ 24%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_covar_vs_fortran.py::test_f2py_oracle PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_covar_vs_fortran.py::test_clip_covars_denom_f2py PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_skewness_vs_fortran.py::test_f2py_oracle PASSED [ 26%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_variance_vs_fortran.py::test_f2py_oracle PASSED [ 27%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_variance_vs_fortran.py::test_clip_rcm_f2py PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 29%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_ADG1_w_closure_f2py PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_ADG1_pdf_driver_f2py PASSED [ 31%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cloud_drop_sed_vs_fortran.py::test_f2py_oracle PASSED [ 32%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_f2py_oracle PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_wpxp2_f2py PASSED [ 34%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_wpxpyp_f2py PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_compute_gamma_skw_vs_fortran.py::test_f2py_oracle PASSED [ 36%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_compute_sigma_sqd_w_vs_fortran.py::test_f2py_oracle PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_config_flags_complete_vs_fortran.py::test_default_values_match_fortran PASSED [ 38%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cos_solar_zen_vs_fortran.py::test_f2py_oracle PASSED [ 39%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_correlations_vs_fortran.py::test_f2py_oracle PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_upxp_vs_fortran.py::test_f2py_oracle PASSED [ 41%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_xp3_vs_fortran.py::test_f2py_oracle PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diffusion_vs_fortran.py::test_f2py_oracle PASSED [ 43%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_fill_holes_mean_vs_fortran.py::test_fill_holes_vertical_f2py PASSED [ 44%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_fill_holes_mean_vs_fortran.py::test_fill_holes_wp2_from_horz_tke_f2py PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_f2py_oracle PASSED [ 46%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_stretched_grid_operators PASSED [ 47%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_grid_type3_construction_matches_fortran PASSED [ 48%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_grid_construction_matches_fortran PASSED [ 49%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_hydrostatic_vs_fortran.py::test_f2py_oracle PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_hydrostatic_vs_fortran.py::test_f2py_oracle_stretched PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_f2py_oracle PASSED [ 51%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_plinterp_f2py PASSED [ 52%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_limits_f_x_responder_vs_fortran.py::test_f2py_oracle PASSED [ 53%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_luhar_3d_driver_vs_fortran.py::test_f2py_oracle PASSED [ 54%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_luhar_params_vs_fortran.py::test_f2py_oracle PASSED [ 55%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_ly93_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 56%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_ly93_pdf_vs_fortran.py::test_driver_f2py PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mean_adv_vs_fortran.py::test_f2py_oracle PASSED [ 58%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mirror_lower_triangular_vs_fortran.py::test_f2py_oracle PASSED [ 59%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_set_Lscale_max_f2py PASSED [ 60%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_calc_Lscale_directly_f2py PASSED [ 61%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_diagnose_Lscale_from_tau_f2py PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mono_flux_limiter_vs_fortran.py::test_full_limiter_f2py PASSED [ 63%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mono_flux_limiter_vs_fortran.py::test_calc_turb_adv_range_f2py PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_hybrid_pdf_main_vs_fortran.py::test_f2py_oracle PASSED [ 65%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_main_vs_fortran.py::test_driver_f2py PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wp4_f2py PASSED [ 67%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wpxp2_f2py PASSED [ 68%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wp2xp_f2py PASSED [ 69%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_new_hybrid_aliases PASSED [ 70%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_setter_f2py PASSED [ 72%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_driver_f2py PASSED [ 73%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_param_names_match_f2py PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_parameter_hard_bounds_match_f2py PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_param_values_match_fortran PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_calc_derived_params_f2py PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_moment_integrals_vs_fortran.py::test_f2py_oracle PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_mean_stdev_L2N_bit_to_bit PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_NN2NL_NN2LL_calc_corr_chi_x_bit_to_bit PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_chi_eta_rt_thl_roundtrip PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pos_definite_vs_fortran.py::test_f2py_oracle PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pvertinterp_vs_fortran.py::test_f2py_oracle PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_rcm_sat_adj_vs_fortran.py::test_f2py_oracle PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_module_vs_fortran.py::test_f2py_oracle PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_ppm_vs_fortran.py::test_f2py_same_grid_identity PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_responder_params_vs_fortran.py::test_f2py_oracle PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_saturation_vs_fortran.py::test_sat_mixrat_f2py PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_setter_var_params_vs_fortran.py::test_f2py_oracle PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sfc_varnce_vs_fortran.py::test_f2py_oracle PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_skx_func_vs_fortran.py::test_f2py_oracle PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_skx_func_vs_fortran.py::test_LG_2005_ansatz_f2py PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_smooth_heaviside_vs_fortran.py::test_f2py_oracle PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_solver_vs_fortran.py::test_solver_f2py_oracle PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sponge_damp_xp23_vs_fortran.py::test_f2py_oracle PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sponge_damp_xp23_vs_fortran.py::test_sponge_damp_xm_f2py PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_spurious_source_vs_fortran.py::test_f2py_oracle PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sunray_sw_vs_fortran.py::test_f2py_oracle PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_w_up_in_cloud_vs_fortran.py::test_f2py_oracle PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_xpyp_term_ta_godunov_vs_fortran.py::test_f2py_oracle PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_xpyp_term_ta_pdf_vs_fortran.py::test_f2py_oracle PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_branch_jax/output/tests/pytests/jax_f2py_unit_tests.xml -
============================= slowest 15 durations =============================
12.44s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_calc_Lscale_directly_f2py
12.03s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_rcm_sat_adj_vs_fortran.py::test_f2py_oracle
8.56s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cos_solar_zen_vs_fortran.py::test_f2py_oracle
7.55s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_plinterp_f2py
6.89s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_ppm_vs_fortran.py::test_f2py_same_grid_identity
6.03s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_module_vs_fortran.py::test_f2py_oracle
6.00s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_corr_mtx_approx_vs_fortran.py::test_f2py_oracle
5.51s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_hybrid_pdf_main_vs_fortran.py::test_f2py_oracle
4.92s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_new_hybrid_aliases
4.35s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_chi_eta_rt_thl_roundtrip
3.70s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_diagnose_Lscale_from_tau_f2py
3.56s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_factor_vs_fortran.py::test_f2py_oracle
2.98s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_f2py_oracle
2.96s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_Nc_Ncn_eqns_vs_fortran.py::test_Ncnm_bit_to_bit_vs_f2py
2.71s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_correlations_vs_fortran.py::test_f2py_oracle
======================= 104 passed in 129.04s (0:02:09) ========================
 WARNING:  New TSDADG PDF.  The variance of w in the 1st PDF component is negative and is being clipped to 0.
 sigma_w_1^2 (before clipping) =   -89.978350249211630     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -28.100062298269087     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -2.3443699986332036     
 WARNING:  New TSDADG PDF.  The variance of thl in the 2nd PDF component is negative and is being clipped to 0.
 sigma_thl_2^2 (before clipping) =   -19.622495050054393     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -31.067635201597646     
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Expected failure test)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_comparison_mutation_test.py
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
Mutation test artifacts: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_comparison_mutation_8rlf6udc
Control: running unmodified bomex comparison...
Control passed.
Mutation heating: running comparison...
PASS heating: thlm mean absolute difference 0.00015; failing columns [1, 2, 3, 4].
Mutation parameter_handling: running comparison...
PASS parameter_handling: wp3 mean absolute difference 9.25992e-07; failing columns [2, 3, 4].
Mutation first_column: running comparison...
PASS first_column: wp3 mean absolute difference 4.69019e-07; failing columns [2, 3, 4].
Mutation missing_stat: running comparison...
PASS missing_stat: wprtp absent only from JAX output; strict comparison rejected it.

==============================================================================
Expected failure test: PASS
==============================================================================
Case: bomex | 4 timesteps x 60 s | 4 columns | CPU/double
Statistics: input/stats/multi_col_stats.in
Tolerances: JAX-versus-Fortran harness defaults (absolute 1e-07; percentage 1e-07%)

[PASS] Unmodified control — JAX and Fortran matched.

[PASS] heating
  Add 1e-6 K/s of spurious heating to every column.
  Numerical difference detected; both models completed 4 timesteps.
  thlm: mean absolute difference 0.00015; mean percentage difference 4.91235e-05%
  Failing columns: 1, 2, 3, 4; first comparison failure: timestep 1.

[PASS] parameter_handling
  Load C8 as [0.2, 0.3, 0.4, 0.5] instead of [0.2, 0.4, 0.6, 0.8].
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 9.25992e-07; mean percentage difference 0.244887%
  Failing columns: 2, 3, 4; first comparison failure: timestep 1.

[PASS] first_column
  Use column 1's previous wp3 in every column's timestep equation.
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 4.69019e-07; mean percentage difference 0.118965%
  Failing columns: 2, 3, 4; first comparison failure: timestep 3.

[PASS] missing_stat
  Omit wprtp from JAX statistics output while keeping its calculation.
  wprtp is missing only from JAX output; both models completed 4 timesteps.
  Strict bindiff detected the missing variable; other stats were unchanged.

Result: PASS — 4/4 mutations verified | 78.6 s
Logs and outputs: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_comparison_mutation_8rlf6udc
==============================================================================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Jax vs Fortran: standard stats)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ ./tests/run_jax_vs_fortran_cases.py -workers 8
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: case default
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 1 flag set = 23 JAX/Fortran pairs
  Flag sets:
    default
  Cases:
    arm (360 iterations)
    atex (360 iterations)
    bomex (native duration)
    cobra (360 iterations)
    dycoms2_rf01 (native duration)
    dycoms2_rf01_fixed_sst (300 iterations)
    dycoms2_rf02_nd (native duration)
    fire (native duration)
    gabls2 (360 iterations)
    gabls3_night (360 iterations)
    jun25_altocu (180 iterations)
    neutral (native duration)
    wangara (native duration)
    dycoms2_rf02_do (native duration)
    dycoms2_rf02_ds (230 iterations)
    lba_kk (360 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (370 iterations)
      - dt_main: 60 s
    lba (93 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (73 iterations)
      - percentage limit: 0.001%
    nov11_altocu (62 iterations)
      - percentage limit: 0.001%
    rico_silhs (360 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (240 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (74 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-----------------------------------------------------------------------------------------------------------------
[match         ] default                  fire                       180 / 180      140.0          3.8      149.6
[match         ] default                  dycoms2_rf01_fixed_sst     300 / 300      196.9          4.1      208.6
[match         ] default                  dycoms2_rf01               240 / 240      198.2         19.3      237.9
[match         ] default                  dycoms2_rf02_nd            360 / 360      252.1          5.2      267.4
[match         ] default                  bomex                      360 / 360      251.6          7.2      271.3
[match         ] default                  gabls2                     360 / 360       98.7         20.1      123.8
[match         ] default                  cobra                      360 / 360      258.5         10.3      282.0
[match         ] default                  gabls3_night               360 / 360       65.3          5.6       74.5
[match         ] default                  arm                        360 / 360      260.1         10.4      284.8
[match         ] default                  atex                       360 / 360      269.8         13.4      299.3
[match         ] default                  jun25_altocu               180 / 180      151.7          7.8      168.1
[match         ] default                  neutral                    360 / 360      248.4          7.8      267.8
[match         ] default                  lba                          93 / 93      232.6          5.7      248.2
[match         ] default                  clex9_oct14                  73 / 73      147.5          5.0      162.3
[match         ] default                  wangara                    480 / 480      319.8          8.0      342.8
[match         ] default                  nov11_altocu                 62 / 62      163.3          4.6      175.4
[match         ] default                  dycoms2_rf02_ds            230 / 230      445.5         22.3      479.3
[match         ] default                  lba_kk_silhs               240 / 240      305.8         27.3      345.5
[match         ] default                  lba_kk                     360 / 360      604.9         18.7      639.3
[match         ] default                  dycoms2_rf02_do            360 / 360      646.5         30.7      690.8
[match         ] default                  lba_silhs                    74 / 74      331.9         20.1      358.2
[match         ] default                  rico                       370 / 370      929.3          9.2      943.3
[match         ] default                  rico_silhs                 360 / 360      770.0          6.6      781.2

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 23m 44.0s
Results JSON: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results/final_bindiff.log [passed]
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Jax Python vs Fortran cases w varying flags)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_vs_fortran_cases.py -debug 0 -max_iters 5 -workers 8 -flag_config_file input/flag_sets/config_core_flags_wo_never_supported_jax_features.json
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_branch_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: 0
  Forwarded to both runs: -debug 0 -max_iters 5
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 18 flag sets = 414 JAX/Fortran pairs
  Flag sets:
    default
    config_core_flags_wo_never_supported_jax_features_flag2
      - saturation_formula = 1
      - l_godunov_upwind_xpyp_ta = .true.
      - l_lh_importance_sampling = .false.
      - l_random_k_lh_start = .true.
      - l_max_overlap_in_cloud = .false.
    config_core_flags_wo_never_supported_jax_features_flag3
      - ipdf_call_placement = 1
      - l_ho_trad_coriolis = .true.
      - l_ho_nontrad_coriolis = .true.
    config_core_flags_wo_never_supported_jax_features_flag4
      - iiPDF_type = 7
    config_core_flags_wo_never_supported_jax_features_flag5
      - l_predict_upwp_vpwp = .false.
    config_core_flags_wo_never_supported_jax_features_flag6
      - l_wp2_fill_holes_tke = .false.
      - l_enable_relaxed_clipping = .true.
      - l_min_xp2_from_corr_wx = .false.
      - l_add_dycore_grid = .true.
      - l_lh_straight_mc = .true.
    config_core_flags_wo_never_supported_jax_features_flag7
      - Lscale_method = 2
      - fill_holes_type = 3
    config_core_flags_wo_never_supported_jax_features_flag8
      - l_upwind_xpyp_ta = .false.
      - l_upwind_xm_ma = .false.
      - l_lh_clustered_sampling = .false.
      - l_lh_instant_var_covar_src = .false.
      - l_lh_limit_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag9
      - l_min_wp2_from_corr_wx = .true.
      - l_stability_correct_tau_zm = .true.
      - l_damp_wp2_using_em = .false.
      - l_use_C7_Richardson = .false.
    config_core_flags_wo_never_supported_jax_features_flag10
      - l_vert_avg_closure = .true.
      - l_use_cloud_cover = .true.
      - l_damp_wp3_Skw_squared = .false.
      - l_use_C11_Richardson = .true.
      - l_rcm_in_cloud_k_lh_start = .false.
    config_core_flags_wo_never_supported_jax_features_flag11
      - l_rcm_supersat_adj = .false.
      - l_C2_cloud_frac = .true.
      - l_use_precip_frac = .false.
      - l_do_expldiff_rtm_thlm = .true.
      - l_use_shear_Richardson = .true.
    config_core_flags_wo_never_supported_jax_features_flag12
      - l_prescribed_avg_deltaz = .true.
      - l_stability_correct_Kh_N2_zm = .true.
      - l_trapezoidal_rule_zt = .true.
      - l_trapezoidal_rule_zm = .true.
      - l_call_pdf_closure_twice = .true.
    config_core_flags_wo_never_supported_jax_features_flag13
      - l_brunt_vaisala_freq_moist = .true.
      - l_use_thvm_in_bv_freq = .true.
      - l_lmm_stepping = .true.
      - l_vary_convect_depth = .true.
    config_core_flags_wo_never_supported_jax_features_flag14
      - l_use_tke_in_wp3_pr_turb_term = .false.
      - l_use_tke_in_wp2_wp3_K_dfsn = .true.
      - l_use_wp3_lim_with_smth_Heaviside = .true.
      - l_smooth_Heaviside_tau_wpxp = .false.
      - l_modify_limiters_for_cnvg_test = .true.
    config_core_flags_wo_never_supported_jax_features_flag15
      - l_mono_flux_lim_rtm = .false.
      - l_mono_flux_lim_um = .false.
      - l_mono_flux_lim_vm = .false.
      - l_mono_flux_lim_spikefix = .false.
    config_core_flags_wo_never_supported_jax_features_flag16
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .false.
      - l_lh_var_frac = .true.
    config_core_flags_wo_never_supported_jax_features_flag17
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .true.
      - l_lh_normalize_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag18
      - ipdf_call_placement = 3
  Cases:
    arm (5 iterations)
    atex (5 iterations)
    bomex (5 iterations)
    cobra (5 iterations)
    dycoms2_rf01 (5 iterations)
    dycoms2_rf01_fixed_sst (5 iterations)
    dycoms2_rf02_nd (5 iterations)
    fire (5 iterations)
    gabls2 (5 iterations)
    gabls3_night (5 iterations)
    jun25_altocu (5 iterations)
    neutral (5 iterations)
    wangara (5 iterations)
    dycoms2_rf02_do (5 iterations)
    dycoms2_rf02_ds (5 iterations)
    lba_kk (5 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (5 iterations)
      - dt_main: 60 s
    lba (5 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (5 iterations)
      - percentage limit: 0.001%
    nov11_altocu (5 iterations)
      - percentage limit: 0.001%
    rico_silhs (5 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (5 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (5 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                                                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-------------------------------------------------------------------------------------------------------------------------------------------------
[match         ] default                                                  cobra                          5 / 5       30.9          1.6       35.8
[match         ] default                                                  fire                           5 / 5       33.4          1.0       38.3
[match         ] default                                                  dycoms2_rf01_fixed_sst         5 / 5       33.4          1.1       38.5
[match         ] default                                                  bomex                          5 / 5       34.1          1.1       39.1
[match         ] default                                                  arm                            5 / 5       34.3          1.6       39.6
[match         ] default                                                  atex                           5 / 5       34.4          1.7       39.8
[match         ] default                                                  dycoms2_rf01                   5 / 5       35.2          1.8       40.6
[match         ] default                                                  dycoms2_rf02_nd                5 / 5       36.4          1.3       41.0
[match         ] default                                                  gabls3_night                   5 / 5       21.4          1.0       24.7
[match         ] default                                                  gabls2                         5 / 5       31.7          1.4       35.4
[match         ] default                                                  neutral                        5 / 5       32.3          1.2       36.8
[match         ] default                                                  wangara                        5 / 5       31.9          1.2       36.4
[match         ] default                                                  jun25_altocu                   5 / 5       33.3          1.2       38.2
[match         ] default                                                  lba_kk                         5 / 5       49.2          1.3       54.1
[match         ] default                                                  dycoms2_rf02_ds                5 / 5       49.4          1.4       54.5
[match         ] default                                                  dycoms2_rf02_do                5 / 5       51.2          1.5       56.3
[match         ] default                                                  rico                           5 / 5       54.1          1.0       58.7
[match         ] default                                                  rico_silhs                     5 / 5       41.3          1.2       45.8
[match         ] default                                                  clex9_oct14                    5 / 5       43.7          1.2       49.7
[match         ] default                                                  nov11_altocu                   5 / 5       46.0          1.3       52.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  arm                            1 / 5       31.7          1.0       36.3
[match         ] default                                                  lba_kk_silhs                   5 / 5       39.9          1.4       46.1
[match         ] default                                                  lba                            5 / 5       79.2          1.7       89.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  atex                           1 / 5       33.9          1.2       39.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  bomex                          1 / 5       39.3          1.2       44.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  cobra                          1 / 5       36.6          1.4       42.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01                   1 / 5       38.7          1.4       43.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01_fixed_sst         1 / 5       36.1          1.1       40.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_nd                1 / 5       37.9          1.1       42.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls3_night                   5 / 5       23.5          1.2       27.2
[match         ] default                                                  lba_silhs                      5 / 5       92.7          2.5      100.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls2                         5 / 5       33.0          1.3       36.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  fire                           1 / 5       36.0          1.1       40.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  jun25_altocu                   1 / 5       34.5          1.2       39.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  neutral                        1 / 5       32.1          1.0       36.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  wangara                        1 / 5       33.2          1.0       37.5
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  rico_silhs                         -        5.6          0.9        6.5
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk_silhs                       -        5.3          1.0        6.3
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_silhs                          -        5.1          1.0        6.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_do                1 / 5       50.2          1.4       55.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_ds                1 / 5       49.9          1.4       54.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk                         1 / 5       48.2          1.3       52.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  clex9_oct14                    1 / 5       43.0          1.4       48.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  rico                           5 / 5       54.4          1.1       58.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  nov11_altocu                   1 / 5       42.5          1.4       48.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  arm                            5 / 5       30.7          1.0       34.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  atex                           5 / 5       30.6          1.1       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  bomex                          5 / 5       31.5          1.2       36.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba                            1 / 5       78.2          1.2       84.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  cobra                          5 / 5       32.5          1.4       37.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01                   5 / 5       33.0          1.4       37.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01_fixed_sst         5 / 5       33.2          1.1       37.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_nd                5 / 5       34.0          1.1       38.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  fire                           5 / 5       30.5          1.1       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls2                         5 / 5       30.7          1.3       34.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls3_night                   5 / 5       21.0          1.0       24.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  neutral                        5 / 5       30.6          1.0       34.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  jun25_altocu                   5 / 5       31.4          1.2       36.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  wangara                        5 / 5       32.1          1.1       36.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_ds                5 / 5       48.7          1.4       54.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_do                5 / 5       50.0          1.6       56.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk                         5 / 5       47.3          1.2       53.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico                           5 / 5       56.0          1.1       60.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  nov11_altocu                   5 / 5       46.7          1.4       52.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico_silhs                     5 / 5       44.2          1.1       48.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  clex9_oct14                    5 / 5       52.2          1.2       58.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  arm                                -       32.6          1.1       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba                            5 / 5       79.0          1.3       85.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk_silhs                   5 / 5       41.0          1.5       46.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  atex                               -       30.2          1.1       31.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  bomex                              -       31.6          1.1       32.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  cobra                              -       31.4          1.2       32.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01                       -       33.7          1.4       35.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01_fixed_sst             -       26.9          1.0       27.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  fire                               -       27.7          1.2       28.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_nd                    -       30.1          1.2       31.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls3_night                       -       24.8          1.0       25.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls2                             -       33.6          1.8       35.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  jun25_altocu                       -       31.5          1.1       32.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  wangara                            -       30.1          1.1       31.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  neutral                            -       31.2          1.3       32.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_silhs                      5 / 5       88.5          2.6       96.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_ds                    -       32.1          1.5       33.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_do                    -       32.7          1.4       34.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico                               -       22.9          1.0       23.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk                             -       30.1          1.2       31.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico_silhs                         -       20.9          1.0       22.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  clex9_oct14                        -       34.2          1.3       35.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  nov11_altocu                       -       33.3          1.2       34.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba                                -       37.3          1.6       38.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk_silhs                       -       30.8          1.6       32.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  arm                            5 / 5       31.1          1.1       35.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_silhs                          -       35.1          2.7       37.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  atex                           5 / 5       30.0          1.2       34.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  bomex                          5 / 5       30.8          1.0       35.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  cobra                          5 / 5       31.9          1.2       36.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01_fixed_sst         5 / 5       31.2          1.1       35.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01                   5 / 5       32.3          1.4       37.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls3_night                   5 / 5       23.6          1.1       27.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_nd                5 / 5       34.1          1.1       38.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  fire                           5 / 5       31.8          1.2       36.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls2                         5 / 5       31.8          1.4       35.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  jun25_altocu                   5 / 5       32.2          1.2       36.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  neutral                        5 / 5       30.0          1.1       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  wangara                        5 / 5       32.1          1.0       36.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_do                5 / 5       49.0          1.6       54.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_ds                5 / 5       48.5          1.5       53.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk                         5 / 5       48.2          1.1       52.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  clex9_oct14                    5 / 5       41.8          1.4       47.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico                           5 / 5       54.6          1.1       59.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico_silhs                     5 / 5       41.7          1.2       46.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  nov11_altocu                   5 / 5       44.2          1.2       49.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk_silhs                   5 / 5       37.9          1.5       42.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  arm                            1 / 5       33.0          1.5       37.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba                            5 / 5       80.6          1.3       90.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  atex                               -       34.8          2.2       39.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  bomex                              -       39.3          1.6       42.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  cobra                              -       37.2          1.8       40.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01                       -       36.8          3.1       42.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01_fixed_sst             -       37.6          1.1       40.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls3_night                       -       24.7          1.0       27.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  fire                               -       37.6          1.4       40.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_nd                    -       39.9          1.4       43.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls2                             -       33.9          1.4       36.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_silhs                      5 / 5       91.9          2.7       99.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  neutral                            -       33.4          1.2       36.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  jun25_altocu                   1 / 5       36.1          1.6       39.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  wangara                            -       33.5          1.2       36.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_do                    -       49.6          1.8       53.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk                             -       46.3          2.3       50.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_ds                    -       51.5          1.8       55.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico                               -       54.8          1.1       57.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  nov11_altocu                       -       42.9          1.7       46.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  clex9_oct14                        -       47.2          1.8       51.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico_silhs                         -       40.9          1.0       43.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  arm                                -       17.4          1.2       18.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  atex                               -       16.0          1.1       17.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  bomex                              -       16.3          1.1       17.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  cobra                              -       17.6          1.3       18.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01_fixed_sst             -       16.6          1.1       17.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01                       -       17.5          1.3       18.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk_silhs                       -       38.6          2.6       43.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_nd                    -       17.5          2.0       19.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba                                -       77.4          4.7       85.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  fire                               -       19.3          1.2       20.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls2                             -       20.4          1.4       21.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  jun25_altocu                       -       20.8          1.2       22.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  neutral                            -       19.2          1.1       20.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  wangara                            -       17.9          1.3       19.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls3_night                       -       24.0          1.0       25.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_do                    -       18.7          1.4       20.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_ds                    -       20.4          1.5       21.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk                             -       18.9          1.2       20.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico                               -       16.3          1.1       17.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  clex9_oct14                        -       21.7          1.2       22.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico_silhs                         -       16.8          1.0       17.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  nov11_altocu                       -       23.3          1.4       24.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba                                -       26.3          1.5       27.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk_silhs                       -       17.4          2.0       19.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_silhs                          -       90.8          4.4       97.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_silhs                          -       23.1          3.4       26.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  arm                            5 / 5       39.6          1.0       45.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  atex                           5 / 5       39.7          1.5       47.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  bomex                          5 / 5       43.6          1.1       49.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  cobra                          5 / 5       44.6          1.4       49.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01_fixed_sst         5 / 5       43.2          1.2       48.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01                   5 / 5       46.1          1.5       52.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_nd                5 / 5       50.5          1.3       57.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  fire                           5 / 5       47.7          1.6       53.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls3_night                   5 / 5       30.3          1.2       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls2                         5 / 5       41.2          1.5       45.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  jun25_altocu                   5 / 5       42.8          1.4       48.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  neutral                        5 / 5       41.9          1.4       47.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  wangara                        5 / 5       43.8          1.0       49.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_do                5 / 5       66.3          1.8       72.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk                         5 / 5       57.4          1.3       63.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_ds                5 / 5       62.3          1.4       68.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico                           5 / 5       66.8          1.2       71.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico_silhs                     5 / 5       54.2          1.2       60.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  nov11_altocu                   5 / 5       56.4          1.4       64.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  clex9_oct14                    5 / 5       58.6          1.4       65.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk_silhs                   5 / 5       43.6          1.6       49.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  arm                            5 / 5       39.2          1.2       44.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba                            5 / 5       92.1          1.5      100.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  atex                           5 / 5       37.6          1.3       42.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  bomex                          5 / 5       34.7          1.2       39.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  cobra                          5 / 5       38.0          1.2       42.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01                   5 / 5       36.7          1.4       41.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01_fixed_sst         5 / 5       36.5          1.1       41.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_nd                5 / 5       39.6          1.1       44.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  fire                           5 / 5       38.6          1.0       43.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls3_night                   5 / 5       25.2          1.2       29.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls2                         5 / 5       36.1          1.4       40.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_silhs                      5 / 5      103.4          2.6      112.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  neutral                        5 / 5       36.4          1.0       40.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  jun25_altocu                   5 / 5       36.1          1.2       40.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  wangara                        5 / 5       35.6          1.1       40.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_do                5 / 5       58.5          1.7       64.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_ds                5 / 5       60.3          1.6       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk                         5 / 5       56.2          1.2       61.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico                           5 / 5       62.0          1.2       67.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  nov11_altocu                   5 / 5       54.6          1.2       61.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  clex9_oct14                    5 / 5       57.7          1.4       64.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico_silhs                     5 / 5       49.8          1.2       55.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 arm                            1 / 5       39.6          1.2       45.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk_silhs                   5 / 5       46.5          1.6       52.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba                            5 / 5       94.1          1.5      101.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 atex                           1 / 5       39.2          1.5       45.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 cobra                          1 / 5       38.2          1.3       43.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 bomex                          1 / 5       43.5          1.0       48.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01                   1 / 5       43.2          1.8       49.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01_fixed_sst         1 / 5       39.4          1.0       45.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls3_night                   5 / 5       25.6          1.2       29.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_nd                1 / 5       41.4          1.1       47.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 fire                           1 / 5       36.4          1.1       41.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls2                         5 / 5       37.2          1.8       41.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 jun25_altocu                   1 / 5       38.4          1.3       44.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_silhs                      5 / 5      102.9          3.2      111.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 neutral                        1 / 5       39.0          1.2       44.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 wangara                        1 / 5       39.1          1.3       48.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_do                1 / 5       65.2          1.6       73.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk                         1 / 5       63.5          1.6       72.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_ds                1 / 5       65.7          1.7       73.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico                           5 / 5       69.9          1.2       76.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 clex9_oct14                    1 / 5       62.8          1.2       70.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 nov11_altocu                   1 / 5       62.8          1.5       70.2
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag11 cobra                              -        5.4          1.4        6.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico_silhs                     5 / 5       53.7          1.2       59.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 arm                            5 / 5       37.0          1.1       42.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba                            1 / 5       98.3          1.3      106.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 atex                           5 / 5       37.8          1.2       42.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk_silhs                   1 / 5       46.1          2.0       52.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 bomex                          5 / 5       39.0          1.1       43.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01                   5 / 5       41.3          1.5       47.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01_fixed_sst         5 / 5       38.9          1.0       44.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls3_night                   5 / 5       25.2          1.2       29.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_nd                5 / 5       39.6          1.2       44.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 fire                           5 / 5       37.6          1.2       42.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls2                         5 / 5       38.9          1.4       43.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 jun25_altocu                   5 / 5       38.4          1.2       43.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 neutral                        5 / 5       34.4          1.2       39.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_silhs                      1 / 5      103.9          2.8      113.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 wangara                        5 / 5       36.4          1.0       41.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_do                5 / 5       54.6          1.5       59.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_ds                5 / 5       55.3          1.8       61.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk                         5 / 5       53.9          1.6       59.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico                           5 / 5       59.6          1.0       64.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 clex9_oct14                    5 / 5       52.2          1.2       58.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 nov11_altocu                   5 / 5       50.0          1.2       56.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico_silhs                     5 / 5       48.3          1.1       53.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk_silhs                   5 / 5       41.1          1.6       46.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba                            5 / 5       86.5          1.2       92.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 arm                            5 / 5       42.8          1.1       47.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 atex                           5 / 5       40.8          1.2       45.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 cobra                          5 / 5       35.5          1.2       43.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 bomex                          5 / 5       48.4          1.3       53.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01                   5 / 5       47.7          1.7       52.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01_fixed_sst         5 / 5       45.8          1.0       50.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls2                         5 / 5       37.3          1.5       41.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls3_night                   5 / 5       28.3          1.4       32.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 fire                           5 / 5       45.7          1.0       50.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_nd                5 / 5       48.4          1.4       53.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_silhs                      5 / 5       90.9          2.6       98.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 jun25_altocu                   5 / 5       43.0          1.2       47.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 neutral                        5 / 5       43.2          1.1       47.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 wangara                        5 / 5       42.8          1.0       47.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_do                5 / 5       61.1          1.5       66.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico                           5 / 5       58.9          1.3       63.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk                         5 / 5       59.5          1.5       64.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_ds                5 / 5       60.3          1.5       65.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 nov11_altocu                   5 / 5       52.5          1.2       58.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 clex9_oct14                    5 / 5       54.1          1.3       59.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico_silhs                     5 / 5       45.6          1.2       50.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba                            5 / 5       85.4          1.2       92.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 atex                           5 / 5       31.3          1.2       36.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 arm                            5 / 5       34.5          1.2       40.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk_silhs                   5 / 5       57.5          1.6       65.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 bomex                          5 / 5       39.2          1.1       44.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 cobra                          5 / 5       41.4          1.2       48.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01                   5 / 5       41.9          2.5       51.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01_fixed_sst         5 / 5       45.6          1.0       50.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 fire                           5 / 5       42.3          1.0       46.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_nd                5 / 5       47.9          1.0       52.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls3_night                   5 / 5       27.2          1.1       30.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls2                         5 / 5       37.5          1.4       41.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 jun25_altocu                   5 / 5       36.4          1.2       42.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 neutral                        5 / 5       33.8          1.2       38.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_silhs                      5 / 5      108.6          3.1      117.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 wangara                        5 / 5       36.2          1.0       40.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_do                5 / 5       55.6          1.4       60.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_ds                5 / 5       54.1          1.4       59.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk                         5 / 5       54.2          1.2       58.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 clex9_oct14                    5 / 5       48.4          1.2       53.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico                           5 / 5       61.0          1.0       65.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 nov11_altocu                   5 / 5       47.6          1.3       53.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico_silhs                     5 / 5       49.1          1.1       53.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk_silhs                   5 / 5       42.8          2.9       54.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba                            5 / 5      100.8          3.1      112.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 arm                            5 / 5       78.7          1.6       91.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 atex                           5 / 5       88.8          1.3       93.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 bomex                          5 / 5       89.1          1.1       94.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 cobra                          5 / 5       89.9          1.3       95.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01                   5 / 5       91.2          2.2       97.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_silhs                      5 / 5      124.0          2.6      132.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01_fixed_sst         5 / 5       77.7          1.0       84.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls3_night                   5 / 5       38.7          1.1       42.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_nd                5 / 5       82.3          1.2       86.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 fire                           5 / 5       67.1          1.0       71.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls2                         5 / 5       80.1          2.2       85.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 jun25_altocu                   5 / 5       82.2          1.2       90.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 neutral                        5 / 5       77.3          1.2       84.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 wangara                        5 / 5       79.4          1.1       86.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_do                5 / 5       99.6          1.5      104.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_ds                5 / 5       90.7          1.4       99.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk                         5 / 5       93.9          1.8      101.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico                           5 / 5      116.7          1.2      121.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk_silhs                   5 / 5       50.5          1.4       55.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico_silhs                     5 / 5       76.8          1.1       81.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 nov11_altocu                   5 / 5       86.6          1.4       92.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 clex9_oct14                    5 / 5       87.2          1.2       92.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 arm                            5 / 5       37.6          1.0       42.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 atex                           5 / 5       32.6          1.4       44.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba                            5 / 5      125.7          2.6      141.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 bomex                          5 / 5       39.0          1.0       44.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01_fixed_sst         5 / 5       38.6          1.1       43.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 cobra                          5 / 5       39.8          1.4       45.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01                   5 / 5       39.8          1.6       45.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_nd                5 / 5       43.3          1.2       48.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls3_night                   5 / 5       22.6          1.0       26.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 fire                           5 / 5       33.2          1.1       37.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_silhs                      5 / 5      109.8          2.7      119.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls2                         5 / 5       33.0          1.4       36.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 jun25_altocu                   5 / 5       31.9          1.1       36.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 neutral                        5 / 5       32.0          1.2       36.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 wangara                        5 / 5       32.6          1.2       37.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_do                5 / 5       47.2          1.3       52.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_ds                5 / 5       49.1          1.3       54.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk                         5 / 5       48.6          1.1       53.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 clex9_oct14                    5 / 5       43.8          1.2       49.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico_silhs                     5 / 5       43.6          1.2       48.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 nov11_altocu                   5 / 5       44.8          1.4       50.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico                           5 / 5       55.0          1.1       59.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk_silhs                   5 / 5       40.8          1.5       45.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba                            5 / 5       73.9          1.2       80.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 arm                            5 / 5       31.0          1.1       35.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 atex                           5 / 5       31.6          1.1       36.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 bomex                          5 / 5       33.0          1.1       37.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 cobra                          5 / 5       32.0          1.2       36.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01                   5 / 5       34.2          1.6       39.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01_fixed_sst         5 / 5       31.8          0.9       36.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls3_night                   5 / 5       23.3          1.1       26.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 fire                           5 / 5       33.2          1.0       38.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_nd                5 / 5       38.3          1.1       42.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls2                         5 / 5       30.0          1.3       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 jun25_altocu                   5 / 5       33.8          1.2       38.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 neutral                        5 / 5       34.4          1.1       39.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_silhs                      5 / 5       87.5          2.6       95.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 wangara                        5 / 5       33.3          1.0       37.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_do                5 / 5       51.2          1.3       56.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_ds                5 / 5       52.2          1.4       57.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk                         5 / 5       51.6          1.2       56.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico                           5 / 5       56.2          1.0       61.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 clex9_oct14                    5 / 5       45.6          1.2       51.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 nov11_altocu                   5 / 5       44.8          1.2       50.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico_silhs                     5 / 5       42.2          1.0       46.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 arm                            5 / 5       32.0          1.2       36.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba                            5 / 5       78.6          1.3       85.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 atex                           5 / 5       31.4          1.4       36.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk_silhs                   5 / 5       41.6          1.9       47.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 bomex                          5 / 5       32.4          1.0       37.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 cobra                          5 / 5       34.4          1.1       39.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01                   5 / 5       34.4          1.4       39.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls3_night                   5 / 5       23.0          1.0       26.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01_fixed_sst         5 / 5       31.8          1.2       36.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_nd                5 / 5       37.2          1.2       41.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls2                         5 / 5       33.7          1.5       37.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 fire                           5 / 5       33.8          1.0       38.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 neutral                        5 / 5       32.7          1.2       37.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 jun25_altocu                   5 / 5       36.0          1.2       40.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_silhs                      5 / 5       91.0          2.7       99.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 wangara                        5 / 5       36.0          1.0       40.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_do                5 / 5       51.1          1.4       56.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_ds                5 / 5       52.5          1.4       57.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk                         5 / 5       52.6          1.2       57.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico                           5 / 5       58.2          1.1       63.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 clex9_oct14                    5 / 5       46.9          1.4       52.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 nov11_altocu                   5 / 5       44.5          1.2       50.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico_silhs                     5 / 5       44.3          1.0       49.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk_silhs                   5 / 5       40.2          1.8       50.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 arm                            5 / 5       41.7          1.4       48.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 atex                           5 / 5       39.5          1.1       44.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba                            5 / 5       88.6          1.5       97.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 bomex                          5 / 5       40.7          1.2       45.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 cobra                          5 / 5       41.4          1.3       46.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01                   5 / 5       46.1          1.4       51.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls3_night                   5 / 5       25.6          1.3       29.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01_fixed_sst         5 / 5       37.0          1.4       43.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls2                         5 / 5       37.1          1.4       41.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_nd                5 / 5       42.2          1.1       47.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 fire                           5 / 5       40.3          1.2       45.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 jun25_altocu                   5 / 5       35.9          1.6       41.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_silhs                      5 / 5      103.7          2.6      112.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 neutral                        5 / 5       35.6          1.1       40.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 wangara                        5 / 5       34.0          1.0       38.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_do                5 / 5       55.2          1.7       61.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_ds                5 / 5       55.1          1.5       60.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk                         5 / 5       53.7          1.2       59.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico                           5 / 5       59.7          1.1       64.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 clex9_oct14                    5 / 5       51.8          1.2       57.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 nov11_altocu                   5 / 5       51.0          1.1       56.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico_silhs                     5 / 5       46.8          1.1       51.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba                            5 / 5       80.7          1.2       87.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk_silhs                   5 / 5       38.3          1.4       43.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_silhs                      5 / 5       79.5          2.7       87.0

Overall cases:
  Match Diff Failed
  ----- ---- ------
    302   62     50

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag2:
  Match Diff Failed
  ----- ---- ------
      2   18      3

Flag set config_core_flags_wo_never_supported_jax_features_flag3:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag4:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag5:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag6:
  Match Diff Failed
  ----- ---- ------
      0   23      0

Flag set config_core_flags_wo_never_supported_jax_features_flag7:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag8:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag9:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag10:
  Match Diff Failed
  ----- ---- ------
      2   21      0

Flag set config_core_flags_wo_never_supported_jax_features_flag11:
  Match Diff Failed
  ----- ---- ------
     22    0      1

Flag set config_core_flags_wo_never_supported_jax_features_flag12:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag13:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag14:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag15:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag16:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag17:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag18:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 48m 45.0s
Results JSON: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_branch_jax/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
Setting overall build result to FAILURE
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] junit
Recording test results
[Checks API] No suitable checks publisher found.
[Pipeline] script
[Pipeline] {
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: FAILURE