Skip to content
Skipping 615 KB.. Full Log
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[None] PASSED [ 73%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_linalg] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_solver] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_rocm_runtime.py::test_rocm_backend_verification_requires_loadable_math_libraries[_sparse] PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_rejects_an_old_driver PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_accepts_a_three_component_new_driver_version PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_cuda13_rejects_an_old_compute_capability PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_query_retries_without_compute_capability PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_report_labels_expected_device_without_claiming_backend_ready PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_numeric_visible_device_resolves_to_its_nvidia_smi_uuid PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_missing_environment_requires_setup_but_remains_selectable PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_human_output_labels_planned_versions PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_preflight_fails_before_creating_an_environment PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-None-False-false-None] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-None-False-false-FASTEST_FIRST] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-true-False-true-None] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-true-False-true-FASTEST_FIRST] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-false-True-true-None] PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[False-false-True-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-None-False-false-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-None-False-false-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-true-False-true-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-true-False-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-false-True-true-None] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_gpu_wrapper_resolves_physical_index_even_when_pci_order_differs[True-false-True-true-FASTEST_FIRST] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[] PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[-1] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[9] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[GPU-missing] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[GPU-test] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[0,0] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_invalid_selection_is_rejected[1,,0] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_explicit_selection_preserves_order_and_expands_unique_prefix PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[0-False] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[1-True] PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[1,0-False] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_preflight_checks_exposed_gpus_only[-False] PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_fastest_first_without_selector_does_not_guess_default PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_truncated_nvidia_row_returns_unavailable PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_metal_query_accepts_gpu_family_capability PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_runtime_info.py::test_metal_runtime_uses_plugin_requirements PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_dispatcher_matches_leaves PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_svp_reference_values PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_sat_mixrat_liq_consistency_and_grad PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/test_saturation.py::test_saturation_formula_enum_values PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_setter_var_params.py::test_moment_reconstruction PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_conversions_and_bulk_fluxes PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_ubar_and_momentum PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_ht_mostr_flux_interp PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_set_scalar_surface_fluxes_updates_surface_arrays_only PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_flux.py::test_shared_surface_flux_path_jits_and_stays_on_device PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_compiled_dump_selects_fatal_columns_and_preserves_source_fields[0] PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_compiled_dump_selects_fatal_columns_and_preserves_source_fields[2] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[-1] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[0] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_lower_debug_levels_suppress_fatal_dump[1] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_scalar_only_nan_and_existing_fatal_headers_use_column_order PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sfc_varnce_diagnostics.py::test_large_field_dump_does_not_abbreviate_arrays PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[-1] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[0] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_impossible_weight_transfer_reports_fatal_status[2] PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_weight_limiter_error_reaches_importance_driver PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-mixture] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[-0.125-cloud2] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-mixture] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud1] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_invalid_fraction_is_local_to_column[1.125-cloud2] PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_diagnostics.py::test_kessler_empty_sample_reports_source_stop PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_driver.py::test_subtimestep_statistics_preserve_previous_window_and_count_once PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_fortran_oracle.py::test_inverse_normal_matches_source_literal_precision PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_port_structure.py::test_silhs_inventory_excludes_mt95 PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_stratification_reproducibility_and_sequence_reuse PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[1] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_strata_cycle_and_sequence_reuse[3] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_deterministic_overlap_pool_is_independent_of_seed PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-eight_cluster_allocation] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-four_cluster_no_precip] PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-False-two_cluster_cp_nocp] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-four_cluster_no_precip] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions0-True-two_cluster_cp_nocp] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-four_cluster_no_precip] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-False-two_cluster_cp_nocp] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-eight_cluster_allocation] PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions1-True-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-eight_cluster_allocation] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-False-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-eight_cluster_allocation] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-four_cluster_no_precip] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_probabilities_weights_and_empty_clusters[fractions2-True-two_cluster_cp_nocp] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-1] PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-2] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[False-3] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-1] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-2] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_importance_samples_membership_and_weighted_estimate[True-3] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_inverse_normal_and_cholesky_reference PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_vertical_overlap_matches_scalar_recurrence_and_maximum_overlap PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[False] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_microphysical_variance_sources_include_optional_dt_terms[True] PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_category_rms_uses_weighted_second_moment_and_real_probability PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[False-True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_uniform_driver_options_and_shared_permutation_state[True-True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[False] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_old_cloud_weighted_sample_count_check_precedes_dispatch[True] PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_invalid_category_draw_is_reported_in_jit PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[1] PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_sampling.py::test_random_starting_level_bounds_and_no_cloud_fallback[-1] PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_mpace_b_sfclyr PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_97_sfclyr PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_twp_ice_equals_cloud_feedback PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_silhs_surface_schemes.py::test_arm_3year_arm_0003_equal_arm_97 PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_clean PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_above_cloud PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad.py::test_simple_rad_bomex PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_table_load PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_time_interp_vs_literal PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_simple_rad_lba.py::test_full_radht_vs_literal PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_vs_fortran_replica PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_soil_vegetation.py::test_soil_veg_init_and_integration PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_single_col PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_vs_numpy_multi_col PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_solver.py::test_solver_residual PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/test_spec_hum_to_mixing_ratio.py::test_conversions PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[-0.0004-0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_clipped_frequency_has_zero_forward_and_reverse_derivatives[0.0-0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.25] PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sponge_damp_xp23.py::test_below_sponge_noop PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_spurious_source.py::test_conservation_identity PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_output_time.py::test_stats_timestamp_uses_end_of_current_model_step PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_expansion_matches_source_families PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt"-expected name | grid | units | long_name] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | bad_grid | K | Profile"-Invalid stats grid] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = "profile | zt | K | Profile-Malformed stats registry entry] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_registry_errors_are_not_silently_skipped[entry(1) = " | zt | K | Profile"-name and grid must be non-empty] PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_single_quoted_registry_entry_is_supported PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_sampling_uses_open_closed_absolute_time_window PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_and_selector_dispatch_updates_pointwise_counts PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_budget_sequence_and_l_count_sample PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_jitted_banks_preserve_column_and_level_selectors PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_rank_one_column_selector_is_bounds_checked PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_direct_banks_accumulate_across_sampled_and_unsampled_steps PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_record_uses_end_step_time PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_oversampling_is_reported_at_the_host_output_boundary PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_config_metadata_data_and_source_grid_contract PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_netcdf_metadata_matches_fortran_schema PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_radiation_registry_entries_require_radiation_grids PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_multiple_runtime_batches_fill_one_output_file PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_silhs_sample_fields_share_the_stats_record PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_sunray_sw.py::test_jit_multicol PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_interpolation_equivalent_everywhere PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_time_select.py::test_endpoints_and_out_of_range PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_deterministic_coefficients PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_variance_combination_monte_carlo PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_corr_quotient_and_grad PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_transform_pdf_chi_eta_component.py::test_zero_component_variances_have_finite_derivatives PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_vary PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_all_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x2_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1x3_const_uses_swapped_x1x2 PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2x3_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x1_const PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x2_const PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NLL_mean_eq.py::test_x3_const_uses_swapped_x2 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_vary_base PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c3_const_x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2_const_x2 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1_const_x1 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c2c3_const_x2x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c3_const_x1x3 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_c1c2_const_x1x2 PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/test_trivar_NNL_covar_eq.py::test_all_const_maps_to_x2x3 PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_baseline_and_supported_radiation_schemes_pass PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg0-overrides0-microphys_scheme] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg1-overrides1-l_gfdl_activation] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg2-overrides2-rad_scheme] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg3-overrides3-l_calc_thlp2_rad] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg4-overrides4-Sponge damping] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg5-overrides5-lh_microphys_type] PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg6-overrides6-l_silhs_rad] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg7-overrides7-l_input_fields] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg8-overrides8-l_test_grid_generalization] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_unsupported_active_driver_features_fail_loud[cfg9-overrides9-grid_adapt_in_time_method] PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_invalid_solar_date_uses_the_source_calendar_failure PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_supported_microphysics_and_cloud_sedimentation_pass_initial_gate PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_unsupported_config_guards.py::test_restart_passes_initial_feature_gate PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_transcription_and_interp PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_update_xp2_mc.py::test_invariants PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_assert_corr_symmetric_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_sfc_varnce_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_length_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_pdf_closure_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_rad_check_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_validation_checks.py::test_invalid_model_arrays_behavior PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices0] PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices1] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices2] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_named_slots_preserve_other_tracer_forcing[indices3] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[thl] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_forcing_on_copies_is_fatal[rt] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[thl] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_surface_flux_on_copies_is_fatal[rt] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices0] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices1] PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices2] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_rejects_invalid_eddy_scalars[4-indices3] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[2-indices0-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[4-indices1-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices2-False] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[0-indices3-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_settings_check_accepts_valid_or_disabled_eddy_scalars[1-indices4-True] PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_scalar_indices.py::test_disabled_option_keeps_all_forcing PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_error_diagnostics.py::test_multiple_lhs_diagnostic_uses_runtime_parameters PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax.xml -
============================= slowest 15 durations =============================
170.42s call     clubb_jax/pytests/auto_llm_generated_pytests/test_interpolation.py::test_lin_interp_between_grids
29.89s call     clubb_jax/pytests/auto_llm_generated_pytests/test_radiation_module.py::test_radiation_schedule_preserves_outputs_and_stats[dycoms2_rf01-False-True]
22.38s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_nested_jit_gradient_matches_unbatched_finite_difference
11.69s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_driver_matches_unbatched_integrals[True]
10.62s call     clubb_jax/pytests/auto_llm_generated_pytests/test_kk_covariance_batch.py::test_driver_matches_unbatched_integrals[False]
9.61s call     clubb_jax/pytests/auto_llm_generated_pytests/test_remapping_ppm.py::test_mass_conservation_refined
8.41s call     clubb_jax/pytests/auto_llm_generated_pytests/test_Nc_Ncn_eqns.py::test_forward_vs_numpy_reference
7.99s call     clubb_jax/pytests/auto_llm_generated_pytests/test_multicolumn_microphys_adapters.py::test_hydrometeor_fill_uses_each_columns_metric[1-False]
7.21s call     clubb_jax/pytests/auto_llm_generated_pytests/test_driver_lifecycle.py::test_batched_silhs_source_output_guard[False]
7.20s call     clubb_jax/pytests/auto_llm_generated_pytests/test_remapping_module.py::test_remap_vals_to_target_two_grids
5.85s call     clubb_jax/pytests/auto_llm_generated_pytests/test_splatting_autodiff.py::test_mixed_columns_preserve_values_and_coefficient_sensitivity[0.0]
5.72s call     clubb_jax/pytests/auto_llm_generated_pytests/test_stats_writer.py::test_output_remapping_preserves_values_on_identical_grids
5.58s call     clubb_jax/pytests/auto_llm_generated_pytests/test_new_pdf.py::test_mixture_fraction
5.57s call     clubb_jax/pytests/auto_llm_generated_pytests/test_read_surface_var_for_bc.py::test_interpolated_surface_values_match_column_reference
5.55s call     clubb_jax/pytests/auto_llm_generated_pytests/test_mixed_moment_pdf_integrals.py::test_bivar_NL_closed_form_and_mc
======================= 857 passed in 763.29s (0:12:43) ========================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (JAX F2PY unit tests)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ bash tests/run_pytests.sh -jax_f2py_unit_tests -include_generated -v --durations=15 --junitxml=/home/jenkins/workspace/clubb_jax/output/tests/pytests/jax_f2py_unit_tests.xml
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-9.1.1, pluggy-1.7.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 104 items

clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_Nc_Ncn_eqns_vs_fortran.py::test_Ncnm_bit_to_bit_vs_f2py PASSED [  0%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_T_in_K_vs_fortran.py::test_f2py_oracle PASSED [  1%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_adg2_driver_vs_fortran.py::test_f2py_oracle PASSED [  2%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_smooth_min_f2py PASSED [  3%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_smooth_max_f2py PASSED [  4%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_compute_Cx_fnc_Richardson_f2py PASSED [  5%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_calc_xpwp_f2py PASSED [  6%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_stability_and_Ri_f2py PASSED [  7%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_vertical_avg_integral_f2py PASSED [  8%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_brunt_vaisala_f2py PASSED [  9%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_calculate_thlp2_rad_f2py PASSED [ 10%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_Lscale_width_vert_avg_f2py PASSED [ 11%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_helper_extras_vs_fortran.py::test_wp23_term_splat_lhs_f2py PASSED [ 12%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_advance_xp3_vs_fortran.py::test_f2py_oracle PASSED [ 13%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_binormal_moments_vs_fortran.py::test_f2py_oracle PASSED [ 14%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_comp_corrs_binormal_vs_fortran.py::test_f2py_oracle PASSED [ 15%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_comp_corrs_binormal_vs_fortran.py::test_smooth_corr_quotient_f2py PASSED [ 16%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_ddzt_umvm_sqd_vs_fortran.py::test_f2py_oracle PASSED [ 17%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_roots_vs_fortran.py::test_f2py_oracle PASSED [ 18%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calc_wp3_on_wp2_vs_fortran.py::test_f2py_oracle PASSED [ 19%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calculate_thvm_vs_fortran.py::test_f2py_oracle PASSED [ 20%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calculate_w_responder_params_vs_fortran.py::test_f2py_oracle PASSED [ 21%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_calendar_vs_fortran.py::test_f2py_oracle PASSED [ 22%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_corr_mtx_approx_vs_fortran.py::test_f2py_oracle PASSED [ 23%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_factor_vs_fortran.py::test_f2py_oracle PASSED [ 24%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_covar_vs_fortran.py::test_f2py_oracle PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_covar_vs_fortran.py::test_clip_covars_denom_f2py PASSED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_skewness_vs_fortran.py::test_f2py_oracle PASSED [ 26%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_variance_vs_fortran.py::test_f2py_oracle PASSED [ 27%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_clip_variance_vs_fortran.py::test_clip_rcm_f2py PASSED [ 28%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 29%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_ADG1_w_closure_f2py PASSED [ 30%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_close_luhar_pdf_vs_fortran.py::test_ADG1_pdf_driver_f2py PASSED [ 31%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cloud_drop_sed_vs_fortran.py::test_f2py_oracle PASSED [ 32%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_f2py_oracle PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_wpxp2_f2py PASSED [ 34%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_coefs_semiimpl_vs_fortran.py::test_wpxpyp_f2py PASSED [ 35%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_compute_gamma_skw_vs_fortran.py::test_f2py_oracle PASSED [ 36%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_compute_sigma_sqd_w_vs_fortran.py::test_f2py_oracle PASSED [ 37%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_config_flags_complete_vs_fortran.py::test_default_values_match_fortran PASSED [ 38%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cos_solar_zen_vs_fortran.py::test_f2py_oracle PASSED [ 39%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_correlations_vs_fortran.py::test_f2py_oracle PASSED [ 40%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_upxp_vs_fortran.py::test_f2py_oracle PASSED [ 41%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_xp3_vs_fortran.py::test_f2py_oracle PASSED [ 42%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diffusion_vs_fortran.py::test_f2py_oracle PASSED [ 43%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_fill_holes_mean_vs_fortran.py::test_fill_holes_vertical_f2py PASSED [ 44%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_fill_holes_mean_vs_fortran.py::test_fill_holes_wp2_from_horz_tke_f2py PASSED [ 45%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_f2py_oracle PASSED [ 46%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_stretched_grid_operators PASSED [ 47%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_grid_type3_construction_matches_fortran PASSED [ 48%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_grid_operators_vs_fortran.py::test_grid_construction_matches_fortran PASSED [ 49%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_hydrostatic_vs_fortran.py::test_f2py_oracle PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_hydrostatic_vs_fortran.py::test_f2py_oracle_stretched PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_f2py_oracle PASSED [ 51%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_plinterp_f2py PASSED [ 52%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_limits_f_x_responder_vs_fortran.py::test_f2py_oracle PASSED [ 53%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_luhar_3d_driver_vs_fortran.py::test_f2py_oracle PASSED [ 54%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_luhar_params_vs_fortran.py::test_f2py_oracle PASSED [ 55%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_ly93_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 56%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_ly93_pdf_vs_fortran.py::test_driver_f2py PASSED [ 57%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mean_adv_vs_fortran.py::test_f2py_oracle PASSED [ 58%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mirror_lower_triangular_vs_fortran.py::test_f2py_oracle PASSED [ 59%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_set_Lscale_max_f2py PASSED [ 60%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_calc_Lscale_directly_f2py PASSED [ 61%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_diagnose_Lscale_from_tau_f2py PASSED [ 62%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mono_flux_limiter_vs_fortran.py::test_full_limiter_f2py PASSED [ 63%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mono_flux_limiter_vs_fortran.py::test_calc_turb_adv_range_f2py PASSED [ 64%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_hybrid_pdf_main_vs_fortran.py::test_f2py_oracle PASSED [ 65%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_main_vs_fortran.py::test_driver_f2py PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wp4_f2py PASSED [ 67%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wpxp2_f2py PASSED [ 68%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_coef_wp2xp_f2py PASSED [ 69%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_new_hybrid_aliases PASSED [ 70%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_f2py_oracle PASSED [ 71%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_setter_f2py PASSED [ 72%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_tsdadg_pdf_vs_fortran.py::test_driver_f2py PASSED [ 73%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_param_names_match_f2py PASSED [ 74%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_parameter_hard_bounds_match_f2py PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_param_values_match_fortran PASSED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_param_names_vs_fortran.py::test_calc_derived_params_f2py PASSED [ 76%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_moment_integrals_vs_fortran.py::test_f2py_oracle PASSED [ 77%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_mean_stdev_L2N_bit_to_bit PASSED [ 78%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_NN2NL_NN2LL_calc_corr_chi_x_bit_to_bit PASSED [ 79%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_chi_eta_rt_thl_roundtrip PASSED [ 80%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pos_definite_vs_fortran.py::test_f2py_oracle PASSED [ 81%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pvertinterp_vs_fortran.py::test_f2py_oracle PASSED [ 82%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_rcm_sat_adj_vs_fortran.py::test_f2py_oracle PASSED [ 83%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_module_vs_fortran.py::test_f2py_oracle PASSED [ 84%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_ppm_vs_fortran.py::test_f2py_same_grid_identity PASSED [ 85%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_responder_params_vs_fortran.py::test_f2py_oracle PASSED [ 86%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_saturation_vs_fortran.py::test_sat_mixrat_f2py PASSED [ 87%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_setter_var_params_vs_fortran.py::test_f2py_oracle PASSED [ 88%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sfc_varnce_vs_fortran.py::test_f2py_oracle PASSED [ 89%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_skx_func_vs_fortran.py::test_f2py_oracle PASSED [ 90%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_skx_func_vs_fortran.py::test_LG_2005_ansatz_f2py PASSED [ 91%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_smooth_heaviside_vs_fortran.py::test_f2py_oracle PASSED [ 92%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_solver_vs_fortran.py::test_solver_f2py_oracle PASSED [ 93%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sponge_damp_xp23_vs_fortran.py::test_f2py_oracle PASSED [ 94%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sponge_damp_xp23_vs_fortran.py::test_sponge_damp_xm_f2py PASSED [ 95%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_spurious_source_vs_fortran.py::test_f2py_oracle PASSED [ 96%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_sunray_sw_vs_fortran.py::test_f2py_oracle PASSED [ 97%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_w_up_in_cloud_vs_fortran.py::test_f2py_oracle PASSED [ 98%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_xpyp_term_ta_godunov_vs_fortran.py::test_f2py_oracle PASSED [ 99%]
clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_xpyp_term_ta_pdf_vs_fortran.py::test_f2py_oracle PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax_f2py_unit_tests.xml -
============================= slowest 15 durations =============================
12.54s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_rcm_sat_adj_vs_fortran.py::test_f2py_oracle
10.34s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_calc_Lscale_directly_f2py
10.10s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cos_solar_zen_vs_fortran.py::test_f2py_oracle
8.19s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_plinterp_f2py
7.05s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_ppm_vs_fortran.py::test_f2py_same_grid_identity
6.54s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_remapping_module_vs_fortran.py::test_f2py_oracle
6.05s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_corr_mtx_approx_vs_fortran.py::test_f2py_oracle
5.59s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_hybrid_pdf_main_vs_fortran.py::test_f2py_oracle
5.35s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_new_pdf_vs_fortran.py::test_new_hybrid_aliases
4.21s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_pdf_utilities_vs_fortran.py::test_corr_chi_eta_rt_thl_roundtrip
3.90s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_cholesky_factor_vs_fortran.py::test_f2py_oracle
3.61s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_diagnose_correlations_vs_fortran.py::test_f2py_oracle
3.35s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_mixing_length_vs_fortran.py::test_diagnose_Lscale_from_tau_f2py
3.33s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_interpolation_vs_fortran.py::test_f2py_oracle
2.79s call     clubb_jax/pytests/auto_llm_generated_pytests/f2py_unit_tests/test_Nc_Ncn_eqns_vs_fortran.py::test_Ncnm_bit_to_bit_vs_f2py
======================= 104 passed in 134.09s (0:02:14) ========================
 WARNING:  New TSDADG PDF.  The variance of w in the 1st PDF component is negative and is being clipped to 0.
 sigma_w_1^2 (before clipping) =   -89.978350249211630     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -28.100062298269087     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -2.3443699986332036     
 WARNING:  New TSDADG PDF.  The variance of thl in the 2nd PDF component is negative and is being clipped to 0.
 sigma_thl_2^2 (before clipping) =   -19.622495050054393     
 WARNING:  New TSDADG PDF.  The variance of thl in the 1st PDF component is negative and is being clipped to 0.
 sigma_thl_1^2 (before clipping) =   -31.067635201597646     
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Expected failure test)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_comparison_mutation_test.py
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
Mutation test artifacts: /home/jenkins/workspace/clubb_jax/output/tests/jax_comparison_mutation_9ps9ujyk
Control: running unmodified bomex comparison...
Control passed.
Mutation heating: running comparison...
PASS heating: thlm mean absolute difference 0.00015; failing columns [1, 2, 3, 4].
Mutation parameter_handling: running comparison...
PASS parameter_handling: wp3 mean absolute difference 9.25992e-07; failing columns [2, 3, 4].
Mutation first_column: running comparison...
PASS first_column: wp3 mean absolute difference 4.69019e-07; failing columns [2, 3, 4].
Mutation missing_stat: running comparison...
PASS missing_stat: wprtp absent only from JAX output; strict comparison rejected it.

==============================================================================
Expected failure test: PASS
==============================================================================
Case: bomex | 4 timesteps x 60 s | 4 columns | CPU/double
Statistics: input/stats/multi_col_stats.in
Tolerances: JAX-versus-Fortran harness defaults (absolute 1e-07; percentage 1e-07%)

[PASS] Unmodified control — JAX and Fortran matched.

[PASS] heating
  Add 1e-6 K/s of spurious heating to every column.
  Numerical difference detected; both models completed 4 timesteps.
  thlm: mean absolute difference 0.00015; mean percentage difference 4.91235e-05%
  Failing columns: 1, 2, 3, 4; first comparison failure: timestep 1.

[PASS] parameter_handling
  Load C8 as [0.2, 0.3, 0.4, 0.5] instead of [0.2, 0.4, 0.6, 0.8].
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 9.25992e-07; mean percentage difference 0.244887%
  Failing columns: 2, 3, 4; first comparison failure: timestep 1.

[PASS] first_column
  Use column 1's previous wp3 in every column's timestep equation.
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 4.69019e-07; mean percentage difference 0.118965%
  Failing columns: 2, 3, 4; first comparison failure: timestep 3.

[PASS] missing_stat
  Omit wprtp from JAX statistics output while keeping its calculation.
  wprtp is missing only from JAX output; both models completed 4 timesteps.
  Strict bindiff detected the missing variable; other stats were unchanged.

Result: PASS — 4/4 mutations verified | 80.7 s
Logs and outputs: /home/jenkins/workspace/clubb_jax/output/tests/jax_comparison_mutation_9ps9ujyk
==============================================================================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Jax vs Fortran: standard stats)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ ./tests/run_jax_vs_fortran_cases.py -workers 8
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: case default
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 1 flag set = 23 JAX/Fortran pairs
  Flag sets:
    default
  Cases:
    arm (360 iterations)
    atex (360 iterations)
    bomex (native duration)
    cobra (360 iterations)
    dycoms2_rf01 (native duration)
    dycoms2_rf01_fixed_sst (300 iterations)
    dycoms2_rf02_nd (native duration)
    fire (native duration)
    gabls2 (360 iterations)
    gabls3_night (360 iterations)
    jun25_altocu (180 iterations)
    neutral (native duration)
    wangara (native duration)
    dycoms2_rf02_do (native duration)
    dycoms2_rf02_ds (240 iterations)
    lba_kk (360 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (370 iterations)
      - dt_main: 60 s
    lba (93 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (73 iterations)
      - percentage limit: 0.001%
    nov11_altocu (62 iterations)
      - percentage limit: 0.001%
    rico_silhs (360 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (240 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (74 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-----------------------------------------------------------------------------------------------------------------
[match         ] default                  fire                       180 / 180      136.9          3.9      146.0
[match         ] default                  dycoms2_rf01_fixed_sst     300 / 300      188.1          4.0      198.9
[match         ] default                  dycoms2_rf01               240 / 240      201.2         19.7      238.9
[match         ] default                  dycoms2_rf02_nd            360 / 360      233.8          6.1      251.2
[match         ] default                  bomex                      360 / 360      239.9          9.2      260.1
[match         ] default                  arm                        360 / 360      239.8         11.4      262.5
[match         ] default                  cobra                      360 / 360      250.1          9.4      269.7
[match         ] default                  gabls3_night               360 / 360       66.5          4.7       74.4
[match         ] default                  gabls2                     360 / 360      107.9         18.7      131.0
[match         ] default                  atex                       360 / 360      256.5         12.5      281.8
[match         ] default                  jun25_altocu               180 / 180      144.5          8.0      161.9
[match         ] default                  neutral                    360 / 360      236.3          7.8      253.9
[match         ] default                  lba                          93 / 93      217.3          5.8      232.4
[match         ] default                  clex9_oct14                  73 / 73      148.9          4.8      160.2
[match         ] default                  wangara                    480 / 480      300.1          7.5      317.4
[match         ] default                  nov11_altocu                 62 / 62      127.5          4.2      138.1
[match         ] default                  dycoms2_rf02_ds            240 / 240      447.3         22.4      480.1
[match         ] default                  lba_kk_silhs               240 / 240      273.9         26.9      307.6
[match         ] default                  lba_kk                     360 / 360      579.7         18.3      608.9
[match         ] default                  lba_silhs                    74 / 74      298.8         20.3      324.5
[match         ] default                  dycoms2_rf02_do            360 / 360      649.7         30.4      689.6
[match         ] default                  rico                       370 / 370      860.8          8.5      873.6
[match         ] default                  rico_silhs                 360 / 360      708.7          6.2      718.8

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 21m 51.1s
Results JSON: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/final_bindiff.log [passed]
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Jax Python vs Fortran cases w varying flags)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_vs_fortran_cases.py -debug 0 -max_iters 5 -workers 8 -flag_config_file input/flag_sets/config_core_flags_wo_never_supported_jax_features.json
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: 0
  Forwarded to both runs: -debug 0 -max_iters 5
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 18 flag sets = 414 JAX/Fortran pairs
  Flag sets:
    default
    config_core_flags_wo_never_supported_jax_features_flag2
      - saturation_formula = 1
      - l_godunov_upwind_xpyp_ta = .true.
      - l_lh_importance_sampling = .false.
      - l_random_k_lh_start = .true.
      - l_max_overlap_in_cloud = .false.
    config_core_flags_wo_never_supported_jax_features_flag3
      - ipdf_call_placement = 1
      - l_ho_trad_coriolis = .true.
      - l_ho_nontrad_coriolis = .true.
    config_core_flags_wo_never_supported_jax_features_flag4
      - iiPDF_type = 7
    config_core_flags_wo_never_supported_jax_features_flag5
      - l_predict_upwp_vpwp = .false.
    config_core_flags_wo_never_supported_jax_features_flag6
      - l_wp2_fill_holes_tke = .false.
      - l_enable_relaxed_clipping = .true.
      - l_min_xp2_from_corr_wx = .false.
      - l_add_dycore_grid = .true.
      - l_lh_straight_mc = .true.
    config_core_flags_wo_never_supported_jax_features_flag7
      - l_diag_Lscale_from_tau = .true.
      - fill_holes_type = 3
    config_core_flags_wo_never_supported_jax_features_flag8
      - l_upwind_xpyp_ta = .false.
      - l_upwind_xm_ma = .false.
      - l_lh_clustered_sampling = .false.
      - l_lh_instant_var_covar_src = .false.
      - l_lh_limit_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag9
      - l_min_wp2_from_corr_wx = .true.
      - l_stability_correct_tau_zm = .true.
      - l_damp_wp2_using_em = .false.
      - l_use_C7_Richardson = .false.
    config_core_flags_wo_never_supported_jax_features_flag10
      - l_vert_avg_closure = .true.
      - l_use_cloud_cover = .true.
      - l_damp_wp3_Skw_squared = .false.
      - l_use_C11_Richardson = .true.
      - l_rcm_in_cloud_k_lh_start = .false.
    config_core_flags_wo_never_supported_jax_features_flag11
      - l_rcm_supersat_adj = .false.
      - l_C2_cloud_frac = .true.
      - l_use_precip_frac = .false.
      - l_do_expldiff_rtm_thlm = .true.
      - l_use_shear_Richardson = .true.
    config_core_flags_wo_never_supported_jax_features_flag12
      - l_prescribed_avg_deltaz = .true.
      - l_stability_correct_Kh_N2_zm = .true.
      - l_trapezoidal_rule_zt = .true.
      - l_trapezoidal_rule_zm = .true.
      - l_call_pdf_closure_twice = .true.
    config_core_flags_wo_never_supported_jax_features_flag13
      - l_brunt_vaisala_freq_moist = .true.
      - l_use_thvm_in_bv_freq = .true.
      - l_lmm_stepping = .true.
      - l_vary_convect_depth = .true.
    config_core_flags_wo_never_supported_jax_features_flag14
      - l_use_tke_in_wp3_pr_turb_term = .false.
      - l_use_tke_in_wp2_wp3_K_dfsn = .true.
      - l_use_wp3_lim_with_smth_Heaviside = .true.
      - l_smooth_Heaviside_tau_wpxp = .false.
      - l_modify_limiters_for_cnvg_test = .true.
    config_core_flags_wo_never_supported_jax_features_flag15
      - l_mono_flux_lim_rtm = .false.
      - l_mono_flux_lim_um = .false.
      - l_mono_flux_lim_vm = .false.
      - l_mono_flux_lim_spikefix = .false.
    config_core_flags_wo_never_supported_jax_features_flag16
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .false.
      - l_lh_var_frac = .true.
    config_core_flags_wo_never_supported_jax_features_flag17
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .true.
      - l_lh_normalize_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag18
      - ipdf_call_placement = 3
  Cases:
    arm (5 iterations)
    atex (5 iterations)
    bomex (5 iterations)
    cobra (5 iterations)
    dycoms2_rf01 (5 iterations)
    dycoms2_rf01_fixed_sst (5 iterations)
    dycoms2_rf02_nd (5 iterations)
    fire (5 iterations)
    gabls2 (5 iterations)
    gabls3_night (5 iterations)
    jun25_altocu (5 iterations)
    neutral (5 iterations)
    wangara (5 iterations)
    dycoms2_rf02_do (5 iterations)
    dycoms2_rf02_ds (5 iterations)
    lba_kk (5 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (5 iterations)
      - dt_main: 60 s
    lba (5 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (5 iterations)
      - percentage limit: 0.001%
    nov11_altocu (5 iterations)
      - percentage limit: 0.001%
    rico_silhs (5 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (5 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (5 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                                                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-------------------------------------------------------------------------------------------------------------------------------------------------
[match         ] default                                                  atex                           5 / 5       29.6          1.2       34.2
[match         ] default                                                  dycoms2_rf01_fixed_sst         5 / 5       30.0          1.1       34.3
[match         ] default                                                  arm                            5 / 5       29.8          1.1       34.6
[match         ] default                                                  cobra                          5 / 5       30.3          1.3       35.3
[match         ] default                                                  dycoms2_rf01                   5 / 5       30.4          1.5       35.5
[match         ] default                                                  bomex                          5 / 5       31.4          1.3       36.1
[match         ] default                                                  fire                           5 / 5       31.6          1.5       36.4
[match         ] default                                                  dycoms2_rf02_nd                5 / 5       32.2          1.2       36.9
[match         ] default                                                  gabls3_night                   5 / 5       19.3          0.9       22.5
[match         ] default                                                  gabls2                         5 / 5       28.4          1.3       31.9
[match         ] default                                                  jun25_altocu                   5 / 5       27.6          1.1       31.8
[match         ] default                                                  neutral                        5 / 5       29.0          1.0       33.2
[match         ] default                                                  wangara                        5 / 5       29.6          1.0       33.7
[match         ] default                                                  lba_kk                         5 / 5       44.7          1.2       49.1
[match         ] default                                                  dycoms2_rf02_ds                5 / 5       46.1          1.5       51.0
[match         ] default                                                  dycoms2_rf02_do                5 / 5       47.3          1.4       52.1
[match         ] default                                                  clex9_oct14                    5 / 5       38.6          1.2       43.9
[match         ] default                                                  rico                           5 / 5       49.5          1.0       53.9
[match         ] default                                                  rico_silhs                     5 / 5       38.2          1.0       42.6
[match         ] default                                                  nov11_altocu                   5 / 5       39.9          1.2       45.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  arm                            1 / 5       28.4          1.0       32.6
[match         ] default                                                  lba_kk_silhs                   5 / 5       35.5          1.5       40.3
[match         ] default                                                  lba                            5 / 5       68.8          1.2       75.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  atex                           1 / 5       27.0          1.1       31.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  bomex                          1 / 5       30.8          1.5       35.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  cobra                          1 / 5       29.9          1.6       34.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01                   1 / 5       30.4          1.3       35.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01_fixed_sst         1 / 5       28.2          0.9       32.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_nd                1 / 5       31.9          1.0       36.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls3_night                   5 / 5       20.0          1.0       23.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls2                         5 / 5       27.5          1.4       31.2
[match         ] default                                                  lba_silhs                      5 / 5       78.7          2.7       86.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  fire                           1 / 5       29.0          1.1       33.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  jun25_altocu                   1 / 5       30.3          1.1       34.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  neutral                        1 / 5       29.1          1.0       33.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  wangara                        1 / 5       30.0          1.0       34.2
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  rico_silhs                         -        5.3          1.0        6.2
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk_silhs                       -        4.7          0.9        5.6
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_silhs                          -        5.0          0.8        5.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_do                1 / 5       46.4          1.4       51.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk                         1 / 5       42.0          1.2       46.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_ds                1 / 5       46.6          1.4       51.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  clex9_oct14                    1 / 5       40.8          1.2       46.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  nov11_altocu                   1 / 5       40.4          1.2       45.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  rico                           5 / 5       51.5          1.0       55.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  arm                            5 / 5       29.2          1.0       33.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  atex                           5 / 5       29.5          1.1       33.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba                            1 / 5       70.6          1.2       76.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  bomex                          5 / 5       28.6          1.0       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  cobra                          5 / 5       29.8          1.2       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01_fixed_sst         5 / 5       28.0          1.0       32.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01                   5 / 5       28.8          1.5       33.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_nd                5 / 5       31.7          1.1       35.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  fire                           5 / 5       30.0          0.9       33.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls3_night                   5 / 5       20.2          1.0       23.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls2                         5 / 5       29.2          1.3       32.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  jun25_altocu                   5 / 5       29.0          1.1       33.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  neutral                        5 / 5       29.3          1.0       33.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  wangara                        5 / 5       30.6          1.0       34.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_do                5 / 5       46.6          1.4       51.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_ds                5 / 5       46.3          1.5       51.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk                         5 / 5       43.2          1.1       47.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  clex9_oct14                    5 / 5       37.5          1.2       42.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico                           5 / 5       50.4          1.1       54.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  nov11_altocu                   5 / 5       40.6          1.2       46.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico_silhs                     5 / 5       37.4          1.0       41.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  arm                                -       26.1          1.0       27.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk_silhs                   5 / 5       34.7          1.6       39.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba                            5 / 5       68.5          1.2       74.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  atex                               -       25.7          1.1       26.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  bomex                              -       25.8          1.0       26.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  cobra                              -       27.6          1.1       28.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01                       -       30.3          1.3       31.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01_fixed_sst             -       24.7          0.9       25.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls3_night                       -       21.3          1.1       22.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_nd                    -       26.4          1.2       27.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  fire                               -       26.2          1.0       27.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls2                             -       29.6          1.3       30.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  jun25_altocu                       -       26.9          1.1       28.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  neutral                            -       26.5          1.0       27.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  wangara                            -       26.2          1.0       27.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_silhs                      5 / 5       77.1          2.4       84.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico                               -       18.3          1.0       19.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_ds                    -       29.1          1.4       30.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_do                    -       29.6          1.4       31.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk                             -       27.8          1.3       29.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico_silhs                         -       18.4          1.0       19.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba                                -       31.5          1.2       32.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  clex9_oct14                        -       31.8          1.1       32.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk_silhs                       -       25.4          1.5       26.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  nov11_altocu                       -       31.8          1.1       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  arm                            5 / 5       27.2          1.0       31.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  atex                           5 / 5       27.8          1.1       31.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_silhs                          -       31.2          2.5       33.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  bomex                          5 / 5       28.5          1.0       32.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  cobra                          5 / 5       27.5          1.1       32.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01                   5 / 5       29.0          1.3       33.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01_fixed_sst         5 / 5       25.9          1.0       29.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls3_night                   5 / 5       19.3          1.1       22.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_nd                5 / 5       30.3          1.2       34.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls2                         5 / 5       27.3          1.2       30.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  fire                           5 / 5       29.5          1.0       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  jun25_altocu                   5 / 5       28.0          1.1       32.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  neutral                        5 / 5       28.7          1.0       32.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  wangara                        5 / 5       28.6          1.0       32.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_do                5 / 5       43.3          1.4       47.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk                         5 / 5       41.8          1.1       46.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_ds                5 / 5       44.9          1.4       49.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico                           5 / 5       48.5          1.0       52.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  clex9_oct14                    5 / 5       38.0          1.2       43.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  nov11_altocu                   5 / 5       38.0          1.1       43.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico_silhs                     5 / 5       37.7          1.0       42.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk_silhs                   5 / 5       31.5          1.4       36.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  arm                            1 / 5       29.0          1.4       32.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba                            5 / 5       69.3          1.3       75.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  atex                               -       28.8          1.5       31.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  bomex                              -       29.9          1.2       32.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  cobra                              -       29.9          1.3       32.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01                       -       29.2          2.6       33.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01_fixed_sst             -       28.0          1.0       30.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_nd                    -       31.4          1.1       34.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls3_night                       -       20.1          0.9       22.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  fire                               -       29.9          1.0       32.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls2                             -       28.4          1.3       31.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  jun25_altocu                   1 / 5       28.7          1.4       31.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_silhs                      5 / 5       78.7          2.4       86.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  neutral                            -       29.6          1.2       32.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  wangara                            -       29.2          1.1       32.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk                             -       42.6          2.0       46.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_do                    -       46.0          1.8       49.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_ds                    -       45.8          1.8       49.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico                               -       48.9          1.1       51.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  clex9_oct14                        -       39.4          1.7       43.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  nov11_altocu                       -       39.2          1.6       43.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico_silhs                         -       35.5          1.1       38.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  arm                                -       14.6          1.1       15.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  atex                               -       14.3          1.1       15.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  bomex                              -       15.6          1.0       16.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  cobra                              -       13.6          1.2       14.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01                       -       14.5          1.3       15.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01_fixed_sst             -       14.9          1.0       15.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk_silhs                       -       34.9          2.3       38.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba                                -       69.5          2.4       74.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_nd                    -       15.8          1.0       16.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  fire                               -       14.4          1.0       15.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls2                             -       15.0          1.3       16.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls3_night                       -       15.9          1.0       16.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  jun25_altocu                       -       15.3          1.0       16.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  neutral                            -       14.7          1.0       15.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  wangara                            -       15.6          1.0       16.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_do                    -       17.2          1.3       18.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk                             -       15.1          1.2       16.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_ds                    -       17.6          1.4       19.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico                               -       15.8          1.0       16.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba                                -       19.1          1.2       20.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  clex9_oct14                        -       19.1          1.2       20.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico_silhs                         -       15.0          1.1       16.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  nov11_altocu                       -       18.9          1.4       20.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk_silhs                       -       15.4          1.6       17.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_silhs                          -       20.0          2.4       22.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_silhs                          -       79.6          3.8       85.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  arm                            5 / 5       27.4          1.0       31.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  atex                           5 / 5       28.3          1.1       32.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  bomex                          5 / 5       29.7          1.0       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  cobra                          5 / 5       29.7          1.1       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01                   5 / 5       30.4          1.4       35.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01_fixed_sst         5 / 5       29.1          1.1       33.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  fire                           5 / 5       29.3          1.0       33.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_nd                5 / 5       31.4          1.1       35.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls3_night                   5 / 5       20.2          0.9       23.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls2                         5 / 5       27.8          1.4       31.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  jun25_altocu                   5 / 5       30.6          1.1       34.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  neutral                        5 / 5       29.4          1.0       33.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  wangara                        5 / 5       30.8          1.0       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_do                5 / 5       45.3          1.4       50.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk                         5 / 5       44.0          1.2       48.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_ds                5 / 5       44.8          1.4       49.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico                           5 / 5       50.4          1.0       54.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  clex9_oct14                    5 / 5       39.3          1.1       44.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  nov11_altocu                   5 / 5       38.2          1.1       43.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico_silhs                     5 / 5       37.4          1.0       41.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk_silhs                   5 / 5       34.8          1.5       39.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba                            5 / 5       67.7          1.2       73.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  arm                            5 / 5       29.0          1.1       33.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  atex                           5 / 5       29.0          1.0       33.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  bomex                          5 / 5       31.6          1.2       36.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  cobra                          5 / 5       31.1          1.4       35.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01                   5 / 5       30.2          1.5       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01_fixed_sst         5 / 5       28.9          1.0       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  fire                           5 / 5       29.6          1.0       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_nd                5 / 5       31.0          1.0       35.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls2                         5 / 5       28.3          1.3       31.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls3_night                   5 / 5       20.9          1.0       24.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_silhs                      5 / 5       79.6          2.5       86.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  neutral                        5 / 5       29.9          1.2       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  jun25_altocu                   5 / 5       30.3          1.1       34.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  wangara                        5 / 5       29.4          1.0       33.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_ds                5 / 5       44.6          1.3       49.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_do                5 / 5       46.3          1.5       51.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk                         5 / 5       43.4          1.1       47.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  nov11_altocu                   5 / 5       37.7          1.2       42.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico                           5 / 5       49.8          1.1       54.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  clex9_oct14                    5 / 5       41.9          1.2       47.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico_silhs                     5 / 5       38.2          1.0       42.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 arm                            1 / 5       28.3          1.0       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk_silhs                   5 / 5       35.4          1.5       40.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba                            5 / 5       68.6          1.2       74.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 atex                           1 / 5       28.9          1.1       33.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 bomex                          1 / 5       29.2          1.0       33.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 cobra                          1 / 5       29.8          1.2       35.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01                   1 / 5       30.5          1.3       35.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls3_night                   5 / 5       19.6          1.0       22.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01_fixed_sst         1 / 5       29.6          1.0       34.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_nd                1 / 5       31.0          1.1       36.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 fire                           1 / 5       28.9          1.0       34.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls2                         5 / 5       28.7          1.5       32.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_silhs                      5 / 5       78.2          2.6       85.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 jun25_altocu                   1 / 5       29.7          1.1       34.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 neutral                        1 / 5       28.2          1.1       33.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 wangara                        1 / 5       30.3          1.0       35.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_do                1 / 5       45.8          1.4       51.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_ds                1 / 5       43.6          1.4       49.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk                         1 / 5       44.8          1.2       50.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 clex9_oct14                    1 / 5       40.0          1.3       46.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico                           5 / 5       49.2          1.1       54.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 nov11_altocu                   1 / 5       41.1          1.3       47.3
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag11 cobra                              -        4.9          1.2        6.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico_silhs                     5 / 5       38.6          1.1       44.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 arm                            5 / 5       28.8          1.1       33.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba                            1 / 5       68.8          1.2       75.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 atex                           5 / 5       27.9          1.3       32.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk_silhs                   1 / 5       36.5          1.7       42.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 bomex                          5 / 5       29.8          1.0       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01                   5 / 5       29.9          1.3       34.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01_fixed_sst         5 / 5       27.8          0.9       31.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls3_night                   5 / 5       20.3          1.0       23.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 fire                           5 / 5       30.0          1.0       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_nd                5 / 5       32.4          1.2       36.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls2                         5 / 5       29.5          1.3       33.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 jun25_altocu                   5 / 5       29.9          1.0       34.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_silhs                      1 / 5       73.9          2.4       81.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 neutral                        5 / 5       30.1          1.0       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 wangara                        5 / 5       30.0          1.0       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_do                5 / 5       47.0          1.4       51.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk                         5 / 5       44.3          1.1       48.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_ds                5 / 5       47.1          1.4       51.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 clex9_oct14                    5 / 5       39.1          1.2       44.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico                           5 / 5       50.8          1.0       55.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 nov11_altocu                   5 / 5       38.3          1.1       43.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico_silhs                     5 / 5       38.5          1.0       42.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba                            5 / 5       69.7          1.2       75.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk_silhs                   5 / 5       34.3          1.4       39.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 arm                            5 / 5       38.8          1.1       43.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 atex                           5 / 5       36.2          1.1       40.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 cobra                          5 / 5       30.9          1.2       35.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 bomex                          5 / 5       40.4          1.0       44.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01                   5 / 5       38.6          1.3       43.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01_fixed_sst         5 / 5       37.3          1.0       41.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls3_night                   5 / 5       23.7          0.9       26.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls2                         5 / 5       27.5          1.4       31.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_nd                5 / 5       41.2          1.1       45.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_silhs                      5 / 5       78.2          2.5       85.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 fire                           5 / 5       39.0          1.0       43.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 jun25_altocu                   5 / 5       38.5          1.1       42.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 neutral                        5 / 5       37.8          1.0       42.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 wangara                        5 / 5       39.5          1.0       43.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_do                5 / 5       54.9          1.4       59.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_ds                5 / 5       53.7          1.3       58.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk                         5 / 5       54.5          1.2       59.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico                           5 / 5       53.9          1.0       58.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 clex9_oct14                    5 / 5       49.2          1.2       54.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 nov11_altocu                   5 / 5       47.7          1.2       52.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 rico_silhs                     5 / 5       41.6          1.0       45.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba                            5 / 5       79.4          1.2       85.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 arm                            5 / 5       30.3          1.0       34.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 atex                           5 / 5       29.2          1.1       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk_silhs                   5 / 5       44.0          1.4       48.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 bomex                          5 / 5       30.1          1.0       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 cobra                          5 / 5       29.8          1.2       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01                   5 / 5       30.5          1.2       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls3_night                   5 / 5       19.6          1.0       22.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01_fixed_sst         5 / 5       30.1          1.0       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_nd                5 / 5       30.8          1.0       35.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 fire                           5 / 5       29.7          1.1       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls2                         5 / 5       29.0          1.2       32.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 jun25_altocu                   5 / 5       29.3          1.1       33.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 lba_silhs                      5 / 5       81.7          2.6       88.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 neutral                        5 / 5       28.7          1.0       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 wangara                        5 / 5       29.8          1.0       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_do                5 / 5       45.9          1.3       50.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk                         5 / 5       43.6          1.2       48.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_ds                5 / 5       46.1          1.5       51.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 clex9_oct14                    5 / 5       37.8          1.1       43.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico                           5 / 5       50.0          1.0       54.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 nov11_altocu                   5 / 5       39.0          1.2       44.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico_silhs                     5 / 5       38.8          1.0       42.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 arm                            5 / 5       29.5          1.0       33.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba                            5 / 5       72.1          1.3       78.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk_silhs                   5 / 5       35.4          1.4       40.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 atex                           5 / 5       27.0          1.4       31.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 bomex                          5 / 5       30.5          1.0       34.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 cobra                          5 / 5       29.9          1.2       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01                   5 / 5       30.7          1.3       35.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01_fixed_sst         5 / 5       28.5          1.0       32.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls3_night                   5 / 5       20.1          1.0       23.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls2                         5 / 5       27.2          1.3       31.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_nd                5 / 5       31.4          1.3       36.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 fire                           5 / 5       29.6          1.2       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 jun25_altocu                   5 / 5       30.3          1.1       34.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_silhs                      5 / 5       81.5          2.5       88.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 neutral                        5 / 5       29.9          1.0       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 wangara                        5 / 5       31.1          1.0       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_do                5 / 5       45.9          1.4       50.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_ds                5 / 5       44.5          1.4       49.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk                         5 / 5       44.5          1.2       49.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico                           5 / 5       51.0          1.0       55.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 clex9_oct14                    5 / 5       38.8          1.2       44.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 nov11_altocu                   5 / 5       40.6          1.1       45.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico_silhs                     5 / 5       38.6          1.0       42.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 arm                            5 / 5       28.6          1.0       32.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk_silhs                   5 / 5       35.0          1.5       39.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 atex                           5 / 5       28.6          1.1       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba                            5 / 5       72.3          1.2       78.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 bomex                          5 / 5       29.8          1.0       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 cobra                          5 / 5       29.1          1.1       33.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01                   5 / 5       29.6          1.3       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01_fixed_sst         5 / 5       27.7          0.9       31.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls3_night                   5 / 5       20.5          1.1       23.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_nd                5 / 5       30.9          1.1       35.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls2                         5 / 5       28.7          1.3       32.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 fire                           5 / 5       30.1          1.0       34.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_silhs                      5 / 5       77.6          2.6       85.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 jun25_altocu                   5 / 5       29.2          1.1       33.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 neutral                        5 / 5       28.9          1.0       32.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 wangara                        5 / 5       30.3          1.0       34.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_do                5 / 5       45.9          1.3       50.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk                         5 / 5       43.0          1.2       47.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_ds                5 / 5       45.3          1.5       50.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico                           5 / 5       50.1          1.0       54.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 clex9_oct14                    5 / 5       39.6          1.2       44.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 nov11_altocu                   5 / 5       39.0          1.1       44.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico_silhs                     5 / 5       37.4          1.0       41.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba                            5 / 5       64.5          1.2       70.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 arm                            5 / 5       29.5          1.0       33.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk_silhs                   5 / 5       35.4          1.5       40.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 atex                           5 / 5       29.0          1.0       33.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 bomex                          5 / 5       29.8          1.0       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 cobra                          5 / 5       29.9          1.1       33.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01                   5 / 5       30.5          1.3       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01_fixed_sst         5 / 5       27.5          1.0       31.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls3_night                   5 / 5       19.6          1.0       22.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_nd                5 / 5       31.6          1.1       35.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls2                         5 / 5       28.3          1.2       31.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 fire                           5 / 5       29.7          1.0       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 jun25_altocu                   5 / 5       29.5          1.1       33.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_silhs                      5 / 5       77.2          2.6       84.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 neutral                        5 / 5       29.2          1.0       33.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 wangara                        5 / 5       28.9          1.0       33.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_do                5 / 5       46.9          1.4       51.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_ds                5 / 5       45.6          1.4       50.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk                         5 / 5       44.2          1.2       49.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico                           5 / 5       50.1          1.0       54.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 clex9_oct14                    5 / 5       40.6          1.1       46.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 nov11_altocu                   5 / 5       40.2          1.2       45.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico_silhs                     5 / 5       35.9          1.0       40.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 arm                            5 / 5       29.4          1.0       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba                            5 / 5       70.2          1.2       76.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk_silhs                   5 / 5       36.7          1.5       41.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 atex                           5 / 5       30.1          1.0       34.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 bomex                          5 / 5       28.8          1.2       33.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 cobra                          5 / 5       30.6          1.1       34.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01                   5 / 5       29.9          1.2       34.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls3_night                   5 / 5       20.2          1.0       23.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01_fixed_sst         5 / 5       28.3          1.0       32.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 fire                           5 / 5       30.3          1.0       34.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_nd                5 / 5       32.4          1.0       36.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls2                         5 / 5       29.9          1.3       33.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 jun25_altocu                   5 / 5       29.9          1.1       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 neutral                        5 / 5       28.2          1.2       32.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_silhs                      5 / 5       79.4          2.5       86.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 wangara                        5 / 5       30.2          1.0       34.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_do                5 / 5       45.7          1.4       50.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk                         5 / 5       44.6          1.1       49.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_ds                5 / 5       47.3          1.5       52.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 clex9_oct14                    5 / 5       39.0          1.2       44.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico                           5 / 5       50.3          1.1       54.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 nov11_altocu                   5 / 5       40.8          1.2       46.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico_silhs                     5 / 5       38.6          1.0       43.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk_silhs                   5 / 5       35.0          1.5       39.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba                            5 / 5       70.4          1.2       76.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 arm                            5 / 5       29.5          1.1       33.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 atex                           5 / 5       29.2          1.0       33.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 bomex                          5 / 5       31.2          0.9       35.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 cobra                          5 / 5       30.2          1.1       34.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01                   5 / 5       31.2          1.2       35.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls3_night                   5 / 5       20.4          1.0       23.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01_fixed_sst         5 / 5       29.2          1.0       33.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls2                         5 / 5       28.2          1.4       32.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 fire                           5 / 5       31.1          1.1       35.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_nd                5 / 5       33.0          1.0       37.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 jun25_altocu                   5 / 5       30.9          1.1       35.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_silhs                      5 / 5       78.7          2.5       86.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 neutral                        5 / 5       30.8          1.2       35.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 wangara                        5 / 5       30.6          1.0       34.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk                         5 / 5       42.4          1.2       46.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_do                5 / 5       46.6          1.4       51.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_ds                5 / 5       45.1          1.4       49.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico                           5 / 5       52.0          1.0       56.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 clex9_oct14                    5 / 5       42.0          1.1       47.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 nov11_altocu                   5 / 5       39.0          1.2       44.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico_silhs                     5 / 5       38.1          0.9       42.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba                            5 / 5       68.1          1.1       73.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk_silhs                   5 / 5       31.8          1.4       36.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_silhs                      5 / 5       68.5          2.3       74.9

Overall cases:
  Match Diff Failed
  ----- ---- ------
    302   62     50

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag2:
  Match Diff Failed
  ----- ---- ------
      2   18      3

Flag set config_core_flags_wo_never_supported_jax_features_flag3:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag4:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag5:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag6:
  Match Diff Failed
  ----- ---- ------
      0   23      0

Flag set config_core_flags_wo_never_supported_jax_features_flag7:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag8:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag9:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag10:
  Match Diff Failed
  ----- ---- ------
      2   21      0

Flag set config_core_flags_wo_never_supported_jax_features_flag11:
  Match Diff Failed
  ----- ---- ------
     22    0      1

Flag set config_core_flags_wo_never_supported_jax_features_flag12:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag13:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag14:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag15:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag16:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag17:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag18:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 38m 33.3s
Results JSON: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
Setting overall build result to FAILURE
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] junit
Recording test results
[Checks API] No suitable checks publisher found.
[Pipeline] script
[Pipeline] {
[Pipeline] emailext
Sending email to: messnermet@uwm.edu
SMTP connection error while sending email. Retrying once more in 10 seconds.
SMTP connection error while sending email. Retrying once more in 10 seconds.
Failed after second try sending email
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: FAILURE